-- Logs begin at Mon 2022-08-29 14:51:06 UTC, end at Mon 2022-08-29 17:24:27 UTC. -- Aug 29 15:27:12.987590 n-d-836830-13 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 15:27:12.997093 n-d-836830-13 devstack@n-api.service[106769]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:27:12 2022] *** Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: nodename: n-d-836830-13 Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: machine: x86_64 Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: clock source: unix Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: pcre jit disabled Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: detected number of CPU cores: 4 Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: current working directory: / Aug 29 15:27:12.999131 n-d-836830-13 devstack@n-api.service[106769]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:27:12.999800 n-d-836830-13 devstack@n-api.service[106769]: your processes number limit is 47680 Aug 29 15:27:12.999800 n-d-836830-13 devstack@n-api.service[106769]: your memory page size is 4096 bytes Aug 29 15:27:12.999800 n-d-836830-13 devstack@n-api.service[106769]: detected max file descriptor number: 2048 Aug 29 15:27:12.999800 n-d-836830-13 devstack@n-api.service[106769]: lock engine: pthread robust mutexes Aug 29 15:27:12.999800 n-d-836830-13 devstack@n-api.service[106769]: thunder lock: enabled Aug 29 15:27:12.999800 n-d-836830-13 devstack@n-api.service[106769]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 15:27:12.999800 n-d-836830-13 devstack@n-api.service[106769]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:27:13.040133 n-d-836830-13 devstack@n-api.service[106769]: Python main interpreter initialized at 0x55b6101319c0 Aug 29 15:27:13.040133 n-d-836830-13 devstack@n-api.service[106769]: python threads support enabled Aug 29 15:27:13.040133 n-d-836830-13 devstack@n-api.service[106769]: your server socket listen backlog is limited to 100 connections Aug 29 15:27:13.040133 n-d-836830-13 devstack@n-api.service[106769]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:27:13.040569 n-d-836830-13 devstack@n-api.service[106769]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:27:13.040569 n-d-836830-13 devstack@n-api.service[106769]: *** Operational MODE: preforking *** Aug 29 15:27:13.040830 n-d-836830-13 devstack@n-api.service[106769]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:27:13.040830 n-d-836830-13 devstack@n-api.service[106769]: spawned uWSGI master process (pid: 106769) Aug 29 15:27:13.041043 n-d-836830-13 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 15:27:13.041606 n-d-836830-13 devstack@n-api.service[106769]: spawned uWSGI worker 1 (pid: 106770, cores: 1) Aug 29 15:27:13.043056 n-d-836830-13 devstack@n-api.service[106769]: spawned uWSGI worker 2 (pid: 106771, cores: 1) Aug 29 15:27:13.043056 n-d-836830-13 devstack@n-api.service[106769]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:27:13.707855 n-d-836830-13 devstack@n-api.service[106771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:27:13.708800 n-d-836830-13 devstack@n-api.service[106770]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:27:14.804238 n-d-836830-13 devstack@n-api.service[106770]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:27:14.804238 n-d-836830-13 devstack@n-api.service[106770]: from cryptography.utils import int_from_bytes Aug 29 15:27:14.804933 n-d-836830-13 devstack@n-api.service[106770]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:27:14.804933 n-d-836830-13 devstack@n-api.service[106770]: from cryptography.utils import int_from_bytes Aug 29 15:27:14.809761 n-d-836830-13 devstack@n-api.service[106771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:27:14.809761 n-d-836830-13 devstack@n-api.service[106771]: from cryptography.utils import int_from_bytes Aug 29 15:27:14.810194 n-d-836830-13 devstack@n-api.service[106771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:27:14.810194 n-d-836830-13 devstack@n-api.service[106771]: from cryptography.utils import int_from_bytes Aug 29 15:27:17.366335 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:27:17.366915 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:27:17.367125 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:27:17.367485 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:27:17.367848 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:27:17.367848 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:27:17.368037 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:27:17.368117 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.368259 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:27:17.368434 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.368624 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:27:17.368756 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.368883 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:27:17.369076 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.369270 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.369407 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.369622 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.369731 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.369951 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.370059 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.370270 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.370357 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.370602 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.370697 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.370889 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.370975 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.371227 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.371326 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.371556 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-13 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.371657 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.371885 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.371975 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.372149 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.372241 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.372464 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.372556 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.372791 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-13 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.372882 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.373095 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.373200 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.373412 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.373498 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.373716 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.373804 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.374034 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.374213 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.374344 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.374659 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.374783 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.374966 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.375122 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.375322 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.375501 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.375690 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.375810 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.375963 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.376114 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.376258 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.376427 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.376579 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.376765 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.376903 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.377081 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.377198 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.377394 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.377506 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.377715 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.377915 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-13 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.378010 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.378234 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.378330 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.378548 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.378641 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.378864 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.379018 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-13 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.379305 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.379454 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.379620 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.379715 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.379942 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.380039 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.380251 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.380350 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.381306 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.381423 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.381625 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.381776 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.381959 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.382285 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.382426 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.382614 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.382720 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.382936 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.383051 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.383267 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.383354 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.383579 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.383679 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.383889 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.383982 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.384211 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.384298 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.384520 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.384614 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.384828 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.384918 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.385081 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.385169 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.385390 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.385477 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.385713 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.385807 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386035 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386136 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386289 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386373 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386603 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386699 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386852 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.386953 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.387194 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.387284 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.387516 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.387602 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.387821 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.387919 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.388073 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.388160 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.388395 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.388482 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.388713 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.388805 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.389019 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.389107 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.389325 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.389418 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.389632 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.389718 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.389939 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.390031 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.390318 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.390429 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.390558 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.390647 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.390866 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.390960 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.391197 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.391331 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.391519 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.391613 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.391837 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.391924 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.392155 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.392255 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.392465 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.392550 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.392789 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.392881 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.393110 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.393204 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.393420 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.393508 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.393730 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.393815 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.394049 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.394154 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.394357 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.394444 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.394664 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.394755 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.394973 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.395096 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.395322 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.395414 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.395656 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.395743 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.395961 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.396098 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.396241 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.396423 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.396538 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.396834 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.396972 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.397146 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.397398 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.397485 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.397719 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.397814 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.397977 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.398080 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.398287 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.398382 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.398597 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.398683 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.398908 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.399002 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.399238 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.399340 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.399545 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.399631 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.399851 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.399937 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.400151 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.400235 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.400456 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.400560 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.400758 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.400844 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.401061 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.401161 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.401366 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.401460 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.401675 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.401762 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.401980 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.402066 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.402286 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.402383 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.402590 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.402676 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.402894 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.402989 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.403240 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.403345 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.403546 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.403633 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.403851 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.403936 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.404168 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.404331 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.404474 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.404560 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.404777 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.404864 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.405095 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.405194 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.405400 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.405486 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.405703 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.405789 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.406019 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.406113 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.406318 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.406410 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.406621 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.406714 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.406948 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.407073 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.407307 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.407393 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.407618 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.407705 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.407939 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.408026 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.408243 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.408329 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.408547 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.408633 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.408851 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.408937 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.409153 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.409238 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.409454 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.409539 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.409753 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.409839 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.410070 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.410162 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.410374 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.410476 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.410686 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.410775 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.410991 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.411143 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.411319 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.411423 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.411641 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.411767 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.412002 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.412096 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.412356 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.412885 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.412979 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.413058 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.413135 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.413212 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.413289 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.413386 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.413625 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.413713 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:27:17.413944 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.414037 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.414258 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.414358 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.414576 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.414674 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.414905 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.414991 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.415244 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.415335 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.415559 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.415645 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.415872 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.415958 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.416195 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.416281 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.416514 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.416599 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.416844 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.416929 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.417162 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.417248 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.417479 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.417586 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.417799 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.417895 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.418113 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.418201 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.418434 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.418520 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.418765 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.418850 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.419113 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.419205 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.419428 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.419514 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.419753 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.419840 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.420082 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.420176 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.420408 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.420493 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.420735 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.420829 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.421056 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.421150 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.421371 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.421464 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.421685 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.421778 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.421997 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.422096 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.422326 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.422420 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.422659 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.422795 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.422973 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.423075 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.423317 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.423403 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.423632 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.423730 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.423959 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.424054 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.424273 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.424361 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.424587 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.424675 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.424903 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.424991 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.425218 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.425358 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.425799 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.425895 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.426136 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.426222 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.426450 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.426544 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.426767 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.426855 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.427106 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.427208 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.428046 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.428143 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.428371 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.428463 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.428932 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429039 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429121 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429210 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429303 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429384 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429604 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429692 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.429914 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.430009 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.430224 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.430311 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.430538 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.430623 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.430846 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.430940 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.431190 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.431301 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.431520 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.431606 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.431829 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.431922 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.432154 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.432241 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.432461 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.432548 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.432779 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.432917 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.433091 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.433178 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.433402 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.433497 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.433708 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.433795 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.434021 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.434121 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.434334 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.434420 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.434641 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.434728 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.434954 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.435089 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.435291 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.435415 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.435599 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.435687 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.435919 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.436004 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.436226 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.436320 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.436534 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.436619 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.436847 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.436931 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.437160 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.437253 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.437466 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.437550 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.437778 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.437869 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.438089 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.438187 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.438399 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.438485 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.438713 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.438798 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.439048 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.439159 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.439360 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.439447 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.439676 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.439764 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.439991 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.440076 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.440316 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.440402 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.440632 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.440726 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.440947 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.441047 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.441249 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.441341 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.441560 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.441647 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.441866 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.441953 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.442172 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.442258 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.442477 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.442567 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.442794 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.442881 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.443798 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.443937 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.444120 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.444292 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.444456 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.444592 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.444720 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.444808 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.445027 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.445123 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.445339 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.445426 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.445652 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.445747 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.445955 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.446050 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.446259 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.446345 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.446564 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.446650 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.446870 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.446964 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.447223 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.447313 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.447560 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.447648 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.447872 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.447959 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.448180 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.448266 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.448488 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.448577 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.448817 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.448902 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.449135 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.449230 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.449447 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.449534 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.449763 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.449849 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.450077 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.450163 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.450391 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.450476 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.450714 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.450801 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.451079 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.451170 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.451368 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.451454 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.451681 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.451769 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.451994 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.452087 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.452309 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.452403 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.452631 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.452717 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.452938 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.453023 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.453259 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.453363 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.453578 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.453664 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.453904 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.453990 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.454233 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.454326 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.454559 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.454646 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.454872 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.454958 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.455212 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.455313 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.455527 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.455672 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.455841 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.455929 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.456154 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.456241 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.456467 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.456554 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.456787 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.456881 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.457103 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.457192 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.457416 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.457510 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.457726 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.457811 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.458038 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.458126 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.458352 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.458436 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.458714 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.458826 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.459049 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.459196 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.460007 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.460102 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.460182 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.460260 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.460402 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.460628 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.460897 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.461000 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.461269 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.461373 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.461587 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.461902 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.462021 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.462183 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.462300 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.462509 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.462642 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.462822 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.462923 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.463167 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.463318 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.463484 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.463618 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.463799 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.463944 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.464118 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.464249 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.464433 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.464564 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.464748 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.464910 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.465051 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.465195 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.465363 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.465501 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.465674 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.465804 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.465982 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.466125 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.466288 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.466420 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.466603 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.466733 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.466922 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.467083 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.467259 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.467349 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.467565 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.467652 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.467875 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.467974 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.468193 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.468278 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.468500 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.468586 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.468826 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.468919 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.469138 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.469223 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.469443 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.469529 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.469750 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.469836 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.470058 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.470146 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.470394 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.470478 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.470707 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.470793 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.471013 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.471118 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.471346 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.471448 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.471653 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.471740 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.471968 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.472053 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.472286 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.472392 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.472592 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.472681 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.472903 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.472987 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.473242 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.473403 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.473519 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.473629 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.473849 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.473981 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.474197 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.474359 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.474493 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.474614 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.474799 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.474931 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.475251 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.475405 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.475528 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.475659 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.475809 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.475930 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.476060 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.476181 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.476344 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.476463 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.476652 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.476790 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.476962 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.477051 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.477279 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.477373 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.477593 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.477851 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.477947 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.478184 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.478270 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.478501 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.478594 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.478819 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.478913 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.479163 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.479412 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.479563 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.479749 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.479847 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.480071 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.480167 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.480396 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.480482 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.480721 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.480808 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.481065 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.481211 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.481400 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.481551 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.481730 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.481859 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.482049 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.482188 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.482409 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.482557 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.482685 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.482792 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.483017 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.483290 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.483396 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.483478 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.483596 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.483740 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.483904 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.484014 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.484211 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.484306 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.484520 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.484615 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.484833 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.484929 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.485138 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.485223 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.485445 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.485537 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.485748 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.485842 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.486060 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.486145 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.486369 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.486462 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.486678 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.486833 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.486967 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.487088 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.487293 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.487381 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.487619 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.487707 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.487929 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.488021 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.488232 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.488318 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.488539 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.488626 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.488846 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.488932 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.489189 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.489276 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.489494 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.489579 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.490355 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.490456 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.490665 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.490858 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.490972 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.491391 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.491484 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.491697 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.491823 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.492006 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.492262 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.492349 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.492609 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.492763 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.492918 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.493199 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.493287 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.493522 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.493678 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.493823 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.494087 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.494223 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.494409 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.494512 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.494720 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.494818 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.495059 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.495174 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.495348 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.495456 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.495653 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.495756 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.495961 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.496052 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.496269 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.496358 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.496579 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.496691 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.496889 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.496980 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.497191 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.497278 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.497508 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.497594 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.497814 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.497902 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.498117 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.498203 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.498422 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.498526 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.498731 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.498818 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.499053 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.499142 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.499361 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.499461 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.499673 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.499758 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.499980 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.500067 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.500284 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.500416 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.500589 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.500704 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.500892 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.501006 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.501196 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.501321 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.501499 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.501627 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.501808 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.501932 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.502115 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.502240 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.502431 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.502555 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.502740 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.502929 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.503082 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.503209 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.503355 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.503479 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.503657 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.503779 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.503953 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.504068 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.504256 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.504399 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.504555 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.504679 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.504857 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.505008 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.505157 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.505284 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.505603 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.506236 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.506418 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.506513 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.506745 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.506843 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.507071 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.507176 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.507379 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.507474 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.507689 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.507789 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.508013 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.508107 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.508345 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.508442 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.508654 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.508742 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.508964 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.509064 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.509273 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.509359 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.509600 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.509686 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.509914 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.510002 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.510246 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.510366 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.510555 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.510668 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.510862 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.510977 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.511191 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.511307 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.511511 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.511637 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.511824 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.511960 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.512139 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.512272 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.512447 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.512577 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.512818 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.512934 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.513062 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.513186 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.513372 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.513502 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.513684 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.513809 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.513989 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.514123 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.514321 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.514454 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.514635 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.514758 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.514939 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.515094 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.515253 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.515348 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.515560 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.515648 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.515868 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.515953 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.516180 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.516276 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.516491 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.516582 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.516803 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.516889 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.517113 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.517209 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.517426 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.517512 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.517738 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.517824 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.518051 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.518138 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.518357 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.518455 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.518669 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.518755 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.518981 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.519097 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.519325 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.519448 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.519639 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.519754 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.519947 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.520069 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.520254 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.520370 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.520562 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.520689 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.520866 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.520991 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.521201 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.521338 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.521543 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.521680 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.521859 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.522063 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.522180 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.522379 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.522495 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.522692 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.522808 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.522995 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.523193 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.523313 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.523433 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.523635 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.523765 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.523956 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.524083 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.524277 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.524454 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.524578 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.524737 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.524994 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.525089 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.525307 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.525403 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.525620 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.525706 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.525931 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.526026 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.526239 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.526337 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.526545 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.526646 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.526854 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.527016 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.527185 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.527286 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.527496 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.527609 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.527805 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.527930 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.528113 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.528272 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.528437 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.528591 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.528743 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.528901 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.529067 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.529210 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.529482 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.529568 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.529795 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.529882 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.530103 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.530191 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.530428 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.530513 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.530738 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.530826 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.531091 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.531184 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.531402 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.531501 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.531730 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.531817 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.532080 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.532174 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.532389 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.532477 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.532704 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.532821 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.533015 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.533164 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.533342 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.533482 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.533665 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.533799 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.533985 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.534127 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.534301 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.534465 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.534607 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.534802 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.534932 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.535137 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.535281 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.535457 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.535597 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.535811 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.535920 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.536141 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.536337 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.536473 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.536679 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.536833 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.537104 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.537206 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.537541 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.537646 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.537815 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.537902 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.538142 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.538238 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.538450 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.538536 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.538765 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.538854 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.539098 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.539191 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.539408 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.539523 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.539732 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.539828 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.540038 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.540151 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.540353 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.540501 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.540665 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.540811 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.540978 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.541123 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.541284 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.541440 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.541590 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.541770 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.541913 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.542102 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.542219 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.542450 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.542537 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.542759 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.542848 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.543096 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.543185 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.543417 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.543513 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.543730 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.543819 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.544036 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.544124 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.544343 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.544429 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.544669 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.544757 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.544975 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.545069 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.545280 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.545375 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.545603 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.545697 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.545917 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.546002 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.546240 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.546333 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.546547 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.546634 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.546873 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.546969 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.547204 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.547305 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.547509 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.547595 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.547816 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.547910 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.548121 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.548218 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.548461 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.548618 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.548768 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.548856 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.549073 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.549160 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.549378 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.549464 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.549690 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.549786 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.549998 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.550086 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.550305 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.550392 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.550878 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.550965 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.551214 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.551305 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.551519 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.551606 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.551825 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.551921 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.552129 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.552223 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.552969 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.553082 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.553276 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.553443 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.553586 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.553682 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.553897 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.553994 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.554206 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.554302 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.554513 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.554607 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.554816 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.554903 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.555161 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.555264 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.555470 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.555558 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.555796 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.555881 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.556109 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.556207 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.556431 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.556519 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.556742 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.556828 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.557050 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.557138 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.557358 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.557453 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.557664 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.557763 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.557976 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.558063 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.558290 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.558378 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.558603 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.558690 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.558913 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.559001 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.559254 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.559346 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.559568 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.559655 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.559885 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.559974 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.560211 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.560423 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.560533 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.560753 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.560843 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.561069 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.561156 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.561383 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.561471 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.561698 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.561786 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.562013 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.562099 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.562327 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.562437 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.562640 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.562783 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.562950 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.563288 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.563401 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.563602 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.563760 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.563933 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.564107 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.564255 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.564450 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.564597 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.564812 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.564905 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.565132 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.565221 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.565513 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.565609 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.565827 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.565913 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.566141 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.566235 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.566498 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.566590 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.566812 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.566944 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.567146 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.567247 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.567469 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.567592 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.567782 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.567875 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.568680 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.568889 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.568981 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.569063 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.569366 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.569473 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.569688 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.569793 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.570031 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.570120 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.570375 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.570470 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.570692 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.570791 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.571010 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.571121 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.571348 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.571476 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.571673 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.571847 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.572009 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.572197 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.572336 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.572537 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.572655 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.572876 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.572979 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.573219 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.573317 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.573554 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.573782 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.573917 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.574098 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.574274 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.574435 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.574622 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.574761 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.574965 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.575112 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.575325 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.575452 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.575690 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.575808 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.576020 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.576136 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.576325 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.576415 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.576634 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.576723 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.576946 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.577078 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.577257 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.577562 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.577663 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.577887 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.577982 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.578199 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.578286 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.578504 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.578664 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.578826 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.579001 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.579175 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.579349 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.579695 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.579783 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.580030 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.580116 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.580348 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.580435 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.580675 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.580768 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.581002 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.581125 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.581322 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.581483 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.581630 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.581719 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.581954 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.582044 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.582265 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.582361 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.582571 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.582658 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.582887 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.582981 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.583224 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.583324 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.583549 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.583917 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.584021 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.584309 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.584397 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.584622 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.584719 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.584930 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.585025 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.585241 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.585338 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.585548 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.585687 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.585877 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.586029 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.586186 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.586398 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.586487 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.586734 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.586822 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.587089 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.587182 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.587412 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.587516 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.587719 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.587809 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.588026 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.588121 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.588332 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.588420 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.588645 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.588740 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.588952 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.589047 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.589260 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.589408 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.589562 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.589650 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.589871 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.589965 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.590175 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.590268 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.590486 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.590573 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.590846 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.590941 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.591195 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.591295 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.591502 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.591598 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.591807 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.591902 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.592122 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.592208 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.592434 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.592520 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.592759 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.592855 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.593070 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.593159 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.593382 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.593469 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.593694 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.593782 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.594005 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.594105 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.594320 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.594554 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.594650 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.594892 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.594980 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.595244 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.595332 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.595582 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.595684 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.595912 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.596008 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.596220 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.596306 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.596530 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.596625 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.596839 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.596933 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.597164 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.597306 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.597479 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.597566 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.597790 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.597887 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.598102 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.598188 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.598416 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.598548 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.598728 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.598966 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.599074 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.599387 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.599648 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.599805 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.599904 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.599996 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.600305 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.600405 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.600612 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.600700 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.600921 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.601032 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.601229 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.601353 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.601537 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.601668 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.601849 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.602000 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.602190 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.602341 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.602508 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.602663 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.602825 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.602981 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.603173 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.603341 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.603493 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.603684 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.603803 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.604009 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.604156 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.604319 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.604415 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.604656 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.604745 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.604974 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.605074 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.605314 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.605402 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.605632 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.605718 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.605941 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.606028 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.606287 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.606373 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.606602 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.606688 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.606922 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.607009 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.607300 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.607387 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.607612 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.607699 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.607936 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.608025 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.608258 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.608345 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.608571 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.608667 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.608979 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.609065 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.609291 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.609378 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.609624 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.609720 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.609964 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.610050 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.610286 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.610381 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.610609 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.610705 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.610917 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.611004 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.611249 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.611355 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.611555 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.611772 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.611861 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.612098 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.612193 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.612449 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.612544 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.612760 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.612846 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.613067 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.613153 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.613376 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.613472 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.613683 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.613792 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.613988 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.614114 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.614301 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.614443 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.614607 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.614764 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.615464 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.615681 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.615785 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.616064 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.616179 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.616428 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.616548 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.616678 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.616872 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.616966 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.617210 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.617309 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.617539 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.617641 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.617856 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.617947 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.618158 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.618245 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.618459 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.618556 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.618763 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.618859 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.619085 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.619178 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.619420 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.619519 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.619753 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.619849 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.620070 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.620166 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.620390 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.620492 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.620699 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.620787 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.621022 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.621111 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.621333 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.621434 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.621641 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.621729 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.621950 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.622038 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.622262 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.622377 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.622567 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.622655 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.622873 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.622960 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.623208 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.623300 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.623524 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.623611 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.623831 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.623925 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.624142 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.624256 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.624452 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.624560 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.624757 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.624844 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.625060 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.625148 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.625397 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.625513 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.625707 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.625817 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.626031 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.626120 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.626352 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.626439 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.626675 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.626781 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.626991 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.627105 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.627326 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.627416 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.627658 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.627773 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.627971 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.628062 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.628282 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.628371 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.628593 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.628694 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.628905 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.628995 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.629216 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.629328 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.629534 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.629670 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.629847 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.630012 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.630158 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.630371 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.631154 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.631661 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.631773 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.631857 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.631951 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.632062 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.632201 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.632398 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.632507 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.632708 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.632832 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.633048 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.633161 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.633395 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.633508 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.633745 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.633836 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.634089 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.634179 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.634408 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.634512 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.634769 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.634870 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.635099 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.635190 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.635408 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.635509 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.635653 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106770) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:27:17.635833 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.636196 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.636561 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.636889 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.637246 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.637600 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.637949 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.638293 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.638646 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.638978 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.639321 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.639654 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.639988 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.640339 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.640659 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.641004 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.641336 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.641655 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.641969 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.642277 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:27:17.642524 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:27:17.791681 n-d-836830-13 devstack@n-api.service[106770]: INFO dbcounter [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Registered counter for database nova_api Aug 29 15:27:17.803469 n-d-836830-13 devstack@n-api.service[106771]: INFO dbcounter [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Registered counter for database nova_api Aug 29 15:27:17.812007 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_db.sqlalchemy.engines [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:17.819517 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writer thread running {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:17.825437 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_db.sqlalchemy.engines [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:17.832195 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writer thread running {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:17.878138 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.context [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=106770) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:27:17.882964 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_concurrency.lockutils [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.883512 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_concurrency.lockutils [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.885336 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_concurrency.lockutils [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.886085 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_concurrency.lockutils [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.886540 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_concurrency.lockutils [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.888561 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_concurrency.lockutils [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106770) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.890560 n-d-836830-13 devstack@n-api.service[106770]: INFO dbcounter [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Registered counter for database nova_cell0 Aug 29 15:27:17.894367 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.context [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=106771) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:27:17.894582 n-d-836830-13 devstack@n-api.service[106770]: INFO dbcounter [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Registered counter for database nova_cell1 Aug 29 15:27:17.899237 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.899736 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.901401 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.903813 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:27:17.903813 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:27:17.904037 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_db.sqlalchemy.engines [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:17.904903 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:27:17.905246 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_db.sqlalchemy.engines [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:17.907120 n-d-836830-13 devstack@n-api.service[106771]: INFO dbcounter [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Registered counter for database nova_cell0 Aug 29 15:27:17.909872 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writer thread running {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:17.911346 n-d-836830-13 devstack@n-api.service[106771]: INFO dbcounter [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Registered counter for database nova_cell1 Aug 29 15:27:17.913081 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writer thread running {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:17.919432 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_db.sqlalchemy.engines [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:17.921695 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_db.sqlalchemy.engines [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:17.927433 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writer thread running {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:18.062071 n-d-836830-13 devstack@n-api.service[106770]: INFO dbcounter [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Registered counter for database nova_cell0 Aug 29 15:27:18.069286 n-d-836830-13 devstack@n-api.service[106770]: DEBUG oslo_db.sqlalchemy.engines [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106770) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:18.073755 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writer thread running {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:18.078216 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writer thread running {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:18.089912 n-d-836830-13 devstack@n-api.service[106771]: INFO dbcounter [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Registered counter for database nova_cell0 Aug 29 15:27:18.099679 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_db.sqlalchemy.engines [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:27:18.106363 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writer thread running {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:27:18.660383 n-d-836830-13 devstack@n-api.service[106770]: WARNING keystonemiddleware.auth_token [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:27:18.664874 n-d-836830-13 devstack@n-api.service[106771]: WARNING keystonemiddleware.auth_token [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:27:18.673112 n-d-836830-13 devstack@n-api.service[106770]: WARNING keystonemiddleware.auth_token [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:27:18.677693 n-d-836830-13 devstack@n-api.service[106771]: WARNING keystonemiddleware.auth_token [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:27:19.177186 n-d-836830-13 devstack@n-api.service[106770]: WARNING keystonemiddleware.auth_token [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:27:19.179760 n-d-836830-13 devstack@n-api.service[106771]: WARNING keystonemiddleware.auth_token [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:27:19.183499 n-d-836830-13 devstack@n-api.service[106770]: WARNING keystonemiddleware.auth_token [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:27:19.185658 n-d-836830-13 devstack@n-api.service[106771]: WARNING keystonemiddleware.auth_token [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:27:19.188574 n-d-836830-13 devstack@n-api.service[106770]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6101319c0 pid: 106770 (default app) Aug 29 15:27:19.190663 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:27:19.190899 n-d-836830-13 devstack@n-api.service[106771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6101319c0 pid: 106771 (default app) Aug 29 15:27:19.191887 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-a7794c25-ca6d-4217-8d93-c334ab8645d8 None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001782 Aug 29 15:27:19.192292 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Mon Aug 29 15:27:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:38.185396 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:38.186602 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Aug 29 15:28:38.187004 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:38.200114 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writing DB stats nova_api:SELECT=3 {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:38.201060 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writing DB stats nova_cell0:SELECT=3 {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:38.202278 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writing DB stats nova_cell1:SELECT=3 {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:38.203334 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:39.101335 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-39cd4803-d559-4bda-a0b3-6b49299a2070 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:39.135873 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-39cd4803-d559-4bda-a0b3-6b49299a2070 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.941609 Aug 29 15:28:39.136814 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 2/3] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:28:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:41.511477 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:41.512494 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-1e23ab36-b325-4979-8a9e-c796b424db99 None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 29 15:28:41.513123 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 2/4] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:41.952201 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-72e64e8c-60f1-4f03-ae2a-7d714e75582e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "swap": 0, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:42.001229 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-72e64e8c-60f1-4f03-ae2a-7d714e75582e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481322 Aug 29 15:28:42.001958 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 3/5] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:28:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:28:42.015317 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writing DB stats nova_api:SELECT=3 {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:42.016442 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writing DB stats nova_cell0:SELECT=3 {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:42.017390 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writing DB stats nova_cell1:SELECT=3 {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:42.019330 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writing DB stats nova_cell0:SELECT=3 {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:28:42.228710 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-cb7fc7f5-2f0e-4311-a00e-d1152354381f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:42.303084 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-cb7fc7f5-2f0e-4311-a00e-d1152354381f admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292851 Aug 29 15:28:42.311412 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 3/6] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 15:28:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:44.730596 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-72e64e8c-60f1-4f03-ae2a-7d714e75582e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:44.731656 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-72e64e8c-60f1-4f03-ae2a-7d714e75582e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 29 15:28:44.732300 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 4/7] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:45.477355 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-76a7439b-d878-4812-b3c9-59720c5cb307 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:45.518700 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-76a7439b-d878-4812-b3c9-59720c5cb307 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.779429 Aug 29 15:28:45.519363 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 4/8] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:28:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:28:45.532034 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-671101cc-e57a-4696-a5e9-7a268e048909 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:45.573085 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-671101cc-e57a-4696-a5e9-7a268e048909 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044981 Aug 29 15:28:45.573709 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 5/9] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 15:28:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:28:48.236981 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-76a7439b-d878-4812-b3c9-59720c5cb307 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:48.238847 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-76a7439b-d878-4812-b3c9-59720c5cb307 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002328 Aug 29 15:28:48.239957 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:48.699767 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-d0b59677-af92-471b-97dd-a3ec12eb27da admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:48.733456 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-d0b59677-af92-471b-97dd-a3ec12eb27da admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485806 Aug 29 15:28:48.734772 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 6/11] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:28:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:28:48.752246 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-e2dea4e2-ae8a-43d0-8ef4-52cb51d8cfc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:48.781084 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-e2dea4e2-ae8a-43d0-8ef4-52cb51d8cfc7 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032368 Aug 29 15:28:48.795224 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 6/12] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 15:28:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:51.355889 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-d0b59677-af92-471b-97dd-a3ec12eb27da admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:51.356894 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-d0b59677-af92-471b-97dd-a3ec12eb27da admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 29 15:28:51.357287 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 7/13] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:51.797710 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-a7a82e14-9242-4dd2-a289-350701613712 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:51.825945 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-a7a82e14-9242-4dd2-a289-350701613712 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462408 Aug 29 15:28:51.834537 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 7/14] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:28:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:28:51.843973 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-e4c74d90-b6ad-4346-9c8f-424e8b00fd54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:51.898591 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-e4c74d90-b6ad-4346-9c8f-424e8b00fd54 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061150 Aug 29 15:28:51.913628 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 8/15] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 15:28:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:54.393841 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-a7a82e14-9242-4dd2-a289-350701613712 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:54.394931 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-a7a82e14-9242-4dd2-a289-350701613712 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 29 15:28:54.395512 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 8/16] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:54.925878 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-e4bfc100-ce13-463d-852d-de68a1dfcca8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:54.955167 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-e4bfc100-ce13-463d-852d-de68a1dfcca8 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552565 Aug 29 15:28:54.956433 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 9/17] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:28:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:28:54.974434 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-d6e607e7-9526-4f85-ab7d-8112afdca656 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:28:55.014602 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-d6e607e7-9526-4f85-ab7d-8112afdca656 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046949 Aug 29 15:28:55.015578 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 9/18] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 15:28:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:28:57.525760 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-e4bfc100-ce13-463d-852d-de68a1dfcca8 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.526764 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-e4bfc100-ce13-463d-852d-de68a1dfcca8 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 29 15:28:57.527561 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 10/19] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:28:57.954566 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-df0d5800-eea5-4fff-95eb-98b60fdde2c5 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:28:57.982107 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-df0d5800-eea5-4fff-95eb-98b60fdde2c5 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447936 Aug 29 15:28:57.983225 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 10/20] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:28:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:00.379528 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-e4bfc100-ce13-463d-852d-de68a1dfcca8 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:00.380564 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-e4bfc100-ce13-463d-852d-de68a1dfcca8 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 29 15:29:00.381961 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 11/21] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:00.805675 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-7baef58b-1cf2-40e2-8d17-54a0f37f851e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:00.825986 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-7baef58b-1cf2-40e2-8d17-54a0f37f851e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.437903 Aug 29 15:29:00.826546 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 11/22] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:29:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:00.839660 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-acffface-ce01-4637-9cd2-3a049985a5a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:00.864521 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-acffface-ce01-4637-9cd2-3a049985a5a9 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028975 Aug 29 15:29:00.865151 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 12/23] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 15:29:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:29:03.224505 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-7baef58b-1cf2-40e2-8d17-54a0f37f851e admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:03.225710 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-7baef58b-1cf2-40e2-8d17-54a0f37f851e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 29 15:29:03.226113 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 12/24] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:29:03.668243 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-e16fca0e-1974-459e-a16a-a4f3927b2963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 2048, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:03.689578 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-e16fca0e-1974-459e-a16a-a4f3927b2963 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455626 Aug 29 15:29:03.690137 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 13/25] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:29:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:03.707202 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-5342a2be-0dfc-49b0-89c3-a6ae1e93155b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:03.737413 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-5342a2be-0dfc-49b0-89c3-a6ae1e93155b admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035435 Aug 29 15:29:03.738433 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 13/26] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 15:29:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:06.146565 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-e16fca0e-1974-459e-a16a-a4f3927b2963 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:06.147657 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-e16fca0e-1974-459e-a16a-a4f3927b2963 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 29 15:29:06.148070 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 14/27] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:06.558183 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-99ea69ea-a345-4d3c-a7a4-4c86d5e97535 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "id": "3", "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:06.579448 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-99ea69ea-a345-4d3c-a7a4-4c86d5e97535 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.425055 Aug 29 15:29:06.580017 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 14/28] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:29:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:06.592216 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-d55fcf68-baca-416c-a15b-ba4654977ae2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:06.617091 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-d55fcf68-baca-416c-a15b-ba4654977ae2 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027853 Aug 29 15:29:06.618849 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 15/29] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 15:29:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:09.006372 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-99ea69ea-a345-4d3c-a7a4-4c86d5e97535 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:09.007559 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-99ea69ea-a345-4d3c-a7a4-4c86d5e97535 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 29 15:29:09.008108 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 15/30] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:09.395951 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-17ae745d-a291-4897-9c5e-a8ac5c5696fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:09.405677 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:09.422254 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-17ae745d-a291-4897-9c5e-a8ac5c5696fc admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407778 Aug 29 15:29:09.430346 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 16/31] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:29:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:09.435445 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-1dbe5bda-d0f5-45dd-bbdd-2027cad03616 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:09.461505 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-1dbe5bda-d0f5-45dd-bbdd-2027cad03616 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029066 Aug 29 15:29:09.462310 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 16/32] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 15:29:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:11.909990 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-17ae745d-a291-4897-9c5e-a8ac5c5696fc admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:11.911070 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-17ae745d-a291-4897-9c5e-a8ac5c5696fc admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 29 15:29:11.911645 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 17/33] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:12.355548 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-ee1dbdee-c9ed-43a7-9db9-4446cc431540 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "ram": 16384, "id": "5", "os-flavor-access:is_public": true}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:12.377555 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-ee1dbdee-c9ed-43a7-9db9-4446cc431540 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458719 Aug 29 15:29:12.378106 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 17/34] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 15:29:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:12.391290 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-4ffca96e-7378-4cf8-8a6c-8a167ce99b0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:12.419868 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-4ffca96e-7378-4cf8-8a6c-8a167ce99b0b admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032145 Aug 29 15:29:12.420849 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 18/35] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 15:29:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:29:35.913717 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-ee1dbdee-c9ed-43a7-9db9-4446cc431540 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:35.914644 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-ee1dbdee-c9ed-43a7-9db9-4446cc431540 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 29 15:29:35.915083 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 18/36] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:35.926643 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:36.308319 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-347f9f51-ddbf-4546-b05d-5473cb85b709 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:36.332165 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-347f9f51-ddbf-4546-b05d-5473cb85b709 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409745 Aug 29 15:29:36.333051 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 19/37] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:29:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:37.453522 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-ee1dbdee-c9ed-43a7-9db9-4446cc431540 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:37.454513 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-ee1dbdee-c9ed-43a7-9db9-4446cc431540 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 29 15:29:37.454905 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 19/38] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:38.006406 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-0da2c1c1-6469-462c-9e4f-51108bd402e4 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.011978 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.wsgi [None req-0da2c1c1-6469-462c-9e4f-51108bd402e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-0da2c1c1-6469-462c-9e4f-51108bd402e4 admin admin] Request method failure captured: Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: Accept: application/json Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: Accept-Encoding: gzip, deflate Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: Connection: keep-alive Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: Content-Length: 0 Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: Host: 10.222.0.83 Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: Openstack-Api-Version: compute 2.90 Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: Openstack-System-Scope: None Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: User-Agent: python-novaclient Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Auth-Token: gAAAAABjDNthVLHPFfWSda2aBrW3BmWZ2j-ZFDAF1KnAG4I6WnQzHCnw-y2QTP6qMpu427sdkVQgDaEY7OHPYhkLNKYvUg0LS00uivPAKnmS7NHYo24FGJvUgFIpCar_093SxUvQ1_b0zGflZNdt-XTBfb1_GdXPG2pmi5zLxV3dweiDsUvqz40 Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Domain-Id: None Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Domain-Name: None Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Identity-Status: Confirmed Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Is-Admin-Project: True Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Domain-Id: default Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Domain-Name: Default Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Name: admin Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Role: reader,member,admin Aug 29 15:29:38.015254 n-d-836830-13 devstack@n-api.service[106770]: X-Roles: reader,member,admin Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2be1d9508c364610be9aca20e58e1d6a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2be1d9508c364610be9aca20e58e1d6a"}]}] Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant: admin Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant-Name: admin Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-User: admin Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-User-Domain-Id: default Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-User-Domain-Name: Default Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-User-Id: 6db5f614a81044e59454d15b8c60cf8f Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: X-User-Name: admin Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: method: > Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: exception: Flavor 42 could not be found. Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: action_args: {'id': '42'} Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:38.016945 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:38.020004 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.021468 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-0da2c1c1-6469-462c-9e4f-51108bd402e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:38.022614 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-0da2c1c1-6469-462c-9e4f-51108bd402e4 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403061 Aug 29 15:29:38.022614 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 20/39] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:29:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:38.026405 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-3e7c0cce-9b90-44de-aa00-c984830c1960 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.031635 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:29:38.053254 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-3e7c0cce-9b90-44de-aa00-c984830c1960 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030452 Aug 29 15:29:38.053813 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 20/40] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 15:29:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:38.077403 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-50385b16-96ec-438d-a4c9-e744ea7f6167 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.100505 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-50385b16-96ec-438d-a4c9-e744ea7f6167 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027074 Aug 29 15:29:38.101153 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 21/41] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 15:29:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:38.111369 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-1892daf8-ea5a-4d55-b73a-962f17abfb34 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:38.117582 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.wsgi [None req-1892daf8-ea5a-4d55-b73a-962f17abfb34 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-1892daf8-ea5a-4d55-b73a-962f17abfb34 admin admin] Request method failure captured: Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: Accept: application/json Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: Accept-Encoding: gzip, deflate Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: Connection: keep-alive Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: Content-Length: 0 Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: Host: 10.222.0.83 Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: Openstack-Api-Version: compute 2.90 Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: Openstack-System-Scope: None Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: User-Agent: python-novaclient Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Auth-Token: gAAAAABjDNthVLHPFfWSda2aBrW3BmWZ2j-ZFDAF1KnAG4I6WnQzHCnw-y2QTP6qMpu427sdkVQgDaEY7OHPYhkLNKYvUg0LS00uivPAKnmS7NHYo24FGJvUgFIpCar_093SxUvQ1_b0zGflZNdt-XTBfb1_GdXPG2pmi5zLxV3dweiDsUvqz40 Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Domain-Id: None Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Domain-Name: None Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Identity-Status: Confirmed Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Is-Admin-Project: True Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Domain-Id: default Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Domain-Name: Default Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Name: admin Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Role: reader,member,admin Aug 29 15:29:38.120990 n-d-836830-13 devstack@n-api.service[106771]: X-Roles: reader,member,admin Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2be1d9508c364610be9aca20e58e1d6a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2be1d9508c364610be9aca20e58e1d6a"}]}] Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant: admin Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant-Name: admin Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-User: admin Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-User-Domain-Id: default Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-User-Domain-Name: Default Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-User-Id: 6db5f614a81044e59454d15b8c60cf8f Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: X-User-Name: admin Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: method: > Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: exception: Flavor 42 could not be found. Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: action_args: {'id': '42'} Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:38.122474 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:38.123521 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:38.124727 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-1892daf8-ea5a-4d55-b73a-962f17abfb34 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:38.125875 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-1892daf8-ea5a-4d55-b73a-962f17abfb34 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014674 Aug 29 15:29:38.125875 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 21/42] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:29:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:39.095904 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-50385b16-96ec-438d-a4c9-e744ea7f6167 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.096941 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-50385b16-96ec-438d-a4c9-e744ea7f6167 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 29 15:29:39.097334 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 22/43] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:39.624625 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-c8c5316f-755f-4c80-8565-1a533f434993 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.630427 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.wsgi [None req-c8c5316f-755f-4c80-8565-1a533f434993 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-c8c5316f-755f-4c80-8565-1a533f434993 admin admin] Request method failure captured: Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: Accept: application/json Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: Accept-Encoding: gzip, deflate Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: Connection: keep-alive Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: Content-Length: 0 Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: Host: 10.222.0.83 Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: Openstack-Api-Version: compute 2.90 Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: Openstack-System-Scope: None Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: User-Agent: python-novaclient Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Auth-Token: gAAAAABjDNtiGf4W4Jka9BYOf3cxziSnWGTn5SDBmwSoYaqGdl7l9qqLaU4-LPoKH6UcjjOn-Xr24-sa6sEJgCKjegRlOI-Ud2z4bwreP3Piin21PsiwZFJx1UM6FjrHavs2tahQOO6EEomHQcnMTwUUy4Duqs1cgnU6_xsh9VP0FzZI5iWCWlI Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Domain-Id: None Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Domain-Name: None Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Identity-Status: Confirmed Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Is-Admin-Project: True Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Domain-Id: default Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Domain-Name: Default Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Name: admin Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Role: reader,member,admin Aug 29 15:29:39.631958 n-d-836830-13 devstack@n-api.service[106771]: X-Roles: reader,member,admin Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2be1d9508c364610be9aca20e58e1d6a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2be1d9508c364610be9aca20e58e1d6a"}]}] Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant: admin Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant-Name: admin Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-User: admin Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-User-Domain-Id: default Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-User-Domain-Name: Default Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-User-Id: 6db5f614a81044e59454d15b8c60cf8f Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: X-User-Name: admin Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: method: > Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: exception: Flavor 84 could not be found. Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: action_args: {'id': '84'} Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:39.633446 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:39.634246 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.635310 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-c8c5316f-755f-4c80-8565-1a533f434993 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:39.636712 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-c8c5316f-755f-4c80-8565-1a533f434993 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396912 Aug 29 15:29:39.636712 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 22/44] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:39.643717 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-77439bc5-d937-48e5-b9cb-cf2db58500ae admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.658438 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-77439bc5-d937-48e5-b9cb-cf2db58500ae admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018368 Aug 29 15:29:39.658970 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 23/45] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:39.670200 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-8242fe48-b8be-4a58-8f9b-17b9ff3d9b7b admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.686044 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-8242fe48-b8be-4a58-8f9b-17b9ff3d9b7b admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021236 Aug 29 15:29:39.686598 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 23/46] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:39.696042 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-fb382faf-c9a8-487d-a7c2-d8aa4edf3b53 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:39.702413 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.wsgi [None req-fb382faf-c9a8-487d-a7c2-d8aa4edf3b53 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-fb382faf-c9a8-487d-a7c2-d8aa4edf3b53 admin admin] Request method failure captured: Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: Accept: application/json Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: Accept-Encoding: gzip, deflate Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: Connection: keep-alive Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: Content-Length: 0 Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: Host: 10.222.0.83 Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: Openstack-Api-Version: compute 2.90 Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: Openstack-System-Scope: None Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: User-Agent: python-novaclient Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Auth-Token: gAAAAABjDNtiGf4W4Jka9BYOf3cxziSnWGTn5SDBmwSoYaqGdl7l9qqLaU4-LPoKH6UcjjOn-Xr24-sa6sEJgCKjegRlOI-Ud2z4bwreP3Piin21PsiwZFJx1UM6FjrHavs2tahQOO6EEomHQcnMTwUUy4Duqs1cgnU6_xsh9VP0FzZI5iWCWlI Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Domain-Id: None Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Domain-Name: None Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Identity-Status: Confirmed Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Is-Admin-Project: True Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Domain-Id: default Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Domain-Name: Default Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Name: admin Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Role: reader,member,admin Aug 29 15:29:39.703952 n-d-836830-13 devstack@n-api.service[106770]: X-Roles: reader,member,admin Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2be1d9508c364610be9aca20e58e1d6a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2be1d9508c364610be9aca20e58e1d6a"}]}] Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant: admin Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant-Name: admin Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-User: admin Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-User-Domain-Id: default Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-User-Domain-Name: Default Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-User-Id: 6db5f614a81044e59454d15b8c60cf8f Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: X-User-Name: admin Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: method: > Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: exception: Flavor 84 could not be found. Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: action_args: {'id': '84'} Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:39.705360 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:39.706610 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:39.707680 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-fb382faf-c9a8-487d-a7c2-d8aa4edf3b53 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:39.708783 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-fb382faf-c9a8-487d-a7c2-d8aa4edf3b53 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012906 Aug 29 15:29:39.708783 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 24/47] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:29:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:40.679044 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-8242fe48-b8be-4a58-8f9b-17b9ff3d9b7b admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:40.680127 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-8242fe48-b8be-4a58-8f9b-17b9ff3d9b7b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 29 15:29:40.680525 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 24/48] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:41.205741 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-15119931-75c8-4723-af45-8681698b2710 admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.212232 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.wsgi [None req-15119931-75c8-4723-af45-8681698b2710 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-15119931-75c8-4723-af45-8681698b2710 admin admin] Request method failure captured: Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: Accept: application/json Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: Accept-Encoding: gzip, deflate Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: Connection: keep-alive Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: Content-Length: 0 Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: Host: 10.222.0.83 Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: Openstack-Api-Version: compute 2.90 Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: Openstack-System-Scope: None Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: User-Agent: python-novaclient Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Auth-Token: gAAAAABjDNtkFF6UP7DxHYkOb8Tvqr_DN6186JwCaka2nWyBKkNn20kgllozqqGJe0ZLbDj3gNabW9G8IwPVguDBa_V7HCSE8p6QbDT60TzHz6CTN9ONbm6q3eRJrq88MzHyiXUrZ_s4CJBqkN0w7nUiDi8wpdcOkZ2nMgd00rNabh2TYGrS8FE Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Domain-Id: None Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Domain-Name: None Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Identity-Status: Confirmed Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Is-Admin-Project: True Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Domain-Id: default Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Domain-Name: Default Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Project-Name: admin Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Role: reader,member,admin Aug 29 15:29:41.213740 n-d-836830-13 devstack@n-api.service[106770]: X-Roles: reader,member,admin Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2be1d9508c364610be9aca20e58e1d6a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2be1d9508c364610be9aca20e58e1d6a"}]}] Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant: admin Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-Tenant-Name: admin Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-User: admin Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-User-Domain-Id: default Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-User-Domain-Name: Default Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-User-Id: 6db5f614a81044e59454d15b8c60cf8f Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: X-User-Name: admin Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: method: > Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: exception: Flavor 451 could not be found. Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: action_args: {'id': '451'} Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:41.215895 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:41.217689 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.218977 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-15119931-75c8-4723-af45-8681698b2710 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106770) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:41.220326 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-15119931-75c8-4723-af45-8681698b2710 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396590 Aug 29 15:29:41.220326 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 25/49] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 15:29:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:41.225813 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-d4a114d5-0d8c-48c2-ad57-15ded15f3341 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.241752 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-d4a114d5-0d8c-48c2-ad57-15ded15f3341 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019480 Aug 29 15:29:41.242284 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 25/50] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:29:41.251756 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.267211 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018865 Aug 29 15:29:41.267771 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 26/51] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:29:41.277390 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-060fe5f0-250c-4f65-9b49-02aac24c21f6 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:41.283941 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.wsgi [None req-060fe5f0-250c-4f65-9b49-02aac24c21f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-060fe5f0-250c-4f65-9b49-02aac24c21f6 admin admin] Request method failure captured: Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: Accept: application/json Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: Accept-Encoding: gzip, deflate Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: Connection: keep-alive Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: Content-Length: 0 Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: Host: 10.222.0.83 Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: Openstack-Api-Version: compute 2.90 Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: Openstack-System-Scope: None Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: User-Agent: python-novaclient Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Auth-Token: gAAAAABjDNtkFF6UP7DxHYkOb8Tvqr_DN6186JwCaka2nWyBKkNn20kgllozqqGJe0ZLbDj3gNabW9G8IwPVguDBa_V7HCSE8p6QbDT60TzHz6CTN9ONbm6q3eRJrq88MzHyiXUrZ_s4CJBqkN0w7nUiDi8wpdcOkZ2nMgd00rNabh2TYGrS8FE Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Domain-Id: None Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Domain-Name: None Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Identity-Status: Confirmed Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Is-Admin-Project: True Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Domain-Id: default Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Domain-Name: Default Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Project-Name: admin Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Role: reader,member,admin Aug 29 15:29:41.285443 n-d-836830-13 devstack@n-api.service[106771]: X-Roles: reader,member,admin Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2be1d9508c364610be9aca20e58e1d6a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2be1d9508c364610be9aca20e58e1d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2be1d9508c364610be9aca20e58e1d6a"}]}] Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant: admin Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant-Id: 2be1d9508c364610be9aca20e58e1d6a Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-Tenant-Name: admin Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-User: admin Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-User-Domain-Id: default Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-User-Domain-Name: Default Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-User-Id: 6db5f614a81044e59454d15b8c60cf8f Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: X-User-Name: admin Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: method: > Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: exception: Flavor 451 could not be found. Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: action_args: {'id': '451'} Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:29:41.287060 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:41.291720 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: ERROR nova.api.openstack.wsgi Aug 29 15:29:41.292973 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-060fe5f0-250c-4f65-9b49-02aac24c21f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:29:41.295145 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-060fe5f0-250c-4f65-9b49-02aac24c21f6 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013122 Aug 29 15:29:41.295145 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 26/52] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 15:29:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:29:42.259445 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:42.260447 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 29 15:29:42.260845 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 27/53] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:42.808141 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-0826bb60-81ef-49a4-b883-c119e9327561 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:42.828897 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-0826bb60-81ef-49a4-b883-c119e9327561 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.416821 Aug 29 15:29:42.829448 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 27/54] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 15:29:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:29:43.803882 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:43.804963 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 29 15:29:43.805368 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 28/55] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:44.337529 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-8b3c701a-1b29-44ea-ad7c-da586a8cdc18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:44.358086 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-8b3c701a-1b29-44ea-ad7c-da586a8cdc18 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.411709 Aug 29 15:29:44.358647 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 28/56] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 15:29:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:45.323547 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:45.324649 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Aug 29 15:29:45.325290 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 29/57] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:45.849030 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-1a964dbc-e5a9-4838-92d4-62c434a9aca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:45.867747 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-1a964dbc-e5a9-4838-92d4-62c434a9aca7 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407376 Aug 29 15:29:45.868286 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 29/58] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 15:29:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:29:46.831448 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:46.832475 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 29 15:29:46.832866 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 30/59] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:47.358437 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-e4b6ea8b-5299-4cfd-94e6-3d32b263999f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:29:47.377440 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-e4b6ea8b-5299-4cfd-94e6-3d32b263999f admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406646 Aug 29 15:29:47.377904 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 30/60] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 15:29:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:29:48.355926 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:48.356930 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 29 15:29:48.357331 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 31/61] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:29:48.883399 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-267a75ac-6db9-4984-8b93-635d5c80a3eb admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:29:48.903648 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-267a75ac-6db9-4984-8b93-635d5c80a3eb admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408316 Aug 29 15:29:48.904177 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 31/62] 10.222.0.83 () {60 vars in 1202 bytes} [Mon Aug 29 15:29:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:30:42.984926 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:42.985977 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-023c3746-fb42-47f5-bf26-3619d50ee13e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Aug 29 15:30:42.986373 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 32/63] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 15:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:30:42.996888 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:43.496574 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-56a389e4-b3d1-42a4-9805-ce90470ee55d admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.518912 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-56a389e4-b3d1-42a4-9805-ce90470ee55d admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.526304 Aug 29 15:30:43.519417 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 32/64] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:30:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:30:43.540462 n-d-836830-13 devstack@n-api.service[106770]: DEBUG dbcounter [-] [106770] Writing DB stats nova_api:SELECT=14 {{(pid=106770) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:30:43.544458 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-d13f7e72-c09c-4398-a439-8b804805ef1e admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.552852 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-d13f7e72-c09c-4398-a439-8b804805ef1e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013831 Aug 29 15:30:43.553377 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 33/65] 10.222.0.83 () {60 vars in 1283 bytes} [Mon Aug 29 15:30:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:43.565834 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-a6cd6d61-0393-478d-8e16-655a3112dbef admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.573537 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-a6cd6d61-0393-478d-8e16-655a3112dbef admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012071 Aug 29 15:30:43.574053 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 33/66] 10.222.0.83 () {60 vars in 1286 bytes} [Mon Aug 29 15:30:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:43.585324 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-dc537d4a-d7ce-485f-a0fe-b60481f2dcbd admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.592872 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-dc537d4a-d7ce-485f-a0fe-b60481f2dcbd admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011116 Aug 29 15:30:43.593416 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 34/67] 10.222.0.83 () {60 vars in 1286 bytes} [Mon Aug 29 15:30:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:30:43.604720 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-5a8bd722-b6ef-4285-9484-82a8d597c669 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:30:43.612900 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-5a8bd722-b6ef-4285-9484-82a8d597c669 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011673 Aug 29 15:30:43.613412 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 34/68] 10.222.0.83 () {60 vars in 1283 bytes} [Mon Aug 29 15:30:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:36:10.461868 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-dc537d4a-d7ce-485f-a0fe-b60481f2dcbd admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.462882 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-dc537d4a-d7ce-485f-a0fe-b60481f2dcbd admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 29 15:36:10.463320 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 35/69] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:10.606107 n-d-836830-13 devstack@n-api.service[106771]: DEBUG dbcounter [-] [106771] Writing DB stats nova_api:SELECT=6 {{(pid=106771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:36:10.751213 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:10.754692 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.755196 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.755620 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.756330 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:10.756901 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:10.757868 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:10.799127 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-151db52d-93df-47bf-a265-41f231759f30 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.194487 Aug 29 15:36:10.799694 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 35/70] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 15:36:10 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:11.631667 n-d-836830-13 devstack@n-api.service[106770]: DEBUG nova.api.openstack.wsgi [None req-dc537d4a-d7ce-485f-a0fe-b60481f2dcbd admin admin] Calling method '>' {{(pid=106770) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:11.633372 n-d-836830-13 devstack@n-api.service[106770]: INFO nova.api.openstack.requestlog [None req-dc537d4a-d7ce-485f-a0fe-b60481f2dcbd admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Aug 29 15:36:11.633775 n-d-836830-13 devstack@n-api.service[106770]: [pid: 106770|app: 0|req: 36/71] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 15:36:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:36:11.827507 n-d-836830-13 devstack@n-api.service[106771]: DEBUG nova.api.openstack.wsgi [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] Calling method '>' {{(pid=106771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:36:11.831174 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.831742 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.832231 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.833540 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:36:11.833994 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:36:11.834407 n-d-836830-13 devstack@n-api.service[106771]: DEBUG oslo_concurrency.lockutils [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:36:11.856868 n-d-836830-13 devstack@n-api.service[106771]: INFO nova.api.openstack.requestlog [None req-14a69f5e-02a5-4b93-b8b1-e4dd8e6b367d admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.082753 Aug 29 15:36:11.857343 n-d-836830-13 devstack@n-api.service[106771]: [pid: 106771|app: 0|req: 36/72] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 15:36:11 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:36:58.598056 n-d-836830-13 devstack@n-api.service[106769]: Mon Aug 29 15:36:58 2022 - graceful shutdown triggered... Aug 29 15:36:58.597562 n-d-836830-13 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 15:36:58.599120 n-d-836830-13 devstack@n-api.service[106770]: Gracefully killing worker 1 (pid: 106770)... Aug 29 15:36:58.600284 n-d-836830-13 devstack@n-api.service[106771]: Gracefully killing worker 2 (pid: 106771)... Aug 29 15:36:59.598586 n-d-836830-13 devstack@n-api.service[106769]: worker 1 buried after 1 seconds Aug 29 15:36:59.598586 n-d-836830-13 devstack@n-api.service[106769]: worker 2 buried after 1 seconds Aug 29 15:36:59.598586 n-d-836830-13 devstack@n-api.service[106769]: goodbye to uWSGI. Aug 29 15:36:59.600200 n-d-836830-13 systemd[1]: devstack@n-api.service: Succeeded. Aug 29 15:36:59.600907 n-d-836830-13 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 15:36:59.603701 n-d-836830-13 systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 15:36:59.619439 n-d-836830-13 devstack@n-api.service[129120]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 15:36:59 2022] *** Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: nodename: n-d-836830-13 Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: machine: x86_64 Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: clock source: unix Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: pcre jit disabled Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: detected number of CPU cores: 4 Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: current working directory: / Aug 29 15:36:59.640425 n-d-836830-13 devstack@n-api.service[129120]: detected binary path: /usr/bin/uwsgi-core Aug 29 15:36:59.641096 n-d-836830-13 devstack@n-api.service[129120]: your processes number limit is 47680 Aug 29 15:36:59.641096 n-d-836830-13 devstack@n-api.service[129120]: your memory page size is 4096 bytes Aug 29 15:36:59.641096 n-d-836830-13 devstack@n-api.service[129120]: detected max file descriptor number: 2048 Aug 29 15:36:59.641096 n-d-836830-13 devstack@n-api.service[129120]: lock engine: pthread robust mutexes Aug 29 15:36:59.641096 n-d-836830-13 devstack@n-api.service[129120]: thunder lock: enabled Aug 29 15:36:59.641096 n-d-836830-13 devstack@n-api.service[129120]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 15:36:59.641096 n-d-836830-13 devstack@n-api.service[129120]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 15:36:59.681967 n-d-836830-13 devstack@n-api.service[129120]: Python main interpreter initialized at 0x5588e34c39c0 Aug 29 15:36:59.681967 n-d-836830-13 devstack@n-api.service[129120]: python threads support enabled Aug 29 15:36:59.681967 n-d-836830-13 devstack@n-api.service[129120]: your server socket listen backlog is limited to 100 connections Aug 29 15:36:59.681967 n-d-836830-13 devstack@n-api.service[129120]: your mercy for graceful operations on workers is 90 seconds Aug 29 15:36:59.682475 n-d-836830-13 devstack@n-api.service[129120]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 15:36:59.682475 n-d-836830-13 devstack@n-api.service[129120]: *** Operational MODE: preforking *** Aug 29 15:36:59.682662 n-d-836830-13 devstack@n-api.service[129120]: *** uWSGI is running in multiple interpreter mode *** Aug 29 15:36:59.682662 n-d-836830-13 devstack@n-api.service[129120]: spawned uWSGI master process (pid: 129120) Aug 29 15:36:59.682873 n-d-836830-13 systemd[1]: Started Devstack devstack@n-api.service. Aug 29 15:36:59.683483 n-d-836830-13 devstack@n-api.service[129120]: spawned uWSGI worker 1 (pid: 129132, cores: 1) Aug 29 15:36:59.683983 n-d-836830-13 devstack@n-api.service[129120]: spawned uWSGI worker 2 (pid: 129133, cores: 1) Aug 29 15:36:59.684276 n-d-836830-13 devstack@n-api.service[129120]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 15:37:00.345233 n-d-836830-13 devstack@n-api.service[129133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:37:00.354928 n-d-836830-13 devstack@n-api.service[129132]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 15:37:01.515192 n-d-836830-13 devstack@n-api.service[129133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:37:01.515192 n-d-836830-13 devstack@n-api.service[129133]: from cryptography.utils import int_from_bytes Aug 29 15:37:01.515841 n-d-836830-13 devstack@n-api.service[129133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:37:01.515841 n-d-836830-13 devstack@n-api.service[129133]: from cryptography.utils import int_from_bytes Aug 29 15:37:01.519912 n-d-836830-13 devstack@n-api.service[129132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:37:01.519912 n-d-836830-13 devstack@n-api.service[129132]: from cryptography.utils import int_from_bytes Aug 29 15:37:01.520382 n-d-836830-13 devstack@n-api.service[129132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 15:37:01.520382 n-d-836830-13 devstack@n-api.service[129132]: from cryptography.utils import int_from_bytes Aug 29 15:37:03.957830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:37:03.958391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:37:03.958619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:37:03.958992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:37:03.959271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:37:03.959660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.960739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.961576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.961576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.961763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.962038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.962359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.962680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.963009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.963299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.963620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.963997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-13 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.964268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.964579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.964891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.965211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.965516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.965837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.966153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.966651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.967123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.967440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.967753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.968095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.968821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.968821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.969125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.969436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.969763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.970074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.970476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-13 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.970798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.971160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.971461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.971877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.972192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.972507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.972828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.973250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.973562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.973905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.974215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.974535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.974856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.975195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.975600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.975908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.976233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.976541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.976869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.977122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.977434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.977755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.978077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.978401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.978654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.978912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.979254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.979577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.979887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.980198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.980506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.980818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.981127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.981436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.981745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.982052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.982370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.982687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.983010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.983345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.983665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.984064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.984318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.984624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.984964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.985283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.985591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.985908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.986231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.986538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.986846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.987178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.987501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.987835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.988140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.988391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.988693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.989006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.989324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.989629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.989936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.990245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.990546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.990855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.991053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 15:37:03.991612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.991731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 15:37:03.991807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.992109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.992226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 15:37:03.992430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.992559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 15:37:03.992748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.992871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 15:37:03.993063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.993203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.993358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.993534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.993665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.993862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.993988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.994187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.994313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.994520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.994620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.994837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.994929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.995186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.995302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.995512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.995660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.995843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.995937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.996108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.996208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.996431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.996533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.996758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-836830-13 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.996850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.997064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.997163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.997373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.997466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.997684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.997775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.997991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.998089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.998297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.998396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.998619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.998709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.998930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.999051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.999266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.999468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.999574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.999782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:03.999875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.000091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.000191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.000404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.000504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.000743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.000836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.001059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.001151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.001367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.001462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.001674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.001768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.001982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.002083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.002283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.002386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.002602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.002703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.002926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.003044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-836830-13 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.003263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.003371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.003576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.003677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.003885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.003976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.004207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.004355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.004547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.004640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.004879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.004979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.005225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.005316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.005543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.005643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.005853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.005946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.006185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.006286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.006506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.006605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.007363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.007693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.007839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.008132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.008273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.008469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.008628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.008780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.009046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.009161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.009393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.009499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.009723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.009823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.010037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.010138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.010295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.010389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.010608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.010708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.010935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.011057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.011315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.011417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.011629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.011725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.011902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.012006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.012157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.012272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.012480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.012590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.012803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.012904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.013371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.013477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.013683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.013815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.013994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.014130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.014306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.014456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.014617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.014779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.014927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.015114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.015265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.015428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.015576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.015739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.015899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.016061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.016216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.016395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.016541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.016708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.016853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.017028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.017176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.017341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.017567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.017710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.017843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.017973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.018102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.018258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.018442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.018569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.018765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.018865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.019099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.019207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.019423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.019523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.019747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.019846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.020060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.020165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.020367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.020466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.020677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.020778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.020999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.021105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.021335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.021437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.021648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.021749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.021908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.022009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.022192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.022288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.023191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.023341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.023499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.023602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.023863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.024002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.024167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.024267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.024481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.024632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.024789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.024882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.025100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.025199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.025417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.025538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.025727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.025833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.026037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.026170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.026347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.026481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.026652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.026744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.027389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.027523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.027523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.027708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.027803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.027905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.027905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.028067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.028200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.028308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.028508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.028600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.028816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.028914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.029124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.029229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.029435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.029536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.029744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.029836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.030055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.030154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.030370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.030535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.030690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.030845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.030999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.031143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.031331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.031444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.031660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.031806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.032038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.032151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.032295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.032395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.032586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.032681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.032892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.032985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.033203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.033374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.033525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.033672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.033853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.033946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.034163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.034269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.034469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.034575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.034775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.034867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.035103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.035210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.035412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.035511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.035717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.035811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.036022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.036125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.036326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.036426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.036630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.036729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.036934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.037027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.037239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.037331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.037545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.037637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.037853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.037959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.038222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.038375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 15:37:04.038522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.038625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.038827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.038927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.039157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.039263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.039503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.039606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.039812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.039912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.040155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.040300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.040491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.040599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.040811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.040903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.041135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.041226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.041452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.041559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.041769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.041914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.042093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.042232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.042396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.042499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.042707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.042809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.043040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.043150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.043364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.043464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.043679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.043779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.043996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.044098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.044305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.044398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.044621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.044722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.044930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.045028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.045253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.045351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.045561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.045661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.045877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.045977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.046214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.046306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.046549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.046649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.046867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.046975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.047213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.047307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.047528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.047629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.047841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.047943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.048153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.048252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.048465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.048567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.048776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.048882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.049090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.049190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.049412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.049504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.049724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.049817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.050036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.050127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.050348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.050440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.050663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.050763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.050972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.051112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.051314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.051406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.051619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.051712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.051934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.052034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.052270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.052413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.052589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.052690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.052907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.053010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.053222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.053331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.053539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.054178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.054368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.054483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.054687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.054856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.055004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.055165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.055349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.055478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.055654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.055759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.055962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.056055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.056270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.056362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.056582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.056682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.056890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.056982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.057216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.057318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.057530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.057642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.057841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.057941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.058145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.058238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.058450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.058550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.058766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.058882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.059102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.059220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.059416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.059508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.059725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.059823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.060042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.060145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.060353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.060452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.060659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.060749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.060978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.061068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.061288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.061389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.061596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.061687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.061901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.062058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.062208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.062315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.062525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.062637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.062844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.062946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.063169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.063276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.063490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.063595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.063808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.063908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.064116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.064208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.064433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.064533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.064744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.064907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.065063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.065185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.065365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.065486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.065680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.065800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.065989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.066110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.066302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.066430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.066611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.066733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.066962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.067125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.067254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.067377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.067565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.067694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.067874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.067977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.068185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.068290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.068492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.068584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.068794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.068885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.069099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.069211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.069538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.069640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.069861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.070173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.070271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.070483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.070591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.070811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.070903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.071152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.071249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.071470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.071563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.071779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.071873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.072089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.072239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.072440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.072549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.072752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.072996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.073171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.073287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.073399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.073520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.073644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.073784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.073950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.074051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.074260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.074352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.075465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.075627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.075744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.075863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.075977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.076963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.077177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.077304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.077436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.077557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.077671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.077792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.077905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.078976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.079119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.079209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.079323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.079417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.079646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.079739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.079966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.080058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.080280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.080371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.080598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.080699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.080912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.081014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.081229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.081330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.081542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.081634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.081855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.081955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.082159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.082290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.082463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.082607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.082774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.082914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.083120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.083316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.083470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.083644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.083778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.083956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.084122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.084479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.084595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.084694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.085300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.085513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.085778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.085963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.086169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.086373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.086727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.086837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.086992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.087110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.087278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.087519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.087650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.087759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.087996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.088096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.088315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.088423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.088620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.088896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.089059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.089231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.089381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.089554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.089661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.089848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.090000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.090167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.090321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.090476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.090638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.090781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.090937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.091102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.091287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.091415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.091603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.091726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.091911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.092015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.092220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.092342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.092535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.092655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.092861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.093003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.093181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.093282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.093508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.093601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.093835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.093937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.094139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.094242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.094447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.094546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.094766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.094859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.095100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.095209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.095409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.095508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.095716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.095808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.096019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.096162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.096325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.096427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.096629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.096730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.096938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.097043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.097244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.097336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.097548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.097651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.097853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.097954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.098158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.098333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.098462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.098555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.098780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.098879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.099107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.099216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.099417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.099517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.099723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.099817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.100026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.100132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.100339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.100456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.100703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.100845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.101019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.101214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.101347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.101523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.101658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.101842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.101974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.102162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.102289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.102477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.102597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.102789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.102895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.103144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.103253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.103453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.103769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.103873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.104082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.104201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.104401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.104517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.104706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.104838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.105070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.105301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.105416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.105632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.105735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.105950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.106047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.106267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.106361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.106594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.106688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.106919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.107012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.107278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.107371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.107590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.107684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.107903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.108005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.108214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.108307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.108523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.108616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.108830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.108930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.109139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.109285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.109445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.109545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.109752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.109859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.110059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.110162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.110367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.110506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.110685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.110814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.110995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.111175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.111380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.111651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.111756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.111966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.112067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.112297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.112389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.112634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.112738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.112915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.113022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.113225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.113317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.113532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.113632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.113847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.113949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.114153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.114302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.114505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.114597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.114841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.114945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.115212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.115306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.115520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.115612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.115829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.115923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.116690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.116793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.117056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.117251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.117391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.117550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.117711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.117879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.118096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.118192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.118411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.118504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.118725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.118825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.119079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.119178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.119367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.119461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.119674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.119775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.119989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.120164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.120300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.120394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.120608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.120701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.120915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.121019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.121235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.121336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.121549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.121641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.121856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.121967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.122163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.122257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.122477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.122661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.122788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.122980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.123131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.123339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.123430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.123742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.123850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.124057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.124150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.124366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.124470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.124673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.124828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.124981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.125083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.125294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.125396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.125598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.125703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.125905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.126025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.126211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.126356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.126532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.126639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.126842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.126953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.127177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.127325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.127495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.127583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.127784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.127922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.128090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.128182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.128402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.128497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.128718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.128808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.129036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.129135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.129345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.129475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.129657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.129750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.129964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.130057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.130271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.130364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.130579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.130673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.130890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.130992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.131228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.131332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.131538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.131633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.131907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.132056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.132345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.132512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.132638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.132735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.132879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.132985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.133181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.133279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.133488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.133572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.133798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.133896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.134104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.134187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.134452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.134565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.134730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.134832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.135056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.135153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.135379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.135474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.135698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.135801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.136024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.136116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.136338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.136430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.136643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.136735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.136957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.137049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.137264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.137358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.137571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.137675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.137879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.138025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.138438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.138540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.138745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.138838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.139073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.139172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.139402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.139548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.139719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.139820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.140033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.140134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.140348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.140453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.140671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.140763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.140998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.141099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.141305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.141407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.141617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.141710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.141931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.142213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.142307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.142531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.142632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.142843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.142989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.143183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.143277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.143496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.143590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.143806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.143898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.144118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.144218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.144430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.144545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.144740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.144861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.145045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.145144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.145351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.145445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.145659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.145765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.145971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.146063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.146284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.146384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.146592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.146728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.146902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.147081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.147217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.147855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.148102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.148234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.148457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.148635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.148781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.148926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.149099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.149204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.149412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.149514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.149737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.149841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.150057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.150152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.150374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.150466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.150694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.150795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.151009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.151135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.151341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.151443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.151727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.151820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.152058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.152159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.152371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.152464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.152685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.152791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.152997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.153098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.153307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.153399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.153629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.153860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.153962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.154197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.154299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.154518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.154612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.154837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.154943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.155178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.155323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.155500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.155650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.155819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.155941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.156135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.156368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.156469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.156692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.156795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.157007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.157109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.157372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.157473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.157698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.157793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.158028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.158121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.158365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.158492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.158686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.158833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.159010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.159192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.159342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.159506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.159658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.159830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.160020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.160146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.160338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.160476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.160646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.160805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.160961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.161124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.161306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.161444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.161623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.161754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.161938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.162083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.162257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.162411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.162572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.162729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.162887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.164724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.164915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.164915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.165916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.166916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.167039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.167273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.167367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.167592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.167686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.167910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.168010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.168226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.168375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.168587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.168690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.168917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.169019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.169230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.169323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.169539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.169633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.169855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.169956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.170169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.170269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.170476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.170568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.170801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.170906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.171138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.171236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.171452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.171545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.171779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.171885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.172092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.172186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.172403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.172626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.172733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.173054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.173212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.173337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.173430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.173611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.173719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.173938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.174038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.174258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.174351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.174569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.174672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.174895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.174995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.175229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.175326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.175538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.175642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.175859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.175953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.176173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.176480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.176586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.176788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.176882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.177101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.177207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.177408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.177511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.177714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.177816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.178025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.178118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.178330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.178473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.179276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.179386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.179609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.179705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.179919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.180122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.199906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.200226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.200366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.200488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.200488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.201315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.201315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.201634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.201729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.201822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.201822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.202004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.202095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.202095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.202330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.203482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.203624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.203743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.203851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.203966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.203966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.204970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.206028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.206028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.207770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.207919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.208977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.209156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.209341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.209501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.209501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.210702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.210702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.211174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.211327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.211327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.211741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.211741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.212051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.212203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.212203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.212487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.212487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.212804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.212804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.214561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.214823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.214823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.215014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.215137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.215263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.215477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.215477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.215743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.216144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.216296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.216473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.216473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.216825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.216987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.217115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.217287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.217287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.217586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.217829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.218964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.219247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.219386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.219523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.219663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.219821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.219974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.220124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.220274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.220433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.220581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.220731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.220886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.221036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.221196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.221359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.221510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.221654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.221794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.221932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.222125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.222286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.222730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.222730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.223045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.223045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.223348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.223505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.223657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.223810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.224973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.225094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.225208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.225321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.225457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.225604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.225829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.225992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.226951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.227770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.228959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.229945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.230971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.231123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.231238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.231363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.231478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.231631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.231773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.231914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.232054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.232246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.232392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.232834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.232997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.233154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.233414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.233574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.233730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.233885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.234062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.234207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.234362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.234506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.234665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.234891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.235074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.235219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.235379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.235541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.235695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.235852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.236007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.236183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.236183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.236578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.236759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.236877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.236991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.237782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.238968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.239096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.239222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.239352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.239352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.240958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.241597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.241718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.241830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.241942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.242054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.242165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.242316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.242433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.242545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.242757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.243912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.244892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.245114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.245261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.245412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.245555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.245696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.245836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.245985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.246140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.246140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.246459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.246698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.246698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.246993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.247173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.247355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.247505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.247505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.247771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.247911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.248063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.248222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.248222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.248577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.248734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.248888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.249056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.249056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.249348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.249503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.249657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.249825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.249825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.250982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.251230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.251345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.251456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.251568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.251679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.251790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.251790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.252921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.253429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.254234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.255942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.256630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.256630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.257570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.257710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.257960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.258274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.258610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.258937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.259286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.259604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.259944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.260260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.260578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.260895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.261212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.261527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.261841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.262177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.262501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.262812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.263427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.263752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.264076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.264394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.264710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.265042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.265358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.265671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.265983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.266297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.266613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.266936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.267273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.267588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.267909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.268234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.268619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.268896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.269211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.269541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.269873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.270225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.270544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.270893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.271250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.271572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.271892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.272201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 15:37:04.272580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 15:37:04.318680 n-d-836830-13 devstack@n-api.service[129133]: INFO dbcounter [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Registered counter for database nova_api Aug 29 15:37:04.337305 n-d-836830-13 devstack@n-api.service[129132]: INFO dbcounter [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Registered counter for database nova_api Aug 29 15:37:04.340152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_db.sqlalchemy.engines [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.346754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writer thread running {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.357009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_db.sqlalchemy.engines [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.363721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writer thread running {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.405726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.context [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=129133) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:37:04.409798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.410278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.411911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.412639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.413650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.415960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.417971 n-d-836830-13 devstack@n-api.service[129133]: INFO dbcounter [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Registered counter for database nova_cell0 Aug 29 15:37:04.421949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.context [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=129132) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 15:37:04.423727 n-d-836830-13 devstack@n-api.service[129133]: INFO dbcounter [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Registered counter for database nova_cell1 Aug 29 15:37:04.426248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.426875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.429329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.430567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:04.431205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:04.432762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_db.sqlalchemy.engines [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.433706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:04.436026 n-d-836830-13 devstack@n-api.service[129132]: INFO dbcounter [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Registered counter for database nova_cell0 Aug 29 15:37:04.437576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writer thread running {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.438661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_db.sqlalchemy.engines [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.441634 n-d-836830-13 devstack@n-api.service[129132]: INFO dbcounter [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Registered counter for database nova_cell1 Aug 29 15:37:04.449252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_db.sqlalchemy.engines [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.453240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_db.sqlalchemy.engines [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.460111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writer thread running {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.462962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writer thread running {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.605200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writer thread running {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.616847 n-d-836830-13 devstack@n-api.service[129133]: INFO dbcounter [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Registered counter for database nova_cell0 Aug 29 15:37:04.623429 n-d-836830-13 devstack@n-api.service[129132]: INFO dbcounter [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Registered counter for database nova_cell0 Aug 29 15:37:04.625207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_db.sqlalchemy.engines [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.630102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writer thread running {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.634550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_db.sqlalchemy.engines [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 15:37:04.639505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writer thread running {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 15:37:04.963148 n-d-836830-13 devstack@n-api.service[129132]: WARNING keystonemiddleware.auth_token [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:37:04.968780 n-d-836830-13 devstack@n-api.service[129132]: WARNING keystonemiddleware.auth_token [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:37:04.983623 n-d-836830-13 devstack@n-api.service[129133]: WARNING keystonemiddleware.auth_token [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:37:04.993985 n-d-836830-13 devstack@n-api.service[129133]: WARNING keystonemiddleware.auth_token [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:37:05.315003 n-d-836830-13 devstack@n-api.service[129132]: WARNING keystonemiddleware.auth_token [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:37:05.321621 n-d-836830-13 devstack@n-api.service[129132]: WARNING keystonemiddleware.auth_token [None req-af19e93a-9e03-43bc-87ce-63073724cfb5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:37:05.326924 n-d-836830-13 devstack@n-api.service[129132]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588e34c39c0 pid: 129132 (default app) Aug 29 15:37:05.372249 n-d-836830-13 devstack@n-api.service[129133]: WARNING keystonemiddleware.auth_token [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 15:37:05.380224 n-d-836830-13 devstack@n-api.service[129133]: WARNING keystonemiddleware.auth_token [None req-7f5c1a5d-e249-48aa-ad83-257a8b30ca88 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 15:37:05.386468 n-d-836830-13 devstack@n-api.service[129133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588e34c39c0 pid: 129133 (default app) Aug 29 15:37:45.512078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.513385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.514696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:45.515564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.373037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.374757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.375634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.376583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:46.778912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '.version_select at 0x7f32f01a1310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:46.786253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=129132) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 15:37:46.786976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.788038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.788721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.819325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.819814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.820245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.837796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:46.838579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:46.839182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:46.848007 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc21c93f-f9d9-4bda-ad65-a217ca1346ed tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.346110 Aug 29 15:37:46.862236 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1/1] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 15:37:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:46.868459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d1ff208-ae2f-473e-b0da-486227afc760 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1617129332", "name": "tempest-test_aggregate-424778048"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:46.906967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-0d1ff208-ae2f-473e-b0da-486227afc760 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid 852d670c-49e7-43a9-9a9e-8348c85cc0c6 for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:37:46.993084 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d1ff208-ae2f-473e-b0da-486227afc760 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.128055 Aug 29 15:37:46.993693 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2/2] 10.222.0.83 () {60 vars in 1165 bytes} [Mon Aug 29 15:37:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:47.005312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dccd9509-1dbd-481e-9490-dac3664f52ff tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:47.021440 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dccd9509-1dbd-481e-9490-dac3664f52ff tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.020452 Aug 29 15:37:47.027088 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3/3] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:37:46 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:47.036090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-560a1102-af80-4002-8fc6-697ad4febb99 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:47.047908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560a1102-af80-4002-8fc6-697ad4febb99 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:47.048602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560a1102-af80-4002-8fc6-697ad4febb99 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:47.049123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560a1102-af80-4002-8fc6-697ad4febb99 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:47.827194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89f84f2d-d366-4b7e-9063-401c7bb76b24 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2019686604", "ram": 512, "vcpus": 1, "disk": 10, "id": 474136195, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:47.884168 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89f84f2d-d366-4b7e-9063-401c7bb76b24 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.522564 Aug 29 15:37:47.884883 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1/4] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:46 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:48.224986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0984c9ef-d227-42f4-bcde-63135892b23f tempest-AZAdminNegativeTestJSON-1128514254 tempest-AZAdminNegativeTestJSON-1128514254-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:48.226491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0984c9ef-d227-42f4-bcde-63135892b23f tempest-AZAdminNegativeTestJSON-1128514254 tempest-AZAdminNegativeTestJSON-1128514254-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e233d95040244c80a83d0383408c1209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6c0505f505498f94765986baa1aa1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0984c9ef-d227-42f4-bcde-63135892b23f tempest-AZAdminNegativeTestJSON-1128514254 tempest-AZAdminNegativeTestJSON-1128514254-project] Request method failure captured: Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1I03Cwn3_YMOc-lGgW2kRt0yh7KFeVfG0m3fIZZxzOmnJ9XABrQkcDDxgaz36zZane__a2sZdEX0v9YY0poFFolTMZhvxbwm9VaL7rmJZvXKPNmvazzQpk9bL57aOxMzDOYi2p0OF7CTW9oFm8u7DwJapwT6Hz0ikzS5ofUysblXY Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bb6c0505f505498f94765986baa1aa1c Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1128514254 Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:37:48.229961 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb6c0505f505498f94765986baa1aa1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bb6c0505f505498f94765986baa1aa1c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb6c0505f505498f94765986baa1aa1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bb6c0505f505498f94765986baa1aa1c"}]}] Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AZAdminNegativeTestJSON-1128514254 Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bb6c0505f505498f94765986baa1aa1c Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1128514254 Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AZAdminNegativeTestJSON-1128514254-project Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e233d95040244c80a83d0383408c1209 Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AZAdminNegativeTestJSON-1128514254-project Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:37:48.231233 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:37:48.232024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.233086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0984c9ef-d227-42f4-bcde-63135892b23f tempest-AZAdminNegativeTestJSON-1128514254 tempest-AZAdminNegativeTestJSON-1128514254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:48.234111 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0984c9ef-d227-42f4-bcde-63135892b23f tempest-AZAdminNegativeTestJSON-1128514254 tempest-AZAdminNegativeTestJSON-1128514254-project] 10.222.0.83 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.343303 Aug 29 15:37:48.236735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2/5] 10.222.0.83 () {58 vars in 1185 bytes} [Mon Aug 29 15:37:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 351 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:48.380407 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-560a1102-af80-4002-8fc6-697ad4febb99 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 1.348065 Aug 29 15:37:48.382146 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4/6] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:37:47 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:48.484239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Calling method '.version_select at 0x7f32effaeca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:48.496699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=129133) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 15:37:48.497430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.497909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.498332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.524602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.525314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.525736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.539460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.540117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.540544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.547085 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7bff453-2036-420b-9a5d-0fdc509facac tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.309745 Aug 29 15:37:48.559859 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3/7] 10.222.0.83 () {60 vars in 1208 bytes} [Mon Aug 29 15:37:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:48.658210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:48.660288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.660968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.661401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.662122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.663332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.663761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.701779 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-24a15a34-1dbc-4b9c-bab9-1fee314ce412 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] 10.222.0.83 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.317750 Aug 29 15:37:48.703096 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 5/8] 10.222.0.83 () {58 vars in 1164 bytes} [Mon Aug 29 15:37:48 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:48.775298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59ae1ae8-4382-4f3b-b1ec-75a9118f8957 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:48.797778 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-59ae1ae8-4382-4f3b-b1ec-75a9118f8957 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] HTTP exception thrown: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59ae1ae8-4382-4f3b-b1ec-75a9118f8957 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Request method failure captured: Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/flavors/474136195/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1I3x24jugbROaadwLKmGFt8W32aN9zoKhCFYzKJLwX1-3OGA9cSnqvovT48QM6xhJ3ZNtvyDl8rI7VYcebW4ewhIZRrnFYpQ-pFFpufSBuNh-TxISYTkHhWv-3CeT98aBxNM4bDpkz2IlPEiHAujB71KLlNV3e2KWcZ_z5-cCV_aM Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:37:48.799632 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_40b8719c00e54dca87df81ed4a755e8d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/40b8719c00e54dca87df81ed4a755e8d"}]}] Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ac7202dcf050479d98b4ed87575249a7 Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:48.800974 n-d-836830-13 devstack@n-api.service[129133]: exception: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'flavor_id': '474136195', 'id': 'hw:cpu_thread_policy'} Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:48.801553 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.802753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:48.802753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:48.802753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:48.802753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:48.802753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:48.802753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:48.802753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:48.805487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59ae1ae8-4382-4f3b-b1ec-75a9118f8957 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Returning 404 to user: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:48.806536 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59ae1ae8-4382-4f3b-b1ec-75a9118f8957 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] 10.222.0.83 "GET /compute/v2.1/flavors/474136195/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.254402 Aug 29 15:37:48.807581 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4/9] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:37:48 2022] GET /compute/v2.1/flavors/474136195/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:48.927510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:48.932070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.932885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.933461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.934997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:48.935684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:48.936114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:48.968910 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b33d5515-4d2e-424e-a109-8a99f5048f1a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 404 microversion: 2.1 time: 0.263906 Aug 29 15:37:48.970108 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 6/10] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:37:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 404 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:49.046168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-55ac9af0-b5e4-400b-93e6-bea812768d41 tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1773582364", "id": 503813575, "os-flavor-access:is_public": "True"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.069191 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-55ac9af0-b5e4-400b-93e6-bea812768d41 tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.260147 Aug 29 15:37:49.069846 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 5/11] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:37:48 2022] POST /compute/v2.1/flavors => generated 446 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:37:49.083406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.085712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.086191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.086647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.087600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.088105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.088748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.137293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01dff37a-9a96-47a0-a957-d92df37d2a85 tempest-AZAdminV2TestJSON-654883456 tempest-AZAdminV2TestJSON-654883456-project-admin] 10.222.0.83 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 704 microversion: 2.1 time: 0.057210 Aug 29 15:37:49.146130 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1185 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 704 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:49.146130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a6797fa7-595f-484b-b686-9265e891b41c tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.148258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a6797fa7-595f-484b-b686-9265e891b41c tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'ac7202dcf050479d98b4ed87575249a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b8719c00e54dca87df81ed4a755e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a6797fa7-595f-484b-b686-9265e891b41c tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Request method failure captured: Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/flavors/474136195/os-extra_specs HTTP/1.1 Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 66 Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1I3x24jugbROaadwLKmGFt8W32aN9zoKhCFYzKJLwX1-3OGA9cSnqvovT48QM6xhJ3ZNtvyDl8rI7VYcebW4ewhIZRrnFYpQ-pFFpufSBuNh-TxISYTkHhWv-3CeT98aBxNM4bDpkz2IlPEiHAujB71KLlNV3e2KWcZ_z5-cCV_aM Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:37:49.150974 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_40b8719c00e54dca87df81ed4a755e8d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/40b8719c00e54dca87df81ed4a755e8d"}]}] Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ac7202dcf050479d98b4ed87575249a7 Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 29 15:37:49.152113 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'flavor_id': '474136195', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:37:49.152697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 29 15:37:49.153622 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.154581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a6797fa7-595f-484b-b686-9265e891b41c tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:49.154581 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a6797fa7-595f-484b-b686-9265e891b41c tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] 10.222.0.83 "POST /compute/v2.1/flavors/474136195/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.013396 Aug 29 15:37:49.154581 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 7/13] 10.222.0.83 () {60 vars in 1221 bytes} [Mon Aug 29 15:37:49 2022] POST /compute/v2.1/flavors/474136195/os-extra_specs => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:49.181879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1090590890", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "availability_zone": "tempest-test_az-1617129332"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.232627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.233526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.234212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.235273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:49.235907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:49.236573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:49.536332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5417276-e51c-40f7-83dc-90565ddd373b tempest-FlavorsV255TestJSON-275662974 tempest-FlavorsV255TestJSON-275662974-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.549255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5417276-e51c-40f7-83dc-90565ddd373b tempest-FlavorsV255TestJSON-275662974 tempest-FlavorsV255TestJSON-275662974-project] 10.222.0.83 "GET /compute/v2.1/flavors/503813575" status: 200 len: 446 microversion: 2.55 time: 0.394980 Aug 29 15:37:49.549255 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 8/14] 10.222.0.83 () {60 vars in 1196 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/flavors/503813575 => generated 446 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:37:49.555809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-06f68b06-9db7-48e2-a005-0f42e2661d5c tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.598407 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-06f68b06-9db7-48e2-a005-0f42e2661d5c tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/474136195/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047452 Aug 29 15:37:49.599621 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 9/15] 10.222.0.83 () {60 vars in 1221 bytes} [Mon Aug 29 15:37:49 2022] POST /compute/v2.1/flavors/474136195/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:37:49.608760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f664ee2-2bed-40d2-9979-3ccdb6c4639a tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] Action: 'update', calling method: .version_select at 0x7f32f055adc0>, body: {"flavor": {"description": "new"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.648649 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f664ee2-2bed-40d2-9979-3ccdb6c4639a tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] 10.222.0.83 "PUT /compute/v2.1/flavors/503813575" status: 200 len: 447 microversion: 2.55 time: 0.047123 Aug 29 15:37:49.657112 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 10/16] 10.222.0.83 () {62 vars in 1216 bytes} [Mon Aug 29 15:37:49 2022] PUT /compute/v2.1/flavors/503813575 => generated 447 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:37:49.661376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eff38bb5-279b-45a1-a1f1-5091464a7241 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.664052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eff38bb5-279b-45a1-a1f1-5091464a7241 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'ac7202dcf050479d98b4ed87575249a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b8719c00e54dca87df81ed4a755e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eff38bb5-279b-45a1-a1f1-5091464a7241 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Request method failure captured: Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1I3x24jugbROaadwLKmGFt8W32aN9zoKhCFYzKJLwX1-3OGA9cSnqvovT48QM6xhJ3ZNtvyDl8rI7VYcebW4ewhIZRrnFYpQ-pFFpufSBuNh-TxISYTkHhWv-3CeT98aBxNM4bDpkz2IlPEiHAujB71KLlNV3e2KWcZ_z5-cCV_aM Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:37:49.665993 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_40b8719c00e54dca87df81ed4a755e8d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/40b8719c00e54dca87df81ed4a755e8d"}]}] Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ac7202dcf050479d98b4ed87575249a7 Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:49.667153 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'flavor_id': '474136195', 'id': 'hw:numa_nodes'} Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:37:49.667840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.673279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eff38bb5-279b-45a1-a1f1-5091464a7241 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:49.674129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eff38bb5-279b-45a1-a1f1-5091464a7241 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] 10.222.0.83 "DELETE /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016641 Aug 29 15:37:49.674129 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 11/17] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:37:49 2022] DELETE /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:49.674718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b9fa653-0ae7-4d7a-b010-52ff4307acb8 tempest-FlavorsV255TestJSON-275662974 tempest-FlavorsV255TestJSON-275662974-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.717884 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b9fa653-0ae7-4d7a-b010-52ff4307acb8 tempest-FlavorsV255TestJSON-275662974 tempest-FlavorsV255TestJSON-275662974-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 6146 microversion: 2.55 time: 0.048136 Aug 29 15:37:49.719017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 12/18] 10.222.0.83 () {60 vars in 1187 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/flavors/detail => generated 6146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:49.723866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f86eda8f-8283-4bbb-af2c-4958a1f001bc tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.754783 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f86eda8f-8283-4bbb-af2c-4958a1f001bc tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/474136195/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034493 Aug 29 15:37:49.755751 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 13/19] 10.222.0.83 () {60 vars in 1221 bytes} [Mon Aug 29 15:37:49 2022] POST /compute/v2.1/flavors/474136195/os-extra_specs => generated 66 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:37:49.762466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-400d7894-47ac-4f40-93ae-55c62abc5cb7 tempest-FlavorsV255TestJSON-275662974 tempest-FlavorsV255TestJSON-275662974-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.789622 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-400d7894-47ac-4f40-93ae-55c62abc5cb7 tempest-FlavorsV255TestJSON-275662974 tempest-FlavorsV255TestJSON-275662974-project] 10.222.0.83 "GET /compute/v2.1/flavors" status: 200 len: 3404 microversion: 2.55 time: 0.031987 Aug 29 15:37:49.790924 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 14/20] 10.222.0.83 () {60 vars in 1166 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/flavors => generated 3404 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:49.795952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2df5384f-cfc6-4a00-b90c-b64f0cd0631b tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.800176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2df5384f-cfc6-4a00-b90c-b64f0cd0631b tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'ac7202dcf050479d98b4ed87575249a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b8719c00e54dca87df81ed4a755e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2df5384f-cfc6-4a00-b90c-b64f0cd0631b tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Request method failure captured: Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 22 Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1I3x24jugbROaadwLKmGFt8W32aN9zoKhCFYzKJLwX1-3OGA9cSnqvovT48QM6xhJ3ZNtvyDl8rI7VYcebW4ewhIZRrnFYpQ-pFFpufSBuNh-TxISYTkHhWv-3CeT98aBxNM4bDpkz2IlPEiHAujB71KLlNV3e2KWcZ_z5-cCV_aM Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:37:49.802077 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_40b8719c00e54dca87df81ed4a755e8d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40b8719c00e54dca87df81ed4a755e8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/40b8719c00e54dca87df81ed4a755e8d"}]}] Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 40b8719c00e54dca87df81ed4a755e8d Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ac7202dcf050479d98b4ed87575249a7 Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: {"hw:numa_nodes": "1"} Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:49.804222 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'flavor_id': '474136195', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:37:49.804960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 29 15:37:49.805839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.808517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2df5384f-cfc6-4a00-b90c-b64f0cd0631b tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:49.809653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2df5384f-cfc6-4a00-b90c-b64f0cd0631b tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659 tempest-FlavorsExtraSpecsNegativeTestJSON-1673885659-project] 10.222.0.83 "PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017765 Aug 29 15:37:49.810835 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 15/21] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:37:49 2022] PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:49.815417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8caf6a1-f6ba-4392-8f8a-3a15fc41be36 tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.862094 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8caf6a1-f6ba-4392-8f8a-3a15fc41be36 tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/503813575" status: 202 len: 0 microversion: 2.55 time: 0.049944 Aug 29 15:37:49.862663 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 16/22] 10.222.0.83 () {60 vars in 1199 bytes} [Mon Aug 29 15:37:49 2022] DELETE /compute/v2.1/flavors/503813575 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:37:49.871238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed678518-7f7e-4d89-960c-5840d3428be2 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.880891 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ed678518-7f7e-4d89-960c-5840d3428be2 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] HTTP exception thrown: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed678518-7f7e-4d89-960c-5840d3428be2 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Request method failure captured: Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/flavors/474136195/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1KlXCpaYre010DAtxa9AVA3Pw5F1m2REWRndCixdWDqmsXVwJk6hcN_SFPBvjhSR3okguFTVhTnh1kAii2pTnytk0X25pmiRMx7sHPtInMKtIXKh36ACqI6fbhSvo-KT6BVUvbEu0PvePp6AfaHkH22UzZpb_fZQI1FXZRgPNFSnU Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 1eb9328a4bc849eaaad28b96916a7c67 Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:37:49.885049 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1eb9328a4bc849eaaad28b96916a7c67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1eb9328a4bc849eaaad28b96916a7c67", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1eb9328a4bc849eaaad28b96916a7c67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1eb9328a4bc849eaaad28b96916a7c67"}]}] Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 1eb9328a4bc849eaaad28b96916a7c67 Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3715bc7f981c43fc9fa89ae3784d8767 Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:49.886149 n-d-836830-13 devstack@n-api.service[129133]: exception: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'flavor_id': '474136195', 'id': 'hw:cpu_thread_policy'} Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.886739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.887937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.887937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.887937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.887937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:49.887937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:49.887937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. Aug 29 15:37:49.887937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.889086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed678518-7f7e-4d89-960c-5840d3428be2 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Returning 404 to user: Flavor 474136195 has no extra specs with key hw:cpu_thread_policy. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:49.891183 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed678518-7f7e-4d89-960c-5840d3428be2 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/474136195/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.024211 Aug 29 15:37:49.892475 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 17/23] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:37:49 2022] DELETE /compute/v2.1/flavors/474136195/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:37:49.900528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d805f4e2-333a-4cd2-83e0-277e4985c889 tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:49.940598 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d805f4e2-333a-4cd2-83e0-277e4985c889 tempest-FlavorsV255TestJSON-822108132 tempest-FlavorsV255TestJSON-822108132-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5709 microversion: 2.55 time: 0.046603 Aug 29 15:37:49.941882 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 18/24] 10.222.0.83 () {60 vars in 1187 bytes} [Mon Aug 29 15:37:49 2022] GET /compute/v2.1/flavors/detail => generated 5709 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:37:49.947154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a77f6f2b-2457-4ddf-b455-5abcc88887f6 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:49.951127 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a77f6f2b-2457-4ddf-b455-5abcc88887f6 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a77f6f2b-2457-4ddf-b455-5abcc88887f6 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Request method failure captured: Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 27 Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1KlXCpaYre010DAtxa9AVA3Pw5F1m2REWRndCixdWDqmsXVwJk6hcN_SFPBvjhSR3okguFTVhTnh1kAii2pTnytk0X25pmiRMx7sHPtInMKtIXKh36ACqI6fbhSvo-KT6BVUvbEu0PvePp6AfaHkH22UzZpb_fZQI1FXZRgPNFSnU Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 1eb9328a4bc849eaaad28b96916a7c67 Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:37:49.952573 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1eb9328a4bc849eaaad28b96916a7c67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1eb9328a4bc849eaaad28b96916a7c67", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1eb9328a4bc849eaaad28b96916a7c67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1eb9328a4bc849eaaad28b96916a7c67"}]}] Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 1eb9328a4bc849eaaad28b96916a7c67 Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3715bc7f981c43fc9fa89ae3784d8767 Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: {"hw:cpu_policy": "shared"} Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:49.953639 n-d-836830-13 devstack@n-api.service[129133]: exception: Request body and URI mismatch Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'flavor_id': '474136195', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:49.954257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:49.955205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:49.955205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:49.955205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 29 15:37:49.955205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:49.956094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a77f6f2b-2457-4ddf-b455-5abcc88887f6 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:49.957121 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a77f6f2b-2457-4ddf-b455-5abcc88887f6 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013995 Aug 29 15:37:49.958223 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 19/25] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:37:49 2022] PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:49.985290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a2ac2bf-7597-4367-a72b-0679a2313e2c tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a2ac2bf-7597-4367-a72b-0679a2313e2c tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Request method failure captured: Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 49 Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1KlXCpaYre010DAtxa9AVA3Pw5F1m2REWRndCixdWDqmsXVwJk6hcN_SFPBvjhSR3okguFTVhTnh1kAii2pTnytk0X25pmiRMx7sHPtInMKtIXKh36ACqI6fbhSvo-KT6BVUvbEu0PvePp6AfaHkH22UzZpb_fZQI1FXZRgPNFSnU Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 1eb9328a4bc849eaaad28b96916a7c67 Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:37:50.001246 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1eb9328a4bc849eaaad28b96916a7c67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1eb9328a4bc849eaaad28b96916a7c67", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1eb9328a4bc849eaaad28b96916a7c67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1eb9328a4bc849eaaad28b96916a7c67"}]}] Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 1eb9328a4bc849eaaad28b96916a7c67 Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3715bc7f981c43fc9fa89ae3784d8767 Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 29 15:37:50.002538 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'flavor_id': '474136195', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 29 15:37:50.003244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:50.004450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:50.005616 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:50.005616 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:50.005616 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:37:50.005616 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:37:50.005616 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 29 15:37:50.005616 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:37:50.009353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a2ac2bf-7597-4367-a72b-0679a2313e2c tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:50.010596 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a2ac2bf-7597-4367-a72b-0679a2313e2c tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.036223 Aug 29 15:37:50.014183 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 20/26] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:37:49 2022] PUT /compute/v2.1/flavors/474136195/os-extra_specs/hw:numa_nodes => generated 117 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:37:50.026583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-581e617b-b599-41bd-add8-8242b02ae378 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:50.077062 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-581e617b-b599-41bd-add8-8242b02ae378 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/474136195" status: 202 len: 0 microversion: 2.1 time: 0.057796 Aug 29 15:37:50.078007 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 21/27] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:37:50 2022] DELETE /compute/v2.1/flavors/474136195 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:50.087831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a30989e-782c-4e52-83d5-88a4667d90df tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:50.133836 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a30989e-782c-4e52-83d5-88a4667d90df tempest-FlavorsExtraSpecsNegativeTestJSON-971407036 tempest-FlavorsExtraSpecsNegativeTestJSON-971407036-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051303 Aug 29 15:37:50.134606 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 22/28] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:50.247879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:37:51.093622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:37:51.094315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:37:51.095077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:37:51.096017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:37:51.097319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:37:51.118261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.118969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.119464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.120318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:51.120990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:51.122415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:51.208381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Getting quotas for project 09bab46673824d9ba81dc152cc0a3895. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:37:51.220580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Getting quotas for user a726e7ddb8914b72925d217021404000 and project 09bab46673824d9ba81dc152cc0a3895. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:37:51.283274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:37:51.297778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:37:51.409973 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9ba9cf03-066a-4513-b930-9dba34bb7deb tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.438191 Aug 29 15:37:51.410979 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 7/29] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:37:51.430061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-712e5281-0383-41e3-9dc3-1f644a916280 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:51.431389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-712e5281-0383-41e3-9dc3-1f644a916280 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:52.648677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-712e5281-0383-41e3-9dc3-1f644a916280 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:52.689095 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-712e5281-0383-41e3-9dc3-1f644a916280 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1243 microversion: 2.1 time: 1.271097 Aug 29 15:37:52.709911 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 23/30] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:51 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1243 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:53.714915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:53.716085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:53.766616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.766856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.767329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:53.772561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:53.773199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:53.773662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:54.159354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:54.184233 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de3d6a38-a8b3-4f19-b99a-d64937de2e06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1235 microversion: 2.1 time: 0.473327 Aug 29 15:37:54.184747 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 8/31] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:53 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1235 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:54.950537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d6649f0c-74ee-4763-83ff-2161837fb0e9 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2082017565", "id": 23485585, "os-flavor-access:is_public": "True"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:55.005269 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d6649f0c-74ee-4763-83ff-2161837fb0e9 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.649701 Aug 29 15:37:55.005861 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 24/32] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:54 2022] POST /compute/v2.1/flavors => generated 424 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:55.019237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07fb50d8-dfd2-4906-9799-5f6b10256bd3 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.094153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07fb50d8-dfd2-4906-9799-5f6b10256bd3 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/23485585" status: 202 len: 0 microversion: 2.1 time: 0.078593 Aug 29 15:37:55.098018 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 9/33] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:37:55 2022] DELETE /compute/v2.1/flavors/23485585 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:55.105240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-726ea63e-956e-469a-afdf-84621bec1f78 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.158523 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-726ea63e-956e-469a-afdf-84621bec1f78 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056821 Aug 29 15:37:55.176458 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 25/34] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:55.184266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51a41973-055f-4fa7-9a5c-47f3a8bca13b tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-721233524", "id": 44229519, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:55.206347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.207945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:55.222395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:55.223743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:55.225463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:55.226423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:55.229141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:55.229818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:55.257521 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-51a41973-055f-4fa7-9a5c-47f3a8bca13b tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.077845 Aug 29 15:37:55.259992 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 10/35] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:55 2022] POST /compute/v2.1/flavors => generated 410 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:55.270827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca4787b0-88a3-4cba-a482-d5c8c64b9441 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.344792 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca4787b0-88a3-4cba-a482-d5c8c64b9441 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.075186 Aug 29 15:37:55.349091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 11/36] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:55.376275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d8656d2-9546-42da-bd45-eb1078824671 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.422090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d8656d2-9546-42da-bd45-eb1078824671 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/44229519" status: 202 len: 0 microversion: 2.1 time: 0.060373 Aug 29 15:37:55.426669 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 12/37] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:37:55 2022] DELETE /compute/v2.1/flavors/44229519 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:55.432632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3dd0122-a661-425b-bb2a-daeccd0a7380 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.480625 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3dd0122-a661-425b-bb2a-daeccd0a7380 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052759 Aug 29 15:37:55.495985 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 13/38] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:55.515777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-496b2b81-ab3d-438f-a5b3-872abb80f8d3 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-785996590", "id": 1530977382, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:55.564264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:55.565189 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-496b2b81-ab3d-438f-a5b3-872abb80f8d3 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.063354 Aug 29 15:37:55.567103 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 14/39] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:55 2022] POST /compute/v2.1/flavors => generated 428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:55.590726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-246884a4-5f70-46ae-90f2-262c2285c78a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.600370 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5918401-e67a-48ea-aa56-7b99d1dd97da tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1297 microversion: 2.1 time: 0.397462 Aug 29 15:37:55.618987 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 26/40] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1297 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:55.632399 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-246884a4-5f70-46ae-90f2-262c2285c78a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1530977382" status: 202 len: 0 microversion: 2.1 time: 0.048832 Aug 29 15:37:55.633232 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 15/41] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:37:55 2022] DELETE /compute/v2.1/flavors/1530977382 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:55.641303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-635a37ee-e00a-409e-b6e4-e862ae452d46 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.684183 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-635a37ee-e00a-409e-b6e4-e862ae452d46 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046652 Aug 29 15:37:55.688582 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 27/42] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:55.724252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42c5a308-9692-4b9a-aec5-723bacfd64c5 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-769424081", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:55.778187 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42c5a308-9692-4b9a-aec5-723bacfd64c5 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.066317 Aug 29 15:37:55.782539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 16/43] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:55 2022] POST /compute/v2.1/flavors => generated 506 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:55.794820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a723778d-18ef-418e-92d0-c364ce21b179 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.833973 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a723778d-18ef-418e-92d0-c364ce21b179 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/2405bf11-55c1-42fe-b706-9ccc5c505a4c" status: 202 len: 0 microversion: 2.1 time: 0.041062 Aug 29 15:37:55.839561 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 28/44] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:55 2022] DELETE /compute/v2.1/flavors/2405bf11-55c1-42fe-b706-9ccc5c505a4c => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:55.843779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4049554c-e8ea-4fd0-aac6-26ee92e2b99a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:55.884150 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4049554c-e8ea-4fd0-aac6-26ee92e2b99a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041913 Aug 29 15:37:55.887048 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 17/45] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:55.913883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3076f3fb-17ac-46c8-ad92-fc882e6177b6 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1059581713", "id": "0903c985-607f-4c1d-878c-9246823fcdb9", "os-flavor-access:is_public": "True"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:55.974126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:55.987212 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3076f3fb-17ac-46c8-ad92-fc882e6177b6 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.075543 Aug 29 15:37:55.992300 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 29/46] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:55 2022] POST /compute/v2.1/flavors => generated 507 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:56.011060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9c83b411-a435-4f57-957b-183ae2e3be42 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:56.029164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=11 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:56.044121 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9c83b411-a435-4f57-957b-183ae2e3be42 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/0903c985-607f-4c1d-878c-9246823fcdb9" status: 202 len: 0 microversion: 2.1 time: 0.043558 Aug 29 15:37:56.045304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 18/47] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:37:55 2022] DELETE /compute/v2.1/flavors/0903c985-607f-4c1d-878c-9246823fcdb9 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:56.055497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11ff1716-439b-436e-a225-4a0d7eced401 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:56.083014 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11ff1716-439b-436e-a225-4a0d7eced401 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033614 Aug 29 15:37:56.091946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 30/48] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:56.104480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1938758c-0da6-47dd-ad89-2c243e1d5bc3 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1981814097", "id": 1690803434, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:56.139581 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1938758c-0da6-47dd-ad89-2c243e1d5bc3 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.039815 Aug 29 15:37:56.140788 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 19/49] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:56 2022] POST /compute/v2.1/flavors => generated 414 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:56.152644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-34569ba3-fe58-478d-94b3-93b17c671863 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:56.160980 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-34569ba3-fe58-478d-94b3-93b17c671863 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/1690803434" status: 200 len: 414 microversion: 2.1 time: 0.011873 Aug 29 15:37:56.162071 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 31/50] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:37:56 2022] GET /compute/v2.1/flavors/1690803434 => generated 414 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:56.626496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:56.627147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:56.636549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.638550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.639292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:56.640014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:56.640474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:56.640902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:57.267675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8528506b-18d2-4a8e-bcae-892472bd23e3 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.361572 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8528506b-18d2-4a8e-bcae-892472bd23e3 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 1.191042 Aug 29 15:37:57.362314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 20/51] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:56 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:57.388744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-983a2183-f1cb-4f77-af8d-81cdcab7a20b tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.448005 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-983a2183-f1cb-4f77-af8d-81cdcab7a20b tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1690803434" status: 202 len: 0 microversion: 2.1 time: 0.063408 Aug 29 15:37:57.456878 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 21/52] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:37:57 2022] DELETE /compute/v2.1/flavors/1690803434 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:57.476873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae9629ac-60e2-447f-8656-d90189d355d0 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.554869 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae9629ac-60e2-447f-8656-d90189d355d0 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091838 Aug 29 15:37:57.578161 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 22/53] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:57.583306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4979aa8e-25c3-4692-bfeb-521bd77bf52a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1464945049", "id": 1802419431, "os-flavor-access:is_public": "False"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:57.634845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4979aa8e-25c3-4692-bfeb-521bd77bf52a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.055459 Aug 29 15:37:57.646011 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 23/54] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:57 2022] POST /compute/v2.1/flavors => generated 430 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:57.664709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8bffbeab-a76f-4356-8964-273584e8a6e8 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "1802419431"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:57.696693 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-8bffbeab-a76f-4356-8964-273584e8a6e8 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] HTTP exception thrown: Flavor 1802419431 could not be found. Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8bffbeab-a76f-4356-8964-273584e8a6e8 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] Request method failure captured: Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 107 Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1PWCX1FAsOeA79Uc2Mt0UcQORbtTZIvwo81k-vHGhGg_fcRvD8RTNzgibfiU4wNGPyefXYW1o3q2njTnUPK6Oxa0tNbQcvITj-kOC1M-2bsCygK3t4EblIXdigO4iJ0r4udYffwKJtY03P_WGyndWv27zsjkIvfY0XHZrmBi23pM0 Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: c643cefb38c648c888cd0f6b23821471 Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FlavorsAdminTestJSON-311644475 Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:37:57.702704 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c643cefb38c648c888cd0f6b23821471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c643cefb38c648c888cd0f6b23821471", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c643cefb38c648c888cd0f6b23821471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c643cefb38c648c888cd0f6b23821471"}]}] Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FlavorsAdminTestJSON-311644475 Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: c643cefb38c648c888cd0f6b23821471 Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-311644475 Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FlavorsAdminTestJSON-311644475-project Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e4f1fb333aaa493f91c1ae14f4f08f58 Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FlavorsAdminTestJSON-311644475-project Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "test", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "1802419431"}} Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:37:57.704161 n-d-836830-13 devstack@n-api.service[129132]: exception: Flavor 1802419431 could not be found. Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '1802419431'}}} Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1802419431 could not be found. Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:37:57.705065 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1802419431 could not be found. Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:37:57.706873 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:37:57.711639 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:37:57.711639 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:37:57.711639 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:37:57.711639 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1802419431 could not be found. Aug 29 15:37:57.711639 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:37:57.713195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8bffbeab-a76f-4356-8964-273584e8a6e8 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] Returning 400 to user: Flavor 1802419431 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:37:57.714396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8bffbeab-a76f-4356-8964-273584e8a6e8 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.066347 Aug 29 15:37:57.720314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 24/55] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:57 2022] POST /compute/v2.1/servers => generated 81 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:37:57.727698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff3e745b-2c89-48ef-a082-5aed0778edd1 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.754271 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff3e745b-2c89-48ef-a082-5aed0778edd1 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1802419431" status: 202 len: 0 microversion: 2.1 time: 0.029758 Aug 29 15:37:57.760896 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 25/56] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:37:57 2022] DELETE /compute/v2.1/flavors/1802419431 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:57.772489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5629ae7-df77-41af-bde5-28a15d9c9e2e tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:57.777445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:37:57.786916 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c6352d4-3d5c-42f3-8a0f-39ba51626919 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 1.164609 Aug 29 15:37:57.790416 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 32/57] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:56 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:57.831227 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5629ae7-df77-41af-bde5-28a15d9c9e2e tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063033 Aug 29 15:37:57.849418 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 26/58] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:57.851330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1b550a9-dc7b-41bb-925d-bd6c16074777 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1249170522", "id": 259522929, "os-flavor-access:is_public": "False"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:57.883090 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1b550a9-dc7b-41bb-925d-bd6c16074777 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.035972 Aug 29 15:37:57.886958 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 33/59] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:57 2022] POST /compute/v2.1/flavors => generated 412 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:37:57.897562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d42fbfc1-3e67-422f-961b-c58e56f7c4b8 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-850112053", "id": 892248033, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:57.933659 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d42fbfc1-3e67-422f-961b-c58e56f7c4b8 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.040885 Aug 29 15:37:57.934283 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 27/60] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:57 2022] POST /compute/v2.1/flavors => generated 410 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:57.958081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e143c18-2166-4a1b-89a1-42949b4b970a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.027669 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e143c18-2166-4a1b-89a1-42949b4b970a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.085255 Aug 29 15:37:58.033800 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 34/61] 10.222.0.83 () {58 vars in 1169 bytes} [Mon Aug 29 15:37:57 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:58.045498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d01aa235-4a75-4edb-999b-5ba12f2a9d0c tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.112303 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d01aa235-4a75-4edb-999b-5ba12f2a9d0c tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.071695 Aug 29 15:37:58.121721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 28/62] 10.222.0.83 () {58 vars in 1177 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:58.133653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-721339ad-5f8b-497f-a8a8-256a0566013a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.171541 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-721339ad-5f8b-497f-a8a8-256a0566013a tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.042356 Aug 29 15:37:58.176559 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 35/63] 10.222.0.83 () {58 vars in 1171 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:58.188993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95461158-3370-4713-9faf-8205fc88845e tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.216546 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95461158-3370-4713-9faf-8205fc88845e tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.031389 Aug 29 15:37:58.218598 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 29/64] 10.222.0.83 () {58 vars in 1169 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:58.234580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82fddb4e-0834-47cf-a88b-08138836f882 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.275911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82fddb4e-0834-47cf-a88b-08138836f882 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.048063 Aug 29 15:37:58.277462 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 36/65] 10.222.0.83 () {58 vars in 1169 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:58.296254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f827fff-65a0-4659-bde4-8017f0760544 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.387454 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f827fff-65a0-4659-bde4-8017f0760544 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.094106 Aug 29 15:37:58.389785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 30/66] 10.222.0.83 () {58 vars in 1175 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:58.410241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dde851a4-5ec3-4d87-9dee-6768cb3f56a9 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.475915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dde851a4-5ec3-4d87-9dee-6768cb3f56a9 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.069114 Aug 29 15:37:58.476518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 37/67] 10.222.0.83 () {58 vars in 1173 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:58.497384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-31098fd7-3f09-4fb9-b3f4-3f52a51500c9 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.579199 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-31098fd7-3f09-4fb9-b3f4-3f52a51500c9 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.087878 Aug 29 15:37:58.583357 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 31/68] 10.222.0.83 () {58 vars in 1169 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:58.599087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-edbf6467-fd51-42c5-93c2-76917d27c7be tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.635388 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-edbf6467-fd51-42c5-93c2-76917d27c7be tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/892248033" status: 202 len: 0 microversion: 2.1 time: 0.040742 Aug 29 15:37:58.636264 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 38/69] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:37:58 2022] DELETE /compute/v2.1/flavors/892248033 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:37:58.645123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae2e391f-4f6a-489a-a545-bb0ebcb9e3fe tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.683632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae2e391f-4f6a-489a-a545-bb0ebcb9e3fe tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042726 Aug 29 15:37:58.691111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 32/70] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:37:58.711346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc4aa874-e424-43f8-a9d2-4c6d1e3ea14d tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.752341 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc4aa874-e424-43f8-a9d2-4c6d1e3ea14d tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/259522929" status: 202 len: 0 microversion: 2.1 time: 0.045359 Aug 29 15:37:58.754048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 39/71] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:37:58 2022] DELETE /compute/v2.1/flavors/259522929 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:37:58.762952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bf69e01-7296-43f8-91f7-92e0068c729f tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.794731 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9bf69e01-7296-43f8-91f7-92e0068c729f tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035604 Aug 29 15:37:58.811269 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 33/72] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:37:58.822238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:37:58.826633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:37:58.839808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:58.840566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:58.841163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:58.842187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:37:58.842775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:37:58.850630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:37:59.101776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:37:59.801339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a184557-90fe-4b4c-8d03-07ab6780428a tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1619380307", "ram": 512, "vcpus": 1, "disk": 10, "id": 182691994, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:59.876446 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a184557-90fe-4b4c-8d03-07ab6780428a tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.070468 Aug 29 15:37:59.887325 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 40/73] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:37:59.906097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03f1faef-002b-4e4a-b8a3-7fca8220ef29 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1314315803", "id": 1685028020, "os-flavor-access:is_public": "False"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:37:59.985744 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-03f1faef-002b-4e4a-b8a3-7fca8220ef29 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.095938 Aug 29 15:38:00.010552 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 41/74] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:37:59 2022] POST /compute/v2.1/flavors => generated 415 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:00.029207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e392d22-9888-4613-8a19-bd39b4a54215 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:00.139547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e392d22-9888-4613-8a19-bd39b4a54215 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/182691994/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.123491 Aug 29 15:38:00.147708 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 42/75] 10.222.0.83 () {60 vars in 1221 bytes} [Mon Aug 29 15:38:00 2022] POST /compute/v2.1/flavors/182691994/os-extra_specs => generated 66 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:00.265064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:00.277345 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7f6fd78-c22f-4577-ada4-196ad1b21d1b tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 1.464555 Aug 29 15:38:00.277946 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 34/76] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:37:58 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:00.305214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-adbdffba-ab4c-463a-a731-c2f93b8b7e64 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.375855 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-adbdffba-ab4c-463a-a731-c2f93b8b7e64 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.081881 Aug 29 15:38:00.377154 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 35/77] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:00.627554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Calling method '.version_select at 0x7f32efed9e50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.629396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.629884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.630498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.675365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.676092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.676689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.689255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.690855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.691693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.715132 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b25349ba-5327-4487-91f1-a0f2b1e8f3ab tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.563116 Aug 29 15:38:00.716437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 43/78] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:00.764285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-644ac611-fc54-4f12-8f7e-23e7c6664042 tempest-FlavorsExtraSpecsTestJSON-775599351 tempest-FlavorsExtraSpecsTestJSON-775599351-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.789582 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-644ac611-fc54-4f12-8f7e-23e7c6664042 tempest-FlavorsExtraSpecsTestJSON-775599351 tempest-FlavorsExtraSpecsTestJSON-775599351-project] 10.222.0.83 "GET /compute/v2.1/flavors/182691994/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.410846 Aug 29 15:38:00.798720 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 36/79] 10.222.0.83 () {58 vars in 1200 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/flavors/182691994/os-extra_specs => generated 66 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:00.804675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2556a9f5-89e9-4dd8-ab21-46cd86cb8c63 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.833629 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2556a9f5-89e9-4dd8-ab21-46cd86cb8c63 tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.033568 Aug 29 15:38:00.834563 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 37/80] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:00.839318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Calling method '.version_select at 0x7f32ef60d280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.841300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.841935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.842536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.863804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.864918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.866294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.893581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Calling method '.version_select at 0x7f32efdf6c10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:00.898971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.902972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.903570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.904525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.907373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.908931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.959951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:00.960735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:00.961391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:00.978820 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-321b7c70-173d-487c-ba19-928685e84af7 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/n-h1-836830-13/servers" status: 200 len: 197 microversion: 2.1 time: 0.139347 Aug 29 15:38:00.982759 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 38/81] 10.222.0.83 () {58 vars in 1215 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/os-hypervisors/n-h1-836830-13/servers => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:00.998499 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef624082-3c52-42e4-9c11-b905947ef147 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.279225 Aug 29 15:38:01.001054 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 44/82] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:38:00 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:01.004598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7272c9f6-e8c4-45bd-88df-56fed4d73b90 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:01.011515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe8b0e74-eb56-4bb8-9f3a-e21f0ca381fd tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.087006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe8b0e74-eb56-4bb8-9f3a-e21f0ca381fd tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1685028020" status: 202 len: 0 microversion: 2.1 time: 0.084381 Aug 29 15:38:01.090616 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 45/83] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:38:01 2022] DELETE /compute/v2.1/flavors/1685028020 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:01.102686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Calling method '.version_select at 0x7f32efdeb280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.108720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.110665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.111370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.135525 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7272c9f6-e8c4-45bd-88df-56fed4d73b90 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/182691994/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.147887 Aug 29 15:38:01.136306 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 39/84] 10.222.0.83 () {60 vars in 1221 bytes} [Mon Aug 29 15:38:00 2022] POST /compute/v2.1/flavors/182691994/os-extra_specs => generated 66 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:01.151842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.153000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.153870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.162156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:01.174173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.175072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.175784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.183642 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd31d783-f513-4468-bd8a-da6462a4716f tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.089727 Aug 29 15:38:01.184539 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 46/85] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:01.260870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:01.348235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8529b6be-0b97-4e8b-b50d-9071a41ab9ad req-54dd72e8-621d-42c1-9b25-4b96bfd03a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bc46d1-38de-4f9d-9f71-9aed32033b69", "tag": "37b7433c-1183-449c-adaf-c605cea346d1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:01.375295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8529b6be-0b97-4e8b-b50d-9071a41ab9ad req-54dd72e8-621d-42c1-9b25-4b96bfd03a64 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.375781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8529b6be-0b97-4e8b-b50d-9071a41ab9ad req-54dd72e8-621d-42c1-9b25-4b96bfd03a64 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.379648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8529b6be-0b97-4e8b-b50d-9071a41ab9ad req-54dd72e8-621d-42c1-9b25-4b96bfd03a64 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.432992 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8529b6be-0b97-4e8b-b50d-9071a41ab9ad req-54dd72e8-621d-42c1-9b25-4b96bfd03a64 service nova] Creating event network-changed:37b7433c-1183-449c-adaf-c605cea346d1 for instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 on n-h1-836830-13 Aug 29 15:38:01.439204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8529b6be-0b97-4e8b-b50d-9071a41ab9ad req-54dd72e8-621d-42c1-9b25-4b96bfd03a64 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:38:01.440468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8529b6be-0b97-4e8b-b50d-9071a41ab9ad req-54dd72e8-621d-42c1-9b25-4b96bfd03a64 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:38:01.447498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.448928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.449674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.451578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.455066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.455518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.478120 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.compute.rpcapi [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 15:38:01.480527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] Releasing lock "compute-rpcapi-router" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:38:01.534348 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f05a6b9d-f062-494e-9b03-e9a51d9fd912 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.395786 Aug 29 15:38:01.535674 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 40/86] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:01.541099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ec0d5c1-1553-4f14-8b53-16fc815308f6 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.591304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0435adbe-dd23-4084-97c1-9ca7d30ab2e1 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Calling method '.version_select at 0x7f32efdf6670>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.595176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0435adbe-dd23-4084-97c1-9ca7d30ab2e1 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '8e694885e1b14e94a1061d12473c2b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:01.602454 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ec0d5c1-1553-4f14-8b53-16fc815308f6 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.065294 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0435adbe-dd23-4084-97c1-9ca7d30ab2e1 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Request method failure captured: Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1UiPSs6-pxUIhlNzPX3RhGOISOiHrUj3ILJCPdAWeDIy4YL9jPQgrhnBTeHoVaG8vmexZ-KtpOF-svrSgbPCg1LtM2itbXGqufETsQAyAVuk22j5cevrvmmk8hnfxNwFuR8I9m04TnhU1yqs-uQAwOgj9u3fmQz9xJ5PZ3SBXepb0 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:01.612644 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f578d0e6a2d34a08a5f1f8cf4808bdd5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}] Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8e694885e1b14e94a1061d12473c2b4a Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:38:01.613837 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:01.617111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 29 15:38:01.618133 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:01.619114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0435adbe-dd23-4084-97c1-9ca7d30ab2e1 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:01.619114 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0435adbe-dd23-4084-97c1-9ca7d30ab2e1 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] 10.222.0.83 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.428348 Aug 29 15:38:01.622781 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 47/88] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 437 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:01.627866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6353d20f-3116-466f-9ecb-a5132349a8f2 tempest-FlavorsExtraSpecsTestJSON-775599351 tempest-FlavorsExtraSpecsTestJSON-775599351-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.631121 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 41/88] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:01.636155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Calling method '.version_select at 0x7f32ef481a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.637960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.638521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.654324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.669348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6353d20f-3116-466f-9ecb-a5132349a8f2 tempest-FlavorsExtraSpecsTestJSON-775599351 tempest-FlavorsExtraSpecsTestJSON-775599351-project] 10.222.0.83 "GET /compute/v2.1/flavors/182691994/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.045250 Aug 29 15:38:01.675333 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 48/89] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/flavors/182691994/os-extra_specs/hw:numa_nodes => generated 22 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:01.684938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.685564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:01.697137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.705392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.705689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.706063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.706827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.707639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.708563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:01.709208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:01.709863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:01.725460 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0cc3764-88b6-4698-8978-d948f39a4394 tempest-HypervisorAdminUnderV252Test-313229048 tempest-HypervisorAdminUnderV252Test-313229048-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/n-h1-836830-13/search" status: 200 len: 105 microversion: 2.1 time: 0.091857 Aug 29 15:38:01.728225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 42/90] 10.222.0.83 () {58 vars in 1212 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/os-hypervisors/n-h1-836830-13/search => generated 105 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:01.777933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2827d714-1a5d-4345-b10e-e5198764a5b7 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1441981539", "id": 313794777, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:01.842923 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2827d714-1a5d-4345-b10e-e5198764a5b7 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.107959 Aug 29 15:38:01.851910 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 43/91] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:01 2022] POST /compute/v2.1/flavors => generated 411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:01.866564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49d90a75-945b-4f49-9e03-efd5cf1a6553 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Calling method '.version_select at 0x7f32ef3f5160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:01.869098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49d90a75-945b-4f49-9e03-efd5cf1a6553 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '8e694885e1b14e94a1061d12473c2b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49d90a75-945b-4f49-9e03-efd5cf1a6553 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Request method failure captured: Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-hosts/n-d-836830-13/reboot HTTP/1.1 Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1UiPSs6-pxUIhlNzPX3RhGOISOiHrUj3ILJCPdAWeDIy4YL9jPQgrhnBTeHoVaG8vmexZ-KtpOF-svrSgbPCg1LtM2itbXGqufETsQAyAVuk22j5cevrvmmk8hnfxNwFuR8I9m04TnhU1yqs-uQAwOgj9u3fmQz9xJ5PZ3SBXepb0 Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:01.882671 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f578d0e6a2d34a08a5f1f8cf4808bdd5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}] Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8e694885e1b14e94a1061d12473c2b4a Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'n-d-836830-13'} Aug 29 15:38:01.883854 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:01.884524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 29 15:38:01.885448 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:01.887373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49d90a75-945b-4f49-9e03-efd5cf1a6553 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:01.888496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49d90a75-945b-4f49-9e03-efd5cf1a6553 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] 10.222.0.83 "GET /compute/v2.1/os-hosts/n-d-836830-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.034305 Aug 29 15:38:01.892493 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 44/92] 10.222.0.83 () {58 vars in 1191 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/os-hosts/n-d-836830-13/reboot => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:01.904083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5b8eb13-08b6-404f-9964-d220175fabd5 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:01.976459 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5b8eb13-08b6-404f-9964-d220175fabd5 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/182691994/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.081330 Aug 29 15:38:01.977632 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 45/93] 10.222.0.83 () {60 vars in 1221 bytes} [Mon Aug 29 15:38:01 2022] POST /compute/v2.1/flavors/182691994/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:02.004436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46bb88c1-f517-46fb-9483-d4c57ca9ce0b tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.005613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:02.018199 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce52c400-e18a-4c3f-b892-cdb80882a2e4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.342296 Aug 29 15:38:02.022833 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 49/94] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:02.039451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-339c2676-7c95-4f35-8686-74ec66afc878 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Calling method '.version_select at 0x7f32efdf61f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.062739 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46bb88c1-f517-46fb-9483-d4c57ca9ce0b tempest-FlavorsAdminTestJSON-311644475 tempest-FlavorsAdminTestJSON-311644475-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5795 microversion: 2.1 time: 0.082125 Aug 29 15:38:02.067921 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 46/95] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:01 2022] GET /compute/v2.1/flavors/detail => generated 5795 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:02.108797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fdccd9c4-8540-4bcc-9509-d66d5e101261 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.120522 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-339c2676-7c95-4f35-8686-74ec66afc878 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-339c2676-7c95-4f35-8686-74ec66afc878 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:02.128814 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:38:02.129990 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:02.130685 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:38:02.132705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.133655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-339c2676-7c95-4f35-8686-74ec66afc878 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.135429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-339c2676-7c95-4f35-8686-74ec66afc878 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.111180 Aug 29 15:38:02.144833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fdccd9c4-8540-4bcc-9509-d66d5e101261 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/182691994/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056444 Aug 29 15:38:02.145723 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 47/96] 10.222.0.83 () {58 vars in 1200 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/flavors/182691994/os-extra_specs => generated 66 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:02.145999 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 50/97] 10.222.0.83 () {58 vars in 1212 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:02.152268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0518cd5a-dfd0-4bc5-98f8-8a2aa78aaa2d tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.158805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-107af1f4-14df-4963-a1ab-630c7f1b7c78 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Calling method '.version_select at 0x7f32efc6eca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.161061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-107af1f4-14df-4963-a1ab-630c7f1b7c78 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '8e694885e1b14e94a1061d12473c2b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-107af1f4-14df-4963-a1ab-630c7f1b7c78 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Request method failure captured: Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hosts/n-d-836830-13 HTTP/1.1 Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1UiPSs6-pxUIhlNzPX3RhGOISOiHrUj3ILJCPdAWeDIy4YL9jPQgrhnBTeHoVaG8vmexZ-KtpOF-svrSgbPCg1LtM2itbXGqufETsQAyAVuk22j5cevrvmmk8hnfxNwFuR8I9m04TnhU1yqs-uQAwOgj9u3fmQz9xJ5PZ3SBXepb0 Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:02.170055 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f578d0e6a2d34a08a5f1f8cf4808bdd5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}] Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8e694885e1b14e94a1061d12473c2b4a Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'n-d-836830-13'} Aug 29 15:38:02.171459 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.172272 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 29 15:38:02.173552 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.180137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-107af1f4-14df-4963-a1ab-630c7f1b7c78 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.181167 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-107af1f4-14df-4963-a1ab-630c7f1b7c78 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] 10.222.0.83 "GET /compute/v2.1/os-hosts/n-d-836830-13" status: 403 len: 109 microversion: 2.1 time: 0.034047 Aug 29 15:38:02.192603 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 51/98] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/os-hosts/n-d-836830-13 => generated 109 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:02.196123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=9,nova_api:INSERT=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:02.201233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54dcd6bd-e16e-427d-9f80-17a48651d5a0 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:02.228622 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0518cd5a-dfd0-4bc5-98f8-8a2aa78aaa2d tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/313794777" status: 202 len: 0 microversion: 2.1 time: 0.081798 Aug 29 15:38:02.232073 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 48/99] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:38:02 2022] DELETE /compute/v2.1/flavors/313794777 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:02.247695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-905781d6-2f62-4cf9-abb8-520ecf71a3c5 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Calling method '.version_select at 0x7f32ef3f5b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.259373 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-905781d6-2f62-4cf9-abb8-520ecf71a3c5 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-905781d6-2f62-4cf9-abb8-520ecf71a3c5 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:02.263160 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:38:02.264949 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.265790 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.267149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.270542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-905781d6-2f62-4cf9-abb8-520ecf71a3c5 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.270542 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-905781d6-2f62-4cf9-abb8-520ecf71a3c5 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028253 Aug 29 15:38:02.276209 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 49/100] 10.222.0.83 () {58 vars in 1191 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:02.282546 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54dcd6bd-e16e-427d-9f80-17a48651d5a0 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "PUT /compute/v2.1/flavors/182691994/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.085682 Aug 29 15:38:02.282762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fe990c1-cce8-4617-9fdb-c039b5bae582 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.291732 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 52/101] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:38:02 2022] PUT /compute/v2.1/flavors/182691994/os-extra_specs/hw:numa_nodes => generated 22 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:02.305431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a017041-55f1-4603-a2b2-ae50884e2bb3 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Calling method '.version_select at 0x7f32efca0820>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.308418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8a017041-55f1-4603-a2b2-ae50884e2bb3 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '8e694885e1b14e94a1061d12473c2b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:02.313519 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fe990c1-cce8-4617-9fdb-c039b5bae582 tempest-FlavorsAdminTestJSON-938707728 tempest-FlavorsAdminTestJSON-938707728-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.036067 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a017041-55f1-4603-a2b2-ae50884e2bb3 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Request method failure captured: Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hosts/n-d-836830-13/shutdown HTTP/1.1 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1UiPSs6-pxUIhlNzPX3RhGOISOiHrUj3ILJCPdAWeDIy4YL9jPQgrhnBTeHoVaG8vmexZ-KtpOF-svrSgbPCg1LtM2itbXGqufETsQAyAVuk22j5cevrvmmk8hnfxNwFuR8I9m04TnhU1yqs-uQAwOgj9u3fmQz9xJ5PZ3SBXepb0 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:02.318143 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f578d0e6a2d34a08a5f1f8cf4808bdd5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}] Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8e694885e1b14e94a1061d12473c2b4a Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'n-d-836830-13'} Aug 29 15:38:02.319879 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.320535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 29 15:38:02.321600 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.323426 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 50/102] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:02.327526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a017041-55f1-4603-a2b2-ae50884e2bb3 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.337783 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a017041-55f1-4603-a2b2-ae50884e2bb3 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] 10.222.0.83 "GET /compute/v2.1/os-hosts/n-d-836830-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.043612 Aug 29 15:38:02.341477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9f79322a-3c26-48d9-8a31-aa8cf0625807 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.346394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 53/103] 10.222.0.83 () {58 vars in 1197 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/os-hosts/n-d-836830-13/shutdown => generated 113 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:02.357112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81d7274b-0ed2-4422-9ade-0af47440ccc7 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Calling method '.version_select at 0x7f32efca5310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.357854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9f79322a-3c26-48d9-8a31-aa8cf0625807 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/182691994/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032882 Aug 29 15:38:02.359616 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 51/104] 10.222.0.83 () {58 vars in 1200 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/flavors/182691994/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:02.378512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9de1b45-f0f4-4428-b0be-bd81cf369740 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.392480 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-81d7274b-0ed2-4422-9ade-0af47440ccc7 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81d7274b-0ed2-4422-9ade-0af47440ccc7 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:02.396364 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:38:02.398831 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:02.399663 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:38:02.400817 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.402027 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.408492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81d7274b-0ed2-4422-9ade-0af47440ccc7 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.415042 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-81d7274b-0ed2-4422-9ade-0af47440ccc7 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.062508 Aug 29 15:38:02.416645 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 54/105] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:02.439369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47348501-c164-46ec-9ed6-84e5da2fc6c7 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Calling method '.version_select at 0x7f32efc6e940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.444924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-47348501-c164-46ec-9ed6-84e5da2fc6c7 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '8e694885e1b14e94a1061d12473c2b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:02.448676 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9de1b45-f0f4-4428-b0be-bd81cf369740 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/182691994/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.075294 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47348501-c164-46ec-9ed6-84e5da2fc6c7 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Request method failure captured: Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hosts/n-d-836830-13/startup HTTP/1.1 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1UiPSs6-pxUIhlNzPX3RhGOISOiHrUj3ILJCPdAWeDIy4YL9jPQgrhnBTeHoVaG8vmexZ-KtpOF-svrSgbPCg1LtM2itbXGqufETsQAyAVuk22j5cevrvmmk8hnfxNwFuR8I9m04TnhU1yqs-uQAwOgj9u3fmQz9xJ5PZ3SBXepb0 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:02.451844 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f578d0e6a2d34a08a5f1f8cf4808bdd5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}] Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8e694885e1b14e94a1061d12473c2b4a Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'n-d-836830-13'} Aug 29 15:38:02.453374 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 29 15:38:02.455069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.455959 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 52/106] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:38:02 2022] DELETE /compute/v2.1/flavors/182691994/os-extra_specs/hw:numa_nodes => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:02.458525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47348501-c164-46ec-9ed6-84e5da2fc6c7 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.461237 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-47348501-c164-46ec-9ed6-84e5da2fc6c7 tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] 10.222.0.83 "GET /compute/v2.1/os-hosts/n-d-836830-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.037829 Aug 29 15:38:02.464014 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 55/107] 10.222.0.83 () {58 vars in 1194 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/os-hosts/n-d-836830-13/startup => generated 110 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:02.473609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d46d176a-caf3-4763-812b-54ab3e488ad0 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Calling method '.version_select at 0x7f32efca0ca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.475389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96cfd240-ce8f-4afe-adba-73370bd2057d tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.503997 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d46d176a-caf3-4763-812b-54ab3e488ad0 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d46d176a-caf3-4763-812b-54ab3e488ad0 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:02.507551 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'nonexistent_hostname'} Aug 29 15:38:02.509785 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:02.510710 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 29 15:38:02.511695 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.512630 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.526088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d46d176a-caf3-4763-812b-54ab3e488ad0 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.529296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d46d176a-caf3-4763-812b-54ab3e488ad0 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.059738 Aug 29 15:38:02.541048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 56/108] 10.222.0.83 () {58 vars in 1215 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:02.548341 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96cfd240-ce8f-4afe-adba-73370bd2057d tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/182691994/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.084046 Aug 29 15:38:02.556790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-273d36d4-91bc-4472-96dc-42fc336e07c8 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Action: 'update', calling method: .version_select at 0x7f32efca04c0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:02.562016 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 53/109] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:38:02 2022] DELETE /compute/v2.1/flavors/182691994/os-extra_specs/hw:cpu_policy => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:02.577408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8fde67e-e446-4f28-bf34-d806333ae318 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-273d36d4-91bc-4472-96dc-42fc336e07c8 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/os-hosts/n-d-836830-13 HTTP/1.1 Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 51 Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:02.581824 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: {"status": "enable", "maintenance_mode": "invalid"} Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.583285 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'n-d-836830-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.583952 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.585791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.586824 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.586824 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:02.586824 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:02.586824 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.586824 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.591412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-273d36d4-91bc-4472-96dc-42fc336e07c8 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.593125 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-273d36d4-91bc-4472-96dc-42fc336e07c8 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-hosts/n-d-836830-13" status: 400 len: 199 microversion: 2.1 time: 0.050798 Aug 29 15:38:02.597414 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 57/110] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:38:02 2022] PUT /compute/v2.1/os-hosts/n-d-836830-13 => generated 199 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:02.620503 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8fde67e-e446-4f28-bf34-d806333ae318 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/182691994/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.056973 Aug 29 15:38:02.621211 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 54/111] 10.222.0.83 () {58 vars in 1200 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/flavors/182691994/os-extra_specs => generated 19 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:02.627637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-616c79d6-90d8-4fcb-8fb0-52ab1b85f213 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Action: 'update', calling method: .version_select at 0x7f32efca5040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:02.634431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84ad4282-ffce-405b-a095-47935c83533d tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-616c79d6-90d8-4fcb-8fb0-52ab1b85f213 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/os-hosts/n-d-836830-13 HTTP/1.1 Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 51 Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:02.642609 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: {"status": "invalid", "maintenance_mode": "enable"} Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.644440 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'n-d-836830-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.645319 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.647238 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.648343 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.648343 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:02.648343 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:02.648343 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 29 15:38:02.648343 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.648343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-616c79d6-90d8-4fcb-8fb0-52ab1b85f213 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.650586 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-616c79d6-90d8-4fcb-8fb0-52ab1b85f213 tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-hosts/n-d-836830-13" status: 400 len: 189 microversion: 2.1 time: 0.043190 Aug 29 15:38:02.657491 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 58/112] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:38:02 2022] PUT /compute/v2.1/os-hosts/n-d-836830-13 => generated 189 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:02.672617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5dc45d98-6b8c-4300-82d3-10e0e01d55bb tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Action: 'update', calling method: .version_select at 0x7f32efca5c10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:02.688393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5dc45d98-6b8c-4300-82d3-10e0e01d55bb tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '8e694885e1b14e94a1061d12473c2b4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f578d0e6a2d34a08a5f1f8cf4808bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5dc45d98-6b8c-4300-82d3-10e0e01d55bb tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Request method failure captured: Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/os-hosts/n-d-836830-13 HTTP/1.1 Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 50 Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1UiPSs6-pxUIhlNzPX3RhGOISOiHrUj3ILJCPdAWeDIy4YL9jPQgrhnBTeHoVaG8vmexZ-KtpOF-svrSgbPCg1LtM2itbXGqufETsQAyAVuk22j5cevrvmmk8hnfxNwFuR8I9m04TnhU1yqs-uQAwOgj9u3fmQz9xJ5PZ3SBXepb0 Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:02.694746 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f578d0e6a2d34a08a5f1f8cf4808bdd5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f578d0e6a2d34a08a5f1f8cf4808bdd5"}]}] Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: f578d0e6a2d34a08a5f1f8cf4808bdd5 Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1973996378 Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8e694885e1b14e94a1061d12473c2b4a Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1973996378-project Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:38:02.696054 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'n-d-836830-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.696852 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 29 15:38:02.697934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.699082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5dc45d98-6b8c-4300-82d3-10e0e01d55bb tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.713525 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5dc45d98-6b8c-4300-82d3-10e0e01d55bb tempest-HostsAdminNegativeTestJSON-1973996378 tempest-HostsAdminNegativeTestJSON-1973996378-project] 10.222.0.83 "PUT /compute/v2.1/os-hosts/n-d-836830-13" status: 403 len: 111 microversion: 2.1 time: 0.039021 Aug 29 15:38:02.714361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84ad4282-ffce-405b-a095-47935c83533d tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/182691994" status: 202 len: 0 microversion: 2.1 time: 0.074461 Aug 29 15:38:02.714526 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 59/113] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:38:02 2022] PUT /compute/v2.1/os-hosts/n-d-836830-13 => generated 111 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:38:02.714673 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 55/114] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:38:02 2022] DELETE /compute/v2.1/flavors/182691994 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:02.714849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:02.725848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ab1823da-12ca-4d03-8391-eca59ef0b579 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:02.727442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76d18b1b-6c74-41ae-8e32-29a43b60267a tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Action: 'update', calling method: .version_select at 0x7f32ef3f5b80>, body: {"status": null, "maintenance_mode": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76d18b1b-6c74-41ae-8e32-29a43b60267a tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/os-hosts/n-d-836830-13 HTTP/1.1 Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 42 Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:02.747812 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: {"status": null, "maintenance_mode": null} Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:38:02.749112 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'n-d-836830-13', 'body': {'status': None, 'maintenance_mode': None}} Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'disable', Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'Enable', Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'Disable', Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance: Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi None Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.757839 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.759289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.760314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:02.760314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:02.760314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 29 15:38:02.760314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.760314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76d18b1b-6c74-41ae-8e32-29a43b60267a tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.760314 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76d18b1b-6c74-41ae-8e32-29a43b60267a tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-hosts/n-d-836830-13" status: 400 len: 127 microversion: 2.1 time: 0.037101 Aug 29 15:38:02.760314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 56/115] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:38:02 2022] PUT /compute/v2.1/os-hosts/n-d-836830-13 => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:02.764964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3faae7af-d800-45ed-9ca2-aed601f0d82c tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Action: 'update', calling method: .version_select at 0x7f32ef47c160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:02.780734 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.hosts [None req-3faae7af-d800-45ed-9ca2-aed601f0d82c tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Enabling host nonexistent_hostname. Aug 29 15:38:02.804309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3faae7af-d800-45ed-9ca2-aed601f0d82c tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3faae7af-d800-45ed-9ca2-aed601f0d82c tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Request method failure captured: Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 50 Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1X7SmcW3NfrO5fKCIR0Od85shWVXenegvLJTBf3zz1CdetVrQo7Mz-vTVZV9W-Dfl5XfjjvE0LGhsKf39ohW_YhyN_Wliec57hucAeNvNzfcmhs2l00RPbHGjGRPmga4zLf1Ia0IfclTWwlG-FRu7Rg_rpxq8kol6v48PyXYpVe50 Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:02.814239 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9dc3c7013c434641a8f461258d4e1d82", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9dc3c7013c434641a8f461258d4e1d82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9dc3c7013c434641a8f461258d4e1d82"}]}] Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9dc3c7013c434641a8f461258d4e1d82 Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1271205755 Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c874ced355e04bc5914827ffe2702e27 Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1271205755-project-admin Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: {"status": "enable", "maintenance_mode": "enable"} Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.815730 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:38:02.816615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:02.817877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:02.819879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3faae7af-d800-45ed-9ca2-aed601f0d82c tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:02.827985 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3faae7af-d800-45ed-9ca2-aed601f0d82c tempest-HostsAdminNegativeTestJSON-1271205755 tempest-HostsAdminNegativeTestJSON-1271205755-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.063647 Aug 29 15:38:02.831248 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 57/116] 10.222.0.83 () {60 vars in 1211 bytes} [Mon Aug 29 15:38:02 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:38:02.844731 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ab1823da-12ca-4d03-8391-eca59ef0b579 tempest-FlavorsExtraSpecsTestJSON-492139574 tempest-FlavorsExtraSpecsTestJSON-492139574-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.134468 Aug 29 15:38:02.845349 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 60/117] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:03.047451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:03.048362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:03.060766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:03.062203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:03.063069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:03.065655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:03.067155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:03.068148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:04.237849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:04.247653 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-305079b3-6f44-4501-906c-9e0a53da7c08 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 1.205587 Aug 29 15:38:04.251747 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 58/118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:03 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:05.277922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:05.278528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:05.301953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:05.304837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:05.307116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:05.311137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:05.314681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:05.321264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:06.059723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:06.067781 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-44a1167e-388e-47c3-a6fe-41f6c8497fc9 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.793690 Aug 29 15:38:06.084456 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 61/119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:05 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:07.092479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:07.093196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:07.107256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:07.115961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:07.118823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:07.120340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:07.123878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:07.124526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:07.880738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:07.892598 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81435d88-a5cb-4c41-90f8-8ce2be01a0ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.804550 Aug 29 15:38:07.900238 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 59/120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:07 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:08.922939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:08.924428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:08.932833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.933559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.934951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:08.935843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:08.937245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:08.938016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:09.149556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:09.162879 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba17afb1-513b-4b4b-94c5-eea5ec68f496 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.242819 Aug 29 15:38:09.163869 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 62/121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:08 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:10.187833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:10.189341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:10.199971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.200466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.206202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.207070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:10.207856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:10.208440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:10.706500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:10.724610 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b03fa4b3-758f-4b3a-86df-01c0ddda1e84 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.542398 Aug 29 15:38:10.727426 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 60/122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:10 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:11.426789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:11.748893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:11.749675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:11.756118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:11.758491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.759778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.760970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.762169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:11.763239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:11.763820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:11.861108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-25e203a2-7056-4a2d-9a27-dc35a159d38c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:11.866813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=5,nova_api:DELETE=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:11.872132 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-25e203a2-7056-4a2d-9a27-dc35a159d38c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.449919 Aug 29 15:38:11.878665 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 63/123] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:38:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:11.957574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:11.966873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ceb617e0-89d7-43c0-9fd5-cccb03016c5d tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.222347 Aug 29 15:38:11.967483 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 61/124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:11 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:12.297717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24385844-fe86-44ad-917c-52b45a3b9002 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-753065151", "id": 975624358, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.324785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24385844-fe86-44ad-917c-52b45a3b9002 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.435201 Aug 29 15:38:12.325941 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 64/125] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:11 2022] POST /compute/v2.1/flavors => generated 421 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:12.338881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f1d55d8-dc3e-4f5b-b4e6-d5df8ccab824 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.347848 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f1d55d8-dc3e-4f5b-b4e6-d5df8ccab824 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014253 Aug 29 15:38:12.348402 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 65/126] 10.222.0.83 () {58 vars in 1182 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:38:12.358920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c473fcb0-920e-4a14-83dc-6e4e64bf7b4b tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1683852834", "id": 1877773698, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.392122 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c473fcb0-920e-4a14-83dc-6e4e64bf7b4b tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.037583 Aug 29 15:38:12.393266 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 66/127] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:12 2022] POST /compute/v2.1/flavors => generated 425 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:12.412227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76c09a23-648a-4e47-aa4d-7bc3b1bb9842 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.425714 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76c09a23-648a-4e47-aa4d-7bc3b1bb9842 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023797 Aug 29 15:38:12.428275 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 67/128] 10.222.0.83 () {58 vars in 1182 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:38:12.442711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b9526b8-d892-4ee9-b6cc-8f08c955dded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Action: 'create', calling method: .version_select at 0x7f32efca5430>, body: {"keypair": {"name": "tempest-keypair-622685922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNgAQFjEfW2FTDt5YgLVl0q0HcdKHnEk/AP4YSDumE5iq5Tn2L9lW3Se68cuV/qQg7eJY6ETbpLYgFLjWX/Joyjeg2y6b1ygc2sSQJ7O5OTpyPqfGj4FegOoqthYX+kzw=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:12.484871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8b9526b8-d892-4ee9-b6cc-8f08c955dded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Getting quotas for project 3ab5abb97d5e40b0a4dea82546dcb92c. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:12.495736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8b9526b8-d892-4ee9-b6cc-8f08c955dded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Getting quotas for user 06856f1488e44bde85de23a5effddbdd and project 3ab5abb97d5e40b0a4dea82546dcb92c. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:12.538750 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b9526b8-d892-4ee9-b6cc-8f08c955dded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101574 Aug 29 15:38:12.539546 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 68/129] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:38:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:12.604659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b5f61a2-d1d2-4e3c-87b1-2f7e4e7caf36 tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] Calling method '.version_select at 0x7f32ef6169d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:12.626367 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b5f61a2-d1d2-4e3c-87b1-2f7e4e7caf36 tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.600009 Aug 29 15:38:12.627701 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 62/130] 10.222.0.83 () {60 vars in 1226 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:38:12.641959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c6b92821-56b7-40dc-ba1b-776c13113c3f tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] Action: 'update', calling method: .version_select at 0x7f32efca0ee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:13.116878 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c6b92821-56b7-40dc-ba1b-776c13113c3f tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.479484 Aug 29 15:38:13.123755 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 69/131] 10.222.0.83 () {62 vars in 1247 bytes} [Mon Aug 29 15:38:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:13.223676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32ef3bcaf0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.228010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.231979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.232605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.234963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.235858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.237350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.275631 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a81b50cd-8132-4838-97a5-0f9a370991e7 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.622740 Aug 29 15:38:13.275631 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 63/132] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:38:12 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:13.280331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.280498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:13.286796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.288114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.288560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.289268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.292193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.292826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.346087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef55417f-fad3-4a48-b071-76ad7de6441c tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-452933541", "id": 950990343, "os-flavor-access:is_public": "True"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:13.372250 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef55417f-fad3-4a48-b071-76ad7de6441c tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.247509 Aug 29 15:38:13.381012 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 70/133] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:38:13 2022] POST /compute/v2.1/flavors => generated 464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:13.386510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f05caebd-b834-4cde-8fbd-4994ef1fa79a tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] Calling method '.version_select at 0x7f32efc0ae50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.398825 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f05caebd-b834-4cde-8fbd-4994ef1fa79a tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016321 Aug 29 15:38:13.399955 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 71/134] 10.222.0.83 () {60 vars in 1226 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:13.404968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32efc0aaf0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.409415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.410123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.410734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.411924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.413261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.413893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.456283 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca6f478c-6bdb-4660-8399-5065077524d0 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.055039 Aug 29 15:38:13.458489 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 72/135] 10.222.0.83 () {58 vars in 1139 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:13.521122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:13.525380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1911190240", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:13.541701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-034a5ef9-711c-4930-b2c2-7c4d0a1310cd tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.265832 Aug 29 15:38:13.543060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 64/136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:13.604955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:13.678852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de30e18b-c6b6-4a23-bc2c-7e8b19f27597 tempest-FlavorsV261TestJSON-1458560854 tempest-FlavorsV261TestJSON-1458560854-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.689291 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de30e18b-c6b6-4a23-bc2c-7e8b19f27597 tempest-FlavorsV261TestJSON-1458560854 tempest-FlavorsV261TestJSON-1458560854-project] 10.222.0.83 "GET /compute/v2.1/flavors/950990343" status: 200 len: 464 microversion: 2.61 time: 0.144901 Aug 29 15:38:13.698705 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 65/137] 10.222.0.83 () {60 vars in 1196 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/flavors/950990343 => generated 464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:13.709169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44666d00-718c-4ef8-b8ca-7d6fe68ae5e8 tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] Action: 'update', calling method: .version_select at 0x7f32ef2c18b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:13.800858 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44666d00-718c-4ef8-b8ca-7d6fe68ae5e8 tempest-QuotaClassesAdmin257Test-473490010 tempest-QuotaClassesAdmin257Test-473490010-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.100691 Aug 29 15:38:13.801827 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 66/138] 10.222.0.83 () {62 vars in 1247 bytes} [Mon Aug 29 15:38:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:13.807357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32ef2c1280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.812077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.812762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.813521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.814564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:13.815205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:13.815948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:13.848218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2f89d9c8-44eb-467e-b0fb-c6886bb18959 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.045101 Aug 29 15:38:13.856217 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 67/139] 10.222.0.83 () {58 vars in 1145 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:13.861677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7772df07-99b0-4f8c-9eac-d0ac3aaf0e65 tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] Action: 'update', calling method: .version_select at 0x7f32f0558940>, body: {"flavor": {"description": "new"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:13.915546 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7772df07-99b0-4f8c-9eac-d0ac3aaf0e65 tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] 10.222.0.83 "PUT /compute/v2.1/flavors/950990343" status: 200 len: 465 microversion: 2.61 time: 0.057632 Aug 29 15:38:13.916415 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 68/140] 10.222.0.83 () {62 vars in 1216 bytes} [Mon Aug 29 15:38:13 2022] PUT /compute/v2.1/flavors/950990343 => generated 465 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:13.932613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-321d9ef6-94dc-495a-8bf4-d46534daf73d tempest-FlavorsV261TestJSON-1458560854 tempest-FlavorsV261TestJSON-1458560854-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:13.965971 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-321d9ef6-94dc-495a-8bf4-d46534daf73d tempest-FlavorsV261TestJSON-1458560854 tempest-FlavorsV261TestJSON-1458560854-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.039787 Aug 29 15:38:13.967266 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 69/141] 10.222.0.83 () {60 vars in 1187 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:13.990647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3f9998b-cb40-4a18-b822-5d8cc44eb61c tempest-FlavorsV261TestJSON-1458560854 tempest-FlavorsV261TestJSON-1458560854-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.016502 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b3f9998b-cb40-4a18-b822-5d8cc44eb61c tempest-FlavorsV261TestJSON-1458560854 tempest-FlavorsV261TestJSON-1458560854-project] 10.222.0.83 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.61 time: 0.031096 Aug 29 15:38:14.017103 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 70/142] 10.222.0.83 () {60 vars in 1166 bytes} [Mon Aug 29 15:38:13 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:14.034179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94ccf2b2-7be1-4d87-bc29-bf0359e14405 tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.055915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94ccf2b2-7be1-4d87-bc29-bf0359e14405 tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/950990343" status: 202 len: 0 microversion: 2.61 time: 0.026013 Aug 29 15:38:14.056704 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 71/143] 10.222.0.83 () {60 vars in 1199 bytes} [Mon Aug 29 15:38:14 2022] DELETE /compute/v2.1/flavors/950990343 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:38:14.064867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e4d474d4-483e-4fab-a789-b5ef08e59188 tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.092595 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e4d474d4-483e-4fab-a789-b5ef08e59188 tempest-FlavorsV261TestJSON-1591675081 tempest-FlavorsV261TestJSON-1591675081-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.031295 Aug 29 15:38:14.097379 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 72/144] 10.222.0.83 () {60 vars in 1187 bytes} [Mon Aug 29 15:38:14 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:14.164764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:14.165110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:14.165577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:14.165976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:14.166379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:14.180168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.182392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.183159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.186093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.186847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.187845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.252649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Getting quotas for project 13ee7f05500a437580afe08f38a79fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:14.262176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Getting quotas for user 010ed8588b2d496bacedebc1863a3857 and project 13ee7f05500a437580afe08f38a79fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:14.285576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:14.290351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:14.411291 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d6276f8-ebb2-4dd2-8a6a-4adda299e537 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950667 Aug 29 15:38:14.414554 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 73/145] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:14.427068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-986b7ff4-65f8-4551-9601-4858e0725603 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.428669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-986b7ff4-65f8-4551-9601-4858e0725603 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:14.508297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-986b7ff4-65f8-4551-9601-4858e0725603 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:14.535014 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-986b7ff4-65f8-4551-9601-4858e0725603 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1219 microversion: 2.1 time: 0.113158 Aug 29 15:38:14.537574 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 73/146] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:14 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:14.564113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:14.564899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:14.584206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.585061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.585741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:14.587043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:14.587847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:14.588459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.104215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:15.117018 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90862fe7-5328-4998-b14e-2fc076e6d6d0 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.555797 Aug 29 15:38:15.120049 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 74/147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:14 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:15.478385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-22c44df9-5ab7-4842-b2e8-2bcaec95542f req-348496ba-11da-4cb1-8057-636786b38db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bc46d1-38de-4f9d-9f71-9aed32033b69", "name": "network-vif-plugged", "status": "completed", "tag": "37b7433c-1183-449c-adaf-c605cea346d1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:15.496924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-22c44df9-5ab7-4842-b2e8-2bcaec95542f req-348496ba-11da-4cb1-8057-636786b38db8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:15.497397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-22c44df9-5ab7-4842-b2e8-2bcaec95542f req-348496ba-11da-4cb1-8057-636786b38db8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:15.497824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-22c44df9-5ab7-4842-b2e8-2bcaec95542f req-348496ba-11da-4cb1-8057-636786b38db8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:15.527524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-22c44df9-5ab7-4842-b2e8-2bcaec95542f req-348496ba-11da-4cb1-8057-636786b38db8 service nova] Creating event network-vif-plugged:37b7433c-1183-449c-adaf-c605cea346d1 for instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 on n-h1-836830-13 Aug 29 15:38:15.540679 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-22c44df9-5ab7-4842-b2e8-2bcaec95542f req-348496ba-11da-4cb1-8057-636786b38db8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429604 Aug 29 15:38:15.541300 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 74/148] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:15.558039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c4d7e68-5a12-4da2-aaa5-505406865b8e tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:15.559082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2c4d7e68-5a12-4da2-aaa5-505406865b8e tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:15.666507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c4d7e68-5a12-4da2-aaa5-505406865b8e tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:15.677091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1015821875", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "1877773698", "adminPass": "***", "networks": [{"uuid": "dd29eb79-db28-4b1a-9ba1-635d40ee17be"}], "security_groups": [{"name": "tempest-securitygroup--1319958693"}], "key_name": "tempest-keypair-622685922", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:15.689254 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c4d7e68-5a12-4da2-aaa5-505406865b8e tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1219 microversion: 2.1 time: 0.134679 Aug 29 15:38:15.703625 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 75/149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:15 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:15.709367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=9,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:UPDATE=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:15.980909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] validate_networks() for [('dd29eb79-db28-4b1a-9ba1-635d40ee17be', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:16.142492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:16.143197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:16.151856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.154447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.158008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.159447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.160520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.161314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.504684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:16.512115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=67 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:16.515156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0f0586c-a764-40b9-bc14-cad82105ee06 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.379123 Aug 29 15:38:16.522984 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 76/150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:16 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:16.719295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:16.720148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:16.729178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.729666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.730272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.731201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:16.732275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:16.736706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:16.822574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:16.836772 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b825942b-0fa0-485d-842c-9bf72d32576a tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1271 microversion: 2.1 time: 0.122868 Aug 29 15:38:16.838707 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 77/151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:16 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:17.513325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:17.515645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:17.515645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:17.520289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:17.520980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:17.539648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.540935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.555062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.555957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.556608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.557576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.558277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.559843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.560013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.560496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.560931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.561645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.562096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.562506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.587142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=83 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:17.610888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Getting quotas for project 3ab5abb97d5e40b0a4dea82546dcb92c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:17.619787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Getting quotas for user 06856f1488e44bde85de23a5effddbdd and project 3ab5abb97d5e40b0a4dea82546dcb92c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:17.664722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:17.675614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:17.811326 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04c89b25-0cb1-4be4-9965-a0b7a37410e8 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.142575 Aug 29 15:38:17.812597 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 75/152] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 2145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:38:17.845802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-320c1e08-3a3d-4c95-8215-07ad0a7a2d08 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.848237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-320c1e08-3a3d-4c95-8215-07ad0a7a2d08 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.893592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:17.909504 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f80af08d-422c-415c-86f0-da7ce9afc126 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1339 microversion: 2.1 time: 0.374873 Aug 29 15:38:17.938613 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 78/153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1339 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:17.954712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:17.958482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:17.965790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=14,nova_api:UPDATE=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:17.979369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.980103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.980719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:17.981622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:17.984233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:17.985101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.086465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.108678 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c4c0ba4-082b-4acc-8977-7b4793fea632 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1277 microversion: 2.1 time: 0.168067 Aug 29 15:38:18.110149 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 79/154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:18.378995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-320c1e08-3a3d-4c95-8215-07ad0a7a2d08 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:18.389162 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-320c1e08-3a3d-4c95-8215-07ad0a7a2d08 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1264 microversion: 2.1 time: 0.566922 Aug 29 15:38:18.390089 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 76/155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:17 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1264 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:18.947767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:18.951428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:18.959642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.960962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.962062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:18.964684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:18.965398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:18.967765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.140704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.141914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.159165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.160056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.160489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.161242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.161830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.162407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.195958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.205264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87da078f-5e1e-43ec-bf97-fa03fb23d8ba tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1488 microversion: 2.1 time: 0.263541 Aug 29 15:38:19.219744 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 80/156] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:18 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1488 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:19.333181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.343702 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8393e26e-0145-42de-8bab-7664565657db tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.207730 Aug 29 15:38:19.347432 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 77/157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:19.360427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.360427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.367210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.367831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.368357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.369142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.369704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.370403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.641328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3627160-60b6-461a-8920-b8d56bbc7cd9 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.651276 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a3627160-60b6-461a-8920-b8d56bbc7cd9 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3627160-60b6-461a-8920-b8d56bbc7cd9 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097-project-admin] Request method failure captured: Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1qqZfNe84qRahT0EfhjPa7eAMzerm3WAvny6myouslf5nY1jM_78QZXVrgF3rx9gs1DB6XkUFqVAfqG-yoTJepnUxfj83jzj-dpmerG4eS0NHwBo_jDLrL8BkHRdC0lRphay05ArrHDuVsEHyOfawrTxnWB9Gr9q2TXexmye0KaN0 Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 33ff2fb111bd450b9c2817f4a523a18c Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:19.661396 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/33ff2fb111bd450b9c2817f4a523a18c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_33ff2fb111bd450b9c2817f4a523a18c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/33ff2fb111bd450b9c2817f4a523a18c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/33ff2fb111bd450b9c2817f4a523a18c"}]}] Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 33ff2fb111bd450b9c2817f4a523a18c Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097-project-admin Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 77dfc1ab0428420fa02966697c1400d8 Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097-project-admin Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:19.663680 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid timestamp for date invalid_time Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'invalid_time'} Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:19.664341 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:19.665618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3627160-60b6-461a-8920-b8d56bbc7cd9 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:19.667235 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3627160-60b6-461a-8920-b8d56bbc7cd9 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097 tempest-InstanceUsageAuditLogNegativeTestJSON-1784266097-project-admin] 10.222.0.83 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.446167 Aug 29 15:38:19.668064 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 81/158] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 448 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:19.675970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:19.677506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:19.688433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.689317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.690040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.691042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:19.691858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:19.692474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:19.795758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:19.806740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-515bd835-5c69-4d72-8263-23743dc86b6f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1356 microversion: 2.1 time: 0.137221 Aug 29 15:38:19.807773 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 82/159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1356 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:19.964639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Action: 'update', calling method: .version_select at 0x7f32ef37d310>, body: {"quota_set": {"ram": "5120"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:20.042998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.043686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.044133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.044872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.045361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.045787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.068187 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8dd2bb0-cfef-4f96-acc1-6d473f2893ad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1641 microversion: 2.1 time: 0.722046 Aug 29 15:38:20.069319 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 78/160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:19 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1641 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:20.128209 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec992041-6ed5-447a-9117-43d1f6f94600 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86" status: 200 len: 148 microversion: 2.57 time: 0.318904 Aug 29 15:38:20.139123 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 83/161] 10.222.0.83 () {62 vars in 1303 bytes} [Mon Aug 29 15:38:19 2022] PUT /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86 => generated 148 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:20.145088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.145600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.152448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.152933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.153550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.154383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.154835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.155271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.184995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:20.235366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15c67902-00ab-425f-9f31-660df9d904af tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.237084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15c67902-00ab-425f-9f31-660df9d904af tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '593ea2cd4b8d4b5084bcb20e951bf615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ff79163aa94ae087ed678244cc7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15c67902-00ab-425f-9f31-660df9d904af tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Request method failure captured: Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1pN4cnO7XWtDRG0Z0Z0GioRqlGM-xM9AgYXXVOTH_Kivqkgw0pZz3XX8Heu3SGS-UgOTNA2taFxiqemXJtgHfUqO4NDjytzXWQJMEFoEdQCQax9c3PPEVv3H4e2V_2dBmtIK-bZfwfTCV924oQqqBpd824E7vtU8ToLXwIhH0PZQQ Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 70ff79163aa94ae087ed678244cc7123 Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:20.238895 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70ff79163aa94ae087ed678244cc7123"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_70ff79163aa94ae087ed678244cc7123", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70ff79163aa94ae087ed678244cc7123"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/70ff79163aa94ae087ed678244cc7123"}]}] Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 70ff79163aa94ae087ed678244cc7123 Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 593ea2cd4b8d4b5084bcb20e951bf615 Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project Aug 29 15:38:20.240286 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: action_args: {} Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:20.241632 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 29 15:38:20.242745 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:20.243698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15c67902-00ab-425f-9f31-660df9d904af tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:20.243698 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15c67902-00ab-425f-9f31-660df9d904af tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] 10.222.0.83 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.169847 Aug 29 15:38:20.245350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 79/162] 10.222.0.83 () {58 vars in 1185 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:20.249932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Calling method '.version_select at 0x7f32ef276c10>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.301590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "compute-rpcapi-router" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:38:20.302058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52fa6880-4620-4ca8-b148-78696d0ba45e tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquired lock "compute-rpcapi-router" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:38:20.304673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.305171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.305575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.306324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.306726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.307538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.316885 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.compute.rpcapi [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 15:38:20.317791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] Releasing lock "compute-rpcapi-router" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:38:20.326720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.327272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.327703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.328571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.329190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.329914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.359848 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5461bfb-f55d-4e49-82b8-b814c606d260 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86/detail" status: 200 len: 463 microversion: 2.57 time: 0.113267 Aug 29 15:38:20.361227 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 80/163] 10.222.0.83 () {60 vars in 1304 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86/detail => generated 463 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:20.366709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1a8b5cc-8afa-4e96-9c50-e37196d49af6 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.368821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d1a8b5cc-8afa-4e96-9c50-e37196d49af6 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '593ea2cd4b8d4b5084bcb20e951bf615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70ff79163aa94ae087ed678244cc7123', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1a8b5cc-8afa-4e96-9c50-e37196d49af6 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Request method failure captured: Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015:38:20 HTTP/1.1 Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1pN4cnO7XWtDRG0Z0Z0GioRqlGM-xM9AgYXXVOTH_Kivqkgw0pZz3XX8Heu3SGS-UgOTNA2taFxiqemXJtgHfUqO4NDjytzXWQJMEFoEdQCQax9c3PPEVv3H4e2V_2dBmtIK-bZfwfTCV924oQqqBpd824E7vtU8ToLXwIhH0PZQQ Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 70ff79163aa94ae087ed678244cc7123 Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:20.370860 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70ff79163aa94ae087ed678244cc7123"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_70ff79163aa94ae087ed678244cc7123", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70ff79163aa94ae087ed678244cc7123"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/70ff79163aa94ae087ed678244cc7123"}]}] Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 70ff79163aa94ae087ed678244cc7123 Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 593ea2cd4b8d4b5084bcb20e951bf615 Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project Aug 29 15:38:20.372102 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '2022-08-29 15:38:20'} Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:20.372654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 29 15:38:20.373736 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:20.374645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1a8b5cc-8afa-4e96-9c50-e37196d49af6 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:20.374645 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1a8b5cc-8afa-4e96-9c50-e37196d49af6 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568 tempest-InstanceUsageAuditLogNegativeTestJSON-408252568-project] 10.222.0.83 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 15:38:20" status: 403 len: 128 microversion: 2.1 time: 0.010483 Aug 29 15:38:20.374645 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 81/164] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015%3A38%3A20 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:20.384742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.385537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.388305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3097a7a4-4846-407e-916f-eabd50e28b8a None None] 10.222.0.83 "DELETE /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 204 len: 0 microversion: 2.1 time: 0.243015 Aug 29 15:38:20.390164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 84/165] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:20 2022] DELETE /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:20.393652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.394338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.395109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.396294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.399326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.400184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.404160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.405639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.415124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.415616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.416051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.418257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.418730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.419221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.618598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.626614 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e20bb8e3-1cb6-44e7-a848-62144960a41f tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1494 microversion: 2.1 time: 0.230130 Aug 29 15:38:20.627220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 85/166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1494 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:20.631846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Action: 'update', calling method: .version_select at 0x7f32ef337940>, body: {"quota_set": {"ram": "2048"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:20.642206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:20.653413 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8de42042-1790-4b97-bbda-f8cd97251e54 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.272627 Aug 29 15:38:20.667460 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 82/167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:20.811621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.812734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.813644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.814532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.815185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.815775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.830463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:20.831401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:20.844018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.844932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.846117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.847918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.848662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.849250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.867352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.868151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.868598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.869324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:20.869782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:20.870201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:20.952899 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0db97fb-7baf-49a5-aff2-67cb5891e389 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86?user_id=4ab9ee1e8d19433ebf9cb952ac4961a9" status: 200 len: 148 microversion: 2.57 time: 0.324542 Aug 29 15:38:20.953808 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 86/168] 10.222.0.83 () {62 vars in 1384 bytes} [Mon Aug 29 15:38:20 2022] PUT /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86?user_id=4ab9ee1e8d19433ebf9cb952ac4961a9 => generated 148 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:20.965160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ed6cd15-08b8-4545-b3d3-0c17ce90f6d7 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] Calling method '.version_select at 0x7f32ef34b040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.052292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:21.065052 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4101c674-102e-4659-a976-598cdb64b372 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1412 microversion: 2.1 time: 0.239404 Aug 29 15:38:21.065873 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 83/169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1412 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:21.161135 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ed6cd15-08b8-4545-b3d3-0c17ce90f6d7 tempest-QuotasAdminTestV257-701022465 tempest-QuotasAdminTestV257-701022465-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86?user_id=4ab9ee1e8d19433ebf9cb952ac4961a9" status: 200 len: 190 microversion: 2.57 time: 0.199684 Aug 29 15:38:21.161717 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 87/170] 10.222.0.83 () {60 vars in 1364 bytes} [Mon Aug 29 15:38:20 2022] GET /compute/v2.1/os-quota-sets/faf537a2aa274e7e92fb1998c7dd1b86?user_id=4ab9ee1e8d19433ebf9cb952ac4961a9 => generated 190 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:21.648695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.649718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:21.656189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.656678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.657118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.657809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.658257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.658839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.676097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:21.676834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:21.690856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.691915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.692598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.696667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:21.697466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:21.698117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:21.936854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:21.947006 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-52babd8b-6cc6-4979-917a-f674d4e4e4d3 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1494 microversion: 2.1 time: 0.302656 Aug 29 15:38:21.948271 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 84/171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:21 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1494 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.089925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.090603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.101520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.101520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.101902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.107505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.108262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.108717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.326202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.337251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eeab6aa3-45cf-4b1c-9a13-8f346d08b658 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.665401 Aug 29 15:38:22.337827 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 88/172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:21 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.344015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-41e14ce1-3285-48fa-b4d2-10c2b3fb4aef req-82f5b9ae-c351-4e97-a50b-2d1d043d1262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180653fe-00d9-440b-b260-5e6c16dbabfb", "tag": "5129e17a-8d35-4a8f-b26c-f8ea560ecc67"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:22.376516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:22.379401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-41e14ce1-3285-48fa-b4d2-10c2b3fb4aef req-82f5b9ae-c351-4e97-a50b-2d1d043d1262 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.388641 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bc176d7c-90ff-4838-80b2-53b479f5aa22 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1412 microversion: 2.1 time: 0.302558 Aug 29 15:38:22.389885 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 85/173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1412 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:22.393606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-41e14ce1-3285-48fa-b4d2-10c2b3fb4aef req-82f5b9ae-c351-4e97-a50b-2d1d043d1262 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.394264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-41e14ce1-3285-48fa-b4d2-10c2b3fb4aef req-82f5b9ae-c351-4e97-a50b-2d1d043d1262 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.423861 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-41e14ce1-3285-48fa-b4d2-10c2b3fb4aef req-82f5b9ae-c351-4e97-a50b-2d1d043d1262 service nova] Creating event network-changed:5129e17a-8d35-4a8f-b26c-f8ea560ecc67 for instance 180653fe-00d9-440b-b260-5e6c16dbabfb on n-h1-836830-13 Aug 29 15:38:22.430637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-41e14ce1-3285-48fa-b4d2-10c2b3fb4aef req-82f5b9ae-c351-4e97-a50b-2d1d043d1262 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090919 Aug 29 15:38:22.431304 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 89/174] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:22.970235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:22.970852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:22.981812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.983331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.983772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:22.984489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:22.984961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:22.985377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.076231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:23.084711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f37ab3ba-7022-47b8-b505-a0e0be4633a1 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1452 microversion: 2.1 time: 0.118566 Aug 29 15:38:23.086470 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 86/175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:22 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:23.365972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:23.367311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:23.374976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.375738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.376371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.377163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.377806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.378423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.430664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c609c830-dc6c-4ff4-885c-5df77d25c062 req-9998dbc7-500f-41f3-b6aa-847c5e95b12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bc46d1-38de-4f9d-9f71-9aed32033b69", "name": "network-vif-deleted", "tag": "37b7433c-1183-449c-adaf-c605cea346d1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:23.442637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c609c830-dc6c-4ff4-885c-5df77d25c062 req-9998dbc7-500f-41f3-b6aa-847c5e95b12a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.443611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c609c830-dc6c-4ff4-885c-5df77d25c062 req-9998dbc7-500f-41f3-b6aa-847c5e95b12a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.444234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c609c830-dc6c-4ff4-885c-5df77d25c062 req-9998dbc7-500f-41f3-b6aa-847c5e95b12a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.455909 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c609c830-dc6c-4ff4-885c-5df77d25c062 req-9998dbc7-500f-41f3-b6aa-847c5e95b12a service nova] Creating event network-vif-deleted:37b7433c-1183-449c-adaf-c605cea346d1 for instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 on n-h1-836830-13 Aug 29 15:38:23.462192 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c609c830-dc6c-4ff4-885c-5df77d25c062 req-9998dbc7-500f-41f3-b6aa-847c5e95b12a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189260 Aug 29 15:38:23.463311 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 90/176] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:23.469802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:23.470735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:23.477097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.477591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.478017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.478693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:23.479690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:23.480349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:23.534609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:23.546460 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1aeeeb40-22e0-4af2-a8b4-1307d89e6162 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.189459 Aug 29 15:38:23.548276 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 87/177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:23 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:23.628732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:23.644637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75d46dcb-6ee6-4c2d-8e43-d8b31a2c359c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1412 microversion: 2.1 time: 0.179184 Aug 29 15:38:23.655394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 91/178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:23 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1412 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.107956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.108572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.115191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.115687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.116128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.116830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.117280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.117862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.159989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.160603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.161349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.161836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lazy-loading 'fault' on Instance uuid 80bc46d1-38de-4f9d-9f71-9aed32033b69 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:24.222312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a726e7ddb8914b72925d217021404000', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09bab46673824d9ba81dc152cc0a3895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.239648 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e096c75-336c-47d2-939a-cbe1f6781bc7 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 200 len: 1329 microversion: 2.1 time: 0.137442 Aug 29 15:38:24.241700 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 88/179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 1329 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.569248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.569795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.575891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.576458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.576956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.577742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.578916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.578916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.668084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:24.669127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:24.679615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.680226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.680751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.681829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:24.682481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:24.683270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:24.818665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.831434 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-99e38fad-38b3-4a6a-8ed8-2df9d8ca0b24 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.266044 Aug 29 15:38:24.832486 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 92/180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:24.852201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:24.862445 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf7b06bc-9ba2-4835-873c-a483aa528b4a tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1412 microversion: 2.1 time: 0.198037 Aug 29 15:38:24.863597 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 89/181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:24 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1412 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:25.264785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.265401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:25.271874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.272593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.273178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.274033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.274642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.275081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.290808 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] HTTP exception thrown: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Request method failure captured: Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 HTTP/1.1 Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1Hk2YUnM_UItYv3-cTVeDN1rvoqO8qvfZanz-wkdtUxwf5CChxGR96U2no52E98zIvC8dmquTmlX6WSxSg5iQwhNAsKiRAeI4BMWaFO6QQ0KyP0EAqcVpQOs9q48FhCSHZUsXnlMFGzC0CMwDcHEKLFjdAiW70RhzyJNK9DHvkWh4 Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 09bab46673824d9ba81dc152cc0a3895 Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:25.293365 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09bab46673824d9ba81dc152cc0a3895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09bab46673824d9ba81dc152cc0a3895", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09bab46673824d9ba81dc152cc0a3895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09bab46673824d9ba81dc152cc0a3895"}]}] Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 09bab46673824d9ba81dc152cc0a3895 Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminTestJSON-1722583686-project Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a726e7ddb8914b72925d217021404000 Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminTestJSON-1722583686-project Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:25.294814 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '80bc46d1-38de-4f9d-9f71-9aed32033b69'} Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:25.295652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:25.296822 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:25.298622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Returning 404 to user: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:25.299734 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b6b134b-c72c-41c2-bb33-1b997b0bb303 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 404 len: 111 microversion: 2.1 time: 0.038907 Aug 29 15:38:25.300712 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 93/182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:25 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:25.309193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d3262a3-b8c9-4b4c-b2ea-fbe2a5642ca1 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:25.320320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3262a3-b8c9-4b4c-b2ea-fbe2a5642ca1 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.320802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3262a3-b8c9-4b4c-b2ea-fbe2a5642ca1 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.321235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3262a3-b8c9-4b4c-b2ea-fbe2a5642ca1 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.462615 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d3262a3-b8c9-4b4c-b2ea-fbe2a5642ca1 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.157279 Aug 29 15:38:25.463435 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 90/183] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:25.483351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f2dffc2d-ab81-4c61-a05c-5a98fa879b13 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:25.534352 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f2dffc2d-ab81-4c61-a05c-5a98fa879b13 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.054375 Aug 29 15:38:25.536964 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 94/184] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:25 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:25.556009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1daee2a6-41b8-4241-8201-81a6ae847631 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-916109489"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:25.559941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-1daee2a6-41b8-4241-8201-81a6ae847631 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid baa8a86d-712c-435f-803c-4b8cb320a158 for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:25.602547 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1daee2a6-41b8-4241-8201-81a6ae847631 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.051227 Aug 29 15:38:25.605014 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 91/185] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:25.617439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d3f73d71-7000-4058-a9a9-3b90eda4b0ba tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:25.638798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3f73d71-7000-4058-a9a9-3b90eda4b0ba tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:25.640425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3f73d71-7000-4058-a9a9-3b90eda4b0ba tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:25.640873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3f73d71-7000-4058-a9a9-3b90eda4b0ba tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:25.918123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-db910d58-9ea3-4b2f-a984-80dbb70b3e0a tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] Action: 'create', calling method: .version_select at 0x7f32ef276af0>, body: {"security_group": {"name": "tempest-securitygroup-635075320", "description": "tempest-description-742398202"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:26.069490 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d3f73d71-7000-4058-a9a9-3b90eda4b0ba tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.456981 Aug 29 15:38:26.071493 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 95/186] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:25 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:26.078147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.078846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.086786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.087518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.088225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.088614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.089054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.089481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.249076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:26.259017 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c81ae87-e1c4-4778-bfd6-491d7e1483fb tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.186482 Aug 29 15:38:26.259017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 96/187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:26.263767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.264391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:26.270638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.271173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.272362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.273165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.273773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.274026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.293608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:26.450546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:26.459935 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef39889a-36c8-424a-8ae1-62581bd1025e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1390 microversion: 2.1 time: 0.199333 Aug 29 15:38:26.460524 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 97/188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:26.466321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b253df8-bd50-4602-a28c-de427f49b97a tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.482970 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b253df8-bd50-4602-a28c-de427f49b97a tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.019947 Aug 29 15:38:26.484275 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 98/189] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:38:26 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:26.503080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2229d2b4-c090-4d9b-9851-71903559658e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:26.529996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2229d2b4-c090-4d9b-9851-71903559658e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:26.529996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2229d2b4-c090-4d9b-9851-71903559658e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:26.532799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2229d2b4-c090-4d9b-9851-71903559658e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:26.754238 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-db910d58-9ea3-4b2f-a984-80dbb70b3e0a tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.116598 Aug 29 15:38:26.756112 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 92/190] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:38:25 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:26.770151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-34e3d59f-612f-4fb5-8482-d1ae68cbc5e4 tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] Action: 'create', calling method: .version_select at 0x7f32ef1d3ee0>, body: {"security_group": {"name": "tempest-securitygroup-1524758396", "description": "tempest-description-131076428"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:26.804498 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2229d2b4-c090-4d9b-9851-71903559658e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.309528 Aug 29 15:38:26.807825 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 99/191] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:26 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:26.820167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f880d55c-cafe-4cf2-9436-a688e114f0a6 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:26.840775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:26.861011 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f880d55c-cafe-4cf2-9436-a688e114f0a6 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.045247 Aug 29 15:38:26.861639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 100/192] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:26 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:26.916901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-292461eb-7eba-4aa5-9f03-b2617ace7bda tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1179740774"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:26.925018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-292461eb-7eba-4aa5-9f03-b2617ace7bda tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid 23a2e9d8-71d4-42d5-9c5a-e62c50f9030f for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:26.992310 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-292461eb-7eba-4aa5-9f03-b2617ace7bda tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.118077 Aug 29 15:38:26.994218 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 101/193] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:27.008632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b7b6571-bcd3-476e-877c-ab3e15729548 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:27.049437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7b6571-bcd3-476e-877c-ab3e15729548 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.050198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7b6571-bcd3-476e-877c-ab3e15729548 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.051240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7b6571-bcd3-476e-877c-ab3e15729548 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.237575 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b7b6571-bcd3-476e-877c-ab3e15729548 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.236553 Aug 29 15:38:27.238181 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 102/194] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:26 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:27.249306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7a7a79c-c45d-49c8-ba41-4d9e0c02e800 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.259967 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7a7a79c-c45d-49c8-ba41-4d9e0c02e800 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.014068 Aug 29 15:38:27.260436 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 103/195] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:27.272764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca47e681-d5ed-420c-a553-9b562c58e2b5 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:27.293400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca47e681-d5ed-420c-a553-9b562c58e2b5 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.293949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca47e681-d5ed-420c-a553-9b562c58e2b5 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.294700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca47e681-d5ed-420c-a553-9b562c58e2b5 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.394512 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-34e3d59f-612f-4fb5-8482-d1ae68cbc5e4 tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.629159 Aug 29 15:38:27.395363 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 93/196] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:38:26 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:27.411111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:27.412407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:27.421238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.422015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.422641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.423573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:27.424266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:27.425095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:27.442251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca47e681-d5ed-420c-a553-9b562c58e2b5 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.173723 Aug 29 15:38:27.442850 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 104/197] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:27 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:27.555706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05c64606-8ed4-40bf-af5a-7e21678e4a12 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] Action: 'create', calling method: .version_select at 0x7f32ef208550>, body: {"security_group": {"name": "tempest-securitygroup-810290277", "description": "tempest-description-1066015571"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:27.954402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:27.967855 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0c20d98-5cde-4765-b438-a4e813026789 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.561845 Aug 29 15:38:27.968439 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 94/198] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:27 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:27.973076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be67f3ce-f1fc-4f0d-b3ab-07e805195f2a tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.028267 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be67f3ce-f1fc-4f0d-b3ab-07e805195f2a tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.058543 Aug 29 15:38:28.029110 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 95/199] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:27 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:28.042678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.045670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:28.059396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.061529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.062175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.063097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.063275 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05c64606-8ed4-40bf-af5a-7e21678e4a12 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.618146 Aug 29 15:38:28.063795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.064711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.065824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 105/200] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:38:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:28.071810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-44568173-a4b6-43d0-ae72-badfba0c1e4c tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-72994464"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.076878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-44568173-a4b6-43d0-ae72-badfba0c1e4c tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid 53167544-5243-4a9d-8231-cf19b6d5aa5f for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:28.125959 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-44568173-a4b6-43d0-ae72-badfba0c1e4c tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.057691 Aug 29 15:38:28.126993 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 106/201] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:28 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:28.143277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11065777-07b2-497e-a46e-4027cf1111e7 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] Action: 'create', calling method: .version_select at 0x7f32ef208310>, body: {"security_group": {"name": "tempest-securitygroup-84124621", "description": "tempest-description-1186484996"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.436695 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11065777-07b2-497e-a46e-4027cf1111e7 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.301669 Aug 29 15:38:28.438036 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 107/202] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:38:28 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:28.444392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9aff35fe-334e-48be-971d-b0b66c4b6d2f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.481019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aff35fe-334e-48be-971d-b0b66c4b6d2f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.483382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aff35fe-334e-48be-971d-b0b66c4b6d2f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.485225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aff35fe-334e-48be-971d-b0b66c4b6d2f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.668384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:28.670284 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9aff35fe-334e-48be-971d-b0b66c4b6d2f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.230969 Aug 29 15:38:28.681218 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 108/203] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:28.686914 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a054ca4-109d-4ffe-a7f5-fbb742b34696 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1390 microversion: 2.1 time: 0.655177 Aug 29 15:38:28.687732 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 96/204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:28 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1390 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:28.692488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a0f1df1-dade-4fc5-a2ee-afa65b210026 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] Calling method '.version_select at 0x7f32ef1b6e50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.694230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e312502a-df39-4db2-ab0f-5df01ce98b8d req-275c431e-1ce9-40ba-98be-dd5b125bf4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180653fe-00d9-440b-b260-5e6c16dbabfb", "name": "network-vif-plugged", "status": "completed", "tag": "5129e17a-8d35-4a8f-b26c-f8ea560ecc67"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.710173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e312502a-df39-4db2-ab0f-5df01ce98b8d req-275c431e-1ce9-40ba-98be-dd5b125bf4cd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.711198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e312502a-df39-4db2-ab0f-5df01ce98b8d req-275c431e-1ce9-40ba-98be-dd5b125bf4cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.712909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e312502a-df39-4db2-ab0f-5df01ce98b8d req-275c431e-1ce9-40ba-98be-dd5b125bf4cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.728920 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e312502a-df39-4db2-ab0f-5df01ce98b8d req-275c431e-1ce9-40ba-98be-dd5b125bf4cd service nova] Creating event network-vif-plugged:5129e17a-8d35-4a8f-b26c-f8ea560ecc67 for instance 180653fe-00d9-440b-b260-5e6c16dbabfb on n-h1-836830-13 Aug 29 15:38:28.734786 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e312502a-df39-4db2-ab0f-5df01ce98b8d req-275c431e-1ce9-40ba-98be-dd5b125bf4cd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045414 Aug 29 15:38:28.735743 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 97/205] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:28.742767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cde24db7-239b-4337-8134-fa6ad6c652d2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.754037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cde24db7-239b-4337-8134-fa6ad6c652d2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:28.754877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cde24db7-239b-4337-8134-fa6ad6c652d2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:28.755443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cde24db7-239b-4337-8134-fa6ad6c652d2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:28.919708 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cde24db7-239b-4337-8134-fa6ad6c652d2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 225 microversion: 2.1 time: 0.182338 Aug 29 15:38:28.928675 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 98/206] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:28 2022] POST /compute/v2.1/os-aggregates/4/action => generated 225 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:28.934140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9ccebffe-8de0-4b14-b911-56813c480c7f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:28.957135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9ccebffe-8de0-4b14-b911-56813c480c7f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.026799 Aug 29 15:38:28.958488 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 99/207] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:28 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:28.970978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f683116b-0e21-4ebc-91af-febc7debe1b2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-917279212"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:28.975604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-f683116b-0e21-4ebc-91af-febc7debe1b2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid 1908f770-3d1d-4945-be1a-ce38001280aa for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:29.167398 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f683116b-0e21-4ebc-91af-febc7debe1b2 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.202550 Aug 29 15:38:29.175166 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 100/208] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:29.181453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.182458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.188777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.189255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.189862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.190555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.190997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.191428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.542439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:29.550690 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8a2bebe-be0f-47c5-977e-0cb8f62963e9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.374090 Aug 29 15:38:29.558356 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 101/209] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:29.563318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8ede203-f9e1-4743-9075-da409fc5ccc2 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-906803119"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:29.569123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-e8ede203-f9e1-4743-9075-da409fc5ccc2 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Generated uuid 025d1eb0-fe25-4a34-906c-83299777bac0 for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:29.600475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:29.619416 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8ede203-f9e1-4743-9075-da409fc5ccc2 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.059621 Aug 29 15:38:29.620185 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 102/210] 10.222.0.83 () {62 vars in 1205 bytes} [Mon Aug 29 15:38:29 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:29.639755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-094191b0-35fb-4247-9e2b-f6a0e371671b req-6f110794-cdfa-476f-989f-efceb022e29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435ef7a8-2d60-4197-b170-d21eed31ad11", "tag": "18eb5aa9-11f9-4a87-847f-fba3665412ca"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:29.660942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-094191b0-35fb-4247-9e2b-f6a0e371671b req-6f110794-cdfa-476f-989f-efceb022e29a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.662606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-094191b0-35fb-4247-9e2b-f6a0e371671b req-6f110794-cdfa-476f-989f-efceb022e29a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.663334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-094191b0-35fb-4247-9e2b-f6a0e371671b req-6f110794-cdfa-476f-989f-efceb022e29a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.674766 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-094191b0-35fb-4247-9e2b-f6a0e371671b req-6f110794-cdfa-476f-989f-efceb022e29a service nova] Creating event network-changed:18eb5aa9-11f9-4a87-847f-fba3665412ca for instance 435ef7a8-2d60-4197-b170-d21eed31ad11 on n-h2-836830-13 Aug 29 15:38:29.680905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-094191b0-35fb-4247-9e2b-f6a0e371671b req-6f110794-cdfa-476f-989f-efceb022e29a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053023 Aug 29 15:38:29.682033 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 103/211] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:29.687723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c9a7e26-c4e9-4d03-81d9-77d09d96ca30 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.721284 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1c9a7e26-c4e9-4d03-81d9-77d09d96ca30 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.037713 Aug 29 15:38:29.722217 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 104/212] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:29 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:29.729660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bdf5d560-e815-40a8-8da6-98848868910d tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1257644207"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:29.855153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bdf5d560-e815-40a8-8da6-98848868910d tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.131367 Aug 29 15:38:29.856035 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 105/213] 10.222.0.83 () {62 vars in 1210 bytes} [Mon Aug 29 15:38:29 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:29.861529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:29.862898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:29.871341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.872209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.872811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:29.873850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:29.874391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:29.874823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.233451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:30.236701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:30.259808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18f7d313-b989-4dc0-af5f-5c128747aded tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1390 microversion: 2.1 time: 0.402079 Aug 29 15:38:30.261203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 106/214] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:29 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1390 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:30.268977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ecc54157-06c1-49c2-913d-51e5adcc7fbb tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.279983 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ecc54157-06c1-49c2-913d-51e5adcc7fbb tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ecc54157-06c1-49c2-913d-51e5adcc7fbb tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Request method failure captured: Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1Jo1D-n7sqDoWx9DDFAXy0KkG59dCEn4eCgpkO51YBRymDqJZ5hmVEFyxQrU9bQsk58F6UaKV3ZeoUYN6vtskHbxdQEOUgXXLlTgpWow3-1m1QJCzSJW2QrJmaJ2I_vVbVFeEpIAduj744j90TaFTtRsMrB6tX64pmdZFksrla-Uo Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:30.282628 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ad02710a3a7e4eb59b295ba888a328a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ad02710a3a7e4eb59b295ba888a328a4"}]}] Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 07cc2434228943d5b28b74e9423429e4 Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: exception: Aggregate 5 could not be found. Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '5'} Aug 29 15:38:30.284026 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.284877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 29 15:38:30.286245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.289388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ecc54157-06c1-49c2-913d-51e5adcc7fbb tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:30.290481 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ecc54157-06c1-49c2-913d-51e5adcc7fbb tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.026343 Aug 29 15:38:30.291688 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 107/215] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:30.297264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b72b9a6-273e-47f1-b664-2a663712e2c6 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.307614 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b72b9a6-273e-47f1-b664-2a663712e2c6 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.014576 Aug 29 15:38:30.316410 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 108/216] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:30.322375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69f84f88-a98c-4e21-9ce9-91bfff251abe tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.326280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:30.337228 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a0f1df1-dade-4fc5-a2ee-afa65b210026 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] 10.222.0.83 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8994 microversion: 2.1 time: 1.652509 Aug 29 15:38:30.337940 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 109/217] 10.222.0.83 () {58 vars in 1191 bytes} [Mon Aug 29 15:38:28 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8994 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:30.338867 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-69f84f88-a98c-4e21-9ce9-91bfff251abe tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69f84f88-a98c-4e21-9ce9-91bfff251abe tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Request method failure captured: Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1Jo1D-n7sqDoWx9DDFAXy0KkG59dCEn4eCgpkO51YBRymDqJZ5hmVEFyxQrU9bQsk58F6UaKV3ZeoUYN6vtskHbxdQEOUgXXLlTgpWow3-1m1QJCzSJW2QrJmaJ2I_vVbVFeEpIAduj744j90TaFTtRsMrB6tX64pmdZFksrla-Uo Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:30.342293 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ad02710a3a7e4eb59b295ba888a328a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ad02710a3a7e4eb59b295ba888a328a4"}]}] Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 07cc2434228943d5b28b74e9423429e4 Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: exception: Aggregate 5 could not be found. Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '5'} Aug 29 15:38:30.343780 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:30.344480 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.345510 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:30.346584 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:30.346584 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:30.346584 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:30.346584 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 29 15:38:30.346584 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.348738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69f84f88-a98c-4e21-9ce9-91bfff251abe tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:30.350578 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69f84f88-a98c-4e21-9ce9-91bfff251abe tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.032380 Aug 29 15:38:30.351790 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 109/218] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:30 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:30.353163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ad7de257-83e2-4cf4-8451-559a3c5e09f0 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:30.357409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:30.361935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a51233f-a617-4e09-be58-8cf6da692e6e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-866981038", "name": "tempest-test_aggregate-18523872"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:30.366637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-8a51233f-a617-4e09-be58-8cf6da692e6e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid a80bf7da-078f-4296-84e4-f84d7e0b060a for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:30.373585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad7de257-83e2-4cf4-8451-559a3c5e09f0 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.375101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad7de257-83e2-4cf4-8451-559a3c5e09f0 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.375620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad7de257-83e2-4cf4-8451-559a3c5e09f0 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.405321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a51233f-a617-4e09-be58-8cf6da692e6e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.048538 Aug 29 15:38:30.408506 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 110/219] 10.222.0.83 () {60 vars in 1165 bytes} [Mon Aug 29 15:38:30 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:30.416642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ac4cc2a-fe62-47b1-9aba-8629ed54c2dc tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] Calling method '.version_select at 0x7f32ef54daf0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.544847 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ad7de257-83e2-4cf4-8451-559a3c5e09f0 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.41 time: 0.195530 Aug 29 15:38:30.545710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 110/220] 10.222.0.83 () {62 vars in 1232 bytes} [Mon Aug 29 15:38:30 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:30.550337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76890582-c8b8-44b7-ad5c-0d92053e4904 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.580346 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76890582-c8b8-44b7-ad5c-0d92053e4904 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.033103 Aug 29 15:38:30.581462 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 111/221] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:30 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:30.589605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-941af527-b4bc-4626-82bf-15a8bc256dd7 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:30.602576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-941af527-b4bc-4626-82bf-15a8bc256dd7 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.603431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-941af527-b4bc-4626-82bf-15a8bc256dd7 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.604019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-941af527-b4bc-4626-82bf-15a8bc256dd7 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.750229 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-941af527-b4bc-4626-82bf-15a8bc256dd7 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.167211 Aug 29 15:38:30.758069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 112/222] 10.222.0.83 () {62 vars in 1232 bytes} [Mon Aug 29 15:38:30 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:38:30.765854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.766708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:30.773538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.774016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.774444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.775170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:30.775618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:30.776034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:30.781701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ac4cc2a-fe62-47b1-9aba-8629ed54c2dc tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.371341 Aug 29 15:38:30.794083 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 111/223] 10.222.0.83 () {58 vars in 1191 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:30.798809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbda18a8-5d83-4708-a49d-38e1712e6a54 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.807420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-bbda18a8-5d83-4708-a49d-38e1712e6a54 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbda18a8-5d83-4708-a49d-38e1712e6a54 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Request method failure captured: Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1Jo1D-n7sqDoWx9DDFAXy0KkG59dCEn4eCgpkO51YBRymDqJZ5hmVEFyxQrU9bQsk58F6UaKV3ZeoUYN6vtskHbxdQEOUgXXLlTgpWow3-1m1QJCzSJW2QrJmaJ2I_vVbVFeEpIAduj744j90TaFTtRsMrB6tX64pmdZFksrla-Uo Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:30.809024 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ad02710a3a7e4eb59b295ba888a328a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ad02710a3a7e4eb59b295ba888a328a4"}]}] Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 07cc2434228943d5b28b74e9423429e4 Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: exception: Aggregate 7 could not be found. Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7'} Aug 29 15:38:30.810375 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.811167 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 29 15:38:30.812287 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:30.813392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbda18a8-5d83-4708-a49d-38e1712e6a54 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:30.813392 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbda18a8-5d83-4708-a49d-38e1712e6a54 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.015296 Aug 29 15:38:30.815327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 112/224] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:30.820249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5e1f5eb-33d7-4874-adb5-7edce799eb78 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.853731 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5e1f5eb-33d7-4874-adb5-7edce799eb78 tempest-AggregatesAdminTestV241-1576974807 tempest-AggregatesAdminTestV241-1576974807-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.037300 Aug 29 15:38:30.856005 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 113/225] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 15:38:30 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:30.873151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cd9b10a8-47b1-4570-8ba3-6be4eefffd67 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] Calling method '.version_select at 0x7f32ef3bcaf0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:30.882309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=13 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:30.955114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:30.965290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c5a84fe-11f5-43d9-9487-853fb3eb670c tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.210172 Aug 29 15:38:30.966443 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 113/226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:30 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:30.985939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53523bbd-7ea8-4d83-957f-50f1ae4e888e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.002774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-53523bbd-7ea8-4d83-957f-50f1ae4e888e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53523bbd-7ea8-4d83-957f-50f1ae4e888e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Request method failure captured: Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1Jo1D-n7sqDoWx9DDFAXy0KkG59dCEn4eCgpkO51YBRymDqJZ5hmVEFyxQrU9bQsk58F6UaKV3ZeoUYN6vtskHbxdQEOUgXXLlTgpWow3-1m1QJCzSJW2QrJmaJ2I_vVbVFeEpIAduj744j90TaFTtRsMrB6tX64pmdZFksrla-Uo Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:31.005276 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ad02710a3a7e4eb59b295ba888a328a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ad02710a3a7e4eb59b295ba888a328a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ad02710a3a7e4eb59b295ba888a328a4"}]}] Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: ad02710a3a7e4eb59b295ba888a328a4 Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1292138892 Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 07cc2434228943d5b28b74e9423429e4 Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminTestJSON-1292138892-project-admin Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: exception: Aggregate 7 could not be found. Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '7'} Aug 29 15:38:31.006739 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:31.007612 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.008825 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53523bbd-7ea8-4d83-957f-50f1ae4e888e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53523bbd-7ea8-4d83-957f-50f1ae4e888e tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.025957 Aug 29 15:38:31.010301 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 114/227] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:30 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:31.038602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5c0ce17-3741-4a07-82b8-092da00016e3 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1158709408"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:31.052105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-e5c0ce17-3741-4a07-82b8-092da00016e3 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid 6e5f6caf-7927-43a9-86e6-b114dc363274 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:31.109381 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e5c0ce17-3741-4a07-82b8-092da00016e3 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100202 Aug 29 15:38:31.110277 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 115/228] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:31.115537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e70dcd5d-cc4e-4e7a-9cf3-c6435e6adef0 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1903812846"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:31.124002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-e70dcd5d-cc4e-4e7a-9cf3-c6435e6adef0 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid 858ddbec-6975-4a5d-a9e4-898a67a2bddf for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:31.152296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e70dcd5d-cc4e-4e7a-9cf3-c6435e6adef0 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040621 Aug 29 15:38:31.153208 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 116/229] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:31.158503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0879befb-7d2b-49ed-be37-75c538c4bc00 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:31.165143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=61,nova_cell0:UPDATE=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:31.179282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0879befb-7d2b-49ed-be37-75c538c4bc00 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.179981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0879befb-7d2b-49ed-be37-75c538c4bc00 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.180658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0879befb-7d2b-49ed-be37-75c538c4bc00 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.363345 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0879befb-7d2b-49ed-be37-75c538c4bc00 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 243 microversion: 2.1 time: 0.207296 Aug 29 15:38:31.365482 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 117/230] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:31 2022] POST /compute/v2.1/os-aggregates/8/action => generated 243 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:31.378437 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cd9b10a8-47b1-4570-8ba3-6be4eefffd67 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/9d9055c1-ce9b-4eb8-b785-bef09d9fd693" status: 202 len: 0 microversion: 2.1 time: 0.521203 Aug 29 15:38:31.381470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d088b18-ffa3-45dc-b61d-3b08f121183f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.383581 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 114/231] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:38:30 2022] DELETE /compute/v2.1/os-security-groups/9d9055c1-ce9b-4eb8-b785-bef09d9fd693 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:31.388489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.389094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:31.399122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.402045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.404774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.408909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.409731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.410315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.413064 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d088b18-ffa3-45dc-b61d-3b08f121183f tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.042248 Aug 29 15:38:31.417134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 118/232] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:31.426879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:31.442857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.445959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.447374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:31.506903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] HTTP exception thrown: Aggregate 8 already has host n-h1-836830-13. Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 40 Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:31.531589 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: {"add_host": {"host": "n-h1-836830-13"}} Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:31.533089 n-d-836830-13 devstack@n-api.service[129133]: exception: Aggregate 8 already has host n-h1-836830-13. Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-836830-13'}}} Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:38:31.534018 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-836830-13-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:38:31.535479 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:38:31.540866 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:38:31.542180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-836830-13-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 38, 31, 485521), 'updated_at': None, 'host': 'n-h1-836830-13', 'aggregate_id': 8}] Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.543219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 8 already has host n-h1-836830-13. Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.544187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 8 already has host n-h1-836830-13. Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:31.545407 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:31.546961 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 already has host n-h1-836830-13. Aug 29 15:38:31.546961 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:31.546961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 409 to user: Aggregate 8 already has host n-h1-836830-13. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:31.546961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c7061fb-6504-45bf-b16e-ae81838ad8a2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/8/action" status: 409 len: 96 microversion: 2.1 time: 0.117145 Aug 29 15:38:31.546961 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 119/233] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:31 2022] POST /compute/v2.1/os-aggregates/8/action => generated 96 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 29 15:38:31.546961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fa7b9189-60f9-48ae-a24e-39a9a47674b6 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] Calling method '.version_select at 0x7f32eef84f70>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:31.867117 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fa7b9189-60f9-48ae-a24e-39a9a47674b6 tempest-SecurityGroupsTestAdminJSON-7193982 tempest-SecurityGroupsTestAdminJSON-7193982-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/3ec8f311-3c63-4ea8-b4ca-279d21555ae3" status: 202 len: 0 microversion: 2.1 time: 0.329053 Aug 29 15:38:31.868178 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 120/234] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:38:31 2022] DELETE /compute/v2.1/os-security-groups/3ec8f311-3c63-4ea8-b4ca-279d21555ae3 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:31.873752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3452602-dea2-46d1-85fa-e67c255d448c tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:31.938843 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3452602-dea2-46d1-85fa-e67c255d448c tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.068948 Aug 29 15:38:31.940736 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 121/235] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:31 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:31.946733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce59aaac-b549-499a-95c6-02dad2491307 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:31.971989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce59aaac-b549-499a-95c6-02dad2491307 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:31.973189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce59aaac-b549-499a-95c6-02dad2491307 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:31.973736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce59aaac-b549-499a-95c6-02dad2491307 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.149692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.159329 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbd4c4b1-e817-45d5-8ed8-699a0d728d84 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1590 microversion: 2.1 time: 0.774563 Aug 29 15:38:32.163093 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 115/236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:31 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1590 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:32.179661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e575eec6-4215-42d5-b1c9-dd2b05e101e2 tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] Calling method '.version_select at 0x7f32ef248820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.361046 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce59aaac-b549-499a-95c6-02dad2491307 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.419417 Aug 29 15:38:32.361953 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 122/237] 10.222.0.83 () {60 vars in 1191 bytes} [Mon Aug 29 15:38:31 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:32.368695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5306b7f4-1981-4273-a389-c4140d38d882 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.381406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5306b7f4-1981-4273-a389-c4140d38d882 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.017371 Aug 29 15:38:32.389451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 123/238] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:32.399276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.400379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.406446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:32.408565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.409065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.410254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.410975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.411570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.412164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.592580 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e575eec6-4215-42d5-b1c9-dd2b05e101e2 tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/8745629d-13a8-471b-8e15-f52e4ed9f8a9" status: 202 len: 0 microversion: 2.1 time: 0.428314 Aug 29 15:38:32.593757 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 116/239] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:38:32 2022] DELETE /compute/v2.1/os-security-groups/8745629d-13a8-471b-8e15-f52e4ed9f8a9 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:32.599634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.600746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:32.623116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.623754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.624382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.625302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:32.625829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:32.626261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:32.793751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4dc5d35a-c7ab-4916-a053-d6409716007f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198559 Aug 29 15:38:32.794339 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 117/240] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:32.799104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e4bc317f-4823-4824-bbb6-ff12888bd1f0 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.829218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e4bc317f-4823-4824-bbb6-ff12888bd1f0 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.033276 Aug 29 15:38:32.829806 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 118/241] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:32 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:32.834623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6c77508e-dcc6-478d-8c96-1fcb16e5e6e8 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.885169 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6c77508e-dcc6-478d-8c96-1fcb16e5e6e8 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.054061 Aug 29 15:38:32.890370 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 119/242] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:32 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:32.895242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-64002fb9-7f55-4164-bbdb-963d75835919 tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] Calling method '.version_select at 0x7f32ef276790>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:32.978802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:32.993037 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fbe3822d-cd3c-4314-8244-e8bf46ce5804 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.598986 Aug 29 15:38:33.007177 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 124/243] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:32 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:33.018446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8320ebe8-b321-4aa8-8b1b-b2ab2f74897a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1485130185"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:33.029155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-8320ebe8-b321-4aa8-8b1b-b2ab2f74897a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid 859363c4-1687-4e76-a81f-04e7bd589b14 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:33.072943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8320ebe8-b321-4aa8-8b1b-b2ab2f74897a tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065068 Aug 29 15:38:33.076409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 125/244] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:33.083470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32eef94280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.088041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.088831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.090485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.093192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.095532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.096298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.184081 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1fabc810-23bd-4322-8c3f-137cf07d65b4 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.106261 Aug 29 15:38:33.185644 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 126/245] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:33.205098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5479b7dd-24c8-484f-813c-f19986fd6368 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1986231074", "availability_zone": "tempest-test_az-1346136975"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:33.257771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-5479b7dd-24c8-484f-813c-f19986fd6368 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid c616378a-ca40-4e78-b02a-6553817ea4a6 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:33.313770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5479b7dd-24c8-484f-813c-f19986fd6368 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.115283 Aug 29 15:38:33.316254 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 127/246] 10.222.0.83 () {60 vars in 1165 bytes} [Mon Aug 29 15:38:33 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:33.598121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7bc4828a-1c19-4aa6-a08c-f86f32678002 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:33.605148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7bc4828a-1c19-4aa6-a08c-f86f32678002 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c90a7444d98e4f45a03053fd032694db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b84eca3324578bdefd2847fa23158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7bc4828a-1c19-4aa6-a08c-f86f32678002 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Request method failure captured: Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 40 Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1JtmiZ32XPxyXqtX1HtyMPCRD9hGeMrpzfiSYSptvrUXRkDH5TNuHRTL7Iu8EFK5cUDWB6ih-HtXEYskiUsurgjJxrAdzByqMkZo0lIZKMgHYYW2b1ybsA5x72tBVAwVLYv5QAYH2ld4YiakIL0r5Bw4MlxZBPvibuXiRrjWIh8Ts Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:33.606806 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a63b84eca3324578bdefd2847fa23158", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a63b84eca3324578bdefd2847fa23158"}]}] Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c90a7444d98e4f45a03053fd032694db Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: {"add_host": {"host": "n-h1-836830-13"}} Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:33.608348 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h1-836830-13'}}} Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:33.609177 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 29 15:38:33.610378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:33.611762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7bc4828a-1c19-4aa6-a08c-f86f32678002 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:33.611762 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7bc4828a-1c19-4aa6-a08c-f86f32678002 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] 10.222.0.83 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.290997 Aug 29 15:38:33.611762 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 128/247] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 15:38:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:33.620158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32ef23a670>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.624293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.624934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.625764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.626642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.627568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.628270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.659174 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-34d3ede7-9787-4602-800b-291f4ffe083a tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.048239 Aug 29 15:38:33.660352 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 129/248] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:33.667360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d49f4cc1-a55a-42c8-bbc9-3117a9c3bf20 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1986231074_new", "availability_zone": "tempest-test_az-1346136975_new"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:33.838739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d49f4cc1-a55a-42c8-bbc9-3117a9c3bf20 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.840300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d49f4cc1-a55a-42c8-bbc9-3117a9c3bf20 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.841043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d49f4cc1-a55a-42c8-bbc9-3117a9c3bf20 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.902629 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-64002fb9-7f55-4164-bbdb-963d75835919 tempest-SecurityGroupsTestAdminJSON-1209287721 tempest-SecurityGroupsTestAdminJSON-1209287721-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/16957163-cfa2-4722-ae4d-c7d4e394a48c" status: 202 len: 0 microversion: 2.1 time: 1.012756 Aug 29 15:38:33.907147 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 120/249] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:38:32 2022] DELETE /compute/v2.1/os-security-groups/16957163-cfa2-4722-ae4d-c7d4e394a48c => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:33.908335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2741dab6-6f22-41f3-a69e-dcb2d39ee6d9 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.935970 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d49f4cc1-a55a-42c8-bbc9-3117a9c3bf20 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 337 microversion: 2.1 time: 0.272104 Aug 29 15:38:33.938872 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 130/250] 10.222.0.83 () {60 vars in 1173 bytes} [Mon Aug 29 15:38:33 2022] PUT /compute/v2.1/os-aggregates/11 => generated 337 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:33.949684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32f09fdee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.954352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.954998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.958678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2741dab6-6f22-41f3-a69e-dcb2d39ee6d9 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.053849 Aug 29 15:38:33.963510 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 121/251] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:33 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:33.963655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.964600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:33.965183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:33.965666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe6cff8b-160a-4467-99a5-8b00276215c3 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:33.977950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:33.988356 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe6cff8b-160a-4467-99a5-8b00276215c3 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.026821 Aug 29 15:38:33.992570 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 122/252] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.003080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6cd2eff-1be0-4673-9bd3-f29c3558b6e2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1679966765"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.011826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-d6cd2eff-1be0-4673-9bd3-f29c3558b6e2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid 87e2a0b6-d995-4a34-825b-ebd076f63cd4 for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:34.029884 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4fbb89bb-dbf9-4840-b72c-4fbf8bfe2f06 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.088369 Aug 29 15:38:34.030698 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 131/253] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:38:33 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.047037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ada9a798-d8f0-4310-afde-2b44b4900142 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.057352 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6cd2eff-1be0-4673-9bd3-f29c3558b6e2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063619 Aug 29 15:38:34.064491 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 123/254] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.071411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.073647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.098802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.100638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.102653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.105461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.109792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.110978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.118302 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ada9a798-d8f0-4310-afde-2b44b4900142 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.079072 Aug 29 15:38:34.125164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 132/255] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:34 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:34.136779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32ef23af70>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.156273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.160824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.161403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.197254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.199430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.199968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.282541 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-076b375e-6374-41f3-8d83-3bf9d4175881 tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts/n-h1-836830-13" status: 200 len: 471 microversion: 2.1 time: 0.155811 Aug 29 15:38:34.284372 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 133/256] 10.222.0.83 () {58 vars in 1173 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/os-hosts/n-h1-836830-13 => generated 471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.299834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2059326287"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.327312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.327813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.328302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.350045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.351064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.351504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.362792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2059326287 could not be found. Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 58 Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:34.365734 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: {"add_host": {"host": "tempest-nonexist_host-2059326287"}} Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:34.367502 n-d-836830-13 devstack@n-api.service[129133]: exception: Compute host tempest-nonexist_host-2059326287 could not be found. Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-2059326287'}}} Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2059326287' is not mapped to any cell Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.368339 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 29 15:38:34.369527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2059326287 could not be found. Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2059326287 could not be found. Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.370854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2059326287 could not be found. Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2059326287 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-733ecfc6-3e4a-44e9-af8c-2a4eca87745f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.085478 Aug 29 15:38:34.372156 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 134/257] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 15:38:34 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:34.389502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12233314-42d1-4f22-aff3-7d15e185115d tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-636782497"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.395173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-12233314-42d1-4f22-aff3-7d15e185115d tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Generated uuid 6818790f-56bf-4d3a-84d4-7f6f111a8310 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:34.431721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-12233314-42d1-4f22-aff3-7d15e185115d tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058196 Aug 29 15:38:34.441427 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 135/258] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.446678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Calling method '.version_select at 0x7f32eef94d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.456103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.456594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.457022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.471496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.472239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.473141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.494180 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ee581e09-4588-4964-84ff-cfcfb2f8c3ba tempest-HostsAdminTestJSON-1247978946 tempest-HostsAdminTestJSON-1247978946-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hosts/n-h2-836830-13" status: 200 len: 471 microversion: 2.1 time: 0.051578 Aug 29 15:38:34.501513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 136/259] 10.222.0.83 () {58 vars in 1173 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/os-hosts/n-h2-836830-13 => generated 471 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.513160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dabc696a-d0bc-4ece-a7e9-9a540583ceba tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.560246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dabc696a-d0bc-4ece-a7e9-9a540583ceba tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.059937 Aug 29 15:38:34.562172 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 137/260] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:34 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:34.574393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-088b673b-f40d-4587-84dd-0d72226b7ad1 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.602466 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-088b673b-f40d-4587-84dd-0d72226b7ad1 tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.031940 Aug 29 15:38:34.603461 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 138/261] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.608119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c09914b-48a1-4335-9382-a14cf7ef39c1 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c09914b-48a1-4335-9382-a14cf7ef39c1 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 283 Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:34.619984 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.621500 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:34.622173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.622845 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.625253 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.626236 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:34.626236 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:34.626236 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:38:34.626236 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.626236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c09914b-48a1-4335-9382-a14cf7ef39c1 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.626609 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c09914b-48a1-4335-9382-a14cf7ef39c1 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.017012 Aug 29 15:38:34.626609 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 139/262] 10.222.0.83 () {60 vars in 1165 bytes} [Mon Aug 29 15:38:34 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:34.642939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ea820c1-bba8-4166-9a0f-c1497b918fad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.689894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ea820c1-bba8-4166-9a0f-c1497b918fad tempest-AggregatesAdminTestJSON-1292138892 tempest-AggregatesAdminTestJSON-1292138892-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.066618 Aug 29 15:38:34.694363 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 140/263] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:34 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:34.695245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8798b950-6eb0-45b1-afec-e9fa821cb8a5 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8798b950-6eb0-45b1-afec-e9fa821cb8a5 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 27 Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:34.698795 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: {"aggregate": {"name": ""}} Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:34.700003 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi '' Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.700770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:38:34.702024 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.711559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8798b950-6eb0-45b1-afec-e9fa821cb8a5 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.712474 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8798b950-6eb0-45b1-afec-e9fa821cb8a5 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.021198 Aug 29 15:38:34.718392 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 141/264] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:34 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:34.723220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.723704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.748380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.748860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.749288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.749983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.750431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.750848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.781161 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] HTTP exception thrown: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Request method failure captured: Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 HTTP/1.1 Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1Hk2YUnM_UItYv3-cTVeDN1rvoqO8qvfZanz-wkdtUxwf5CChxGR96U2no52E98zIvC8dmquTmlX6WSxSg5iQwhNAsKiRAeI4BMWaFO6QQ0KyP0EAqcVpQOs9q48FhCSHZUsXnlMFGzC0CMwDcHEKLFjdAiW70RhzyJNK9DHvkWh4 Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 09bab46673824d9ba81dc152cc0a3895 Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:34.784339 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09bab46673824d9ba81dc152cc0a3895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09bab46673824d9ba81dc152cc0a3895", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09bab46673824d9ba81dc152cc0a3895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09bab46673824d9ba81dc152cc0a3895"}]}] Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 09bab46673824d9ba81dc152cc0a3895 Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminTestJSON-1722583686-project Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a726e7ddb8914b72925d217021404000 Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminTestJSON-1722583686-project Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.785813 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '80bc46d1-38de-4f9d-9f71-9aed32033b69'} Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.786595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.788694 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.791270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Returning 404 to user: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.792335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-840c80c0-d618-48ed-a0d4-d459f8a32599 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "DELETE /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 404 len: 111 microversion: 2.1 time: 0.072966 Aug 29 15:38:34.793064 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 142/265] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:34 2022] DELETE /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:34.798275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dd9926f2-78c9-485d-8e7b-6c54b4783aa9 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-54611544"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.801978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dd9926f2-78c9-485d-8e7b-6c54b4783aa9 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c90a7444d98e4f45a03053fd032694db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b84eca3324578bdefd2847fa23158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dd9926f2-78c9-485d-8e7b-6c54b4783aa9 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Request method failure captured: Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 58 Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1JtmiZ32XPxyXqtX1HtyMPCRD9hGeMrpzfiSYSptvrUXRkDH5TNuHRTL7Iu8EFK5cUDWB6ih-HtXEYskiUsurgjJxrAdzByqMkZo0lIZKMgHYYW2b1ybsA5x72tBVAwVLYv5QAYH2ld4YiakIL0r5Bw4MlxZBPvibuXiRrjWIh8Ts Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:34.804513 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a63b84eca3324578bdefd2847fa23158", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a63b84eca3324578bdefd2847fa23158"}]}] Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c90a7444d98e4f45a03053fd032694db Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: {"aggregate": {"name": "tempest-test_aggregate-54611544"}} Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:34.805669 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-54611544'}}} Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:34.806359 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:34.807406 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 29 15:38:34.808447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.810256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dd9926f2-78c9-485d-8e7b-6c54b4783aa9 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.811506 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dd9926f2-78c9-485d-8e7b-6c54b4783aa9 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.017246 Aug 29 15:38:34.816287 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 143/266] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:34 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:34.821846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.822902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] [instance: 80bc46d1-38de-4f9d-9f71-9aed32033b69] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:34.830325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.831393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.832076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.833034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:34.834257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:34.835295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:34.850898 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] HTTP exception thrown: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Request method failure captured: Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 HTTP/1.1 Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1Hk2YUnM_UItYv3-cTVeDN1rvoqO8qvfZanz-wkdtUxwf5CChxGR96U2no52E98zIvC8dmquTmlX6WSxSg5iQwhNAsKiRAeI4BMWaFO6QQ0KyP0EAqcVpQOs9q48FhCSHZUsXnlMFGzC0CMwDcHEKLFjdAiW70RhzyJNK9DHvkWh4 Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 09bab46673824d9ba81dc152cc0a3895 Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:34.852860 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09bab46673824d9ba81dc152cc0a3895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09bab46673824d9ba81dc152cc0a3895", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09bab46673824d9ba81dc152cc0a3895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09bab46673824d9ba81dc152cc0a3895"}]}] Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 09bab46673824d9ba81dc152cc0a3895 Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1722583686 Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminTestJSON-1722583686-project Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a726e7ddb8914b72925d217021404000 Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminTestJSON-1722583686-project Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.854032 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '80bc46d1-38de-4f9d-9f71-9aed32033b69'} Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.854770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. Aug 29 15:38:34.855839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.858298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] Returning 404 to user: Instance 80bc46d1-38de-4f9d-9f71-9aed32033b69 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.859357 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c87a075-9eb0-47fc-8722-8af3fa6a4dd4 tempest-AggregatesAdminTestJSON-1722583686 tempest-AggregatesAdminTestJSON-1722583686-project] 10.222.0.83 "GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69" status: 404 len: 111 microversion: 2.1 time: 0.041861 Aug 29 15:38:34.860091 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 144/267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/80bc46d1-38de-4f9d-9f71-9aed32033b69 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:34.864814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff3530c0-1644-481f-8c49-401449d9401e tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-683598634"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.869511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-ff3530c0-1644-481f-8c49-401449d9401e tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid b551edc2-0db7-4ad9-a630-2a6bdca5339b for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:34.902175 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff3530c0-1644-481f-8c49-401449d9401e tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040771 Aug 29 15:38:34.909820 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 145/268] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:34.917787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8618243c-4b0d-46cf-b729-118298b08131 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-683598634"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:34.926671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-8618243c-4b0d-46cf-b729-118298b08131 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid 7d586c41-a81e-4233-8e5a-6cc4deff67c4 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:34.938682 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-8618243c-4b0d-46cf-b729-118298b08131 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-683598634 already exists. Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8618243c-4b0d-46cf-b729-118298b08131 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 59 Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:34.940980 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: {"aggregate": {"name": "tempest-test_aggregate-683598634"}} Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:34.942652 n-d-836830-13 devstack@n-api.service[129133]: exception: Aggregate tempest-test_aggregate-683598634 already exists. Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-683598634'}}} Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 29 15:38:34.944171 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-683598634 already exists. Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:34.945472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-683598634 already exists. Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-683598634 already exists. Aug 29 15:38:34.946517 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:34.948536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8618243c-4b0d-46cf-b729-118298b08131 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-683598634 already exists. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:34.949656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8618243c-4b0d-46cf-b729-118298b08131 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.038618 Aug 29 15:38:34.953919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 146/269] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:34 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:34.959535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-feb6f385-7175-422d-903d-31fff1b9b44b tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:34.985529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:34.999403 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bccb0a7b-e66c-4a2d-bf25-4a61b18874da tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.937011 Aug 29 15:38:35.003922 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-feb6f385-7175-422d-903d-31fff1b9b44b tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.048376 Aug 29 15:38:35.006249 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 124/270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:34 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:35.007440 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 147/271] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:34 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:35.029552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a591b01-f87a-4389-a7fc-23abc1855083 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1144861863"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:35.044142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-3a591b01-f87a-4389-a7fc-23abc1855083 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid a88b4c17-82fc-4829-b453-ead3871be2a7 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:35.085591 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a591b01-f87a-4389-a7fc-23abc1855083 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.072982 Aug 29 15:38:35.086955 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 148/272] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:35.099074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ce6e509-5c84-4c83-89cd-9b0f12c2d83e tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.103810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2ce6e509-5c84-4c83-89cd-9b0f12c2d83e tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c90a7444d98e4f45a03053fd032694db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b84eca3324578bdefd2847fa23158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ce6e509-5c84-4c83-89cd-9b0f12c2d83e tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Request method failure captured: Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1JtmiZ32XPxyXqtX1HtyMPCRD9hGeMrpzfiSYSptvrUXRkDH5TNuHRTL7Iu8EFK5cUDWB6ih-HtXEYskiUsurgjJxrAdzByqMkZo0lIZKMgHYYW2b1ybsA5x72tBVAwVLYv5QAYH2ld4YiakIL0r5Bw4MlxZBPvibuXiRrjWIh8Ts Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:35.106611 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a63b84eca3324578bdefd2847fa23158", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a63b84eca3324578bdefd2847fa23158"}]}] Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c90a7444d98e4f45a03053fd032694db Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:38:35.108075 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '15'} Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:35.108739 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 29 15:38:35.109733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.113835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ce6e509-5c84-4c83-89cd-9b0f12c2d83e tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:35.117468 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2ce6e509-5c84-4c83-89cd-9b0f12c2d83e tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.023044 Aug 29 15:38:35.119549 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 125/273] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:35 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:35.130037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99375b9c-9463-44a6-b78b-109cf7707ea2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.185828 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-99375b9c-9463-44a6-b78b-109cf7707ea2 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.061190 Aug 29 15:38:35.186622 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 149/274] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:35 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 29 15:38:35.197187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7031e2d7-736b-4e7b-bde0-9c1b4cb3c468 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.224406 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-7031e2d7-736b-4e7b-bde0-9c1b4cb3c468 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7031e2d7-736b-4e7b-bde0-9c1b4cb3c468 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:35.226829 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: exception: Aggregate -1 could not be found. Aug 29 15:38:35.228092 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '-1'} Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:38:35.228810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.229923 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.231258 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.231258 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.231258 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:35.231258 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:35.231258 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 15:38:35.231258 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.237293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7031e2d7-736b-4e7b-bde0-9c1b4cb3c468 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:35.238414 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7031e2d7-736b-4e7b-bde0-9c1b4cb3c468 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046554 Aug 29 15:38:35.246557 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 126/275] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:35 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:35.257177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f8d9451a-71fa-478b-baad-0a9e6a5f89cc tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2049808477"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:35.261142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-f8d9451a-71fa-478b-baad-0a9e6a5f89cc tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid 00d4ee2a-72f6-4dfd-8917-9a5dfd34b877 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:35.321824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f8d9451a-71fa-478b-baad-0a9e6a5f89cc tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067591 Aug 29 15:38:35.325392 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 150/276] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:35.337401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c63e6297-cb1f-4636-a409-040de235eaba tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.340437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c63e6297-cb1f-4636-a409-040de235eaba tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c90a7444d98e4f45a03053fd032694db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b84eca3324578bdefd2847fa23158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c63e6297-cb1f-4636-a409-040de235eaba tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Request method failure captured: Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1JtmiZ32XPxyXqtX1HtyMPCRD9hGeMrpzfiSYSptvrUXRkDH5TNuHRTL7Iu8EFK5cUDWB6ih-HtXEYskiUsurgjJxrAdzByqMkZo0lIZKMgHYYW2b1ybsA5x72tBVAwVLYv5QAYH2ld4YiakIL0r5Bw4MlxZBPvibuXiRrjWIh8Ts Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:35.342170 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a63b84eca3324578bdefd2847fa23158", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a63b84eca3324578bdefd2847fa23158"}]}] Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c90a7444d98e4f45a03053fd032694db Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:38:35.343710 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '16'} Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:35.344419 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.345435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c63e6297-cb1f-4636-a409-040de235eaba tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:35.347785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c63e6297-cb1f-4636-a409-040de235eaba tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] 10.222.0.83 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.011992 Aug 29 15:38:35.349121 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 127/277] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:35.361329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-216ccf3d-01fe-4ab4-9c2c-474526a0fad0 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.366949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:35.419882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-216ccf3d-01fe-4ab4-9c2c-474526a0fad0 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.063706 Aug 29 15:38:35.420673 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 151/278] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:35 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:35.431096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-617824eb-b27a-42b3-99a6-35a18e43ef0d tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.442594 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-617824eb-b27a-42b3-99a6-35a18e43ef0d tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-617824eb-b27a-42b3-99a6-35a18e43ef0d tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:35.450911 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: exception: Aggregate -1 could not be found. Aug 29 15:38:35.452404 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '-1'} Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.453044 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 29 15:38:35.454979 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.457733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-617824eb-b27a-42b3-99a6-35a18e43ef0d tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:35.462095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-617824eb-b27a-42b3-99a6-35a18e43ef0d tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034972 Aug 29 15:38:35.464612 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 128/279] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:35.472665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5e8ed72-84b7-431d-9359-6e47bb56b158 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.474063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5e8ed72-84b7-431d-9359-6e47bb56b158 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c90a7444d98e4f45a03053fd032694db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b84eca3324578bdefd2847fa23158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5e8ed72-84b7-431d-9359-6e47bb56b158 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Request method failure captured: Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1JtmiZ32XPxyXqtX1HtyMPCRD9hGeMrpzfiSYSptvrUXRkDH5TNuHRTL7Iu8EFK5cUDWB6ih-HtXEYskiUsurgjJxrAdzByqMkZo0lIZKMgHYYW2b1ybsA5x72tBVAwVLYv5QAYH2ld4YiakIL0r5Bw4MlxZBPvibuXiRrjWIh8Ts Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:35.479590 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a63b84eca3324578bdefd2847fa23158", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a63b84eca3324578bdefd2847fa23158"}]}] Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c90a7444d98e4f45a03053fd032694db Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:38:35.481283 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:35.482088 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:35.483717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5e8ed72-84b7-431d-9359-6e47bb56b158 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:35.484754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5e8ed72-84b7-431d-9359-6e47bb56b158 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] 10.222.0.83 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.012820 Aug 29 15:38:35.484754 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 152/280] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:35.497042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be72d0c7-a696-43ce-9e70-308222978e42 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-924920125"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:35.502096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-be72d0c7-a696-43ce-9e70-308222978e42 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid b2a1a674-9773-4600-bfc9-0197da97e2da for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:35.575487 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be72d0c7-a696-43ce-9e70-308222978e42 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081117 Aug 29 15:38:35.579273 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 129/281] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:35.592556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8d9b168-3255-4c58-9fa4-f8b59358467b tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:35.635300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d9b168-3255-4c58-9fa4-f8b59358467b tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.636426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d9b168-3255-4c58-9fa4-f8b59358467b tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.636865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d9b168-3255-4c58-9fa4-f8b59358467b tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.910665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:35.911332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:35.934324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.937403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.939260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.940130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:35.941751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:35.944503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:35.971067 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8d9b168-3255-4c58-9fa4-f8b59358467b tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.384263 Aug 29 15:38:35.973443 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 153/282] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 15:38:35 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:35.992770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e1ef6675-c77f-4b81-84b3-00f098616566 req-c2187ea6-8c80-4470-bedf-31282ae66d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180653fe-00d9-440b-b260-5e6c16dbabfb", "tag": "5129e17a-8d35-4a8f-b26c-f8ea560ecc67"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:36.043260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e1ef6675-c77f-4b81-84b3-00f098616566 req-c2187ea6-8c80-4470-bedf-31282ae66d80 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.043744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e1ef6675-c77f-4b81-84b3-00f098616566 req-c2187ea6-8c80-4470-bedf-31282ae66d80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.044171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e1ef6675-c77f-4b81-84b3-00f098616566 req-c2187ea6-8c80-4470-bedf-31282ae66d80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.084160 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e1ef6675-c77f-4b81-84b3-00f098616566 req-c2187ea6-8c80-4470-bedf-31282ae66d80 service nova] Creating event network-changed:5129e17a-8d35-4a8f-b26c-f8ea560ecc67 for instance 180653fe-00d9-440b-b260-5e6c16dbabfb on n-h1-836830-13 Aug 29 15:38:36.101219 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e1ef6675-c77f-4b81-84b3-00f098616566 req-c2187ea6-8c80-4470-bedf-31282ae66d80 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120050 Aug 29 15:38:36.101881 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 154/283] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:36.119068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a3c88a9-60f5-42f5-b403-6fe1cc4147f1 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:36.127946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a3c88a9-60f5-42f5-b403-6fe1cc4147f1 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c90a7444d98e4f45a03053fd032694db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a63b84eca3324578bdefd2847fa23158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a3c88a9-60f5-42f5-b403-6fe1cc4147f1 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Request method failure captured: Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 43 Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1JtmiZ32XPxyXqtX1HtyMPCRD9hGeMrpzfiSYSptvrUXRkDH5TNuHRTL7Iu8EFK5cUDWB6ih-HtXEYskiUsurgjJxrAdzByqMkZo0lIZKMgHYYW2b1ybsA5x72tBVAwVLYv5QAYH2ld4YiakIL0r5Bw4MlxZBPvibuXiRrjWIh8Ts Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:36.129699 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a63b84eca3324578bdefd2847fa23158", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a63b84eca3324578bdefd2847fa23158"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a63b84eca3324578bdefd2847fa23158"}]}] Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a63b84eca3324578bdefd2847fa23158 Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-775350900 Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c90a7444d98e4f45a03053fd032694db Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-775350900-project Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: {"remove_host": {"host": "n-h1-836830-13"}} Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:36.131877 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-836830-13'}}} Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:36.132826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 29 15:38:36.133835 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:36.134828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a3c88a9-60f5-42f5-b403-6fe1cc4147f1 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:36.134828 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a3c88a9-60f5-42f5-b403-6fe1cc4147f1 tempest-AggregatesAdminNegativeTestJSON-775350900 tempest-AggregatesAdminNegativeTestJSON-775350900-project] 10.222.0.83 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.028752 Aug 29 15:38:36.144520 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 155/284] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 15:38:36 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:36.154529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.160290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:36.179512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.180041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.180478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.181186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.181670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.185448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.540100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:36.554087 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eb19a695-d278-4736-9518-e51dccb94800 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 200 len: 1590 microversion: 2.1 time: 0.647601 Aug 29 15:38:36.554675 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 130/285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:35 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 1590 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:36.559349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f280ffb-18e2-41aa-bced-56ed691c389f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:36.585672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f280ffb-18e2-41aa-bced-56ed691c389f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.588238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f280ffb-18e2-41aa-bced-56ed691c389f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.592828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f280ffb-18e2-41aa-bced-56ed691c389f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:36.788500 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f280ffb-18e2-41aa-bced-56ed691c389f tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.232508 Aug 29 15:38:36.795242 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 131/286] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 15:38:36 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:36.804431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf78b1d2-fa98-441b-bf69-35eb540b5c33 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:36.856661 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf78b1d2-fa98-441b-bf69-35eb540b5c33 tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.060253 Aug 29 15:38:36.863787 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 132/287] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:36 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:36.869561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d96379e9-9397-4658-b738-471c4ac990df tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-318247603"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:36.872987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.aggregate [None req-d96379e9-9397-4658-b738-471c4ac990df tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Generated uuid 0971460d-5588-4a7e-b92f-bedb3f6a0031 for aggregate {{(pid=129132) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 15:38:36.921493 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d96379e9-9397-4658-b738-471c4ac990df tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056282 Aug 29 15:38:36.923768 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 133/288] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 15:38:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:36.953737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:36.975985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:36.981680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:36.984071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:36.984565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.008157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:37.008652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:37.009090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:37.043830 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.compute.aggregates [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 15:38:37.044798 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Request method failure captured: Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 42 Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1LwYByb-ii6vhX5qLQK_0jfMzXh_bekHpIAkcUgFjed6g7AEuvg8M3ndlTOefrw4xR2lZ7wqtDHNaocKdtGVeslmw4ZV_1tEP7_-qFOaM6AzdGRROtofSAED0teJ3RujhAu6xloBBGb9DqJPMu33W62HUSkOLP5PRSO4iYXq-1zjU Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:37.050670 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_23102ab5fb294dd58fbce2d1550b0c64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/23102ab5fb294dd58fbce2d1550b0c64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/23102ab5fb294dd58fbce2d1550b0c64"}]}] Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 23102ab5fb294dd58fbce2d1550b0c64 Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-371653517 Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f8045d0542154b06b845a173a438d6e2 Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: {"remove_host": {"host": "nonexist_host"}} Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:37.054457 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 29 15:38:37.055354 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 29 15:38:37.056543 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.061914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-59184e7f-025b-4687-92e9-d0d11e8e64ff tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.117514 Aug 29 15:38:37.064706 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 134/289] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 15:38:36 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:37.070628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7308bd2f-0e0b-48ea-b933-ef182754eaba tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:37.129309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7308bd2f-0e0b-48ea-b933-ef182754eaba tempest-AggregatesAdminNegativeTestJSON-371653517 tempest-AggregatesAdminNegativeTestJSON-371653517-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.067612 Aug 29 15:38:37.131672 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 135/290] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:38:37 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 15:38:37.270267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:37.283056 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4ef1d54-72eb-4cc9-ae2a-7cee83a4cf12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 1.137098 Aug 29 15:38:37.297146 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 156/291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:36 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:38.305893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:38.306499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:38.317686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.318706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.319503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.325542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:38.325939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:38.326382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:38.641878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:38.658938 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fbadab6-f203-4506-b0b7-d6b065a087f4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.357704 Aug 29 15:38:38.672580 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 136/292] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:38 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:39.212314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-82ba6a6b-5dd7-427a-adc7-68a139b825ed req-1337df7a-49da-48a0-831b-e386f4a4d6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435ef7a8-2d60-4197-b170-d21eed31ad11", "name": "network-vif-plugged", "status": "completed", "tag": "18eb5aa9-11f9-4a87-847f-fba3665412ca"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:39.236777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-82ba6a6b-5dd7-427a-adc7-68a139b825ed req-1337df7a-49da-48a0-831b-e386f4a4d6af service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.237264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-82ba6a6b-5dd7-427a-adc7-68a139b825ed req-1337df7a-49da-48a0-831b-e386f4a4d6af service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.237696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-82ba6a6b-5dd7-427a-adc7-68a139b825ed req-1337df7a-49da-48a0-831b-e386f4a4d6af service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.290882 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-82ba6a6b-5dd7-427a-adc7-68a139b825ed req-1337df7a-49da-48a0-831b-e386f4a4d6af service nova] Creating event network-vif-plugged:18eb5aa9-11f9-4a87-847f-fba3665412ca for instance 435ef7a8-2d60-4197-b170-d21eed31ad11 on n-h2-836830-13 Aug 29 15:38:39.314676 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-82ba6a6b-5dd7-427a-adc7-68a139b825ed req-1337df7a-49da-48a0-831b-e386f4a4d6af service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106585 Aug 29 15:38:39.317354 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 137/293] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:39.684307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:39.685256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:39.706873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.707753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.708393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.710006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:39.717332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:39.717980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:39.886567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-581780671", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:39.993628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:40.160855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:40.174644 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d3d6786-e0a9-4ff9-8193-6fbe41cb0bd2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.494964 Aug 29 15:38:40.197273 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 138/294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:39 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:40.858222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:40.858783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:40.859427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:40.860506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:40.860839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:40.891547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.892130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.894998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.901997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:40.902609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:40.903587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:40.947124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Getting quotas for project 13ccf42f8444482a9e97a08cf7668fd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:40.959167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Getting quotas for user e63e67306f07404dab97802890c990a0 and project 13ccf42f8444482a9e97a08cf7668fd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:40.983837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:40.991613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:41.055698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d9fff49-26e5-422b-ae30-95502b11edc1 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.261210 Aug 29 15:38:41.056331 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 157/295] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:41.079744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-426a6a92-52f4-4034-addd-952510f34c9e tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.080912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-426a6a92-52f4-4034-addd-952510f34c9e tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.177048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-426a6a92-52f4-4034-addd-952510f34c9e tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.186367 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-426a6a92-52f4-4034-addd-952510f34c9e tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1219 microversion: 2.1 time: 0.119303 Aug 29 15:38:41.196675 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 139/296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:41.204597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:41.206085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:41.213893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.214690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.215377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.216280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:41.216958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:41.217601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:41.668957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:41.691515 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20654440-154d-4091-8a35-e7cae61648b9 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.489782 Aug 29 15:38:41.695650 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 158/297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:41 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:42.212369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-50dc865d-b61d-486c-9fcd-3498431d6bcb tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.212990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-50dc865d-b61d-486c-9fcd-3498431d6bcb tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.439743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-50dc865d-b61d-486c-9fcd-3498431d6bcb tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:42.452127 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-50dc865d-b61d-486c-9fcd-3498431d6bcb tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1219 microversion: 2.1 time: 0.243399 Aug 29 15:38:42.453111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 140/298] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1219 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:42.716428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:42.717451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:42.727221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.729259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.729796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:42.731179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:42.731818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:42.732530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.125889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.155456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:43.170366 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17242e7a-3c0f-4503-a7d0-557214a5fec8 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1319 microversion: 2.1 time: 0.460003 Aug 29 15:38:43.192873 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 159/299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:42 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:43.478675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:43.480417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:43.505095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.506098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.508013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.510857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:43.511405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:43.514535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:43.612735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1216246862", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:43.701737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:43.712563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:43.719737 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5738bee-39a4-46d5-9ada-f3436ded9bcc tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1271 microversion: 2.1 time: 0.245841 Aug 29 15:38:43.724908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 160/300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:44.047569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cefd6bf1-cf58-4e25-97d6-b3e50b4103d1 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Calling method '.version_select at 0x7f32ef1b68b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.050124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cefd6bf1-cf58-4e25-97d6-b3e50b4103d1 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '93b93788fbf74965a928d861437f36c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da09625509a4cb883cfd164e66dc795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cefd6bf1-cf58-4e25-97d6-b3e50b4103d1 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Request method failure captured: Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2BHNOo8csul_sZyCwC63YXPP7279RsLj-IYsw966gouLlNNCo0eObscOJn8irU-sKvluBxtzVHiCxdp7o9lIDvtbbXEWtLxhV8yDWQQkl9laUht88sFQxLN23IPiiJGwQ8H8nq86Yj188IU6VcaDxARQhlr6seiz25WgyWyeP5ym8 Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:44.054629 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2da09625509a4cb883cfd164e66dc795", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2da09625509a4cb883cfd164e66dc795"}]}] Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 93b93788fbf74965a928d861437f36c6 Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:38:44.055967 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:44.056826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 29 15:38:44.057902 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.059673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cefd6bf1-cf58-4e25-97d6-b3e50b4103d1 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:44.060140 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cefd6bf1-cf58-4e25-97d6-b3e50b4103d1 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.334089 Aug 29 15:38:44.072702 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 161/301] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 15:38:43 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:44.086629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-767e311a-5a19-411c-9233-d9637d3b7bc3 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Calling method '.version_select at 0x7f32eef94d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.093973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-767e311a-5a19-411c-9233-d9637d3b7bc3 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '93b93788fbf74965a928d861437f36c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da09625509a4cb883cfd164e66dc795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-767e311a-5a19-411c-9233-d9637d3b7bc3 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Request method failure captured: Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2BHNOo8csul_sZyCwC63YXPP7279RsLj-IYsw966gouLlNNCo0eObscOJn8irU-sKvluBxtzVHiCxdp7o9lIDvtbbXEWtLxhV8yDWQQkl9laUht88sFQxLN23IPiiJGwQ8H8nq86Yj188IU6VcaDxARQhlr6seiz25WgyWyeP5ym8 Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:44.096449 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2da09625509a4cb883cfd164e66dc795", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2da09625509a4cb883cfd164e66dc795"}]}] Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 93b93788fbf74965a928d861437f36c6 Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:38:44.097865 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:44.098567 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 29 15:38:44.100543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.102611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:44.103124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:44.103623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:44.104199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:44.104677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:44.106697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-767e311a-5a19-411c-9233-d9637d3b7bc3 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:44.111486 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-767e311a-5a19-411c-9233-d9637d3b7bc3 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.035628 Aug 29 15:38:44.121429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 162/302] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:44.134288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.137242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.138503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73f8429f-52ea-407d-a6a6-d90f9b811333 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Calling method '.version_select at 0x7f32ef3371f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.140489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.141382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.145733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.146236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.157503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73f8429f-52ea-407d-a6a6-d90f9b811333 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '93b93788fbf74965a928d861437f36c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da09625509a4cb883cfd164e66dc795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73f8429f-52ea-407d-a6a6-d90f9b811333 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Request method failure captured: Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2BHNOo8csul_sZyCwC63YXPP7279RsLj-IYsw966gouLlNNCo0eObscOJn8irU-sKvluBxtzVHiCxdp7o9lIDvtbbXEWtLxhV8yDWQQkl9laUht88sFQxLN23IPiiJGwQ8H8nq86Yj188IU6VcaDxARQhlr6seiz25WgyWyeP5ym8 Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:44.161044 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2da09625509a4cb883cfd164e66dc795", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2da09625509a4cb883cfd164e66dc795"}]}] Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 93b93788fbf74965a928d861437f36c6 Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:38:44.163590 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:44.164624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 29 15:38:44.165766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:44.168906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73f8429f-52ea-407d-a6a6-d90f9b811333 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:44.175928 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73f8429f-52ea-407d-a6a6-d90f9b811333 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.053050 Aug 29 15:38:44.190486 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 163/303] 10.222.0.83 () {58 vars in 1179 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:44.197287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.198185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.213047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.214326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.216814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.218013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:44.220000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:44.221895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:44.270684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Getting quotas for project 7261af070ed14fdba6888924eefb492a. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:44.300681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Getting quotas for user 30d7f5f663fe43aaa83d4f896fc177db and project 7261af070ed14fdba6888924eefb492a. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:44.339414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:44.347551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:44.463616 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fdf013e0-5402-401a-b501-252199fc58ca tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.542840 Aug 29 15:38:44.465227 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 141/304] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:38:44.592361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.604060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f73515df-cd7d-424e-bf40-805d966fbd25 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1469 microversion: 2.1 time: 0.410955 Aug 29 15:38:44.606032 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 164/305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1469 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:44.624416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-93c9460c-f657-4d86-bcb4-e4bcc847cd68 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:44.626434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-93c9460c-f657-4d86-bcb4-e4bcc847cd68 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:44.785026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-93c9460c-f657-4d86-bcb4-e4bcc847cd68 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:44.796664 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-93c9460c-f657-4d86-bcb4-e4bcc847cd68 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1223 microversion: 2.1 time: 0.186857 Aug 29 15:38:44.797609 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 165/306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:45.024890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Calling method '.version_select at 0x7f32ef1d3160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.026813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.027340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.027774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.078150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.078643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.091348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.131432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.131928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.132362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.156848 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d75a48f0-9a44-48ec-aa32-35096d94b5e3 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.690273 Aug 29 15:38:45.167229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 142/307] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:44 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:45.183294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.184158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.205945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.206541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.206894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.207654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.209259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.209259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.314259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-889408697", "block_migration": true, "disk_over_commit": false}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:45.317152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.326967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.330263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.331721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.332721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.334494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.337722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.415603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.449088 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1a0acd42-db28-4285-995f-6cc58ce87963 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1277 microversion: 2.1 time: 0.279322 Aug 29 15:38:45.455177 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 143/308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:45.470725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c15110d9-51d8-4928-8a72-9f3197c86a38 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Calling method '.version_select at 0x7f32ef248160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.473746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c15110d9-51d8-4928-8a72-9f3197c86a38 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '93b93788fbf74965a928d861437f36c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da09625509a4cb883cfd164e66dc795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c15110d9-51d8-4928-8a72-9f3197c86a38 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Request method failure captured: Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2BHNOo8csul_sZyCwC63YXPP7279RsLj-IYsw966gouLlNNCo0eObscOJn8irU-sKvluBxtzVHiCxdp7o9lIDvtbbXEWtLxhV8yDWQQkl9laUht88sFQxLN23IPiiJGwQ8H8nq86Yj188IU6VcaDxARQhlr6seiz25WgyWyeP5ym8 Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:45.478624 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2da09625509a4cb883cfd164e66dc795", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2da09625509a4cb883cfd164e66dc795"}]}] Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 93b93788fbf74965a928d861437f36c6 Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1'} Aug 29 15:38:45.479916 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:45.480648 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 29 15:38:45.481727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.487946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c15110d9-51d8-4928-8a72-9f3197c86a38 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:45.489540 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c15110d9-51d8-4928-8a72-9f3197c86a38 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.033274 Aug 29 15:38:45.498037 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 144/309] 10.222.0.83 () {58 vars in 1173 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:45.504179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5aa6afbc-2b41-46e5-92ad-72ce19265ff9 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Calling method '.version_select at 0x7f32ef47c700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.524925 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-5aa6afbc-2b41-46e5-92ad-72ce19265ff9 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] HTTP exception thrown: Hypervisor with ID '6766b088-fd99-4eb4-b00a-c4690fb6589e' could not be found. Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5aa6afbc-2b41-46e5-92ad-72ce19265ff9 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Request method failure captured: Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-hypervisors/6766b088-fd99-4eb4-b00a-c4690fb6589e/uptime HTTP/1.1 Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2De4RquPLdFWpkwKM-8WaKVjajarVkmtI4gjV1IwtgjgLoZMg1DcfQm2JOd4vvxFXzF5F602tF_uWnXdOJIwJZQFECLajnx9Gyz3CbMNyYPm3qq0F0dn3tLY3sSHJwFmkpsSCh4N9kg7X_lMqj5i773xu9WqsDd-vFtbmxYqVTgw4 Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7f0ab849ef5645f093be2726cdee452c Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1048722269 Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:45.542525 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7f0ab849ef5645f093be2726cdee452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7f0ab849ef5645f093be2726cdee452c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7f0ab849ef5645f093be2726cdee452c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7f0ab849ef5645f093be2726cdee452c"}]}] Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1048722269 Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7f0ab849ef5645f093be2726cdee452c Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1048722269 Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 6a9cc3578acc48fdbeef31b84ff27d4c Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: exception: Hypervisor with ID '6766b088-fd99-4eb4-b00a-c4690fb6589e' could not be found. Aug 29 15:38:45.544077 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6766b088-fd99-4eb4-b00a-c4690fb6589e'} Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6766b088-fd99-4eb4-b00a-c4690fb6589e' Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 15:38:45.544881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6766b088-fd99-4eb4-b00a-c4690fb6589e' could not be found. Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.546332 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.547973 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.547973 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.547973 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.547973 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:45.547973 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:45.547973 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6766b088-fd99-4eb4-b00a-c4690fb6589e' could not be found. Aug 29 15:38:45.547973 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.550174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5aa6afbc-2b41-46e5-92ad-72ce19265ff9 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Returning 404 to user: Hypervisor with ID '6766b088-fd99-4eb4-b00a-c4690fb6589e' could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:45.551272 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5aa6afbc-2b41-46e5-92ad-72ce19265ff9 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/6766b088-fd99-4eb4-b00a-c4690fb6589e/uptime" status: 404 len: 123 microversion: 2.1 time: 0.051388 Aug 29 15:38:45.560557 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 145/310] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/os-hypervisors/6766b088-fd99-4eb4-b00a-c4690fb6589e/uptime => generated 123 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:45.610147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Calling method '.version_select at 0x7f32ef2c1700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.619554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.625996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.626770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.669222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.671437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.672869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.691774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.692738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.711757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.726250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-00acf9d9-8033-43e1-b479-a8e26569e490 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.164210 Aug 29 15:38:45.734142 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 146/311] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:45.742223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4244ad6-3c0a-4e01-97a9-77c278a9c6b5 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Calling method '.version_select at 0x7f32ef2489d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.746464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4244ad6-3c0a-4e01-97a9-77c278a9c6b5 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '93b93788fbf74965a928d861437f36c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da09625509a4cb883cfd164e66dc795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4244ad6-3c0a-4e01-97a9-77c278a9c6b5 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Request method failure captured: Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2BHNOo8csul_sZyCwC63YXPP7279RsLj-IYsw966gouLlNNCo0eObscOJn8irU-sKvluBxtzVHiCxdp7o9lIDvtbbXEWtLxhV8yDWQQkl9laUht88sFQxLN23IPiiJGwQ8H8nq86Yj188IU6VcaDxARQhlr6seiz25WgyWyeP5ym8 Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:45.749398 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2da09625509a4cb883cfd164e66dc795", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2da09625509a4cb883cfd164e66dc795"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2da09625509a4cb883cfd164e66dc795"}]}] Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2da09625509a4cb883cfd164e66dc795 Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-810836083 Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 93b93788fbf74965a928d861437f36c6 Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-810836083-project Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1'} Aug 29 15:38:45.750805 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:45.751627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 29 15:38:45.752624 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.756433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4244ad6-3c0a-4e01-97a9-77c278a9c6b5 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:45.757873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4244ad6-3c0a-4e01-97a9-77c278a9c6b5 tempest-HypervisorAdminNegativeTestJSON-810836083 tempest-HypervisorAdminNegativeTestJSON-810836083-project] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020161 Aug 29 15:38:45.767758 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 147/312] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:45.772910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3290ca3-452c-4316-8d23-1b7df04cea56 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Calling method '.version_select at 0x7f32ef276af0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.774818 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b3290ca3-452c-4316-8d23-1b7df04cea56 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] HTTP exception thrown: Hypervisor with ID 'e5027e7f-8ec4-4296-b02e-270281acc685' could not be found. Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3290ca3-452c-4316-8d23-1b7df04cea56 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Request method failure captured: Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-hypervisors/e5027e7f-8ec4-4296-b02e-270281acc685 HTTP/1.1 Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2De4RquPLdFWpkwKM-8WaKVjajarVkmtI4gjV1IwtgjgLoZMg1DcfQm2JOd4vvxFXzF5F602tF_uWnXdOJIwJZQFECLajnx9Gyz3CbMNyYPm3qq0F0dn3tLY3sSHJwFmkpsSCh4N9kg7X_lMqj5i773xu9WqsDd-vFtbmxYqVTgw4 Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7f0ab849ef5645f093be2726cdee452c Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1048722269 Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:45.777894 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7f0ab849ef5645f093be2726cdee452c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7f0ab849ef5645f093be2726cdee452c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7f0ab849ef5645f093be2726cdee452c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7f0ab849ef5645f093be2726cdee452c"}]}] Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1048722269 Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7f0ab849ef5645f093be2726cdee452c Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1048722269 Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 6a9cc3578acc48fdbeef31b84ff27d4c Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: exception: Hypervisor with ID 'e5027e7f-8ec4-4296-b02e-270281acc685' could not be found. Aug 29 15:38:45.779062 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e5027e7f-8ec4-4296-b02e-270281acc685'} Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e5027e7f-8ec4-4296-b02e-270281acc685' Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 29 15:38:45.779713 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:38:45.780850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e5027e7f-8ec4-4296-b02e-270281acc685' could not be found. Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e5027e7f-8ec4-4296-b02e-270281acc685' could not be found. Aug 29 15:38:45.781892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:45.783826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3290ca3-452c-4316-8d23-1b7df04cea56 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] Returning 404 to user: Hypervisor with ID 'e5027e7f-8ec4-4296-b02e-270281acc685' could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:45.785600 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b3290ca3-452c-4316-8d23-1b7df04cea56 tempest-HypervisorAdminNegativeTestJSON-1048722269 tempest-HypervisorAdminNegativeTestJSON-1048722269-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/e5027e7f-8ec4-4296-b02e-270281acc685" status: 404 len: 123 microversion: 2.1 time: 0.015683 Aug 29 15:38:45.792177 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 148/313] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/os-hypervisors/e5027e7f-8ec4-4296-b02e-270281acc685 => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:45.825352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:45.826451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:45.839878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.840382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.840881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:45.841595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:45.842051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:45.842474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.003454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.016043 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f8f07518-8eda-4267-b1b3-6fb14fbd97ab tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1275 microversion: 2.1 time: 0.195494 Aug 29 15:38:46.017208 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 149/314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:45 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:46.197265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lazy-loading 'flavor' on Instance uuid 435ef7a8-2d60-4197-b170-d21eed31ad11 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:38:46.301217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Going to try to live migrate instance to tempest-host-889408697 {{(pid=129133) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:38:46.312279 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] HTTP exception thrown: Compute host tempest-host-889408697 could not be found. Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Request method failure captured: Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11/action HTTP/1.1 Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 106 Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1l13gqt-1h_Ax7xep6VBclf1l1tpVn4PJVRlgK7egykGKoN6JND9_8d0N1yfecJjAv_jikHyM9OQOUsexiTlSvjLUHCBIHfxrJmL5vDNNF-bd1KGNDsvSRqwpm9BwMzA8YU3-dv8d1skq1s-4p0mwnCNLnwsDqkGbmXJFxpB7Lc0A Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3b7b790bc2b545109b7b17d26b85cb9c Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveMigrationNegativeTest-190318384 Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:46.317311 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3b7b790bc2b545109b7b17d26b85cb9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3b7b790bc2b545109b7b17d26b85cb9c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3b7b790bc2b545109b7b17d26b85cb9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3b7b790bc2b545109b7b17d26b85cb9c"}]}] Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveMigrationNegativeTest-190318384 Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3b7b790bc2b545109b7b17d26b85cb9c Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-190318384 Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveMigrationNegativeTest-190318384-project-admin Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: b66f43896bed46f38ba26352ec7c0884 Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveMigrationNegativeTest-190318384-project-admin Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: {"os-migrateLive": {"host": "tempest-host-889408697", "block_migration": true, "disk_over_commit": false}} Aug 29 15:38:46.319522 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: exception: Compute host tempest-host-889408697 could not be found. Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '435ef7a8-2d60-4197-b170-d21eed31ad11', 'body': {'os-migrateLive': {'host': 'tempest-host-889408697', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:38:46.321335 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-889408697 could not be found. Aug 29 15:38:46.322928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-889408697 could not be found. Aug 29 15:38:46.325466 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-889408697 could not be found. Aug 29 15:38:46.328447 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:46.331135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Returning 400 to user: Compute host tempest-host-889408697 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:46.332312 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-986d8661-20ad-423a-ad9e-b7e096699637 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11/action" status: 400 len: 99 microversion: 2.1 time: 1.533604 Aug 29 15:38:46.336692 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 166/315] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Aug 29 15:38:44 2022] POST /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11/action => generated 99 bytes in 1538 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:38:46.341572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.342305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.361718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.362218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.362656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.363393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.363845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.364266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.475750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:46.476711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:46.491857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.492520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.494041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.496184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:46.496925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:46.497635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:46.979523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:46.992221 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8770a2f-812e-478e-b6aa-caa308ecc493 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1469 microversion: 2.1 time: 0.652602 Aug 29 15:38:46.999074 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 150/316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1469 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:47.257782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.272876 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f7593976-dd6f-4336-8762-930e35da5941 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.799071 Aug 29 15:38:47.274594 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 167/317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:46 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:47.280625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:47.281442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:47.297657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.300974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.302175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.307549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:47.308306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:47.309034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:47.410698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:47.423192 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e186b99-3a12-4882-a638-a7595434b3a9 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1281 microversion: 2.1 time: 0.146908 Aug 29 15:38:47.435894 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 168/318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:47 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:47.450914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-394991455", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:47.453099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-527323774", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "ebc91776-3d70-481a-8f9a-8935c9cd12b8"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:47.539950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:47.572628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] validate_networks() for [('ebc91776-3d70-481a-8f9a-8935c9cd12b8', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:38:48.149368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:48.150510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:48.151081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:48.151653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:48.152107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:48.189571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.191667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.192592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.196582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.197261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.198078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.226432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Getting quotas for project 13ee7f05500a437580afe08f38a79fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:48.242217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Getting quotas for user 010ed8588b2d496bacedebc1863a3857 and project 13ee7f05500a437580afe08f38a79fb9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:48.279527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:48.284450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:48.393066 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ed188a5-95be-44a9-bb46-618bd4e9de56 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945265 Aug 29 15:38:48.394227 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 169/319] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:38:48.518310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:38:48.518889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:38:48.519472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:38:48.520113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:38:48.520704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:38:48.534863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.539707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.540767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.541766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:48.543155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:48.544358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:48.588556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:38:48.602417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for user f12698b45a114720af9c98b163077f59 and project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:38:48.637830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:38:48.642466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:38:48.750705 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4cdf7e0-aca3-4576-9bf6-057598dce1fd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.755322 Aug 29 15:38:48.759421 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 151/320] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:38:49.076215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24d6ea62-1259-42ed-ba03-7cb0fe777c2f tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-519258689", "id": 1857483771, "os-flavor-access:is_public": "False"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:49.118725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24d6ea62-1259-42ed-ba03-7cb0fe777c2f tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.723129 Aug 29 15:38:49.138011 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 170/321] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:48 2022] POST /compute/v2.1/flavors => generated 438 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:49.149086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8996a543-10c4-4f5a-9b38-b5a77e25ed6d req-61630ad1-231a-4101-8ffe-cb6b4cf4f31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b106a174-dbd7-4322-ad4f-e1489c630958", "tag": "68c8dd60-4bc8-40a7-bdf0-61e56ee38ac9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:49.178921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8996a543-10c4-4f5a-9b38-b5a77e25ed6d req-61630ad1-231a-4101-8ffe-cb6b4cf4f31c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.181819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8996a543-10c4-4f5a-9b38-b5a77e25ed6d req-61630ad1-231a-4101-8ffe-cb6b4cf4f31c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.183476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8996a543-10c4-4f5a-9b38-b5a77e25ed6d req-61630ad1-231a-4101-8ffe-cb6b4cf4f31c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.202390 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8996a543-10c4-4f5a-9b38-b5a77e25ed6d req-61630ad1-231a-4101-8ffe-cb6b4cf4f31c service nova] Creating event network-changed:68c8dd60-4bc8-40a7-bdf0-61e56ee38ac9 for instance b106a174-dbd7-4322-ad4f-e1489c630958 on n-h2-836830-13 Aug 29 15:38:49.215453 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8996a543-10c4-4f5a-9b38-b5a77e25ed6d req-61630ad1-231a-4101-8ffe-cb6b4cf4f31c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075547 Aug 29 15:38:49.218837 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 171/322] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:49.234893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.237689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.249263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.253419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.256554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.257925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.259487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.261134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.426410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Action: 'update', calling method: .version_select at 0x7f32ef248280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:49.431565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.432505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.433101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.442783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.444320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.445017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.455299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] HTTP exception thrown: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Request method failure captured: Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393 HTTP/1.1 Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 56 Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2Hyi2DD5uPFfCx44vzN56vBKFgEtPowVg485cUcnnU4sQCgb3XGL5RMqwwHqO4EqbTFY4Q_FzJNdmIKpbUbCsGpUtT-PK8H4uC9GJHLBlyV0heuSqAODOBPXvow5vwgsX77z8us8CEFxxug539wARN7PmZ3Enr-6AKRPuY670DMcE Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2e9b5476d08040c4b1b24e87f40d78e4 Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:49.457321 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2e9b5476d08040c4b1b24e87f40d78e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2e9b5476d08040c4b1b24e87f40d78e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2e9b5476d08040c4b1b24e87f40d78e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2e9b5476d08040c4b1b24e87f40d78e4"}]}] Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2e9b5476d08040c4b1b24e87f40d78e4 Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 38bbfbfe975543769bfe3efd1a5d7cb0 Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:38:49.459001 n-d-836830-13 devstack@n-api.service[129132]: exception: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '02fb2a6d-4185-430c-98a1-6f54b34af393', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.459908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:49.461251 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:49.463406 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:49.463406 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:49.463406 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:49.463406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Returning 404 to user: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:49.463406 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1442402e-dffe-495b-8a7b-20c0c10fc582 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393" status: 404 len: 110 microversion: 2.53 time: 0.698663 Aug 29 15:38:49.463406 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 152/323] 10.222.0.83 () {62 vars in 1309 bytes} [Mon Aug 29 15:38:48 2022] PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393 => generated 110 bytes in 700 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:49.471604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.472232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.480336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.480985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.481418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.482119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.483261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.483690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.601802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:49.617268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab9b8638-874d-4657-ae59-8e21f9492614 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1222 microversion: 2.1 time: 0.155763 Aug 29 15:38:49.617855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 153/324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:49.628081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.634913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.644222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.645124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.645724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.646696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.647351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.647933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.807073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:49.816639 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1236b857-13fa-4b37-8f69-1b7f7730449a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.593786 Aug 29 15:38:49.817219 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 172/325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:49.833223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:49.834785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:49.844299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.848903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.850210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.851911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:49.856742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:49.858879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:49.878629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:49.892368 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f681862-4a75-45b0-bfbb-1a12b17c61f5 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1323 microversion: 2.1 time: 0.270348 Aug 29 15:38:49.893680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 154/326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:49.900385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc38314f-9d0c-4b01-8029-1f04c4804fc3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:49.991552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.001117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.003089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.004986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57525d20-fb7d-4158-8db4-9f9b1273272f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1265 microversion: 2.25 time: 0.186671 Aug 29 15:38:50.006185 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 173/327] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:49 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:50.010953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Action: 'update', calling method: .version_select at 0x7f32eeeaa790>, body: {"status": "disabled"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.015231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.015955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.016599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.026185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.026752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.027279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.036281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] HTTP exception thrown: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Request method failure captured: Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393 HTTP/1.1 Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 22 Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2Hyi2DD5uPFfCx44vzN56vBKFgEtPowVg485cUcnnU4sQCgb3XGL5RMqwwHqO4EqbTFY4Q_FzJNdmIKpbUbCsGpUtT-PK8H4uC9GJHLBlyV0heuSqAODOBPXvow5vwgsX77z8us8CEFxxug539wARN7PmZ3Enr-6AKRPuY670DMcE Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2e9b5476d08040c4b1b24e87f40d78e4 Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:50.039246 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2e9b5476d08040c4b1b24e87f40d78e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2e9b5476d08040c4b1b24e87f40d78e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2e9b5476d08040c4b1b24e87f40d78e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2e9b5476d08040c4b1b24e87f40d78e4"}]}] Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2e9b5476d08040c4b1b24e87f40d78e4 Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 38bbfbfe975543769bfe3efd1a5d7cb0 Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: {"status": "disabled"} Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: exception: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.040811 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '02fb2a6d-4185-430c-98a1-6f54b34af393', 'body': {'status': 'disabled'}} Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.041693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:50.042971 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:50.044386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.044386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.045196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Returning 404 to user: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:50.048085 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-686ad359-e721-4961-b0d9-60c5da9ea77f tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393" status: 404 len: 110 microversion: 2.53 time: 0.038862 Aug 29 15:38:50.053056 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 174/328] 10.222.0.83 () {62 vars in 1309 bytes} [Mon Aug 29 15:38:50 2022] PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393 => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:50.058076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Action: 'update', calling method: .version_select at 0x7f32eef53af0>, body: {"status": "enabled"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.062872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.063610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.064216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.072926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.074008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.074955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.081972 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] HTTP exception thrown: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Request method failure captured: Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393 HTTP/1.1 Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 21 Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2Hyi2DD5uPFfCx44vzN56vBKFgEtPowVg485cUcnnU4sQCgb3XGL5RMqwwHqO4EqbTFY4Q_FzJNdmIKpbUbCsGpUtT-PK8H4uC9GJHLBlyV0heuSqAODOBPXvow5vwgsX77z8us8CEFxxug539wARN7PmZ3Enr-6AKRPuY670DMcE Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2e9b5476d08040c4b1b24e87f40d78e4 Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:38:50.083972 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2e9b5476d08040c4b1b24e87f40d78e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2e9b5476d08040c4b1b24e87f40d78e4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2e9b5476d08040c4b1b24e87f40d78e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2e9b5476d08040c4b1b24e87f40d78e4"}]}] Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2e9b5476d08040c4b1b24e87f40d78e4 Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507 Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 38bbfbfe975543769bfe3efd1a5d7cb0 Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: {"status": "enabled"} Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: exception: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.085158 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '02fb2a6d-4185-430c-98a1-6f54b34af393', 'body': {'status': 'enabled'}} Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.085896 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:50.086975 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:50.088876 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. Aug 29 15:38:50.088876 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.088876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Returning 404 to user: Service 02fb2a6d-4185-430c-98a1-6f54b34af393 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:50.088876 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c860408-5e11-4398-82a7-d7cd6610134d tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393" status: 404 len: 110 microversion: 2.53 time: 0.031477 Aug 29 15:38:50.088876 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 175/329] 10.222.0.83 () {62 vars in 1309 bytes} [Mon Aug 29 15:38:50 2022] PUT /compute/v2.1/os-services/02fb2a6d-4185-430c-98a1-6f54b34af393 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:50.102000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.104911 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc38314f-9d0c-4b01-8029-1f04c4804fc3 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/1857483771/action" status: 200 len: 97 microversion: 2.1 time: 0.209399 Aug 29 15:38:50.106133 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 155/330] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:38:49 2022] POST /compute/v2.1/flavors/1857483771/action => generated 97 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:50.111496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.111496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.111496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.111957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.111957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.111957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.119250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d01adb04-cf76-497e-af8e-4de0ccf5d2c2 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.144954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a741a08-c1c0-4e99-b6c8-8e520f70a6cb tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.051185 Aug 29 15:38:50.145634 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 176/331] 10.222.0.83 () {60 vars in 1178 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:50.159205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.165283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.165283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.165584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.166545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.167259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.167826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.204626 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78d23592-5f72-4416-ab22-a0e7e1a20b27 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.049128 Aug 29 15:38:50.205903 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 177/332] 10.222.0.83 () {60 vars in 1211 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:50.222238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.227158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.227799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.228593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.229670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.230282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.231175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.231309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d01adb04-cf76-497e-af8e-4de0ccf5d2c2 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project a75d546db2fb40baa9ad3d22fbeb7ce1 combination. Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d01adb04-cf76-497e-af8e-4de0ccf5d2c2 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Request method failure captured: Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/flavors/1857483771/action HTTP/1.1 Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 67 Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2FpsMdXOG73rmDCqMLDen4VU5OUBqLNrLuiy3VcIFdsv7_FVYm_J0O89c-hz8FdPW_pF8I1cHo-5txsJG1Fi1BmrXZl2BHTTKGHXnts9U4g-SS7NFw4WZtj9mBEl7VhX2NIVuT6YWluQrKij3Zbxgt1e5pV3G1YZVwEHFF_FnjlPA Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ecea19ee353d4977baafbdf022b94887 Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:50.244940 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea19ee353d4977baafbdf022b94887"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea19ee353d4977baafbdf022b94887", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea19ee353d4977baafbdf022b94887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea19ee353d4977baafbdf022b94887"}]}] Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ecea19ee353d4977baafbdf022b94887 Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9a1de22711264e42abe8de3f935f35b1 Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: {"addTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} Aug 29 15:38:50.246458 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: exception: Flavor access already exists for flavor 32 and project a75d546db2fb40baa9ad3d22fbeb7ce1 combination. Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1857483771', 'body': {'addTenantAccess': {'tenant': 'a75d546db2fb40baa9ad3d22fbeb7ce1'}}} Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:38:50.247272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-a75d546db2fb40baa9ad3d22fbeb7ce1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:38:50.248393 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:38:50.249366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:38:50.250303 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-a75d546db2fb40baa9ad3d22fbeb7ce1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 38, 50, 217107), 'updated_at': None, 'flavor_id': 32, 'project_id': 'a75d546db2fb40baa9ad3d22fbeb7ce1'}] Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.251236 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project a75d546db2fb40baa9ad3d22fbeb7ce1 combination. Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.253812 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project a75d546db2fb40baa9ad3d22fbeb7ce1 combination. Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:50.257052 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:50.260501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project a75d546db2fb40baa9ad3d22fbeb7ce1 combination. Aug 29 15:38:50.260501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.260501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d01adb04-cf76-497e-af8e-4de0ccf5d2c2 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project a75d546db2fb40baa9ad3d22fbeb7ce1 combination. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:50.260501 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d01adb04-cf76-497e-af8e-4de0ccf5d2c2 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/1857483771/action" status: 409 len: 152 microversion: 2.1 time: 0.133081 Aug 29 15:38:50.260501 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 156/333] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/flavors/1857483771/action => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:38:50.260501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4588bb94-b500-4910-9e36-5313548f9b4f tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.287543 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7ed0551-8d9f-44a7-b9f6-93b0f1b193f5 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.069340 Aug 29 15:38:50.288595 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 178/334] 10.222.0.83 () {60 vars in 1178 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:50.301215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.305953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.306679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.308099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.309145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.309842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.310233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.364517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cde029b1-0712-4096-be5a-29a0bf229b02 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?host=n-d-836830-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.067587 Aug 29 15:38:50.365585 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 179/335] 10.222.0.83 () {60 vars in 1237 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/os-services?host=n-d-836830-13&binary=xxx => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.374298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0279d6dc-a63b-4deb-a28c-da9c4a826073 req-ab8a2fbb-489f-41af-9e7f-cfb35a194187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2d7a62-7fe7-4929-b78e-3b523dc8a929", "tag": "65c347dd-1374-473a-a580-cb4ebd4b80d3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.388377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0279d6dc-a63b-4deb-a28c-da9c4a826073 req-ab8a2fbb-489f-41af-9e7f-cfb35a194187 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.388810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0279d6dc-a63b-4deb-a28c-da9c4a826073 req-ab8a2fbb-489f-41af-9e7f-cfb35a194187 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.389548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0279d6dc-a63b-4deb-a28c-da9c4a826073 req-ab8a2fbb-489f-41af-9e7f-cfb35a194187 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.403624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0279d6dc-a63b-4deb-a28c-da9c4a826073 req-ab8a2fbb-489f-41af-9e7f-cfb35a194187 service nova] Creating event network-changed:65c347dd-1374-473a-a580-cb4ebd4b80d3 for instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 on n-h1-836830-13 Aug 29 15:38:50.409894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0279d6dc-a63b-4deb-a28c-da9c4a826073 req-ab8a2fbb-489f-41af-9e7f-cfb35a194187 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042890 Aug 29 15:38:50.410738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 180/336] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:50.417532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.421743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.422357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.422839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.423784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.424245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.424698 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4588bb94-b500-4910-9e36-5313548f9b4f tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/1857483771/action" status: 200 len: 21 microversion: 2.1 time: 0.172550 Aug 29 15:38:50.424820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.430436 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 157/337] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/flavors/1857483771/action => generated 21 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:38:50.440755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e33fb698-f698-4c2d-a4c2-bb01b95aa632 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.452787 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4848fe6-f770-4611-b93d-c159e24ab353 tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.040369 Aug 29 15:38:50.454159 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 181/338] 10.222.0.83 () {60 vars in 1178 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:50.467717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.473941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.474777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.475561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.478706 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e33fb698-f698-4c2d-a4c2-bb01b95aa632 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1857483771" status: 202 len: 0 microversion: 2.1 time: 0.046694 Aug 29 15:38:50.479596 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 158/339] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:38:50 2022] DELETE /compute/v2.1/flavors/1857483771 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:50.480709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.481329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.482012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.490519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab15019e-1c84-4884-8128-89f883b48478 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.519923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:50.532926 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab15019e-1c84-4884-8128-89f883b48478 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.048580 Aug 29 15:38:50.534687 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92be7ece-44c2-4c06-98db-0451f2898b6b tempest-ServicesAdminNegativeV253TestJSON-2124939507 tempest-ServicesAdminNegativeV253TestJSON-2124939507-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.071009 Aug 29 15:38:50.535578 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 182/340] 10.222.0.83 () {60 vars in 1239 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:50.543270 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 159/341] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.558305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e68899a2-576e-4df0-8baa-3cdcf9f50f53 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-683284455", "id": 1900577815, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.585767 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e68899a2-576e-4df0-8baa-3cdcf9f50f53 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.035449 Aug 29 15:38:50.586553 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 160/342] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/flavors => generated 437 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:50.601068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb681114-5b14-45e1-b9da-964f0efb89bc tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.606999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=6,nova_api:INSERT=9 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:50.613936 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-cb681114-5b14-45e1-b9da-964f0efb89bc tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb681114-5b14-45e1-b9da-964f0efb89bc tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Request method failure captured: Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/flavors/1900577815/os-flavor-access HTTP/1.1 Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2FpsMdXOG73rmDCqMLDen4VU5OUBqLNrLuiy3VcIFdsv7_FVYm_J0O89c-hz8FdPW_pF8I1cHo-5txsJG1Fi1BmrXZl2BHTTKGHXnts9U4g-SS7NFw4WZtj9mBEl7VhX2NIVuT6YWluQrKij3Zbxgt1e5pV3G1YZVwEHFF_FnjlPA Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ecea19ee353d4977baafbdf022b94887 Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:50.616065 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea19ee353d4977baafbdf022b94887"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea19ee353d4977baafbdf022b94887", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea19ee353d4977baafbdf022b94887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea19ee353d4977baafbdf022b94887"}]}] Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ecea19ee353d4977baafbdf022b94887 Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9a1de22711264e42abe8de3f935f35b1 Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: exception: Access list not available for public flavors. Aug 29 15:38:50.617241 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'flavor_id': '1900577815'} Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 29 15:38:50.617975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.619379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb681114-5b14-45e1-b9da-964f0efb89bc tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:50.619379 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb681114-5b14-45e1-b9da-964f0efb89bc tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/1900577815/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.024494 Aug 29 15:38:50.620386 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 161/343] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/flavors/1900577815/os-flavor-access => generated 91 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:38:50.629673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d61d95b-a16d-477b-a44f-9248c2cebbbc tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.656211 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d61d95b-a16d-477b-a44f-9248c2cebbbc tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1900577815" status: 202 len: 0 microversion: 2.1 time: 0.031435 Aug 29 15:38:50.656466 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 162/344] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:38:50 2022] DELETE /compute/v2.1/flavors/1900577815 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:38:50.664665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.665232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.671506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.671978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.672406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.673099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.673553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.673973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.759602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.770849 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c126314c-7dfa-4e6c-b840-e28da313b291 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1222 microversion: 2.1 time: 0.110350 Aug 29 15:38:50.779249 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 163/345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.793011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bc57cec4-7aaa-468d-9dd0-d51e97e656e8 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.825812 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bc57cec4-7aaa-468d-9dd0-d51e97e656e8 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.045061 Aug 29 15:38:50.836654 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 164/346] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:50.844232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.845041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.850393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81e5537c-489c-42b0-8e67-c2ee83fb9ecf tempest-ServicesAdminNegativeV253TestJSON-565118280 tempest-ServicesAdminNegativeV253TestJSON-565118280-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.852299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.852925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.853522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.854359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.854698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-81e5537c-489c-42b0-8e67-c2ee83fb9ecf tempest-ServicesAdminNegativeV253TestJSON-565118280 tempest-ServicesAdminNegativeV253TestJSON-565118280-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f4606fc339fe4f2288286f804c6f94cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31534f72535e49e7b43e1904b1772d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:50.854953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.855603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81e5537c-489c-42b0-8e67-c2ee83fb9ecf tempest-ServicesAdminNegativeV253TestJSON-565118280 tempest-ServicesAdminNegativeV253TestJSON-565118280-project] Request method failure captured: Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2F9gul9HmEVXLZR8ZI5omysb7wCKk2iazNx4SwLKcrCAlZNQNwdKSijH6EE5P8decIdyd_v86v7PXeNas4c-6Gcxho3_AFYz3NfwBcG2A9bzASVtmtJ2U_AD0c82xK1rEZjJrnOArGK5yIo2EW7wUZjUKxpMVEkg7X9BOm_tNquYw Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.53 Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 31534f72535e49e7b43e1904b1772d34 Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-565118280 Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:50.856498 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/31534f72535e49e7b43e1904b1772d34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_31534f72535e49e7b43e1904b1772d34", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/31534f72535e49e7b43e1904b1772d34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/31534f72535e49e7b43e1904b1772d34"}]}] Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-565118280 Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 31534f72535e49e7b43e1904b1772d34 Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-565118280 Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServicesAdminNegativeV253TestJSON-565118280-project Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f4606fc339fe4f2288286f804c6f94cf Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-565118280-project Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:38:50.857732 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:50.858402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:38:50.859416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:50.860450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81e5537c-489c-42b0-8e67-c2ee83fb9ecf tempest-ServicesAdminNegativeV253TestJSON-565118280 tempest-ServicesAdminNegativeV253TestJSON-565118280-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:50.860450 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-81e5537c-489c-42b0-8e67-c2ee83fb9ecf tempest-ServicesAdminNegativeV253TestJSON-565118280 tempest-ServicesAdminNegativeV253TestJSON-565118280-project] 10.222.0.83 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.313599 Aug 29 15:38:50.860450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 183/347] 10.222.0.83 () {60 vars in 1178 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/os-services => generated 112 bytes in 315 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:38:50.870246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4928518-0f72-4d5a-a08c-7215910f4faf tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-248450645", "id": 801646406, "os-flavor-access:is_public": "False"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:50.892359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:50.909089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4928518-0f72-4d5a-a08c-7215910f4faf tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.044681 Aug 29 15:38:50.909738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 184/348] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:50 2022] POST /compute/v2.1/flavors => generated 435 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:50.923984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:50.924722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:50.936225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.939795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.940462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:50.941794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:50.942469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:50.948097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.093820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.108966 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3026f44-9cdf-4de7-b4ae-13e6a4f10ff3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.269826 Aug 29 15:38:51.111097 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 165/349] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:51.298101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.307109 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0cf7caf-2f34-4ef9-a6e9-b82ff33658e0 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1323 microversion: 2.1 time: 0.394250 Aug 29 15:38:51.307685 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 185/350] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:50 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:51.312570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.313794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.320650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.321222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.321706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.322572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.322984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.323714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.398134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.418055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee8c905e-44e0-48ec-8495-92601eeef035 tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:51.431320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee8c905e-44e0-48ec-8495-92601eeef035 tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9219bd04e3094ffabddfc2b0d2e18583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75d546db2fb40baa9ad3d22fbeb7ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.433578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee8c905e-44e0-48ec-8495-92601eeef035 tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Request method failure captured: Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/flavors/801646406/action HTTP/1.1 Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 67 Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2DBlUkApe5f_g4vWccXJ61N2VQ6R5NupHEZHvF6t0-3hcYKu7qLlC608PH_Qo4PYrG8SbuTo8Q33aOQJdiF25aUrOJDE7UAcnaf7I098ByUlfIViERJE_LTe_srnF6BtVOc30BkEsUbpzu2jdqZhyoMfXBnQ-xKjFMItzc9UuJ8gM Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a75d546db2fb40baa9ad3d22fbeb7ce1 Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-713056169 Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:51.434608 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a75d546db2fb40baa9ad3d22fbeb7ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a75d546db2fb40baa9ad3d22fbeb7ce1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a75d546db2fb40baa9ad3d22fbeb7ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a75d546db2fb40baa9ad3d22fbeb7ce1"}]}] Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-713056169 Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a75d546db2fb40baa9ad3d22fbeb7ce1 Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-713056169 Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FlavorsAccessNegativeTestJSON-713056169-project Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9219bd04e3094ffabddfc2b0d2e18583 Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-713056169-project Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: {"addTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} Aug 29 15:38:51.436082 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '801646406', 'body': {'addTenantAccess': {'tenant': 'a75d546db2fb40baa9ad3d22fbeb7ce1'}}} Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:51.436877 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 29 15:38:51.438107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.441425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee8c905e-44e0-48ec-8495-92601eeef035 tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:51.444975 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee8c905e-44e0-48ec-8495-92601eeef035 tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] 10.222.0.83 "POST /compute/v2.1/flavors/801646406/action" status: 403 len: 130 microversion: 2.1 time: 0.332653 Aug 29 15:38:51.445422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.447172 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7d8ec6f7-7e86-4de2-8e3e-5b8189921310 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1265 microversion: 2.25 time: 0.138195 Aug 29 15:38:51.447826 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 166/351] 10.222.0.83 () {60 vars in 1197 bytes} [Mon Aug 29 15:38:51 2022] POST /compute/v2.1/flavors/801646406/action => generated 130 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:51.448908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 186/352] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:51.457614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9677f84-2da3-4beb-9df8-9c9641155a3c tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.481250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9677f84-2da3-4beb-9df8-9c9641155a3c tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/801646406" status: 202 len: 0 microversion: 2.1 time: 0.028233 Aug 29 15:38:51.481829 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 167/353] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:38:51 2022] DELETE /compute/v2.1/flavors/801646406 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:38:51.491358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca38118f-75a0-4069-aaa3-6cd4ccfa770a tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.516830 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca38118f-75a0-4069-aaa3-6cd4ccfa770a tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030364 Aug 29 15:38:51.517906 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 187/354] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:51.540136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d140cf24-02f7-4082-85eb-4757dffce741 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-23607146", "id": 1615741843, "os-flavor-access:is_public": "False"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:51.563797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d140cf24-02f7-4082-85eb-4757dffce741 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.027086 Aug 29 15:38:51.576924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d630e7c0-97e2-45b8-9b4b-d6fec2c99534 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:51.582157 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 168/355] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:51 2022] POST /compute/v2.1/flavors => generated 437 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:51.792472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:51.793069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:51.800573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.801273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.801703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.802513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:51.803177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:51.803913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:51.878330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.887968 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-09d0facd-5d96-4f1f-9d1e-e8d4060f61a1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1222 microversion: 2.1 time: 0.099291 Aug 29 15:38:51.888765 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 169/356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:51 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:51.918991 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d630e7c0-97e2-45b8-9b4b-d6fec2c99534 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/1615741843/action" status: 200 len: 97 microversion: 2.1 time: 0.346020 Aug 29 15:38:51.923405 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 188/357] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:38:51 2022] POST /compute/v2.1/flavors/1615741843/action => generated 97 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:38:51.933236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0543cd8f-1493-46ac-ac5a-4423f851793c tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:51.938889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0543cd8f-1493-46ac-ac5a-4423f851793c tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9219bd04e3094ffabddfc2b0d2e18583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a75d546db2fb40baa9ad3d22fbeb7ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0543cd8f-1493-46ac-ac5a-4423f851793c tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Request method failure captured: Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/flavors/1615741843/action HTTP/1.1 Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 70 Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2DBlUkApe5f_g4vWccXJ61N2VQ6R5NupHEZHvF6t0-3hcYKu7qLlC608PH_Qo4PYrG8SbuTo8Q33aOQJdiF25aUrOJDE7UAcnaf7I098ByUlfIViERJE_LTe_srnF6BtVOc30BkEsUbpzu2jdqZhyoMfXBnQ-xKjFMItzc9UuJ8gM Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a75d546db2fb40baa9ad3d22fbeb7ce1 Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-713056169 Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:38:51.944801 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a75d546db2fb40baa9ad3d22fbeb7ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a75d546db2fb40baa9ad3d22fbeb7ce1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a75d546db2fb40baa9ad3d22fbeb7ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a75d546db2fb40baa9ad3d22fbeb7ce1"}]}] Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-713056169 Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a75d546db2fb40baa9ad3d22fbeb7ce1 Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-713056169 Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FlavorsAccessNegativeTestJSON-713056169-project Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9219bd04e3094ffabddfc2b0d2e18583 Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-713056169-project Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: {"removeTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} Aug 29 15:38:51.946283 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1615741843', 'body': {'removeTenantAccess': {'tenant': 'a75d546db2fb40baa9ad3d22fbeb7ce1'}}} Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can( Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:51.947084 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 29 15:38:51.948615 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:51.949981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0543cd8f-1493-46ac-ac5a-4423f851793c tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:51.951156 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0543cd8f-1493-46ac-ac5a-4423f851793c tempest-FlavorsAccessNegativeTestJSON-713056169 tempest-FlavorsAccessNegativeTestJSON-713056169-project] 10.222.0.83 "POST /compute/v2.1/flavors/1615741843/action" status: 403 len: 133 microversion: 2.1 time: 0.025059 Aug 29 15:38:51.951913 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 170/358] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:38:51 2022] POST /compute/v2.1/flavors/1615741843/action => generated 133 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:51.963965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53c5bad6-6f02-40de-a012-291f37ac7089 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a75d546db2fb40baa9ad3d22fbeb7ce1"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:52.133857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.135179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.144987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.146948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.148199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.149239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.150812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.151610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.457540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.472259 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06177593-bf2d-496b-95d1-d79a386a15f6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.344958 Aug 29 15:38:52.477073 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 171/359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.483146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.487813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.504211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.505915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.507566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.508478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.511708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.512361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.644852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53c5bad6-6f02-40de-a012-291f37ac7089 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/1615741843/action" status: 200 len: 21 microversion: 2.1 time: 0.687754 Aug 29 15:38:52.650723 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 189/360] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:38:51 2022] POST /compute/v2.1/flavors/1615741843/action => generated 21 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:38:52.656659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.657391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.664181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.664783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.665481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.666260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.666796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.667348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.764718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.776799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.778428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.779586 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-43c1ec6d-36c8-4ef2-bb8f-64400733c43f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1313 microversion: 2.25 time: 0.127441 Aug 29 15:38:52.791619 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 190/361] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:52.799955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1fd6e493-8813-4783-870b-b63549675ec0 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.808781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:52.821063 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5cffb7c8-3b17-44a2-8cc7-9a1ae0a12c18 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1323 microversion: 2.1 time: 0.339148 Aug 29 15:38:52.822176 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 172/362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.838019 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1fd6e493-8813-4783-870b-b63549675ec0 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1615741843" status: 202 len: 0 microversion: 2.1 time: 0.045174 Aug 29 15:38:52.838618 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 191/363] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:38:52 2022] DELETE /compute/v2.1/flavors/1615741843 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:52.848349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56e3987e-bbd7-40e8-afe0-952e0c3f28a9 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.894986 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-56e3987e-bbd7-40e8-afe0-952e0c3f28a9 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.051296 Aug 29 15:38:52.898029 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 173/364] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:52.923749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ee78dcf-d4a8-4109-99d8-3d7e28242822 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1670479999", "id": 424612337, "os-flavor-access:is_public": "False"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:52.924182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:52.924937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:52.938641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.939425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.939855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.940746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:52.941385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:52.942000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:52.964894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ee78dcf-d4a8-4109-99d8-3d7e28242822 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.047301 Aug 29 15:38:52.966504 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 174/365] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:38:52 2022] POST /compute/v2.1/flavors => generated 436 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:52.978487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d1cf5da-2dd2-4dfb-9162-12ac3066bd7e tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d7bf3bf3b2aa46f9b8a821aeffd4570c"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:53.092234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.103244 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3340adf2-9855-424d-b9d3-56dc029a1f14 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1270 microversion: 2.1 time: 0.194561 Aug 29 15:38:53.104036 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 192/366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:52 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:53.303571 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-9d1cf5da-2dd2-4dfb-9162-12ac3066bd7e tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] HTTP exception thrown: Flavor access not found for 36 / d7bf3bf3b2aa46f9b8a821aeffd4570c combination. Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d1cf5da-2dd2-4dfb-9162-12ac3066bd7e tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Request method failure captured: Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/flavors/424612337/action HTTP/1.1 Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 70 Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2FpsMdXOG73rmDCqMLDen4VU5OUBqLNrLuiy3VcIFdsv7_FVYm_J0O89c-hz8FdPW_pF8I1cHo-5txsJG1Fi1BmrXZl2BHTTKGHXnts9U4g-SS7NFw4WZtj9mBEl7VhX2NIVuT6YWluQrKij3Zbxgt1e5pV3G1YZVwEHFF_FnjlPA Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ecea19ee353d4977baafbdf022b94887 Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:38:53.305353 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea19ee353d4977baafbdf022b94887"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea19ee353d4977baafbdf022b94887", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea19ee353d4977baafbdf022b94887"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea19ee353d4977baafbdf022b94887"}]}] Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ecea19ee353d4977baafbdf022b94887 Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-133470321 Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9a1de22711264e42abe8de3f935f35b1 Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: {"removeTenantAccess": {"tenant": "d7bf3bf3b2aa46f9b8a821aeffd4570c"}} Aug 29 15:38:53.306551 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: exception: Flavor access not found for 36 / d7bf3bf3b2aa46f9b8a821aeffd4570c combination. Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '424612337', 'body': {'removeTenantAccess': {'tenant': 'd7bf3bf3b2aa46f9b8a821aeffd4570c'}}} Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 29 15:38:53.307293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / d7bf3bf3b2aa46f9b8a821aeffd4570c combination. Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / d7bf3bf3b2aa46f9b8a821aeffd4570c combination. Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.308319 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / d7bf3bf3b2aa46f9b8a821aeffd4570c combination. Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d1cf5da-2dd2-4dfb-9162-12ac3066bd7e tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Returning 404 to user: Flavor access not found for 36 / d7bf3bf3b2aa46f9b8a821aeffd4570c combination. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d1cf5da-2dd2-4dfb-9162-12ac3066bd7e tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/424612337/action" status: 404 len: 124 microversion: 2.1 time: 0.332783 Aug 29 15:38:53.309404 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 175/367] 10.222.0.83 () {60 vars in 1197 bytes} [Mon Aug 29 15:38:52 2022] POST /compute/v2.1/flavors/424612337/action => generated 124 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:53.315990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57bbed29-dcac-44bd-8ea1-c223cca1f613 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.333840 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57bbed29-dcac-44bd-8ea1-c223cca1f613 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/424612337" status: 202 len: 0 microversion: 2.1 time: 0.021326 Aug 29 15:38:53.334667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 193/368] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:38:53 2022] DELETE /compute/v2.1/flavors/424612337 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:53.348037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dcfbc928-f151-4f28-ac2f-0918c632c9a4 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.381330 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dcfbc928-f151-4f28-ac2f-0918c632c9a4 tempest-FlavorsAccessNegativeTestJSON-133470321 tempest-FlavorsAccessNegativeTestJSON-133470321-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.040852 Aug 29 15:38:53.398480 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 176/369] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:53.500756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.501937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:53.509563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.510056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.510519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.511258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.518775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.519493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.825285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.846707 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-efa1689f-83d1-4faf-947c-a2c7fae1a052 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.350705 Aug 29 15:38:53.847316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 194/370] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:53.873753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.874378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:53.880492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.881476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.881910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.882617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:53.883111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:53.883516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:53.903889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:53.951237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.961285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.962800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:53.963972 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-99097465-56c3-4bd9-bde4-16e60aa74069 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1319 microversion: 2.25 time: 0.115726 Aug 29 15:38:53.971591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 195/371] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1319 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:53.978659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:53.983364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.002212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.002759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.003464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.008022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.008695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.009282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.033801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1dfa0da1-98ed-4899-9fc1-6daeb6352b39 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Calling method '.version_select at 0x7f32eef25790>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.262864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.277910 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2484e7a0-f6ce-4a0a-981a-6aebb4014952 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1323 microversion: 2.1 time: 0.304288 Aug 29 15:38:54.278501 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 196/372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.283104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.288510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.298149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.299386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.299826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.300759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.301221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.303825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.510356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:54.524281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-daf74975-2097-4228-8534-caad295b7684 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1276 microversion: 2.1 time: 0.244691 Aug 29 15:38:54.524880 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 197/373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:54.605160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1dfa0da1-98ed-4899-9fc1-6daeb6352b39 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557" status: 200 len: 371 microversion: 2.1 time: 0.912687 Aug 29 15:38:54.614435 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 177/374] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:38:53 2022] GET /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557 => generated 371 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:54.619406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Action: 'update', calling method: .version_select at 0x7f32eee18af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:54.872262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.874039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:54.875571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.877800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.879234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.881485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.882161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.884484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.884766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.885602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.886610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.897475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:54.898429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:54.899132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:54.985509 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d9229dc9-69d7-436b-a695-6967fb58b54e tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557" status: 200 len: 328 microversion: 2.1 time: 0.370702 Aug 29 15:38:54.988062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 198/375] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:38:54 2022] PUT /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557 => generated 328 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:54.998740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:54.999695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.012422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.014043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.014820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.018549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.020214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.022068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.217122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.228586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8d136fe-878c-491f-917e-78d139945105 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.363862 Aug 29 15:38:55.243065 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 178/376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:55.243756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-057f15b3-dab7-4d04-a767-cd930bc0aad1 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.269172 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-057f15b3-dab7-4d04-a767-cd930bc0aad1 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557" status: 202 len: 0 microversion: 2.1 time: 0.036601 Aug 29 15:38:55.270136 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 179/377] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:38:55 2022] DELETE /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:38:55.280455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9dd40ed-9cce-43e8-85ca-19c77cce45a0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Calling method '.version_select at 0x7f32eef1faf0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.522438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.548100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.557894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:55.564667 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-492ca6c0-60ec-4ca0-a34b-9a3c9e72e234 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.575321 Aug 29 15:38:55.569109 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 199/378] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:54 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:55.594449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.597704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.616451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.621281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.621731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.626075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.626535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.631650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.717134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9dd40ed-9cce-43e8-85ca-19c77cce45a0 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557" status: 200 len: 371 microversion: 2.1 time: 0.441456 Aug 29 15:38:55.718449 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 180/379] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/os-quota-sets/f03b5a83a1334637a71483a2fe697557 => generated 371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:55.724022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:55.725767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:55.734093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.734812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.735537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:55.736615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:55.737455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:55.739178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.264773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.279483 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-343e047b-ddcd-4b13-9401-d50ddfea8869 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.556913 Aug 29 15:38:56.281510 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 181/380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:56.300076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.311853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4754e5c7-61bf-4d94-be15-3491d83d2bef tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Calling method '.version_select at 0x7f32eeeb3f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.315468 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d350b45-8f14-4abd-bb94-493ee3cf5eda tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1323 microversion: 2.1 time: 0.733162 Aug 29 15:38:56.317807 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 200/381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:55 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1323 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:56.329377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.330859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.343189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.344129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.345017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.346559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.347323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.348269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.574623 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4754e5c7-61bf-4d94-be15-3491d83d2bef tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.291336 Aug 29 15:38:56.576430 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 182/382] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6/defaults => generated 371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:56.581871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-dfc12b96-6ec9-42fc-9b54-2db8852ae2a3 req-4d922b54-e1af-428c-adba-1ed90eed4461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d99101-0823-46e5-9f79-d44dfabf604c", "tag": "e9d2f9a1-50b7-4d78-8fe3-09622b410585"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:56.595353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dfc12b96-6ec9-42fc-9b54-2db8852ae2a3 req-4d922b54-e1af-428c-adba-1ed90eed4461 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.595836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dfc12b96-6ec9-42fc-9b54-2db8852ae2a3 req-4d922b54-e1af-428c-adba-1ed90eed4461 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.596270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dfc12b96-6ec9-42fc-9b54-2db8852ae2a3 req-4d922b54-e1af-428c-adba-1ed90eed4461 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.609276 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-dfc12b96-6ec9-42fc-9b54-2db8852ae2a3 req-4d922b54-e1af-428c-adba-1ed90eed4461 service nova] Creating event network-changed:e9d2f9a1-50b7-4d78-8fe3-09622b410585 for instance 64d99101-0823-46e5-9f79-d44dfabf604c on n-h2-836830-13 Aug 29 15:38:56.615845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-dfc12b96-6ec9-42fc-9b54-2db8852ae2a3 req-4d922b54-e1af-428c-adba-1ed90eed4461 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037365 Aug 29 15:38:56.617708 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 183/383] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:56.624294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:56.626477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:56.635422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.636419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.637124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.638295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.639527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.641005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.800652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.812454 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2057e446-712d-4e6d-9171-99c108cdac29 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.488948 Aug 29 15:38:56.828342 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 201/384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:56.835484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-05be8f26-cf8d-4d16-aaa5-ab561561f2ec req-4b32fdaf-f3ba-4929-91cb-8b64c4317518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2d7a62-7fe7-4929-b78e-3b523dc8a929", "name": "network-vif-plugged", "status": "completed", "tag": "65c347dd-1374-473a-a580-cb4ebd4b80d3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:56.850305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-05be8f26-cf8d-4d16-aaa5-ab561561f2ec req-4b32fdaf-f3ba-4929-91cb-8b64c4317518 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:56.851146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-05be8f26-cf8d-4d16-aaa5-ab561561f2ec req-4b32fdaf-f3ba-4929-91cb-8b64c4317518 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:56.851759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-05be8f26-cf8d-4d16-aaa5-ab561561f2ec req-4b32fdaf-f3ba-4929-91cb-8b64c4317518 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:56.865436 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-05be8f26-cf8d-4d16-aaa5-ab561561f2ec req-4b32fdaf-f3ba-4929-91cb-8b64c4317518 service nova] Creating event network-vif-plugged:65c347dd-1374-473a-a580-cb4ebd4b80d3 for instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 on n-h1-836830-13 Aug 29 15:38:56.872526 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-05be8f26-cf8d-4d16-aaa5-ab561561f2ec req-4b32fdaf-f3ba-4929-91cb-8b64c4317518 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042541 Aug 29 15:38:56.874039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 202/385] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:56.900602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.909976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.916032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:56.917611 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1990548-49b4-4df7-a44c-bd0eff26b57f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.298639 Aug 29 15:38:56.918685 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 184/386] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:56 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:56.934853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Action: 'update', calling method: .version_select at 0x7f32eee18e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:57.079486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.079968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.080400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.081114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.081563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.081978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.137072 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15082d7f-a046-4317-ac44-c9f1fb9b089c tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14" status: 200 len: 328 microversion: 2.1 time: 0.206836 Aug 29 15:38:57.143586 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 203/387] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:38:56 2022] PUT /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14 => generated 328 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:57.150127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Calling method '.version_select at 0x7f32eef25820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.219248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.219738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.220330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.220899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.221351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.222120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.241589 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f07b4400-ba7c-4765-b21e-e1d44d9c2f82 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14/detail" status: 200 len: 916 microversion: 2.1 time: 0.096052 Aug 29 15:38:57.242208 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 185/388] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14/detail => generated 916 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:38:57.307863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.309101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.328090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.329334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.330225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.331153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.331884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.332507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.340241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.341653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.352193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.353275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.353974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.355441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.356117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.356785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.610892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.623569 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0376d287-510a-41f2-b31a-d8f18eff16b4 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1323 microversion: 2.1 time: 0.289658 Aug 29 15:38:57.627408 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 186/389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:57.634649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Action: 'update', calling method: .version_select at 0x7f32eef25430>, body: {"quota_set": {"ram": "2048"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:57.675691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:57.691768 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c86e6e6-99e0-4a3e-85c2-b5ab60dd41f1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.393472 Aug 29 15:38:57.692561 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 204/390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:57.697509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-899ef453-a279-4083-869c-a47aee08cf0a req-a1d81202-8dd7-4da1-800c-1abee517678b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ded473b-3579-4ae6-bc06-c592f9a2ff27", "tag": "a1f80472-728b-4075-96ee-a1794cf38722"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:57.719424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-899ef453-a279-4083-869c-a47aee08cf0a req-a1d81202-8dd7-4da1-800c-1abee517678b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.721473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-899ef453-a279-4083-869c-a47aee08cf0a req-a1d81202-8dd7-4da1-800c-1abee517678b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.722064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-899ef453-a279-4083-869c-a47aee08cf0a req-a1d81202-8dd7-4da1-800c-1abee517678b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.748323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-899ef453-a279-4083-869c-a47aee08cf0a req-a1d81202-8dd7-4da1-800c-1abee517678b service nova] Creating event network-changed:a1f80472-728b-4075-96ee-a1794cf38722 for instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 on n-h2-836830-13 Aug 29 15:38:57.757003 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-899ef453-a279-4083-869c-a47aee08cf0a req-a1d81202-8dd7-4da1-800c-1abee517678b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062913 Aug 29 15:38:57.761388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 205/391] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:57.838654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:57.839476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:57.841074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.841917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.842512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.843353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.844018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.844439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.847914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.848644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.849857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.851127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.851994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.852609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.924637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.925410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.926218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:57.927113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:57.928646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:57.929255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.008516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.017484 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ba68fc1-8a3b-40c6-ab63-d47ce2b0d799 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.183205 Aug 29 15:38:58.021768 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 206/392] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:57 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:38:58.027718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.028689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.044321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.046433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.048156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.049733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.050367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.050952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.066459 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e17f9967-835b-47c5-8aaa-9723a2ae79ae tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14?user_id=79469725d8b24289846eef62bf0427d6" status: 200 len: 328 microversion: 2.1 time: 0.437386 Aug 29 15:38:58.074875 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 187/393] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:38:57 2022] PUT /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14?user_id=79469725d8b24289846eef62bf0427d6 => generated 328 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:58.080498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81ee3795-80dc-4ecc-9807-aaa6dd5f1fa7 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Calling method '.version_select at 0x7f32eef25700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.278934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.292126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.294165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.295878 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b85efa7c-daab-40ea-8c36-0081afbffc7d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.272681 Aug 29 15:38:58.296447 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 207/394] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:58.426640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:58.432381 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81ee3795-80dc-4ecc-9807-aaa6dd5f1fa7 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14?user_id=79469725d8b24289846eef62bf0427d6" status: 200 len: 370 microversion: 2.1 time: 0.355779 Aug 29 15:38:58.433000 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 188/395] 10.222.0.83 () {58 vars in 1323 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/os-quota-sets/62f1f658f0944b66a46b5e496f61ec14?user_id=79469725d8b24289846eef62bf0427d6 => generated 370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:58.651351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.652634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.665176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.671677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.673019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.673913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.676490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.677938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.713479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:58.715643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:58.729110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.729601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.730028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.736514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:58.737296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:58.739462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:58.971297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:58.981334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02e9bba2-9706-45b3-8250-afb109272403 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1472 microversion: 2.1 time: 0.336491 Aug 29 15:38:58.994086 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 208/396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:59.008983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-69f69a3f-dc3d-4d99-8fdd-4687adb34d15 req-89220ffc-b2d0-4b26-bd9a-e0acdce9be6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b106a174-dbd7-4322-ad4f-e1489c630958", "name": "network-vif-plugged", "status": "completed", "tag": "68c8dd60-4bc8-40a7-bdf0-61e56ee38ac9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:38:59.030280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-69f69a3f-dc3d-4d99-8fdd-4687adb34d15 req-89220ffc-b2d0-4b26-bd9a-e0acdce9be6d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.034404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-69f69a3f-dc3d-4d99-8fdd-4687adb34d15 req-89220ffc-b2d0-4b26-bd9a-e0acdce9be6d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.035128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-69f69a3f-dc3d-4d99-8fdd-4687adb34d15 req-89220ffc-b2d0-4b26-bd9a-e0acdce9be6d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.048375 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-69f69a3f-dc3d-4d99-8fdd-4687adb34d15 req-89220ffc-b2d0-4b26-bd9a-e0acdce9be6d service nova] Creating event network-vif-plugged:68c8dd60-4bc8-40a7-bdf0-61e56ee38ac9 for instance b106a174-dbd7-4322-ad4f-e1489c630958 on n-h2-836830-13 Aug 29 15:38:59.054567 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-69f69a3f-dc3d-4d99-8fdd-4687adb34d15 req-89220ffc-b2d0-4b26-bd9a-e0acdce9be6d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057601 Aug 29 15:38:59.055599 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 209/397] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:59.061197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.061968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.069894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.070669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.071387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.072325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.073032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.073670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.111894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Request method failure captured: Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929/diagnostics HTTP/1.1 Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2AZUF-gdBPSxPLbhOnogEJa3efmSJD2ZN-L8EeMhgMW-Zv7_xvctlI1OYuV9NORpNoJAD-_71pc_0UE81h3WXRkLYOYNtqwIqP5f35vEeg8AnN1OgV53itcv0a5FzBU0u_pYNzRMxspRaknb0OB0Nu17_6mfhcRDuIIvAZJ_MvagQ Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 7261af070ed14fdba6888924eefb492a Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-882134222 Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:38:59.115696 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7261af070ed14fdba6888924eefb492a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7261af070ed14fdba6888924eefb492a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7261af070ed14fdba6888924eefb492a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7261af070ed14fdba6888924eefb492a"}]}] Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-882134222 Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 7261af070ed14fdba6888924eefb492a Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-882134222 Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerDiagnosticsNegativeTest-882134222-project Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 30d7f5f663fe43aaa83d4f896fc177db Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-882134222-project Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:38:59.116981 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '1b2d7a62-7fe7-4929-b78e-3b523dc8a929'} Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:38:59.118017 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 29 15:38:59.119441 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:38:59.121376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:38:59.122242 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e2dd35f-6566-4baf-8da0-4ff020afcf65 tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.065559 Aug 29 15:38:59.123066 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 210/398] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929/diagnostics => generated 117 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:38:59.133472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.134097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.136181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:38:59.144107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.144689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.145041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.145896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.146440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.146860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.222097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.236833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-050fe374-f347-44c6-87a0-27792ddfd7ab tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.526813 Aug 29 15:38:59.237864 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 189/399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:58 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:59.242574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c450616c-6425-432e-be9a-57b8dca932c7 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Calling method '.version_select at 0x7f32eef25f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.347863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.357212 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-06940b13-75e9-4577-906d-b9224d500195 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.228734 Aug 29 15:38:59.358169 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 211/400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:38:59.363064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.363600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.370310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.370758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.371588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.372026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.372619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.373724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.405464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:38:59.561998 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77dea5d2-d173-49e1-b8df-db608b95083b tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 204 len: 0 microversion: 2.1 time: 0.198577 Aug 29 15:38:59.562946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 212/401] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:38:59 2022] DELETE /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:38:59.576207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.580582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.595345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.597522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.599403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.600393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.603116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.603882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.707638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c450616c-6425-432e-be9a-57b8dca932c7 tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.468782 Aug 29 15:38:59.710959 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 190/402] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6/defaults => generated 371 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:38:59.719792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:38:59.720637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:38:59.729088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.730347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.730999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.732021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:38:59.732877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:38:59.733992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:38:59.838221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.850053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.852424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:38:59.853904 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-957f9874-8a52-4ea5-bcfe-058c624da830 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.288101 Aug 29 15:38:59.854741 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 213/403] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:38:59.859631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Action: 'update', calling method: .version_select at 0x7f32eee619d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:00.040580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:00.050284 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-188dbf8e-3b87-4189-8b05-e233e394010d tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1478 microversion: 2.1 time: 0.335446 Aug 29 15:39:00.056874 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 191/404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:38:59 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1478 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:00.260672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.261374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.276781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.277416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.277976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.279814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.281579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.284862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.288596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.289077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.290859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.291651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.292148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.292731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.303563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:00.700627 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-efe54689-d0fb-481e-bfe6-0a2eadfefbbc tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6" status: 200 len: 329 microversion: 2.1 time: 0.844445 Aug 29 15:39:00.718403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 214/405] 10.222.0.83 () {60 vars in 1263 bytes} [Mon Aug 29 15:38:59 2022] PUT /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6 => generated 329 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:00.723669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:00.724604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:00.744480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.745360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.745674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:00.746665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:00.747982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:00.748397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.043546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.056936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8c2a88e-98b5-4e50-93f0-9ca25cac54a5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.337111 Aug 29 15:39:01.058404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 215/406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:01.064842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Action: 'update', calling method: .version_select at 0x7f32eeeaa8b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:01.103498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.119288 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1b340346-b2b6-438f-9e7c-8b3bb8d9a753 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.860401 Aug 29 15:39:01.133520 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 192/407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:00 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:01.149181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.149916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.157224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.157990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.158647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.159537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.160149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.160722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.293694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=65 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:01.302069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.304963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.305359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.306133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.306586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.307007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.328155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=35 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:01.657563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.672278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.674654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:01.676209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08356b63-7461-41d8-8119-2b0b1b090a84 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.539832 Aug 29 15:39:01.679348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 193/408] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:01.719549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=10,nova_api:INSERT=24 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:01.801932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Calling method '.version_select at 0x7f32eeedac10>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.810496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.811435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.812193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.861986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.863384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.865213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.912118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.917208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.918116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.921015 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6b1ffb4-c861-42e9-bb7f-04d6e25de54f tempest-QuotasAdminTestJSON-478782406 tempest-QuotasAdminTestJSON-478782406-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6" status: 200 len: 329 microversion: 2.1 time: 0.861321 Aug 29 15:39:01.947114 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 216/409] 10.222.0.83 () {60 vars in 1263 bytes} [Mon Aug 29 15:39:01 2022] PUT /compute/v2.1/os-quota-sets/2cbf43758c944fe6bb6fad543fd251a6 => generated 329 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:01.956044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.956460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:01.956573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.957068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.957973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:01.967471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.967967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.968397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:01.969412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:01.969874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:01.970298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.011262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.012118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.012855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.013614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lazy-loading 'fault' on Instance uuid 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:02.041235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.042099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.042686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.051670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36c47b56-057f-4353-a7fe-600bedf1a0fb tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2077 microversion: 2.53 time: 0.371030 Aug 29 15:39:02.053544 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 194/410] 10.222.0.83 () {60 vars in 1243 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2077 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:02.058747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bf307487-33d4-42a3-ae81-f200a0ee2e74 req-a9c6946f-4fee-4a73-a319-0b609f4e5509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2d7a62-7fe7-4929-b78e-3b523dc8a929", "name": "network-vif-deleted", "tag": "65c347dd-1374-473a-a580-cb4ebd4b80d3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:02.069513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf307487-33d4-42a3-ae81-f200a0ee2e74 req-a9c6946f-4fee-4a73-a319-0b609f4e5509 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.069993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf307487-33d4-42a3-ae81-f200a0ee2e74 req-a9c6946f-4fee-4a73-a319-0b609f4e5509 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.070545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf307487-33d4-42a3-ae81-f200a0ee2e74 req-a9c6946f-4fee-4a73-a319-0b609f4e5509 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.084973 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bf307487-33d4-42a3-ae81-f200a0ee2e74 req-a9c6946f-4fee-4a73-a319-0b609f4e5509 service nova] Creating event network-vif-deleted:65c347dd-1374-473a-a580-cb4ebd4b80d3 for instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 on n-h1-836830-13 Aug 29 15:39:02.090795 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bf307487-33d4-42a3-ae81-f200a0ee2e74 req-a9c6946f-4fee-4a73-a319-0b609f4e5509 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035877 Aug 29 15:39:02.091758 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 195/411] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:02.094871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30d7f5f663fe43aaa83d4f896fc177db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7261af070ed14fdba6888924eefb492a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.105853 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7e619a45-96a9-452d-9f26-3738a7d60d3e tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 200 len: 1313 microversion: 2.1 time: 0.157367 Aug 29 15:39:02.106032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Calling method '.version_select at 0x7f32eef1fee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.109041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 217/412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:01 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.110669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.111226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.111781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.127350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.129186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.136275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.137041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.137655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.144956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.151338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.151966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.152777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.153475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.154187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.158344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:02.168341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.169181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.169961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.182939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.183839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.184733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.233822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.234476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.235083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.244263 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-852437c4-b89c-4389-b35e-0c6d2d48cef7 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 767 microversion: 2.53 time: 0.141812 Aug 29 15:39:02.244978 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 196/413] 10.222.0.83 () {60 vars in 1222 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 767 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:02.252378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.256702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.264855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.265606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.266047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.266797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.267279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.267738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.452914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.463126 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0eefcd64-2128-4449-a355-1221ffc15071 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1319 microversion: 2.1 time: 0.349140 Aug 29 15:39:02.464149 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 218/414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.469254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Calling method '.version_select at 0x7f32eeeaa4c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.472836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.473508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.473939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.497628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.498188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.498869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.521951 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d68bad4f-2d49-4d2e-8bc2-ec86e0a44007 tempest-HypervisorAdminV253TestBase-2071747035 tempest-HypervisorAdminV253TestBase-2071747035-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/3483d464-4aa9-4900-8568-a192b6f12386" status: 200 len: 794 microversion: 2.53 time: 0.055253 Aug 29 15:39:02.533234 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 219/415] 10.222.0.83 () {60 vars in 1298 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/os-hypervisors/3483d464-4aa9-4900-8568-a192b6f12386 => generated 794 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:02.712612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:02.713375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:02.727204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.729272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.730606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.734174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:02.735320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:02.737464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:02.815889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.825501 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-481c141a-d8a3-4859-9a5f-a844416216af tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.577239 Aug 29 15:39:02.829926 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 197/416] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:02.979087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.988902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.991552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:02.993004 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68aaa531-798c-4cb3-a18e-2db31ac2ffe4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.285610 Aug 29 15:39:02.993890 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 220/417] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:02 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:03.129756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.130578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] [instance: 1b2d7a62-7fe7-4929-b78e-3b523dc8a929] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.137731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.138220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.138649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.139458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.140076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.140760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.157287 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] HTTP exception thrown: Instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 could not be found. Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Request method failure captured: Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 HTTP/1.1 Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2AZUF-gdBPSxPLbhOnogEJa3efmSJD2ZN-L8EeMhgMW-Zv7_xvctlI1OYuV9NORpNoJAD-_71pc_0UE81h3WXRkLYOYNtqwIqP5f35vEeg8AnN1OgV53itcv0a5FzBU0u_pYNzRMxspRaknb0OB0Nu17_6mfhcRDuIIvAZJ_MvagQ Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7261af070ed14fdba6888924eefb492a Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-882134222 Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:39:03.159283 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7261af070ed14fdba6888924eefb492a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7261af070ed14fdba6888924eefb492a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7261af070ed14fdba6888924eefb492a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7261af070ed14fdba6888924eefb492a"}]}] Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-882134222 Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7261af070ed14fdba6888924eefb492a Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-882134222 Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerDiagnosticsNegativeTest-882134222-project Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 30d7f5f663fe43aaa83d4f896fc177db Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-882134222-project Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 could not be found. Aug 29 15:39:03.160728 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1b2d7a62-7fe7-4929-b78e-3b523dc8a929'} Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 could not be found. Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:03.162085 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 could not be found. Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 could not be found. Aug 29 15:39:03.164627 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:03.166058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] Returning 404 to user: Instance 1b2d7a62-7fe7-4929-b78e-3b523dc8a929 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:03.166058 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9256eca3-70e9-4727-aca7-1449826ff4eb tempest-ServerDiagnosticsNegativeTest-882134222 tempest-ServerDiagnosticsNegativeTest-882134222-project] 10.222.0.83 "GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929" status: 404 len: 111 microversion: 2.1 time: 0.034857 Aug 29 15:39:03.167320 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 198/418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/1b2d7a62-7fe7-4929-b78e-3b523dc8a929 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:03.486984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.487735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.504489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.507987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.509168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.510011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.511113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.511560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.733405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:03.750767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-228e3c24-4ccf-4d84-bed1-2ae6c0b34442 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1468 microversion: 2.1 time: 0.268661 Aug 29 15:39:03.759861 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 221/419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1468 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:03.852937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:03.853802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:03.867528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.868060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.868507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:03.871491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:03.871914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:03.872376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.303986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.304600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.314468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.315059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.315473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.316170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.316618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.317038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.360196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.376613 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-247a32a9-badc-48aa-ac9e-14a4b0988ce2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.528211 Aug 29 15:39:04.379583 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 222/420] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:03 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:04.382736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:04.406259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.407405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.420357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.421418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.422067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.423182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.423845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.425540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.602337 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-72679214-8f1a-46d8-8b67-6da67b160d49 tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] 10.222.0.83 "DELETE /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 204 len: 0 microversion: 2.1 time: 0.829399 Aug 29 15:39:04.606239 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 199/421] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:03 2022] DELETE /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:39:04.612397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e57fece8-f093-431d-925e-d91766b62724 req-0b8d3f3f-9c5f-4b2a-bf12-98c815cffac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d99101-0823-46e5-9f79-d44dfabf604c", "name": "network-vif-plugged", "status": "completed", "tag": "e9d2f9a1-50b7-4d78-8fe3-09622b410585"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:04.628335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e57fece8-f093-431d-925e-d91766b62724 req-0b8d3f3f-9c5f-4b2a-bf12-98c815cffac2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.633199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e57fece8-f093-431d-925e-d91766b62724 req-0b8d3f3f-9c5f-4b2a-bf12-98c815cffac2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.633860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e57fece8-f093-431d-925e-d91766b62724 req-0b8d3f3f-9c5f-4b2a-bf12-98c815cffac2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.648040 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e57fece8-f093-431d-925e-d91766b62724 req-0b8d3f3f-9c5f-4b2a-bf12-98c815cffac2 service nova] Creating event network-vif-plugged:e9d2f9a1-50b7-4d78-8fe3-09622b410585 for instance 64d99101-0823-46e5-9f79-d44dfabf604c on n-h2-836830-13 Aug 29 15:39:04.654010 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e57fece8-f093-431d-925e-d91766b62724 req-0b8d3f3f-9c5f-4b2a-bf12-98c815cffac2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046247 Aug 29 15:39:04.655873 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 200/422] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:04.667255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.668113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.674813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.675591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.676021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.676905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.678167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.678914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.694707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.707934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.710305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:04.711749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d3d1727-c29e-465d-af80-a5521450e7d5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.329862 Aug 29 15:39:04.711981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:04.719046 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 223/423] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:04.730947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:04.731929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:04.752918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.754828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.759201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.760881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:04.761514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:04.762952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:04.870790 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec13698f-3514-4e34-9848-66e353b7a786 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 204 len: 0 microversion: 2.1 time: 0.211087 Aug 29 15:39:04.873259 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 201/424] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:04 2022] DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:05.015812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:05.025662 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9afde767-a23e-4a10-98a4-883a5f3e98dd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1474 microversion: 2.1 time: 0.303676 Aug 29 15:39:05.042149 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 224/425] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:04 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1474 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:05.085768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-873996543", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "975624358", "adminPass": "***", "networks": [{"uuid": "dd29eb79-db28-4b1a-9ba1-635d40ee17be"}], "security_groups": [{"name": "tempest-securitygroup--1319958693"}], "key_name": "tempest-keypair-622685922", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:05.329150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] validate_networks() for [('dd29eb79-db28-4b1a-9ba1-635d40ee17be', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:05.404823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:05.407631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:05.440965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.443732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.446140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.450230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.450973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.454299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.750568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:05.761162 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b1a22305-aa6a-480a-b06f-5a431d1261ae tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.361108 Aug 29 15:39:05.777129 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 225/426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:05 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:05.788163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:05.792759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:05.820441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.820936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.821368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:05.828209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:05.828720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:05.830226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.026911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:06.027375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:06.027844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:06.028398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:06.028818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:06.044350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.044918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.045364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.046136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.046589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.059283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.103174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:06.153449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Getting quotas for project 3ab5abb97d5e40b0a4dea82546dcb92c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:06.168515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Getting quotas for user 06856f1488e44bde85de23a5effddbdd and project 3ab5abb97d5e40b0a4dea82546dcb92c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:06.210392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:06.217335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:06.263174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.286511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.291109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.294675 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e243b13-4c91-43b8-b20a-3afcfcfe316e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.528035 Aug 29 15:39:06.298638 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 226/427] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:05 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:06.307423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:06.308130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:06.317379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.319227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.319805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.320925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.321460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.322081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.365565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9257c1f2-ba7a-4c22-9ba2-dc036e4a4c99 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.290377 Aug 29 15:39:06.367401 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 202/428] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:06.379283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b95477c6-9d1e-4211-971c-f66b77fb425c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:06.383103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b95477c6-9d1e-4211-971c-f66b77fb425c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:06.570675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b95477c6-9d1e-4211-971c-f66b77fb425c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.577902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b95477c6-9d1e-4211-971c-f66b77fb425c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1261 microversion: 2.1 time: 0.203344 Aug 29 15:39:06.582343 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 203/429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:06 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:06.785432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:06.787652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:06.799712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.804836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.805507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.806429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:06.807065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:06.807821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:06.946433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:06.964109 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-160302d9-2181-4d72-9b7f-f2e22d1d696a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1474 microversion: 2.1 time: 0.662292 Aug 29 15:39:06.964947 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 227/430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:06 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1474 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:07.088827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:07.099832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fffb90f-08b8-47e9-bcaf-224f4a2b52e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.317631 Aug 29 15:39:07.105307 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 204/431] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:06 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:07.326397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:07.327333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:07.337447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.338604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.339295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.340829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.354923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.356915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.605618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:07.606134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:07.619311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.620019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.623251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.624196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:07.625341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:07.628982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:07.786173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:07.798439 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee024e02-9bb3-45a0-a2b5-a5b1fb3a96d1 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1313 microversion: 2.1 time: 0.197809 Aug 29 15:39:07.801056 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 205/432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:07 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:07.978473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:07.985624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:07.986397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:07.992056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:07.993518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:07.998301 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce4d40dd-7e96-4dcf-baa2-d709a68c2940 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 0.673535 Aug 29 15:39:07.999011 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 228/433] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:07 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:08.002965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.004767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.005377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.011434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.011920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.012357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.124704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:08.125777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:08.137671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.138171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.143297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.144075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.149146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.149967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.566473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:08.581068 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5c33e4b-d2fa-482c-9139-ac0d7cfd7aa2 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.460129 Aug 29 15:39:08.581720 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 229/434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:08 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:08.823577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:08.824816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:08.825441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:08.831895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.833042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.834159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.834878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:08.835369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:08.835845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:08.838865 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-780fd66d-504b-4290-81af-90d7f4df7c97 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1474 microversion: 2.1 time: 0.857046 Aug 29 15:39:08.843324 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 206/435] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:07 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1474 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:08.967324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:08.993767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ebfc1d08-843a-4409-b927-d7921b37cd54 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1319 microversion: 2.1 time: 0.172303 Aug 29 15:39:09.003927 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 230/436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:08 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:09.024738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.026020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.037611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.053076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.054002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.055992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.056813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.057466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.097550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9cf115ba-b09b-47f6-87b6-5d762400e6b1 req-7b15f2e4-e6ea-409c-a098-1d680aeba7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180653fe-00d9-440b-b260-5e6c16dbabfb", "name": "network-vif-deleted", "tag": "5129e17a-8d35-4a8f-b26c-f8ea560ecc67"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:09.150848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9cf115ba-b09b-47f6-87b6-5d762400e6b1 req-7b15f2e4-e6ea-409c-a098-1d680aeba7a8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.154610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9cf115ba-b09b-47f6-87b6-5d762400e6b1 req-7b15f2e4-e6ea-409c-a098-1d680aeba7a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.155608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9cf115ba-b09b-47f6-87b6-5d762400e6b1 req-7b15f2e4-e6ea-409c-a098-1d680aeba7a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.221625 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9cf115ba-b09b-47f6-87b6-5d762400e6b1 req-7b15f2e4-e6ea-409c-a098-1d680aeba7a8 service nova] Creating event network-vif-deleted:5129e17a-8d35-4a8f-b26c-f8ea560ecc67 for instance 180653fe-00d9-440b-b260-5e6c16dbabfb on n-h1-836830-13 Aug 29 15:39:09.242226 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9cf115ba-b09b-47f6-87b6-5d762400e6b1 req-7b15f2e4-e6ea-409c-a098-1d680aeba7a8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148987 Aug 29 15:39:09.247702 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 231/437] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:39:09.605514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:09.606856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:09.619888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.639006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.639774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:09.644056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:09.645678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:09.647758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.064610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.069106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:10.080559 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dbb5f6c3-9f2e-449a-a779-0689e5433c89 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.479318 Aug 29 15:39:10.086232 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 232/438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:10.124798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.138850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.154524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.159581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.163287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.164902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.165933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.166583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.350456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.362080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.372958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.379833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b52db84-ce1a-46cb-879d-cadb66bbd69f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1361 microversion: 2.25 time: 1.358740 Aug 29 15:39:10.384000 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 207/439] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:09 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1361 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:10.400088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:10.407269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:10.430577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.431969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.433293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.436614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:10.437276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:10.438927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:10.730730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:10.749200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b1fb056-d953-4c81-bf39-e3f2e1c98fd2 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1474 microversion: 2.1 time: 0.637943 Aug 29 15:39:10.759717 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 233/440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1474 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.123261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:11.125144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.148067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.156674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.160333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.170638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.173855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.174500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.186403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.203485 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0d744e8-8406-4976-b294-c9b21074519b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1319 microversion: 2.1 time: 0.815536 Aug 29 15:39:11.204110 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 208/441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:10 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1319 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:11.347329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:11.853856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1007563887", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:11.888928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:11.910967 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33aa1529-68bb-4a93-84cd-043fe15704d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.797610 Aug 29 15:39:11.915874 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 234/442] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:11.917550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=33 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:11.949540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:11.952673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:11.967534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.971322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.972128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:11.975562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:11.977591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:11.978290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.012825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:12.429066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.446389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.451678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:12.456144 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-436ea848-10e6-4db6-b47d-bee1217744ec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1557 microversion: 2.25 time: 0.539149 Aug 29 15:39:12.459867 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 235/443] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:11 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1557 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:12.795748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:12.796175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:12.796652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:12.797059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:12.797470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:12.811718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=47 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:12.815809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.819714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.826588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.832037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.833013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.833662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.902169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Getting quotas for project 068087b8e3274eb98dabdb60c8db2368. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:12.914351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Getting quotas for user 67701a88fc354d4c9ae7d16f8ee1355b and project 068087b8e3274eb98dabdb60c8db2368. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:12.917183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:12.924536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.925711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.926586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.928591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:12.930485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:12.931125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:12.955218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:12.957494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:13.001855 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-612f17f7-f32e-4771-b1ea-7b441633b488 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.540100 Aug 29 15:39:13.002735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 236/444] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:12 2022] GET /compute/v2.1/os-services => generated 949 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:13.010207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.011118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.028985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.034332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.035705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.037183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.038107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.038701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.095389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17b4513f-8e72-4585-9f31-3f65150207c7 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890141 Aug 29 15:39:13.099950 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 209/445] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:13.131807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.132259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.132708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.133172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lazy-loading 'fault' on Instance uuid b106a174-dbd7-4322-ad4f-e1489c630958 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:13.216774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d044707b-28ff-4c3a-8d3c-ca9b79450385 tempest-InstanceUsageAuditLogTestJSON-1811785315 tempest-InstanceUsageAuditLogTestJSON-1811785315-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.264049 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d044707b-28ff-4c3a-8d3c-ca9b79450385 tempest-InstanceUsageAuditLogTestJSON-1811785315 tempest-InstanceUsageAuditLogTestJSON-1811785315-project-admin] 10.222.0.83 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29 15:39:12" status: 200 len: 318 microversion: 2.1 time: 0.162752 Aug 29 15:39:13.265674 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 210/446] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-29%2015%3A39%3A12 => generated 318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:13.283592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5ccc59ef-f587-45e9-8cb6-158511d8431d req-85e20282-a12a-42e9-a5e8-a929b334a29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ded473b-3579-4ae6-bc06-c592f9a2ff27", "name": "network-vif-plugged", "status": "completed", "tag": "a1f80472-728b-4075-96ee-a1794cf38722"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:13.303340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:13.324456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5ccc59ef-f587-45e9-8cb6-158511d8431d req-85e20282-a12a-42e9-a5e8-a929b334a29a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.324958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5ccc59ef-f587-45e9-8cb6-158511d8431d req-85e20282-a12a-42e9-a5e8-a929b334a29a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.330235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5ccc59ef-f587-45e9-8cb6-158511d8431d req-85e20282-a12a-42e9-a5e8-a929b334a29a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.370762 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-5ccc59ef-f587-45e9-8cb6-158511d8431d req-85e20282-a12a-42e9-a5e8-a929b334a29a service nova] Creating event network-vif-plugged:a1f80472-728b-4075-96ee-a1794cf38722 for instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 on n-h2-836830-13 Aug 29 15:39:13.383395 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5ccc59ef-f587-45e9-8cb6-158511d8431d req-85e20282-a12a-42e9-a5e8-a929b334a29a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116288 Aug 29 15:39:13.384764 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 211/447] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:13.391511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.392056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.404239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.404745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.405180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.405952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.406317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.412721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.525493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:13.541189 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5840eb97-fbdc-4b65-8c88-c4db56724f70 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 200 len: 1309 microversion: 2.1 time: 0.536684 Aug 29 15:39:13.542779 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 237/448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:13.579368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0d55ec92-dc24-4b60-bbd9-4dc40ce8c655 req-1c552dab-05cc-4b86-8317-2d60d82624c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b106a174-dbd7-4322-ad4f-e1489c630958", "name": "network-vif-deleted", "tag": "68c8dd60-4bc8-40a7-bdf0-61e56ee38ac9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:13.590604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0d55ec92-dc24-4b60-bbd9-4dc40ce8c655 req-1c552dab-05cc-4b86-8317-2d60d82624c9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.591347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0d55ec92-dc24-4b60-bbd9-4dc40ce8c655 req-1c552dab-05cc-4b86-8317-2d60d82624c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.592915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0d55ec92-dc24-4b60-bbd9-4dc40ce8c655 req-1c552dab-05cc-4b86-8317-2d60d82624c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.648090 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0d55ec92-dc24-4b60-bbd9-4dc40ce8c655 req-1c552dab-05cc-4b86-8317-2d60d82624c9 service nova] Creating event network-vif-deleted:68c8dd60-4bc8-40a7-bdf0-61e56ee38ac9 for instance b106a174-dbd7-4322-ad4f-e1489c630958 on n-h2-836830-13 Aug 29 15:39:13.678257 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0d55ec92-dc24-4b60-bbd9-4dc40ce8c655 req-1c552dab-05cc-4b86-8317-2d60d82624c9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132093 Aug 29 15:39:13.684703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 238/449] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:13.951219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:13.952778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:13.962593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:13.975795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:13.978083 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-20755497-7c74-47c1-b263-90b3a3fc0dab tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1387 microversion: 2.1 time: 0.592097 Aug 29 15:39:13.980166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:13.996083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:13.996612 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 212/450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1387 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.001271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.002783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.003489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.010195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.016642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:14.033335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.033917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.034264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.039102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.041695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.042323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.316956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:14.330054 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbf8fb63-c4f8-4be1-a502-ffaa025f3695 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1318 microversion: 2.1 time: 0.331846 Aug 29 15:39:14.343137 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 213/451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:14.343137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.347553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.347553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.347945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.352003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.352687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.353279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.367286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:14.369891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 64d99101-0823-46e5-9f79-d44dfabf604c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:14.429519 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-033d3f11-32d2-424d-9057-4c2c575beb0a tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.097310 Aug 29 15:39:14.439849 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 214/452] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:14.453859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5659ac3-ab0a-4e8a-9611-47801f3c4bdc tempest-InstanceUsageAuditLogTestJSON-1811785315 tempest-InstanceUsageAuditLogTestJSON-1811785315-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.469870 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-103cb981-e8d5-47a8-a9e1-5fb1500c8925 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 2051 microversion: 2.25 time: 0.783751 Aug 29 15:39:14.470814 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 239/453] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:13 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 2051 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:14.487819 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5659ac3-ab0a-4e8a-9611-47801f3c4bdc tempest-InstanceUsageAuditLogTestJSON-1811785315 tempest-InstanceUsageAuditLogTestJSON-1811785315-project-admin] 10.222.0.83 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.040695 Aug 29 15:39:14.488408 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 215/454] 10.222.0.83 () {58 vars in 1185 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:14.493098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-151402149", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:14.506685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.510409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.510899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.511373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.512104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.519579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.520274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.567243 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac73895b-9542-468d-a6e2-78f935581dd7 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.073389 Aug 29 15:39:14.570450 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 216/455] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/os-services => generated 949 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:14.581089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:14.592636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:14.594154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:14.605254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.606644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.607347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.608495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:14.609174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:14.609817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:14.937873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 64d99101-0823-46e5-9f79-d44dfabf604c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:15.041919 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf32e31d-b080-42fd-b9dc-a694b958c572 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 2051 microversion: 2.25 time: 0.470104 Aug 29 15:39:15.043605 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 217/456] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:14 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 2051 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:15.057200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.059387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:15.070072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.070617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.071096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.071808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.072261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.072683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.091382 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] HTTP exception thrown: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Request method failure captured: Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 HTTP/1.1 Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN17aCRynDLFP-ILYn7D4gMztb5PckGS8jLJcYZM1RSl6sI1EM8fPC8W2_iwdHVfUN9Iaqjg4dTTKSV610snpeywnv2iI95TD8CC4Bmabfyf-IwiH-iEJ9qM__LIUYDq7EakDrwYyAcCnNCunb4kfa2Guawg7yVX_ybcyyLuPv8ENz0 Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:39:15.093312 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ccf42f8444482a9e97a08cf7668fd7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ccf42f8444482a9e97a08cf7668fd7"}]}] Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e63e67306f07404dab97802890c990a0 Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:15.094516 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b106a174-dbd7-4322-ad4f-e1489c630958'} Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:15.095269 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:15.097466 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:15.098713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Returning 404 to user: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:15.098713 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d512dc35-35df-4e3c-9ced-96d4feed939a tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 404 len: 111 microversion: 2.1 time: 0.049748 Aug 29 15:39:15.101369 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 218/457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:15.106725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.111440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.112211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.112810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.114025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.114868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.115778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.146128 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1fe1a4a7-5f49-4668-9d6c-3e5cb125382e tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?host=n-d-836830-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042979 Aug 29 15:39:15.154835 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 219/458] 10.222.0.83 () {58 vars in 1196 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/os-services?host=n-d-836830-13&binary=xxx => generated 16 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:15.161152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.162931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:15.171836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.172571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.173166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.174990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.175870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.176451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.504339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:15.518894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ec841aa-c0b5-48ea-a98e-ebb7696fb691 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1387 microversion: 2.1 time: 0.362413 Aug 29 15:39:15.520103 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 220/459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1387 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:15.526582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.531280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.532508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.533028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.535284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.535850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.536272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.543380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:15.544397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:15.545052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:15.546881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:15.547773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:15.559621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.560430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.561223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.562436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.563605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.564229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.574423 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b10d6e8c-9cb4-494a-8510-739dc0f82326 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.053008 Aug 29 15:39:15.593578 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 221/460] 10.222.0.83 () {60 vars in 1217 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:15.612521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.618055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.618749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.619479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.620443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.621092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.621716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.626756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Getting quotas for project 068087b8e3274eb98dabdb60c8db2368. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:15.644831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Getting quotas for user 67701a88fc354d4c9ae7d16f8ee1355b and project 068087b8e3274eb98dabdb60c8db2368. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:15.665436 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-caf0c7a1-5196-41f9-8a45-c50f79086017 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.070045 Aug 29 15:39:15.666671 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 222/461] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:15.672130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1980646671", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:15.702946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:15.705588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:15.746507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:15.802527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ecdd5903-0d14-4864-a212-14f0749ee09e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330484 Aug 29 15:39:15.807782 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 240/462] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:15.819469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:15.823648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:15.842825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.844030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.847005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:15.850747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:15.851407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:15.855185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.080656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:16.081143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:16.081538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:16.081914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:16.083139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:16.095317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.095993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.096576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.097452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.098080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.098788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.129761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Getting quotas for project 13ccf42f8444482a9e97a08cf7668fd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:16.136213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Getting quotas for user e63e67306f07404dab97802890c990a0 and project 13ccf42f8444482a9e97a08cf7668fd7. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:16.151185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:16.153896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:16.218741 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9bceb72d-aa5f-4085-8e80-cecc7afcbe88 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550552 Aug 29 15:39:16.219862 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 223/463] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:16.226879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-13", "block_migration": "auto"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:16.230323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:16.237848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.238731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.239667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.240676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.241383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.242004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.395002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'flavor' on Instance uuid 64d99101-0823-46e5-9f79-d44dfabf604c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:16.500210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Going to try to live migrate instance to n-h1-836830-13 {{(pid=129132) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:39:16.703169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:16.714113 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0c1f5f24-b8ee-4727-a840-3a6cf8d509d0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1468 microversion: 2.1 time: 0.904643 Aug 29 15:39:16.718588 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 241/464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:15 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1468 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:16.729541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:16.737911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.738407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.742568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.744171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.745416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.747457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.829833 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b35372ef-0003-4093-ac0e-2b139b1e7819 tempest-ServicesAdminNegativeTestJSON-613748367 tempest-ServicesAdminNegativeTestJSON-613748367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.103330 Aug 29 15:39:16.838290 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 242/465] 10.222.0.83 () {58 vars in 1198 bytes} [Mon Aug 29 15:39:16 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:16.863073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4761c9db-03d7-472e-a542-680751a34481 req-182d1565-f7e9-4b3a-ba79-77204805a13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d", "tag": "8d30ed14-51e2-4054-870b-8855250723d8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:16.893307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4761c9db-03d7-472e-a542-680751a34481 req-182d1565-f7e9-4b3a-ba79-77204805a13b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.894234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4761c9db-03d7-472e-a542-680751a34481 req-182d1565-f7e9-4b3a-ba79-77204805a13b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.895046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4761c9db-03d7-472e-a542-680751a34481 req-182d1565-f7e9-4b3a-ba79-77204805a13b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.917813 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4761c9db-03d7-472e-a542-680751a34481 req-182d1565-f7e9-4b3a-ba79-77204805a13b service nova] Creating event network-changed:8d30ed14-51e2-4054-870b-8855250723d8 for instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d on n-h1-836830-13 Aug 29 15:39:16.931511 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4761c9db-03d7-472e-a542-680751a34481 req-182d1565-f7e9-4b3a-ba79-77204805a13b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091785 Aug 29 15:39:16.937543 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 243/466] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:16.944792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:16.945845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:16.967578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.968514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.969168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:16.970099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:16.971167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:16.973955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.179333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:17.192291 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-63cc85d1-186e-4da2-b005-b46e6d39b2d4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1209 microversion: 2.1 time: 0.252840 Aug 29 15:39:17.194601 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 244/467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:16 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1209 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:17.207097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb17f913-deda-4693-8cc9-78e099c34623 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:17.208050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cb17f913-deda-4693-8cc9-78e099c34623 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:17.210904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:17.347547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cb17f913-deda-4693-8cc9-78e099c34623 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:17.370411 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb17f913-deda-4693-8cc9-78e099c34623 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1220 microversion: 2.1 time: 0.173429 Aug 29 15:39:17.373202 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 245/468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:17 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:17.393089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:17.394172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:17.403045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.404664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.405809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:17.406620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:17.407631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:17.408252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.248186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:18.257708 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b16595e6-c2ab-4fb4-83c1-c26ebd33b523 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1387 microversion: 2.1 time: 0.882359 Aug 29 15:39:18.267500 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 246/469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:17 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1387 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:18.272777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:18.273323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:18.295935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.296680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.297331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.298218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:18.298828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:18.299432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:18.484559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lazy-loading 'flavor' on Instance uuid 7ded473b-3579-4ae6-bc06-c592f9a2ff27 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:18.592884 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cfb2478f-c285-45f3-b5e9-96f4b00867d5 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27/action" status: 202 len: 0 microversion: 2.1 time: 0.323754 Aug 29 15:39:18.596571 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 247/470] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:18 2022] POST /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:19.096800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f4038352-27fc-4cdd-9118-f58d6a52f3f9 tempest-ServicesAdminNegativeTestJSON-2050081558 tempest-ServicesAdminNegativeTestJSON-2050081558-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.104895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f4038352-27fc-4cdd-9118-f58d6a52f3f9 tempest-ServicesAdminNegativeTestJSON-2050081558 tempest-ServicesAdminNegativeTestJSON-2050081558-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b88e2477a1f045ddad0b708732a31225', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b1119bf8134e529b2eede6020ac5f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f4038352-27fc-4cdd-9118-f58d6a52f3f9 tempest-ServicesAdminNegativeTestJSON-2050081558 tempest-ServicesAdminNegativeTestJSON-2050081558-project] Request method failure captured: Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2c2LbrGPz9SJixqEAcG1LIVGH6zgpR4IoReTlZqTNhFjYHC6JpgHsfCmhNhNqnbFLo2kD6TpPk2Sn8N0Pc7v-VDX2LxLPkwICfFR_tmrFb3U1uYEonZ2qnrTQAIO4HYtDNF615_GC_zWXHzUx78XK1AMycC6gGsY9Ay69hGdMKqRk Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 32b1119bf8134e529b2eede6020ac5f7 Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-2050081558 Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:39:19.110940 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32b1119bf8134e529b2eede6020ac5f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_32b1119bf8134e529b2eede6020ac5f7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32b1119bf8134e529b2eede6020ac5f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/32b1119bf8134e529b2eede6020ac5f7"}]}] Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-2050081558 Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 32b1119bf8134e529b2eede6020ac5f7 Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-2050081558 Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServicesAdminNegativeTestJSON-2050081558-project Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: b88e2477a1f045ddad0b708732a31225 Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-2050081558-project Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:39:19.112512 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:39:19.113361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 29 15:39:19.115519 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:19.122507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f4038352-27fc-4cdd-9118-f58d6a52f3f9 tempest-ServicesAdminNegativeTestJSON-2050081558 tempest-ServicesAdminNegativeTestJSON-2050081558-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:19.124218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f4038352-27fc-4cdd-9118-f58d6a52f3f9 tempest-ServicesAdminNegativeTestJSON-2050081558 tempest-ServicesAdminNegativeTestJSON-2050081558-project] 10.222.0.83 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.527962 Aug 29 15:39:19.138403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 248/471] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:18 2022] GET /compute/v2.1/os-services => generated 112 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:19.163362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.165800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.189300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.190540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.193853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.196507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.197249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.200104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.458052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.470505 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18686e49-b4b2-431d-b0ad-86df20a087ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1271 microversion: 2.1 time: 0.330656 Aug 29 15:39:19.491985 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 249/472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1271 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:19.501225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.504042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.523440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.524152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.524739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.525591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.526939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.528068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.698933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:19.715348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e96515c-2019-426d-95c8-cd59de5615b5 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1278 microversion: 2.1 time: 0.221601 Aug 29 15:39:19.719272 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 250/473] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:19.727919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:19.728616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:19.751364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.753284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.754488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:19.756899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:19.759911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:19.761395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.569794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:20.579946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6242bac8-912b-4c06-a54e-180de6353659 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1459 microversion: 2.1 time: 0.858919 Aug 29 15:39:20.586001 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 251/474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:19 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1459 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:20.592421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:20.595086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:20.610473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.610978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.612352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.613085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:20.639665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:20.640219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:20.701262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:21.256800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:21.264986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-672f4d0e-9800-4fbd-bab9-3bcddec82861 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1387 microversion: 2.1 time: 0.677091 Aug 29 15:39:21.266347 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 252/475] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:20 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1387 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:21.271629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.272436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.278861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.279747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.280453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.281658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.282332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.283000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.535909 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d34ef35b-c12e-4ded-ae79-b70ef282ab79 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c/action" status: 202 len: 0 microversion: 2.25 time: 5.314686 Aug 29 15:39:21.537882 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 224/476] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:39:16 2022] POST /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c/action => generated 0 bytes in 5317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:21.543165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.544009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.563289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.567006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.569920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.571992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.576896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.577464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.736987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:21.752492 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4383e9b4-311e-45e7-b7c9-60a468b781b3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.484815 Aug 29 15:39:21.753721 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 253/477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:21.760019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:21.760966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:21.768249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.768857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.769622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:21.770339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:21.770850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:21.772391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.132810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:22.141883 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90bddbfc-99dd-42b2-baaa-607320cf8598 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1278 microversion: 2.1 time: 0.386881 Aug 29 15:39:22.156731 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 254/478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:22.162004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c28461c7-142b-4b88-a6e1-b220a63e7087 req-5f638740-74c4-465e-bfa8-04a738e609e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d", "name": "network-vif-plugged", "status": "completed", "tag": "8d30ed14-51e2-4054-870b-8855250723d8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:22.173991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c28461c7-142b-4b88-a6e1-b220a63e7087 req-5f638740-74c4-465e-bfa8-04a738e609e8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.175042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c28461c7-142b-4b88-a6e1-b220a63e7087 req-5f638740-74c4-465e-bfa8-04a738e609e8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.175693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c28461c7-142b-4b88-a6e1-b220a63e7087 req-5f638740-74c4-465e-bfa8-04a738e609e8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.189645 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c28461c7-142b-4b88-a6e1-b220a63e7087 req-5f638740-74c4-465e-bfa8-04a738e609e8 service nova] Creating event network-vif-plugged:8d30ed14-51e2-4054-870b-8855250723d8 for instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d on n-h1-836830-13 Aug 29 15:39:22.195494 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c28461c7-142b-4b88-a6e1-b220a63e7087 req-5f638740-74c4-465e-bfa8-04a738e609e8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037043 Aug 29 15:39:22.199836 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 255/479] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:22.491502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3434ccd8-d702-4eb7-9a54-06348e5630be tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Action: 'create', calling method: .version_select at 0x7f32eec6d5e0>, body: {"keypair": {"name": "tempest-keypair-2017420291", "type": "ssh", "user_id": "f8a0c242c0c0443bbb99e1cd5371933e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZOxq9Ov5Bgh1d5wmaYshvqDKpeIDXNuvp3Fp+7Cz3Gq1Q9nuM5WvXLsX/R6PrQKNNL/i8kaLw+NeAgLvqjeICR8fsPsuykz79pLaWfzxU3jgdO2Yx7BK09GcbwZmsZHQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:22.538531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3434ccd8-d702-4eb7-9a54-06348e5630be tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Getting quotas for project 358d784c7a48416bb9bf68d7c6adee3f. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:22.549421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3434ccd8-d702-4eb7-9a54-06348e5630be tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Getting quotas for user d8f725e9c0a2461a9f1ecf7614603b36 and project 358d784c7a48416bb9bf68d7c6adee3f. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:22.574589 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e35af5b-8542-4f18-af55-8699ed312342 tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1612 microversion: 2.1 time: 1.035250 Aug 29 15:39:22.575489 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 225/480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:21 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1612 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:22.595258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d2a4ffbb-fde8-4b1d-aff2-1bd88b5172cd req-ede4948f-9d01-4e30-9f72-87449e335b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ecae4f-8a73-4f39-be3f-da87823b9d94", "tag": "0e4dbec9-a639-455d-9630-3a4e82a180c1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:22.609957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d2a4ffbb-fde8-4b1d-aff2-1bd88b5172cd req-ede4948f-9d01-4e30-9f72-87449e335b96 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.610716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d2a4ffbb-fde8-4b1d-aff2-1bd88b5172cd req-ede4948f-9d01-4e30-9f72-87449e335b96 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.611353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d2a4ffbb-fde8-4b1d-aff2-1bd88b5172cd req-ede4948f-9d01-4e30-9f72-87449e335b96 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.623964 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d2a4ffbb-fde8-4b1d-aff2-1bd88b5172cd req-ede4948f-9d01-4e30-9f72-87449e335b96 service nova] Creating event network-changed:0e4dbec9-a639-455d-9630-3a4e82a180c1 for instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 on n-h1-836830-13 Aug 29 15:39:22.630163 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d2a4ffbb-fde8-4b1d-aff2-1bd88b5172cd req-ede4948f-9d01-4e30-9f72-87449e335b96 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053456 Aug 29 15:39:22.631661 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3434ccd8-d702-4eb7-9a54-06348e5630be tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.430287 Aug 29 15:39:22.631816 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 226/481] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:22.632878 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 256/482] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 15:39:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:39:22.637531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:22.639890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:22.648667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:22.651580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:22.657887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.658376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.658994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.659214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.659551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.659988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.660431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.660840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:22.661893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.662158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:22.662793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:22.663220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.049845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.051064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.078585 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18c6fcbd-8f60-441d-9cae-4614ce017351 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1387 microversion: 2.1 time: 0.444484 Aug 29 15:39:23.079296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.081060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.082232 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf1c329f-4316-4632-ac11-28eba1ae2a21 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 0.449260 Aug 29 15:39:23.082790 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 227/483] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:22 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:23.083919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 257/484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:22 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1387 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.090333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11e791d6-3e7a-46db-8dfc-fb054c2ab2a5 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Action: 'create', calling method: .version_select at 0x7f32eec6d160>, body: {"keypair": {"name": "tempest-keypair-1673108755", "type": "ssh", "user_id": "f8a0c242c0c0443bbb99e1cd5371933e", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVb/6NEOHx6MC3f18sMSLuATCThcLGtfSdjGtKtVBs2Ktemyxtc8N6R14SxKQdZh7O/y+/4fyauCVCmTzQepi/t/7Pjak03ctVGyWn6VCKSdX2+46Dmc7M2Z/6f/yQLVQ=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.099588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.105345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.107757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.108395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.109513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.110044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.110472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.135265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bb08acd1-15b9-44f9-ae93-78d54310aa9f tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.049760 Aug 29 15:39:23.143577 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 258/485] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:23.149018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5de4a5a1-c313-45f5-bf14-79ec2bbc8c03 req-0c193e9e-aeec-49fc-adcc-0d43d43f8f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86e619ff-e04f-483a-bbb9-a229dc41fa28", "tag": "a8f67aff-26f5-4d21-bd5c-7b7a7113cdb4"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.154340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-11e791d6-3e7a-46db-8dfc-fb054c2ab2a5 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Getting quotas for project 358d784c7a48416bb9bf68d7c6adee3f. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:23.165061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5de4a5a1-c313-45f5-bf14-79ec2bbc8c03 req-0c193e9e-aeec-49fc-adcc-0d43d43f8f57 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.165636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5de4a5a1-c313-45f5-bf14-79ec2bbc8c03 req-0c193e9e-aeec-49fc-adcc-0d43d43f8f57 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.166057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5de4a5a1-c313-45f5-bf14-79ec2bbc8c03 req-0c193e9e-aeec-49fc-adcc-0d43d43f8f57 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.176837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-11e791d6-3e7a-46db-8dfc-fb054c2ab2a5 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Getting quotas for user d8f725e9c0a2461a9f1ecf7614603b36 and project 358d784c7a48416bb9bf68d7c6adee3f. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:23.179299 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5de4a5a1-c313-45f5-bf14-79ec2bbc8c03 req-0c193e9e-aeec-49fc-adcc-0d43d43f8f57 service nova] Creating event network-changed:a8f67aff-26f5-4d21-bd5c-7b7a7113cdb4 for instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 on n-h1-836830-13 Aug 29 15:39:23.185689 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5de4a5a1-c313-45f5-bf14-79ec2bbc8c03 req-0c193e9e-aeec-49fc-adcc-0d43d43f8f57 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040789 Aug 29 15:39:23.187173 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 259/486] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:23.193850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.194931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.204347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.205775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.206718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.207621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.209088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.209686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.253360 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11e791d6-3e7a-46db-8dfc-fb054c2ab2a5 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.165928 Aug 29 15:39:23.262095 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 228/487] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:39:23.274637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-13", "block_migration": true, "disk_over_commit": false}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.279421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.298934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.299487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.299924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.300633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.309848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.310311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.405562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Lazy-loading 'flavor' on Instance uuid 7ded473b-3579-4ae6-bc06-c592f9a2ff27 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:23.436288 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 while it is in vm_state suspended Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Request method failure captured: Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27/action HTTP/1.1 Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 98 Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1l13gqt-1h_Ax7xep6VBclf1l1tpVn4PJVRlgK7egykGKoN6JND9_8d0N1yfecJjAv_jikHyM9OQOUsexiTlSvjLUHCBIHfxrJmL5vDNNF-bd1KGNDsvSRqwpm9BwMzA8YU3-dv8d1skq1s-4p0mwnCNLnwsDqkGbmXJFxpB7Lc0A Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3b7b790bc2b545109b7b17d26b85cb9c Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-LiveMigrationNegativeTest-190318384 Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:39:23.445303 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3b7b790bc2b545109b7b17d26b85cb9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3b7b790bc2b545109b7b17d26b85cb9c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3b7b790bc2b545109b7b17d26b85cb9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3b7b790bc2b545109b7b17d26b85cb9c"}]}] Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-LiveMigrationNegativeTest-190318384 Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3b7b790bc2b545109b7b17d26b85cb9c Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-190318384 Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-LiveMigrationNegativeTest-190318384-project-admin Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: b66f43896bed46f38ba26352ec7c0884 Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-LiveMigrationNegativeTest-190318384-project-admin Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: {"os-migrateLive": {"host": "n-h1-836830-13", "block_migration": true, "disk_over_commit": false}} Aug 29 15:39:23.446719 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'os-migrateLive' instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 while it is in vm_state suspended Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7ded473b-3579-4ae6-bc06-c592f9a2ff27', 'body': {'os-migrateLive': {'host': 'n-h1-836830-13', 'block_migration': True, 'disk_over_commit': False}}} Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:39:23.447461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:23.448472 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 while it is in vm_state suspended Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 while it is in vm_state suspended Aug 29 15:39:23.449609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:23.452416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 while it is in vm_state suspended {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:23.453294 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec68f65b-b1d0-493c-b904-88766d0bfade tempest-LiveMigrationNegativeTest-190318384 tempest-LiveMigrationNegativeTest-190318384-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27/action" status: 409 len: 155 microversion: 2.1 time: 0.190153 Aug 29 15:39:23.454191 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 229/488] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27/action => generated 155 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:39:23.459627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.460247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.484222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.484735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.485362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.486082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.486536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.486956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.556108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.564616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-56906723-c46d-43ca-972d-37cf4893624c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.375979 Aug 29 15:39:23.565450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 260/489] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.571007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dc8d0bc1-26d9-46d6-a65a-aad26ca393b5 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Calling method '.version_select at 0x7f32eedaedc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.581188 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dc8d0bc1-26d9-46d6-a65a-aad26ca393b5 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "GET /compute/v2.1/os-keypairs/tempest-keypair-2017420291?user_id=f8a0c242c0c0443bbb99e1cd5371933e" status: 200 len: 512 microversion: 2.10 time: 0.014547 Aug 29 15:39:23.591632 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 261/490] 10.222.0.83 () {60 vars in 1340 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2017420291?user_id=f8a0c242c0c0443bbb99e1cd5371933e => generated 512 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:23.596902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.597797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.606098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.606856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.607521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.608446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.609314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.610140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.664036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:23.817273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:23.819786 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d6105f34-9d53-4a77-874b-acc98ce01727 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 204 len: 0 microversion: 2.1 time: 0.226701 Aug 29 15:39:23.821164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 262/491] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:23 2022] DELETE /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:23.829181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79d8111f-eba6-49e7-83ca-e35a38738923 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 0.373859 Aug 29 15:39:23.830354 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 230/492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:23.837042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7525fbb6-66d3-4b45-a5cc-280a0a9376ac tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Action: 'create', calling method: .version_select at 0x7f32eec6ac10>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1116083105", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHe4/Jvrp1KSLoPEvXpPP4YCDXc5oPjqrPpnLUM/jXgo5W3dOQEebdPXFzkLMrmHaXoM2wP+vDQrVi3PKB2lT0mcUHGxwQj0/eBagyz/TSmeSPj1CwE2fhVhq4IEhMq9Aw=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:23.859688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-7525fbb6-66d3-4b45-a5cc-280a0a9376ac tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Getting quotas for project 358d784c7a48416bb9bf68d7c6adee3f. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:23.866467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-7525fbb6-66d3-4b45-a5cc-280a0a9376ac tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Getting quotas for user d8f725e9c0a2461a9f1ecf7614603b36 and project 358d784c7a48416bb9bf68d7c6adee3f. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:23.902197 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7525fbb6-66d3-4b45-a5cc-280a0a9376ac tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.070422 Aug 29 15:39:23.903347 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 231/493] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:39:23.909089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:23.910067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:23.924211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.931008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.936518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:23.937679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:23.938657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:23.939597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.125508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-952b03b9-7857-40de-b2b6-ce96be112133 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Action: 'create', calling method: .version_select at 0x7f32eedae1f0>, body: {"keypair": {"name": "tempest-keypair-375066813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA+e4hwvTfabnPV0WuJVjfW8+PVxvttnU3H5QBaTZTEG2FUmySWUx7NWR77yUYkPPLOzSL8Hmvr3+TNQfVf24J/8gYkg/VKMurMVuyygzV8UqGCkttM52eCDqm3YOWvuQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:24.144687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-952b03b9-7857-40de-b2b6-ce96be112133 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Getting quotas for project b14d17b6ccdc4d4d874ff1e303d3eb6c. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:24.152426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-952b03b9-7857-40de-b2b6-ce96be112133 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Getting quotas for user 53387bcdf14248b9bdf716e782b786d7 and project b14d17b6ccdc4d4d874ff1e303d3eb6c. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:24.173549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.186060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-952b03b9-7857-40de-b2b6-ce96be112133 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.363080 Aug 29 15:39:24.187472 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38866f9a-2f0b-4dda-8852-80f48f0a2b11 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1465 microversion: 2.1 time: 0.282787 Aug 29 15:39:24.188358 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 263/494] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:39:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:24.189278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 232/495] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:23 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1465 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.195647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.196966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.204388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.205112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.205792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.206666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53e687cc-5597-4eb5-a4e5-4634c026b36b tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Calling method '.version_select at 0x7f32eee61040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.207143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.207813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.208501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.218387 n-d-836830-13 devstack@n-api.service[129133]: WARNING oslo_db.sqlalchemy.utils [None req-53e687cc-5597-4eb5-a4e5-4634c026b36b tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:39:24.242239 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53e687cc-5597-4eb5-a4e5-4634c026b36b tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "GET /compute/v2.1/os-keypairs?user_id=f8a0c242c0c0443bbb99e1cd5371933e" status: 200 len: 726 microversion: 2.10 time: 0.051751 Aug 29 15:39:24.243591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 264/496] 10.222.0.83 () {60 vars in 1259 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/os-keypairs?user_id=f8a0c242c0c0443bbb99e1cd5371933e => generated 726 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:24.253199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.254504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.275782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.277971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.278551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.279426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.279945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.280403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.439064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.448409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-909721c9-e9f5-400b-a65f-6c5a2098cf14 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1387 microversion: 2.1 time: 0.257890 Aug 29 15:39:24.462406 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 233/497] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1387 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:24.467699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a18df616-ed18-4a63-a67b-3370d95f9274 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Calling method '.version_select at 0x7f32eee7b160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.495233 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a18df616-ed18-4a63-a67b-3370d95f9274 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1116083105" status: 204 len: 0 microversion: 2.10 time: 0.031343 Aug 29 15:39:24.496453 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 234/498] 10.222.0.83 () {60 vars in 1325 bytes} [Mon Aug 29 15:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1116083105 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:39:24.507999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-536b9cbd-001d-4266-bc96-bdc795f42455 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Calling method '.version_select at 0x7f32eec6d8b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.533287 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-536b9cbd-001d-4266-bc96-bdc795f42455 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673108755?user_id=f8a0c242c0c0443bbb99e1cd5371933e" status: 204 len: 0 microversion: 2.10 time: 0.031990 Aug 29 15:39:24.534322 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 235/499] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673108755?user_id=f8a0c242c0c0443bbb99e1cd5371933e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:39:24.548401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f62b9ee-e6e4-499e-b28c-8c21d65d0306 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] Calling method '.version_select at 0x7f32eedc6af0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.564033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:24.576683 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0f62b9ee-e6e4-499e-b28c-8c21d65d0306 tempest-KeyPairsV210TestJSON-1128194750 tempest-KeyPairsV210TestJSON-1128194750-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017420291?user_id=f8a0c242c0c0443bbb99e1cd5371933e" status: 204 len: 0 microversion: 2.10 time: 0.036232 Aug 29 15:39:24.577965 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 236/500] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017420291?user_id=f8a0c242c0c0443bbb99e1cd5371933e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:39:24.590424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.591522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.601928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.602816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.603565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.604708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.605379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.606459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.878246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.894394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.896259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:24.902183 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f09fc45-16e8-4a9d-ba7e-3637fdaa1cd1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 0.656489 Aug 29 15:39:24.903322 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 265/501] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:24.908341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:24.917955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:24.932009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.932515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.932935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:24.933633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:24.934082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:24.934502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.201728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.211330 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-591c5c13-179e-4948-af2e-ef03c6eea41d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.629261 Aug 29 15:39:25.211922 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 237/502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.228092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.228949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.236620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.237372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.238100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.239284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.240123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.240800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.401267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.409291 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1765fa33-7411-4ab1-b06d-de279a6a3a66 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 0.504635 Aug 29 15:39:25.416684 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 266/503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:24 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.471064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.471746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.479826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.480334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.480772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.481474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.481933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.482355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.722492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.743642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8c5d84e-b6fd-4248-9fb1-6321551591e4 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1465 microversion: 2.1 time: 0.530663 Aug 29 15:39:25.749749 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 238/504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1465 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.771586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8fd0ae14-be3b-4ec3-a540-4f60fa341048 req-558c7698-9fa2-41f6-b2de-c2d1724b5e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e2579b-c29e-4192-8302-a770b308a3a7", "tag": "a4339b79-2141-4902-a2a4-7f36cca30560"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:25.784441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8fd0ae14-be3b-4ec3-a540-4f60fa341048 req-558c7698-9fa2-41f6-b2de-c2d1724b5e7d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.785924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8fd0ae14-be3b-4ec3-a540-4f60fa341048 req-558c7698-9fa2-41f6-b2de-c2d1724b5e7d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.786704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8fd0ae14-be3b-4ec3-a540-4f60fa341048 req-558c7698-9fa2-41f6-b2de-c2d1724b5e7d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.807100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8fd0ae14-be3b-4ec3-a540-4f60fa341048 req-558c7698-9fa2-41f6-b2de-c2d1724b5e7d service nova] Creating event network-changed:a4339b79-2141-4902-a2a4-7f36cca30560 for instance 81e2579b-c29e-4192-8302-a770b308a3a7 on n-h1-836830-13 Aug 29 15:39:25.813300 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8fd0ae14-be3b-4ec3-a540-4f60fa341048 req-558c7698-9fa2-41f6-b2de-c2d1724b5e7d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060128 Aug 29 15:39:25.815300 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 239/505] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:25.879651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:25.892116 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-420bfb78-2692-42ff-bc17-516741c5077f tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1586 microversion: 2.1 time: 0.422275 Aug 29 15:39:25.892116 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 267/506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1586 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:25.912342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.912931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.919341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.919999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.920583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.921460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.922055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.922622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.930336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:25.931148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:25.941322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.941811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.942415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.943384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:25.944001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:25.944575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:25.958990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:26.111580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=15 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:26.159250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe569500-2ac8-40ec-8d02-33c4758190b5 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251769 Aug 29 15:39:26.170327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 240/507] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d/os-interface => generated 284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:26.237426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.240267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.252764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.253746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.254399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.257612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.258457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.258897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.910103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:26.924026 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b4cda60e-b66b-4391-8d4d-df490ecf0095 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.690670 Aug 29 15:39:26.925402 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 241/508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:26.932197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:26.933322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:26.941506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.942254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.943660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:26.945737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:26.946392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:26.947054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.055797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.077905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.079407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:27.080806 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4be5c7b5-80cf-4465-aa72-1cd933e93603 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 1.155023 Aug 29 15:39:27.085445 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 268/509] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:25 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:39:27.092941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:27.111680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:27.126098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.126585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.127010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:27.134376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:27.134861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:27.138411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.432041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:28.449563 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f8765d4c-cd77-4dad-b2b5-07c20733d946 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1465 microversion: 2.1 time: 1.362382 Aug 29 15:39:28.450535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 269/510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:27 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1465 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:28.467214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-aabbf1e6-bfa2-442e-b2b6-05bd0aaddd7b req-774c2a62-3e05-4148-bad3-dee513b0ba68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d99101-0823-46e5-9f79-d44dfabf604c", "name": "network-vif-unplugged", "status": "completed", "tag": "e9d2f9a1-50b7-4d78-8fe3-09622b410585"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:28.492123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aabbf1e6-bfa2-442e-b2b6-05bd0aaddd7b req-774c2a62-3e05-4148-bad3-dee513b0ba68 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.493508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aabbf1e6-bfa2-442e-b2b6-05bd0aaddd7b req-774c2a62-3e05-4148-bad3-dee513b0ba68 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.495243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aabbf1e6-bfa2-442e-b2b6-05bd0aaddd7b req-774c2a62-3e05-4148-bad3-dee513b0ba68 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.506599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:28.517987 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e0aee10-5aa2-4047-9ac7-d8b7a7140979 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 1.591246 Aug 29 15:39:28.518582 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 242/511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:26 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:28.523105 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-aabbf1e6-bfa2-442e-b2b6-05bd0aaddd7b req-774c2a62-3e05-4148-bad3-dee513b0ba68 service nova] Creating event network-vif-unplugged:e9d2f9a1-50b7-4d78-8fe3-09622b410585 for instance 64d99101-0823-46e5-9f79-d44dfabf604c on n-h2-836830-13 Aug 29 15:39:28.530675 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-aabbf1e6-bfa2-442e-b2b6-05bd0aaddd7b req-774c2a62-3e05-4148-bad3-dee513b0ba68 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078283 Aug 29 15:39:28.532517 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 270/512] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:28.534873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:28.535859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.540578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:28.542675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:28.548687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.549213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.549667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.550388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.550848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.551301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.553569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.554403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.555157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:28.556169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:28.556911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:28.557605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.230996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.241778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e692e87f-7bc7-4bc2-a3bf-a8c242d4f71a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.714978 Aug 29 15:39:29.255555 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 243/513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:28 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:29.255555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2e2f4557-0166-4e3f-b51b-26db0dd4205c req-8511afc0-fd21-4629-813d-0003d7162485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ecae4f-8a73-4f39-be3f-da87823b9d94", "name": "network-vif-plugged", "status": "completed", "tag": "0e4dbec9-a639-455d-9630-3a4e82a180c1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:29.278442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2e2f4557-0166-4e3f-b51b-26db0dd4205c req-8511afc0-fd21-4629-813d-0003d7162485 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.280220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2e2f4557-0166-4e3f-b51b-26db0dd4205c req-8511afc0-fd21-4629-813d-0003d7162485 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.284908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2e2f4557-0166-4e3f-b51b-26db0dd4205c req-8511afc0-fd21-4629-813d-0003d7162485 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.317204 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2e2f4557-0166-4e3f-b51b-26db0dd4205c req-8511afc0-fd21-4629-813d-0003d7162485 service nova] Creating event network-vif-plugged:0e4dbec9-a639-455d-9630-3a4e82a180c1 for instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 on n-h1-836830-13 Aug 29 15:39:29.330291 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2e2f4557-0166-4e3f-b51b-26db0dd4205c req-8511afc0-fd21-4629-813d-0003d7162485 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085785 Aug 29 15:39:29.335121 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 244/514] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:29.451327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b8e09985-507d-4d09-8b2a-084129f249b6 req-4bc18efb-6851-49ef-909b-a9bec9581f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ded473b-3579-4ae6-bc06-c592f9a2ff27", "name": "network-vif-deleted", "tag": "a1f80472-728b-4075-96ee-a1794cf38722"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:29.485330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b8e09985-507d-4d09-8b2a-084129f249b6 req-4bc18efb-6851-49ef-909b-a9bec9581f66 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.489233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b8e09985-507d-4d09-8b2a-084129f249b6 req-4bc18efb-6851-49ef-909b-a9bec9581f66 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.490483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b8e09985-507d-4d09-8b2a-084129f249b6 req-4bc18efb-6851-49ef-909b-a9bec9581f66 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.523485 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b8e09985-507d-4d09-8b2a-084129f249b6 req-4bc18efb-6851-49ef-909b-a9bec9581f66 service nova] Creating event network-vif-deleted:a1f80472-728b-4075-96ee-a1794cf38722 for instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 on n-h2-836830-13 Aug 29 15:39:29.544321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b8e09985-507d-4d09-8b2a-084129f249b6 req-4bc18efb-6851-49ef-909b-a9bec9581f66 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099135 Aug 29 15:39:29.545598 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 245/515] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:29.551297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:29.559074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:29.582824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.583996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.587751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.588899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:29.589844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:29.591246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:29.981808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:29.998744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-357add3b-a3e9-4633-bf60-962455b3beba tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 200 len: 1294 microversion: 2.1 time: 0.447460 Aug 29 15:39:29.999305 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 246/516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:29 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 1294 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.031179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.040646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.057388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.057894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.058334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.059065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.065101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.073215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.292426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.316627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.322761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.326736 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-259640b4-d07b-4691-9997-003cee7285b2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 1.791427 Aug 29 15:39:30.334849 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 271/517] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:28 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:30.343662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.346689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.368694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.370204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.370864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.371828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.372772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.374734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.407654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.421287 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7663712c-a9d4-4c7f-8552-abed57efcefd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 0.418174 Aug 29 15:39:30.438879 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 247/518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:29 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.626349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-36d2c8aa-a1c9-4b8b-9d39-ea96bfb0fb40 req-3219bc4a-0f2e-4834-8a6c-79056f7b413d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d99101-0823-46e5-9f79-d44dfabf604c", "tag": "e9d2f9a1-50b7-4d78-8fe3-09622b410585"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:30.654949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-36d2c8aa-a1c9-4b8b-9d39-ea96bfb0fb40 req-3219bc4a-0f2e-4834-8a6c-79056f7b413d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.658226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-36d2c8aa-a1c9-4b8b-9d39-ea96bfb0fb40 req-3219bc4a-0f2e-4834-8a6c-79056f7b413d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.660589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-36d2c8aa-a1c9-4b8b-9d39-ea96bfb0fb40 req-3219bc4a-0f2e-4834-8a6c-79056f7b413d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.700915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-36d2c8aa-a1c9-4b8b-9d39-ea96bfb0fb40 req-3219bc4a-0f2e-4834-8a6c-79056f7b413d service nova] Creating event network-changed:e9d2f9a1-50b7-4d78-8fe3-09622b410585 for instance 64d99101-0823-46e5-9f79-d44dfabf604c on n-h2-836830-13 Aug 29 15:39:30.714431 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-36d2c8aa-a1c9-4b8b-9d39-ea96bfb0fb40 req-3219bc4a-0f2e-4834-8a6c-79056f7b413d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095101 Aug 29 15:39:30.717878 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 248/519] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:30.732703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-160113083", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "21199f17-4c6d-400b-9a1f-170228f2818d"}], "security_groups": [{"name": "tempest-securitygroup--1204412294"}], "key_name": "tempest-keypair-375066813", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:30.874021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:30.883243 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4005a2f-6171-4486-b345-21815469b15e tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.546449 Aug 29 15:39:30.899015 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 272/520] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:30 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:30.911978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:30.912916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:30.930773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.945789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.953349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:30.954108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:30.954591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:30.955040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.330910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] validate_networks() for [('21199f17-4c6d-400b-9a1f-170228f2818d', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:31.687725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:31.704899 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54fb9c0a-ffd6-49e6-ba43-017656b8fb21 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1586 microversion: 2.1 time: 0.804608 Aug 29 15:39:31.709225 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 273/521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:30 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1586 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:31.719202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.721340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 7ded473b-3579-4ae6-bc06-c592f9a2ff27] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.736113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.738994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.740318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.749265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.750083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.750764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.756928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:31.786345 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] HTTP exception thrown: Instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 could not be found. Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Request method failure captured: Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 HTTP/1.1 Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1iwubv8A-qVPj_GpJzJGn313t2oUWBOzDUgsbvvo-RBkjp4x9RtSPQt2cgp-nKvFrdtF6U8DugwLJQUFF-gO8IDQEc-D54jlgNIxlTAih3VFy7UDSDcgHt0hvwEs_EbW7B_V3IQJTvE99c19i9kaKab_z1-6XMT7y7JDqphCsImo4 Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 13ee7f05500a437580afe08f38a79fb9 Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveMigrationNegativeTest-267543177 Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:39:31.791823 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ee7f05500a437580afe08f38a79fb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ee7f05500a437580afe08f38a79fb9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ee7f05500a437580afe08f38a79fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ee7f05500a437580afe08f38a79fb9"}]}] Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveMigrationNegativeTest-267543177 Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 13ee7f05500a437580afe08f38a79fb9 Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-267543177 Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveMigrationNegativeTest-267543177-project Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 010ed8588b2d496bacedebc1863a3857 Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveMigrationNegativeTest-267543177-project Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 could not be found. Aug 29 15:39:31.793376 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '7ded473b-3579-4ae6-bc06-c592f9a2ff27'} Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 could not be found. Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:31.794239 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 could not be found. Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 could not be found. Aug 29 15:39:31.795899 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:31.799809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Returning 404 to user: Instance 7ded473b-3579-4ae6-bc06-c592f9a2ff27 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:31.801004 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28e50d98-959d-4a26-bbe0-66c383d44682 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27" status: 404 len: 111 microversion: 2.1 time: 0.090424 Aug 29 15:39:31.805896 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 274/522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:31 2022] GET /compute/v2.1/servers/7ded473b-3579-4ae6-bc06-c592f9a2ff27 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:31.812159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:31.813123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:31.820490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.821321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.821994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:31.822958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:31.823724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:31.824375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.161162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.176019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.178330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.179848 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ad8e781-0972-4037-b08c-39d8069aff0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 0.372128 Aug 29 15:39:32.180717 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 275/523] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:31 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:32.195460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.199667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.221805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.223189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.223791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.225320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.225880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.226401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.504385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:32.504963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:32.505917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:32.506775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:32.507392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:32.518184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.519247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.519947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.521905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.522664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.524115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.555910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Getting quotas for project b14d17b6ccdc4d4d874ff1e303d3eb6c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:32.564191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Getting quotas for user 53387bcdf14248b9bdf716e782b786d7 and project b14d17b6ccdc4d4d874ff1e303d3eb6c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:32.580130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:32.581919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:32.591281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-faf812bf-fa27-4664-990b-0bfa5aad351b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 0.409152 Aug 29 15:39:32.592427 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 276/524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:32 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:32.597797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e7f5056e-39f8-40a0-afcc-7ada1fa064ba req-fb310cac-08d8-4fb5-8c86-6ec0031a0907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86e619ff-e04f-483a-bbb9-a229dc41fa28", "name": "network-vif-plugged", "status": "completed", "tag": "a8f67aff-26f5-4d21-bd5c-7b7a7113cdb4"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:32.601008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:32.609515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e7f5056e-39f8-40a0-afcc-7ada1fa064ba req-fb310cac-08d8-4fb5-8c86-6ec0031a0907 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.610249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e7f5056e-39f8-40a0-afcc-7ada1fa064ba req-fb310cac-08d8-4fb5-8c86-6ec0031a0907 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.611121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e7f5056e-39f8-40a0-afcc-7ada1fa064ba req-fb310cac-08d8-4fb5-8c86-6ec0031a0907 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.649882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e7f5056e-39f8-40a0-afcc-7ada1fa064ba req-fb310cac-08d8-4fb5-8c86-6ec0031a0907 service nova] Creating event network-vif-plugged:a8f67aff-26f5-4d21-bd5c-7b7a7113cdb4 for instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 on n-h1-836830-13 Aug 29 15:39:32.663130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e7f5056e-39f8-40a0-afcc-7ada1fa064ba req-fb310cac-08d8-4fb5-8c86-6ec0031a0907 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067005 Aug 29 15:39:32.666028 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 277/525] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:32.678911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.679802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.690427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.692365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.694298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.695136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.695754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.696443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.725780 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b84ad69a-b895-40e5-8934-ea6c88ce7dc3 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.004759 Aug 29 15:39:32.727684 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 249/526] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:32.733872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:32.750236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:32.751182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:32.779829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.780326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.780755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.781508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:32.781966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:32.782449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:32.899414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:32.902702 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28f86d4c-e34f-4ad9-8511-5d4c5bf8142f tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "DELETE /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 204 len: 0 microversion: 2.1 time: 0.232018 Aug 29 15:39:32.904121 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 278/527] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:32 2022] DELETE /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:33.106656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-245635736", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:33.118013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.129376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2d4043e5-fa42-4248-b7a0-8d7164a9c5b4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.392536 Aug 29 15:39:33.130981 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 250/528] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:32 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:33.137687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76b2933c-b176-4a71-a558-4b2296d2912c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.138416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:33.138880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-76b2933c-b176-4a71-a558-4b2296d2912c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.221183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:33.241968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-76b2933c-b176-4a71-a558-4b2296d2912c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.253210 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76b2933c-b176-4a71-a558-4b2296d2912c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1240 microversion: 2.1 time: 0.120885 Aug 29 15:39:33.254389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 251/529] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1240 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:33.272464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1d935119-34c3-4aad-a6f2-4f9db2da1536 req-e72955fa-06dc-41a9-b186-bea29b622dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d", "tag": "8d30ed14-51e2-4054-870b-8855250723d8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:33.296492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d935119-34c3-4aad-a6f2-4f9db2da1536 req-e72955fa-06dc-41a9-b186-bea29b622dfd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.297181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d935119-34c3-4aad-a6f2-4f9db2da1536 req-e72955fa-06dc-41a9-b186-bea29b622dfd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.299433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d935119-34c3-4aad-a6f2-4f9db2da1536 req-e72955fa-06dc-41a9-b186-bea29b622dfd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.331757 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1d935119-34c3-4aad-a6f2-4f9db2da1536 req-e72955fa-06dc-41a9-b186-bea29b622dfd service nova] Creating event network-changed:8d30ed14-51e2-4054-870b-8855250723d8 for instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d on n-h1-836830-13 Aug 29 15:39:33.351988 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1d935119-34c3-4aad-a6f2-4f9db2da1536 req-e72955fa-06dc-41a9-b186-bea29b622dfd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095500 Aug 29 15:39:33.352933 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 252/530] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:33.361483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.362462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.373930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.374896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.375367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.376132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.376586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.377180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.546848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.557677 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4c9bd8e-efc5-41f7-87cb-4426cb569156 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1475 microversion: 2.1 time: 0.203278 Aug 29 15:39:33.559198 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 253/531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1475 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:33.564325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.565297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.574327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.575216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.575893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.576829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.577665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.578181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.757007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.768826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.771487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.775393 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2aa58f0-f4c4-4d3d-8d7c-42edb9390a7a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 0.212755 Aug 29 15:39:33.778317 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 254/532] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:33.788320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:33.789738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:33.799000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.799659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.800205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.801090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.801644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.802228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.910325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:33.911643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:33.912366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:33.913133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:33.913752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:33.924536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.925387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.926056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.927156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:33.927843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:33.928485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:33.950415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:33.956303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for user cc90d88d1e574a94858bbe2523855caa and project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:33.963497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:33.971635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:33.975766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:33.978996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d38038e-e9d6-4c77-bb84-010330db72ce tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 0.199374 Aug 29 15:39:33.992261 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 255/533] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:33 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:34.028727 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71c17661-ba5a-4ac2-ac83-712e78aece03 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122901 Aug 29 15:39:34.035763 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 279/534] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:34.054863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c12160b9-a48e-4867-8694-e097803cd54e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.055546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c12160b9-a48e-4867-8694-e097803cd54e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.112615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c12160b9-a48e-4867-8694-e097803cd54e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.121388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c12160b9-a48e-4867-8694-e097803cd54e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1212 microversion: 2.1 time: 0.081731 Aug 29 15:39:34.122684 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 256/535] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1212 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:34.153331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.154133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.161219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.162070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.162667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.163602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.164392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.165091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.277521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.278291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.288030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.293777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.296284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.297501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.298721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.300683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.392690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.403364 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0339c850-e030-448d-a962-21d31dceb51c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1244 microversion: 2.1 time: 0.131840 Aug 29 15:39:34.404537 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 257/536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1244 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:34.471908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.484029 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d325b767-258e-4f84-954c-4ece62b34053 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1313 microversion: 2.1 time: 0.335347 Aug 29 15:39:34.484755 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 280/537] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:34.582443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.583386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.592250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.592799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.593181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.593936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.594413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.594865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.804486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:34.805322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:34.813486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.814158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.815225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.815942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:34.816400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:34.823545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:34.896948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:34.905873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04c2df36-8281-432f-88c4-ede9f12c0df1 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1475 microversion: 2.1 time: 0.327111 Aug 29 15:39:34.907485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 258/538] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1475 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.004359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.006266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.024665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.025464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.026345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.028429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.030014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.033711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.238055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.248910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.250346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.259686 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-691b0c50-6751-4c9d-8af1-3aad220fa70e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 0.462444 Aug 29 15:39:35.261229 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 281/539] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:39:35.279497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ba5246bd-069e-44e0-a7ab-e38279238cf5 req-0331892e-ce64-4ebf-bea6-194f212fab73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e2579b-c29e-4192-8302-a770b308a3a7", "name": "network-vif-plugged", "status": "completed", "tag": "a4339b79-2141-4902-a2a4-7f36cca30560"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:35.292491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ba5246bd-069e-44e0-a7ab-e38279238cf5 req-0331892e-ce64-4ebf-bea6-194f212fab73 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.293336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ba5246bd-069e-44e0-a7ab-e38279238cf5 req-0331892e-ce64-4ebf-bea6-194f212fab73 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.294119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ba5246bd-069e-44e0-a7ab-e38279238cf5 req-0331892e-ce64-4ebf-bea6-194f212fab73 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.312555 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ba5246bd-069e-44e0-a7ab-e38279238cf5 req-0331892e-ce64-4ebf-bea6-194f212fab73 service nova] Creating event network-vif-plugged:a4339b79-2141-4902-a2a4-7f36cca30560 for instance 81e2579b-c29e-4192-8302-a770b308a3a7 on n-h1-836830-13 Aug 29 15:39:35.319517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ba5246bd-069e-44e0-a7ab-e38279238cf5 req-0331892e-ce64-4ebf-bea6-194f212fab73 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056501 Aug 29 15:39:35.320813 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 282/540] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:35.327059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.328287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.335735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.337880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.338805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.340008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.340682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.341307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.480768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.493377 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a796be5a-2030-48b1-a510-f85c0ab8d7fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1208 microversion: 2.1 time: 0.170818 Aug 29 15:39:35.494406 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 283/541] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1208 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.500202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.501070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.509112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.515081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.516345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.517221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.517818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.518331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.872686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.895103 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-534e2741-991a-49a0-90b8-4b6fcafe185f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1292 microversion: 2.1 time: 0.397577 Aug 29 15:39:35.899168 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 284/542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1292 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:35.914327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.917156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.934721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.937402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.938150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.942042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:35.943895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:35.944350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:35.958268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:35.973205 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ce58e33-c95e-4c94-a50d-108b8de869d6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 0.973063 Aug 29 15:39:35.975985 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 259/543] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:34 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:35.988436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:35.991970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:35.998535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.000261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.001237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.006373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.007506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.010725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.416141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.425421 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1b8b8c9-0565-4f71-a8b5-a6d3284eefd0 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1475 microversion: 2.1 time: 0.447556 Aug 29 15:39:36.430768 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 260/544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1475 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:36.439438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.441020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.451861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.452987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.453705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.455663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.456456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.457128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.529993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.545709 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bb4eafec-dedf-4e3c-a6a7-9c99da1b3432 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1463 microversion: 2.1 time: 0.643063 Aug 29 15:39:36.546677 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 285/545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:35 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1463 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:36.561701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.562674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.570762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.571667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.572345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.573284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.573960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.574608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.901938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.910970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.913303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:36.915362 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a86681c-7739-4466-9666-d4f2a9bbfd57 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 0.482745 Aug 29 15:39:36.916281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 261/546] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:36.921211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:36.922224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:36.937931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.938908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.939523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:36.940370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:36.940967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:36.941591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.027595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.042439 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cfec75ba-09ed-4b01-83c2-2d7e8c1f198a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1270 microversion: 2.1 time: 0.492017 Aug 29 15:39:37.043040 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 286/547] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1270 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.049912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d433fd18-ec0d-4399-8917-72d8904617b7 req-3c5d64ad-cb3f-40ce-8764-18c7473aeedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435ef7a8-2d60-4197-b170-d21eed31ad11", "name": "network-vif-deleted", "tag": "18eb5aa9-11f9-4a87-847f-fba3665412ca"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:37.060156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d433fd18-ec0d-4399-8917-72d8904617b7 req-3c5d64ad-cb3f-40ce-8764-18c7473aeedb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.060668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d433fd18-ec0d-4399-8917-72d8904617b7 req-3c5d64ad-cb3f-40ce-8764-18c7473aeedb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.061170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d433fd18-ec0d-4399-8917-72d8904617b7 req-3c5d64ad-cb3f-40ce-8764-18c7473aeedb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.072992 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d433fd18-ec0d-4399-8917-72d8904617b7 req-3c5d64ad-cb3f-40ce-8764-18c7473aeedb service nova] Creating event network-vif-deleted:18eb5aa9-11f9-4a87-847f-fba3665412ca for instance 435ef7a8-2d60-4197-b170-d21eed31ad11 on n-h2-836830-13 Aug 29 15:39:37.078194 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d433fd18-ec0d-4399-8917-72d8904617b7 req-3c5d64ad-cb3f-40ce-8764-18c7473aeedb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032530 Aug 29 15:39:37.079146 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 287/548] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:37.085167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.086143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.096360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.097208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.097890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.100193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.100854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.101474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.211968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.220152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:37.225863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f964728-b967-43e6-a7a1-7e347d999062 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1464 microversion: 2.1 time: 0.307977 Aug 29 15:39:37.235870 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 262/549] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:36 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1464 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.250478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.255204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.264514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.273265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87942716-758d-48ed-9676-031468f01f15 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1298 microversion: 2.1 time: 0.189808 Aug 29 15:39:37.276069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 288/550] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1298 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.283228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.284411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.285876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.288199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.288945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.289624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.445849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1961406715", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "79ecae4f-8a73-4f39-be3f-da87823b9d94"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:37.511827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:37.592005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.602398 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be1719a2-73bc-4ff2-9e1c-3c4e5ebafbe6 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1320 microversion: 2.1 time: 0.365048 Aug 29 15:39:37.605720 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 263/551] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1320 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.615251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.616694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.625724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.626640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.628232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.629100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.629792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.631050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.666459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.666941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.667391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.667855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lazy-loading 'fault' on Instance uuid 435ef7a8-2d60-4197-b170-d21eed31ad11 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:37.740134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010ed8588b2d496bacedebc1863a3857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ee7f05500a437580afe08f38a79fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:37.751151 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5f83985-431e-4a17-95c4-7d5c52ed50ac tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 200 len: 1309 microversion: 2.1 time: 0.142575 Aug 29 15:39:37.752037 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 264/552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:37.943575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:37.944508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:37.950733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.951540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.952140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:37.953008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:37.953622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:37.954362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.375962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:38.377114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:38.377821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:38.378462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:38.379335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:38.392223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.393085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.393758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.394750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.395613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.396615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.423054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Getting quotas for project 068087b8e3274eb98dabdb60c8db2368. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:38.430800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Getting quotas for user 67701a88fc354d4c9ae7d16f8ee1355b and project 068087b8e3274eb98dabdb60c8db2368. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:38.431423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.443762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.449448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.454730 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-56af3679-8aab-4ced-96f7-9b6d48bd94ae tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1567 microversion: 2.25 time: 0.516669 Aug 29 15:39:38.458057 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 265/553] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:37 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1567 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:38.461392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:38.464882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:38.465589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.466727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.477926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.479900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.480751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.482299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.483149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.483903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.536186 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b71e93de-7a1e-4e88-a885-7bba67ef58ef tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091699 Aug 29 15:39:38.555615 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 289/554] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:39:38.564879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.577746 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba5769c0-4ba8-472c-a20e-ba68a54bf771 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1270 microversion: 2.1 time: 0.117264 Aug 29 15:39:38.584116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.584928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.591610 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 266/555] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.593496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.593981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.594413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.595128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.595580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.595997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.596346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bee8b61f-93f5-4665-b7e6-8709c5e695bd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.596955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bee8b61f-93f5-4665-b7e6-8709c5e695bd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.662870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bee8b61f-93f5-4665-b7e6-8709c5e695bd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.670167 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bee8b61f-93f5-4665-b7e6-8709c5e695bd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1214 microversion: 2.1 time: 0.077415 Aug 29 15:39:38.671680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 267/556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.677473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.678174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.689048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.689429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.689867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.690567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.691099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.691531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.799670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.816111 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c08abc22-015e-4c1b-ac2e-9f38393a8466 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1298 microversion: 2.1 time: 0.258986 Aug 29 15:39:38.816699 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 290/557] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1298 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.822916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:38.823566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] [instance: 435ef7a8-2d60-4197-b170-d21eed31ad11] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:38.848487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.849606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.850222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.851949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:38.853006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:38.853744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:38.882721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] HTTP exception thrown: Instance 435ef7a8-2d60-4197-b170-d21eed31ad11 could not be found. Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Request method failure captured: Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 HTTP/1.1 Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1iwubv8A-qVPj_GpJzJGn313t2oUWBOzDUgsbvvo-RBkjp4x9RtSPQt2cgp-nKvFrdtF6U8DugwLJQUFF-gO8IDQEc-D54jlgNIxlTAih3VFy7UDSDcgHt0hvwEs_EbW7B_V3IQJTvE99c19i9kaKab_z1-6XMT7y7JDqphCsImo4 Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 13ee7f05500a437580afe08f38a79fb9 Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveMigrationNegativeTest-267543177 Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:39:38.884429 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ee7f05500a437580afe08f38a79fb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ee7f05500a437580afe08f38a79fb9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ee7f05500a437580afe08f38a79fb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ee7f05500a437580afe08f38a79fb9"}]}] Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveMigrationNegativeTest-267543177 Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 13ee7f05500a437580afe08f38a79fb9 Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-267543177 Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveMigrationNegativeTest-267543177-project Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 010ed8588b2d496bacedebc1863a3857 Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveMigrationNegativeTest-267543177-project Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 435ef7a8-2d60-4197-b170-d21eed31ad11 could not be found. Aug 29 15:39:38.885756 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '435ef7a8-2d60-4197-b170-d21eed31ad11'} Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435ef7a8-2d60-4197-b170-d21eed31ad11 could not be found. Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:38.886450 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435ef7a8-2d60-4197-b170-d21eed31ad11 could not be found. Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435ef7a8-2d60-4197-b170-d21eed31ad11 could not be found. Aug 29 15:39:38.887788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:38.895459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] Returning 404 to user: Instance 435ef7a8-2d60-4197-b170-d21eed31ad11 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:38.898218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bda8e7d2-2f7b-4943-b48c-dab1fccede12 tempest-LiveMigrationNegativeTest-267543177 tempest-LiveMigrationNegativeTest-267543177-project] 10.222.0.83 "GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11" status: 404 len: 111 microversion: 2.1 time: 0.080280 Aug 29 15:39:38.903093 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 291/558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/435ef7a8-2d60-4197-b170-d21eed31ad11 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:38.933505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:38.953119 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a69b4856-724d-4557-b02b-175652321dde tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1470 microversion: 2.1 time: 0.280020 Aug 29 15:39:38.953712 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 268/559] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:38 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1470 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:38.987878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:38.993638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:39.018078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.018565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.018995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.020622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.030769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.031340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.181302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1151936408", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "10e124fc-0fc1-4d6c-9bea-015d572a2eb7"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:39.254022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:39.336331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4aaa7793-479b-40b0-aec8-b8f5998a639d tempest-DeleteServersAdminTestJSON-1257617851 tempest-DeleteServersAdminTestJSON-1257617851-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7/action" status: 202 len: 0 microversion: 2.1 time: 0.359427 Aug 29 15:39:39.340667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 292/560] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:38 2022] POST /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:39.358067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:39.360298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] validate_networks() for [('10e124fc-0fc1-4d6c-9bea-015d572a2eb7', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:39.362130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:39.379693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.380423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.380695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.381882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.382327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.382739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.471374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:39.474865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:39.477299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:39.477956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lazy-loading 'fault' on Instance uuid 81e2579b-c29e-4192-8302-a770b308a3a7 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:40.035332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.049104 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88175e6c-676c-4bc4-a4a8-27d49ff97661 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1453 microversion: 2.1 time: 0.703952 Aug 29 15:39:40.063483 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 293/561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:39 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1453 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.071883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.073386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.094333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.101523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.102011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.102735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.103192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.103781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.303571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:40.304101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:40.304454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:40.304857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:40.305261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:40.315473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.316006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.316445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.317168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.317739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.318169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.347623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:40.354470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for user 09663bec61af43278da1d69c37594558 and project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:40.367783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:40.369821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:40.373021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:40.452907 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cd967388-2495-4430-813a-a8516edcb0f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.429601 Aug 29 15:39:40.454944 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 269/562] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:39:40.467757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.468791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.485402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.485916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.486356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.487445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.487938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.488488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.606881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.624155 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-da011ae7-dbf6-4fe8-bda4-709a75d29b2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1270 microversion: 2.1 time: 0.162799 Aug 29 15:39:40.626064 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 270/563] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.642081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.642999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.665180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.665814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.666272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.666997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.667786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.670104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.751144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:40.761601 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aaa42d29-e3b1-4f7b-9618-0612439dd8a4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1266 microversion: 2.1 time: 0.134115 Aug 29 15:39:40.762490 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 271/564] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:40.767533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:40.768147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:40.779882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.780418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.781418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:40.782147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:40.787488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:40.790989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.199426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.217174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.228380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.231679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04c1c4c2-853f-44b1-8772-b1d5ab32b750 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1557 microversion: 2.25 time: 1.164795 Aug 29 15:39:41.252268 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 294/565] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1557 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:41.274621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.278345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.296481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.297284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.298967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.300023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.301957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.304781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.367772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:39:41.552966 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53d8f981-5b28-40ec-ab8e-60d0c10c552b tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "DELETE /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 204 len: 0 microversion: 2.1 time: 0.297284 Aug 29 15:39:41.554944 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 295/566] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:41 2022] DELETE /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:39:41.575364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.576031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.582898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.584204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.584804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.585659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.586100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.586709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.733229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.734555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:41.751935 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f4772780-8fcd-4949-9824-90767cb46675 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1212 microversion: 2.1 time: 0.190510 Aug 29 15:39:41.752793 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8375632-a294-4548-b9ed-6f70198f5c41 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.989079 Aug 29 15:39:41.753880 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 296/567] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1212 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:41.755694 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 272/568] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:40 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:41.760595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da549f79-15ff-460a-9d05-93a852c27b4c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '.version_select at 0x7f32eebf3dc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.760893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.761513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.766878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da549f79-15ff-460a-9d05-93a852c27b4c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.767717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da549f79-15ff-460a-9d05-93a852c27b4c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.768335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da549f79-15ff-460a-9d05-93a852c27b4c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.776149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.776481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.776921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.781755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.784305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.787134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.808418 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da549f79-15ff-460a-9d05-93a852c27b4c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 440 microversion: 2.25 time: 0.051481 Aug 29 15:39:41.809213 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 297/569] 10.222.0.83 () {60 vars in 1184 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/os-migrations => generated 440 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:41.814154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:41.815956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:41.832455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.835412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.836097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.836843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.837997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.837997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.860492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:41.863342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:41.863956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:41.864957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lazy-loading 'fault' on Instance uuid 81e2579b-c29e-4192-8302-a770b308a3a7 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:42.158434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.171638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f17f9bbf-67e7-4d63-a7c6-bf01ae937e48 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1459 microversion: 2.1 time: 0.414226 Aug 29 15:39:42.184909 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 273/570] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1459 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.200969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.202024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.214997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.215690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.216197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.217176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.217965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.218665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.312143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.313082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:42.324309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbe173a5-e2b6-4127-aa73-8c61584b7d37 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1272 microversion: 2.1 time: 0.131801 Aug 29 15:39:42.324710 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-425d04a0-7633-480a-bec5-0eed5fd56dab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.513993 Aug 29 15:39:42.325225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 274/571] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.325573 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 298/572] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:41 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:42.330123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2a5ef2fa-31bb-47d1-a8a6-f47e54b9582a req-50248e37-9985-48df-ad29-ac96647a05c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f4e3dc-31bd-4a4c-9227-6f82b15689dd", "tag": "8ef28b6f-7fba-4c28-abcf-33308d70c8af"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:42.344009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.346651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.348647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2a5ef2fa-31bb-47d1-a8a6-f47e54b9582a req-50248e37-9985-48df-ad29-ac96647a05c8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.349482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2a5ef2fa-31bb-47d1-a8a6-f47e54b9582a req-50248e37-9985-48df-ad29-ac96647a05c8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.350072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2a5ef2fa-31bb-47d1-a8a6-f47e54b9582a req-50248e37-9985-48df-ad29-ac96647a05c8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.357341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.358272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.358883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.359617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.360528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.361018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.377275 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2a5ef2fa-31bb-47d1-a8a6-f47e54b9582a req-50248e37-9985-48df-ad29-ac96647a05c8 service nova] Creating event network-changed:8ef28b6f-7fba-4c28-abcf-33308d70c8af for instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd on n-h2-836830-13 Aug 29 15:39:42.389465 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2a5ef2fa-31bb-47d1-a8a6-f47e54b9582a req-50248e37-9985-48df-ad29-ac96647a05c8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059881 Aug 29 15:39:42.390650 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 299/573] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:42.749812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 64d99101-0823-46e5-9f79-d44dfabf604c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:42.776395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.777346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.793174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.794581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.796727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.800974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.801720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.803946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.804965 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-86a951d3-84cc-4e1c-9260-a4ef288dfb2e tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 2051 microversion: 2.25 time: 0.478284 Aug 29 15:39:42.808636 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 275/574] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 2051 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:42.820142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:42.821838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:42.836680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.838645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.841211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:42.844461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:42.845296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:42.846589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.197458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.208780 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca039a83-0176-45ba-93a7-84660a8e40e6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1278 microversion: 2.1 time: 0.438651 Aug 29 15:39:43.211614 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 300/575] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1278 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:43.220292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-583006978", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "ebc91776-3d70-481a-8f9a-8935c9cd12b8"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:43.324470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] validate_networks() for [('ebc91776-3d70-481a-8f9a-8935c9cd12b8', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:43.479349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:43.487272 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19b9437d-9e73-4f33-8dca-4c4c44cde9aa tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.675858 Aug 29 15:39:43.491387 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 276/576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:42 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:43.499680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:43.500294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:43.525366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.525962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.527602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.529379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.530670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.531635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.648594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:43.654399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:43.654900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:43.655403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lazy-loading 'fault' on Instance uuid 81e2579b-c29e-4192-8302-a770b308a3a7 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:44.204378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:44.214490 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c121f3b-9702-49b3-9654-3d1cdcaaf30f tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1459 microversion: 2.1 time: 0.721885 Aug 29 15:39:44.223401 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 277/577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:43 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1459 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:44.236994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.240811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.253239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.255492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.257029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.257956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.258807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.260808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.895483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:44.896616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:44.897227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:44.898189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:44.898761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:44.903555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:44.908311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=29 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:44.912716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.913660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.914282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.915349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.915965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.916535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.917825 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8d1d6b0-017a-4ea6-9731-96a1def38fda tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.690767 Aug 29 15:39:44.933685 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 278/578] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:44.941558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:44.942656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:44.960474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:44.967968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for user f12698b45a114720af9c98b163077f59 and project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:44.968973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.969570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.972043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.979537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:44.980423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:44.981012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:44.986327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:44.988692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:45.056578 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15dfe56d-8221-4de5-ad7b-8ae5e98261c1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.841029 Aug 29 15:39:45.057769 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 301/579] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:39:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:39:45.064693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.065616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.073966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.075015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.076236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.078261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.078993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.079531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.306170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.318497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33ad5a33-a361-43e5-918d-0dd2a89034c7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.259328 Aug 29 15:39:45.328612 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 302/580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:45.339496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c2e76181-aa73-4a92-b01f-c68b1d782854 req-ecf85eb0-9bc9-4b22-a801-3d99641a73e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e266eab-6b47-440b-bb3b-cd7801c3d859", "tag": "88188c6a-a8cf-4565-990b-5ba98a2ea997"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:45.369083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c2e76181-aa73-4a92-b01f-c68b1d782854 req-ecf85eb0-9bc9-4b22-a801-3d99641a73e0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.369573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c2e76181-aa73-4a92-b01f-c68b1d782854 req-ecf85eb0-9bc9-4b22-a801-3d99641a73e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.371352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c2e76181-aa73-4a92-b01f-c68b1d782854 req-ecf85eb0-9bc9-4b22-a801-3d99641a73e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.374081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.377600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:45.390918 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3fe0b1d9-80d8-440a-9460-6366a192867a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.452682 Aug 29 15:39:45.391434 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c2e76181-aa73-4a92-b01f-c68b1d782854 req-ecf85eb0-9bc9-4b22-a801-3d99641a73e0 service nova] Creating event network-changed:88188c6a-a8cf-4565-990b-5ba98a2ea997 for instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 on n-h2-836830-13 Aug 29 15:39:45.404447 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 279/581] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:44 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:45.405063 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c2e76181-aa73-4a92-b01f-c68b1d782854 req-ecf85eb0-9bc9-4b22-a801-3d99641a73e0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067517 Aug 29 15:39:45.405063 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 303/582] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:45.418136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.422879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.429751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.430242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.430678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.431411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.431864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.432281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.571707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.576058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.578215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.578894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.581162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.582242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.584261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.616984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:45.638293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8edcb27e-8cc4-4229-bb23-3fdda15d9f84 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.235284 Aug 29 15:39:45.656445 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 304/583] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/os-services => generated 949 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:45.665232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f8d0bd12-8e58-42c6-a861-260e14797fa0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.666717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f8d0bd12-8e58-42c6-a861-260e14797fa0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.726513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.736857 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-72e33286-f08e-4c87-85a2-1cc925e5ccbe tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.339410 Aug 29 15:39:45.744955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 280/584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:45.747397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.748015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.753040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8d0bd12-8e58-42c6-a861-260e14797fa0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.755580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.756315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.756740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.757600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.758253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.758825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.762088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8d0bd12-8e58-42c6-a861-260e14797fa0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.763571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8d0bd12-8e58-42c6-a861-260e14797fa0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.764726 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f8d0bd12-8e58-42c6-a861-260e14797fa0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1261 microversion: 2.25 time: 0.105848 Aug 29 15:39:45.765502 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 305/585] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:45.770420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4e43dbf3-b3c6-44a2-b1a6-bb67af829dfe req-6d44e4f8-ebbb-49f1-886b-6bc45d555b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be3f8db-e1cc-464f-a8a6-2c6db7509cc6", "tag": "b1ef1508-7946-4d7e-9dfe-e71ca18740e6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:45.782734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e43dbf3-b3c6-44a2-b1a6-bb67af829dfe req-6d44e4f8-ebbb-49f1-886b-6bc45d555b5f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.783247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e43dbf3-b3c6-44a2-b1a6-bb67af829dfe req-6d44e4f8-ebbb-49f1-886b-6bc45d555b5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.783677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e43dbf3-b3c6-44a2-b1a6-bb67af829dfe req-6d44e4f8-ebbb-49f1-886b-6bc45d555b5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.795551 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4e43dbf3-b3c6-44a2-b1a6-bb67af829dfe req-6d44e4f8-ebbb-49f1-886b-6bc45d555b5f service nova] Creating event network-changed:b1ef1508-7946-4d7e-9dfe-e71ca18740e6 for instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 on n-h1-836830-13 Aug 29 15:39:45.795944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.796432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.796871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.797353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lazy-loading 'fault' on Instance uuid 81e2579b-c29e-4192-8302-a770b308a3a7 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:39:45.802783 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4e43dbf3-b3c6-44a2-b1a6-bb67af829dfe req-6d44e4f8-ebbb-49f1-886b-6bc45d555b5f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035286 Aug 29 15:39:45.803853 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 306/586] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:45.810652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.814398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.814858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.815318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.816041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.816672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.817228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.840528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63e67306f07404dab97802890c990a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ccf42f8444482a9e97a08cf7668fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:45.843321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8cdbad16-00ab-486a-b6c2-9e8900f00551 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?host=n-d-836830-13" status: 200 len: 581 microversion: 2.1 time: 0.038122 Aug 29 15:39:45.843922 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 307/587] 10.222.0.83 () {58 vars in 1174 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/os-services?host=n-d-836830-13 => generated 581 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:45.849362 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e7bdcd7-134a-472a-b7a2-62556b2fe166 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 200 len: 1310 microversion: 2.1 time: 0.105774 Aug 29 15:39:45.850374 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 281/588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:45.856403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.859933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.860417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.860856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.861572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.862026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.862450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.886602 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4838a8da-8b4f-44be-b85d-e5077a856003 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.033673 Aug 29 15:39:45.887252 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 308/589] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:45.900282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.903881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.904549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.905173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.905907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.906437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.906863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.931749 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3398010b-2835-4625-bb78-04bcd73c5ae5 tempest-ServicesAdminTestJSON-2104831034 tempest-ServicesAdminTestJSON-2104831034-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.035867 Aug 29 15:39:45.932352 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 282/590] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/os-services => generated 949 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:45.940571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:45.940571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:45.950143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.950635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.951159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:45.951905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:45.952520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:45.953105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.126967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.136125 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d9254721-f1aa-4701-a13b-af96c3560880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.200880 Aug 29 15:39:46.136810 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 309/591] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:45 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:46.344798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.345481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.353273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.353758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.354372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.355275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.355866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.356682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.412786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.413859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.419986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.420780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.421222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.421955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.422515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.423002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.509246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.517514 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ae873fe-8aab-4a50-898c-cb6ef7c1aa73 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.182117 Aug 29 15:39:46.518080 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 283/592] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:46.608846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.617808 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5db5f0a-0de3-4f65-b905-226599338461 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.209428 Aug 29 15:39:46.618475 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 310/593] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:46.758212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.758788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.764868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.765358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.765806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.766724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.767206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.767620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.789858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.790476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.799098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.799839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.800439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.801333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.801991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.802574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.886744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.895479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.897441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.898959 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1781686f-1ef9-4736-8e59-14a5458e8c1e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1265 microversion: 2.25 time: 0.114085 Aug 29 15:39:46.899546 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 311/594] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:39:46.906848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.906848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.910599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.911962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.912595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.913482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.914119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.914786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.928910 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] HTTP exception thrown: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Request method failure captured: Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 HTTP/1.1 Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN17aCRynDLFP-ILYn7D4gMztb5PckGS8jLJcYZM1RSl6sI1EM8fPC8W2_iwdHVfUN9Iaqjg4dTTKSV610snpeywnv2iI95TD8CC4Bmabfyf-IwiH-iEJ9qM__LIUYDq7EakDrwYyAcCnNCunb4kfa2Guawg7yVX_ybcyyLuPv8ENz0 Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:39:46.930575 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ccf42f8444482a9e97a08cf7668fd7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ccf42f8444482a9e97a08cf7668fd7"}]}] Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e63e67306f07404dab97802890c990a0 Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.931913 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '81e2579b-c29e-4192-8302-a770b308a3a7'} Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:46.932711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.933994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.936637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Returning 404 to user: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:46.936637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72ea3c2b-cd39-46fa-bbc2-bc5bbe6a07c3 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 404 len: 111 microversion: 2.1 time: 0.031504 Aug 29 15:39:46.937571 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 312/595] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:46.942294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.943609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.945948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:46.950942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.951526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.951953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.952655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.953165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.953587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.955222 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f128c33-7648-4f2e-a1c8-400066c7b98b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.201130 Aug 29 15:39:46.955935 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 284/596] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:46.968301 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] HTTP exception thrown: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Request method failure captured: Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 HTTP/1.1 Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN17aCRynDLFP-ILYn7D4gMztb5PckGS8jLJcYZM1RSl6sI1EM8fPC8W2_iwdHVfUN9Iaqjg4dTTKSV610snpeywnv2iI95TD8CC4Bmabfyf-IwiH-iEJ9qM__LIUYDq7EakDrwYyAcCnNCunb4kfa2Guawg7yVX_ybcyyLuPv8ENz0 Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:39:46.969882 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ccf42f8444482a9e97a08cf7668fd7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ccf42f8444482a9e97a08cf7668fd7"}]}] Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e63e67306f07404dab97802890c990a0 Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.971447 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '81e2579b-c29e-4192-8302-a770b308a3a7'} Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:46.972284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:46.973655 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:46.975748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Returning 404 to user: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:46.975748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e26a809a-e614-49e7-8940-a5ca41ca6240 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "DELETE /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 404 len: 111 microversion: 2.1 time: 0.032706 Aug 29 15:39:46.975748 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 313/597] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:46 2022] DELETE /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:46.981619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:46.982235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: 81e2579b-c29e-4192-8302-a770b308a3a7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:46.988145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.988653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.989042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:46.990261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:46.990709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:46.991451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.007810 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] HTTP exception thrown: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Request method failure captured: Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 HTTP/1.1 Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN17aCRynDLFP-ILYn7D4gMztb5PckGS8jLJcYZM1RSl6sI1EM8fPC8W2_iwdHVfUN9Iaqjg4dTTKSV610snpeywnv2iI95TD8CC4Bmabfyf-IwiH-iEJ9qM__LIUYDq7EakDrwYyAcCnNCunb4kfa2Guawg7yVX_ybcyyLuPv8ENz0 Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:39:47.009301 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ccf42f8444482a9e97a08cf7668fd7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ccf42f8444482a9e97a08cf7668fd7"}]}] Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e63e67306f07404dab97802890c990a0 Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:47.010713 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '81e2579b-c29e-4192-8302-a770b308a3a7'} Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:47.011606 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. Aug 29 15:39:47.012860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.014100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Returning 404 to user: Instance 81e2579b-c29e-4192-8302-a770b308a3a7 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:47.014100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ebfad98-d74c-4288-a4cb-36a499ba9662 tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7" status: 404 len: 111 microversion: 2.1 time: 0.033829 Aug 29 15:39:47.014503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 285/598] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:46 2022] GET /compute/v2.1/servers/81e2579b-c29e-4192-8302-a770b308a3a7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:47.020000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.020979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.027193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.027690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.028128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.028847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.029300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.029725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.044512 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] HTTP exception thrown: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Request method failure captured: Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 HTTP/1.1 Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN17aCRynDLFP-ILYn7D4gMztb5PckGS8jLJcYZM1RSl6sI1EM8fPC8W2_iwdHVfUN9Iaqjg4dTTKSV610snpeywnv2iI95TD8CC4Bmabfyf-IwiH-iEJ9qM__LIUYDq7EakDrwYyAcCnNCunb4kfa2Guawg7yVX_ybcyyLuPv8ENz0 Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:39:47.046111 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ccf42f8444482a9e97a08cf7668fd7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ccf42f8444482a9e97a08cf7668fd7"}]}] Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e63e67306f07404dab97802890c990a0 Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.047509 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b106a174-dbd7-4322-ad4f-e1489c630958'} Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:47.048259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.050201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.052435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Returning 404 to user: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:47.052435 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-221ad958-555f-422a-ac49-aec279133edd tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 404 len: 111 microversion: 2.1 time: 0.031915 Aug 29 15:39:47.052435 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 314/599] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:39:47 2022] DELETE /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:39:47.056814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.057487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] [instance: b106a174-dbd7-4322-ad4f-e1489c630958] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.063425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.063904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.064338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.065020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.065469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.065888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.081132 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] HTTP exception thrown: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Request method failure captured: Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 HTTP/1.1 Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN17aCRynDLFP-ILYn7D4gMztb5PckGS8jLJcYZM1RSl6sI1EM8fPC8W2_iwdHVfUN9Iaqjg4dTTKSV610snpeywnv2iI95TD8CC4Bmabfyf-IwiH-iEJ9qM__LIUYDq7EakDrwYyAcCnNCunb4kfa2Guawg7yVX_ybcyyLuPv8ENz0 Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:39:47.082848 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_13ccf42f8444482a9e97a08cf7668fd7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/13ccf42f8444482a9e97a08cf7668fd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/13ccf42f8444482a9e97a08cf7668fd7"}]}] Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 13ccf42f8444482a9e97a08cf7668fd7 Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1671717313 Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e63e67306f07404dab97802890c990a0 Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersAdminTestJSON-1671717313-project Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.084674 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b106a174-dbd7-4322-ad4f-e1489c630958'} Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:39:47.085733 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. Aug 29 15:39:47.087083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:39:47.088345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] Returning 404 to user: Instance b106a174-dbd7-4322-ad4f-e1489c630958 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:39:47.088345 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3326b0fc-9099-42b5-b5d4-35116905257c tempest-DeleteServersAdminTestJSON-1671717313 tempest-DeleteServersAdminTestJSON-1671717313-project] 10.222.0.83 "GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958" status: 404 len: 111 microversion: 2.1 time: 0.031648 Aug 29 15:39:47.088345 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 286/600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/b106a174-dbd7-4322-ad4f-e1489c630958 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:39:47.157996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.158698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.166047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.166858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.167528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.168693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.169244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.169894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.188163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:47.326150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.335395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-301b3c33-7fa6-4d5e-b6ac-15bdef296a98 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.181181 Aug 29 15:39:47.336077 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 315/601] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:47.411952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a62c6061-f821-4d32-9c60-f681204efe5b req-68b085ae-f60a-4f03-baae-861df5fa8997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e2579b-c29e-4192-8302-a770b308a3a7", "name": "network-vif-deleted", "tag": "a4339b79-2141-4902-a2a4-7f36cca30560"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:47.422783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a62c6061-f821-4d32-9c60-f681204efe5b req-68b085ae-f60a-4f03-baae-861df5fa8997 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.423362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a62c6061-f821-4d32-9c60-f681204efe5b req-68b085ae-f60a-4f03-baae-861df5fa8997 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.424171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a62c6061-f821-4d32-9c60-f681204efe5b req-68b085ae-f60a-4f03-baae-861df5fa8997 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.437208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a62c6061-f821-4d32-9c60-f681204efe5b req-68b085ae-f60a-4f03-baae-861df5fa8997 service nova] Creating event network-vif-deleted:a4339b79-2141-4902-a2a4-7f36cca30560 for instance 81e2579b-c29e-4192-8302-a770b308a3a7 on n-h1-836830-13 Aug 29 15:39:47.443834 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a62c6061-f821-4d32-9c60-f681204efe5b req-68b085ae-f60a-4f03-baae-861df5fa8997 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035798 Aug 29 15:39:47.445029 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 287/602] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:47.540763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.541858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.548580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.549339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.550524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.551463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.552391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.553214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.647966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.648692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.656989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.658141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.658926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.659908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.660805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.662272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.772013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.780334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6df7bdb7-49b6-4a28-a2eb-bbcd6f9fc24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.246526 Aug 29 15:39:47.781616 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 316/603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:47.928631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.929238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.931406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:47.946580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.947056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.947350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.947929 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d39176d-abde-45b1-9605-c909491355e4 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.304724 Aug 29 15:39:47.948573 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 288/604] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:47.949340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.949802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.950218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.978240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:47.978907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:47.986719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.987273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.987692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:47.988368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:47.988815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:47.989285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.050585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.064948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.067166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.070245 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b6aa0dde-11fc-4dd4-84c2-173317e9c3ef tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1265 microversion: 2.25 time: 0.145288 Aug 29 15:39:48.071852 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 317/605] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:48.221991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.236378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-746d4e9c-3978-479d-a431-5693cee5b8c5 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.261867 Aug 29 15:39:48.237414 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 289/606] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:47 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:48.357479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.358296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.382609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.383775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.384559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.386214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.387359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.388099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.581151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:48.591395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe9ad35e-3013-4ed0-b1d5-79fa4cdbb265 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.238004 Aug 29 15:39:48.592403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 318/607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:48.805226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.806374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.820814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.822250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.823831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.826302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.826779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.827245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.971118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:48.972933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:48.987325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.988221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.991534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:48.995883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:48.996541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:48.997378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.033116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.047634 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4109d9a6-b9a4-4f27-a303-5caf583e7dd2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.245956 Aug 29 15:39:49.056061 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 290/608] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:49.095599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.096214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.103950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.104662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.105106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.106650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.107462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.108550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.193211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.197628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.206315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.207772 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28e6db73-3bf0-4c3f-b8b8-a1586e793725 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.242889 Aug 29 15:39:49.208697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.208927 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 319/609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:48 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:49.217389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9ca323fe-9cd6-4935-bd97-cbe83e81926b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1265 microversion: 2.25 time: 0.125942 Aug 29 15:39:49.231554 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 291/610] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:49.258061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.258677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.264773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.265263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.265701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.266654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.267160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.267589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.420307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.428638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d478fa3-cef1-48dc-8580-63b87496e257 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.174853 Aug 29 15:39:49.429365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 292/611] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:49.528906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1154014439", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:49.597658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:39:49.613352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:49.613970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:49.625246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.626052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.626668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.629545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:49.630752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:49.633272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:49.974560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:49.984726 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d78db17-0cf8-4abb-bf5a-369115db4ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.375176 Aug 29 15:39:49.985510 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 293/612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:49 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:50.034248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:39:50.035461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:39:50.036394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:39:50.037126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:39:50.037551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:39:50.049785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.050509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.051036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.052390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.052917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.053657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.070177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.070736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.076281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Getting quotas for project 90d10fdad3184fc4b6813a8575069bc9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:39:50.077442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.077929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.078365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.079518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.079977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.080400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.089447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Getting quotas for user 1fa00248ff214f93bcc67dd0d1a04c61 and project 90d10fdad3184fc4b6813a8575069bc9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:39:50.111457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:39:50.114103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:39:50.174614 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8bdbbb4d-2185-46ce-96bd-c2774426121c tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964326 Aug 29 15:39:50.175873 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 320/613] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:39:50.189999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-832c2437-0a73-4dc7-b133-a0c6783ffc80 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.191645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-832c2437-0a73-4dc7-b133-a0c6783ffc80 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.364817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=45 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:50.373786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.385836 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f01b0b0-081e-4a85-93f0-becb66d1d8b3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.318495 Aug 29 15:39:50.389078 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 294/614] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:50.415293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.418995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.439634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.443549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.444856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.449391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.451748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.452504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.574885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-832c2437-0a73-4dc7-b133-a0c6783ffc80 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.585093 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-832c2437-0a73-4dc7-b133-a0c6783ffc80 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1214 microversion: 2.1 time: 0.401562 Aug 29 15:39:50.587658 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 321/615] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1214 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:50.602274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.604608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.624242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.624930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.625696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.626560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.627013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.627452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.801229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.810580 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7c5cff55-090b-4fde-adc9-e9c351a257cb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.420083 Aug 29 15:39:50.811251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 295/616] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:50.816153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ee8285a8-2931-4230-a8fb-cf6586bb7c21 req-159e7ff4-5aae-41a6-bd44-759e7e8c5b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb03030-409e-4060-8428-d865da5f212f", "tag": "e137ebac-7c12-45fe-b69b-ca4fed9d7199"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:50.827267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ee8285a8-2931-4230-a8fb-cf6586bb7c21 req-159e7ff4-5aae-41a6-bd44-759e7e8c5b72 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.827981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ee8285a8-2931-4230-a8fb-cf6586bb7c21 req-159e7ff4-5aae-41a6-bd44-759e7e8c5b72 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.828641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ee8285a8-2931-4230-a8fb-cf6586bb7c21 req-159e7ff4-5aae-41a6-bd44-759e7e8c5b72 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.841376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ee8285a8-2931-4230-a8fb-cf6586bb7c21 req-159e7ff4-5aae-41a6-bd44-759e7e8c5b72 service nova] Creating event network-changed:e137ebac-7c12-45fe-b69b-ca4fed9d7199 for instance 7eb03030-409e-4060-8428-d865da5f212f on n-h2-836830-13 Aug 29 15:39:50.847332 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ee8285a8-2931-4230-a8fb-cf6586bb7c21 req-159e7ff4-5aae-41a6-bd44-759e7e8c5b72 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034879 Aug 29 15:39:50.847929 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 296/617] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:50.852312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.868124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.870363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:50.874190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:50.874908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:50.875873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19d29f60-4ac5-4279-9334-cc2361306c9b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1257 microversion: 2.25 time: 0.286470 Aug 29 15:39:50.876577 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 322/618] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1257 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:50.892495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.898946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.899616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:50.900379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:50.900849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:50.901275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.033598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e3ce7c8-982b-4b0e-b180-82e5d2dd19dd tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-8149122", "id": 2065238787, "os-flavor-access:is_public": "False"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:51.055060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e3ce7c8-982b-4b0e-b180-82e5d2dd19dd tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.177001 Aug 29 15:39:51.056379 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 323/619] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:50 2022] POST /compute/v2.1/flavors => generated 428 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:51.061500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.062296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.069123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.069622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.070053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.070917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.071847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.072284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.090801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.132513 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fa36ebf-bf6b-477c-b6ee-ba5318cf9e3c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.272557 Aug 29 15:39:51.133024 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 297/620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:50 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.150993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7db6f778-da4c-4876-92ee-93ff96358447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8e4bb55738954024a58df82ddf006a67"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:51.295642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7db6f778-da4c-4876-92ee-93ff96358447 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/2065238787/action" status: 200 len: 97 microversion: 2.1 time: 0.159175 Aug 29 15:39:51.299523 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 298/621] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:39:51 2022] POST /compute/v2.1/flavors/2065238787/action => generated 97 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:51.532806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57ba2a01-8d1a-404f-b540-c6865e727901 tempest-FlavorsAccessTestJSON-1277383245 tempest-FlavorsAccessTestJSON-1277383245-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.557090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57ba2a01-8d1a-404f-b540-c6865e727901 tempest-FlavorsAccessTestJSON-1277383245 tempest-FlavorsAccessTestJSON-1277383245-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 6235 microversion: 2.1 time: 0.252790 Aug 29 15:39:51.557974 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 299/622] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/flavors/detail => generated 6235 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.580937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1a1bb892-7d91-4856-8838-97fbe2a84b4c req-7268e99c-ebd8-457f-8435-6a2e5c4fecb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e266eab-6b47-440b-bb3b-cd7801c3d859", "name": "network-vif-plugged", "status": "completed", "tag": "88188c6a-a8cf-4565-990b-5ba98a2ea997"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:51.591723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1a1bb892-7d91-4856-8838-97fbe2a84b4c req-7268e99c-ebd8-457f-8435-6a2e5c4fecb6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.592208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1a1bb892-7d91-4856-8838-97fbe2a84b4c req-7268e99c-ebd8-457f-8435-6a2e5c4fecb6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.592956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1a1bb892-7d91-4856-8838-97fbe2a84b4c req-7268e99c-ebd8-457f-8435-6a2e5c4fecb6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.606404 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1a1bb892-7d91-4856-8838-97fbe2a84b4c req-7268e99c-ebd8-457f-8435-6a2e5c4fecb6 service nova] Creating event network-vif-plugged:88188c6a-a8cf-4565-990b-5ba98a2ea997 for instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 on n-h2-836830-13 Aug 29 15:39:51.611405 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1a1bb892-7d91-4856-8838-97fbe2a84b4c req-7268e99c-ebd8-457f-8435-6a2e5c4fecb6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052122 Aug 29 15:39:51.612001 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 300/623] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:51.618360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.619082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.629031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.629532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.630105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.630701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.631357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.631959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.647670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.656991 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c056622-a2e9-4286-9635-d4ed4755a72d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.599397 Aug 29 15:39:51.657703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 324/624] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.664943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-754563cb-0ea5-4c70-8d7d-0405c2ad78ab tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8e4bb55738954024a58df82ddf006a67"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:51.741699 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-754563cb-0ea5-4c70-8d7d-0405c2ad78ab tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/2065238787/action" status: 200 len: 21 microversion: 2.1 time: 0.082572 Aug 29 15:39:51.742536 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 325/625] 10.222.0.83 () {60 vars in 1200 bytes} [Mon Aug 29 15:39:51 2022] POST /compute/v2.1/flavors/2065238787/action => generated 21 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:51.747949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.748764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.754714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.756450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.756647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.757341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.757825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.758310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.784779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.793153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be2be104-8543-4935-b155-09de794920ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.179631 Aug 29 15:39:51.793731 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 301/626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.798262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-565b0d78-1173-4ae4-a13c-bededc6b9f19 tempest-FlavorsAccessTestJSON-1277383245 tempest-FlavorsAccessTestJSON-1277383245-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.823597 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-565b0d78-1173-4ae4-a13c-bededc6b9f19 tempest-FlavorsAccessTestJSON-1277383245 tempest-FlavorsAccessTestJSON-1277383245-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028676 Aug 29 15:39:51.824209 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 302/627] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.831143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.831955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.839877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.840092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.840487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.840986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.842240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.842881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.843696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.850287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:51.850527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f45e81c7-a33b-441e-a820-365bb1286dee tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1266 microversion: 2.1 time: 0.105204 Aug 29 15:39:51.858820 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 326/628] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:51.870501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8405a35-bb60-40c3-b990-c1a3e577b555 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.892195 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8405a35-bb60-40c3-b990-c1a3e577b555 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/2065238787" status: 202 len: 0 microversion: 2.1 time: 0.028348 Aug 29 15:39:51.894530 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 327/629] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:39:51 2022] DELETE /compute/v2.1/flavors/2065238787 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:51.901803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:51.902411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:51.908562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.908928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.909367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.910058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:51.910524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:51.910947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:51.982563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.993245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.994523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.995606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:51.995734 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6912a7a0-b63a-4a7b-9836-12942d8cb23b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1313 microversion: 2.25 time: 0.097766 Aug 29 15:39:51.996587 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 328/630] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:52.000953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d808dfe-e51f-4f38-881f-60a91174abc1 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.005439 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9fac04fa-88b0-4a80-905f-9a173bf57417 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.177752 Aug 29 15:39:52.006638 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 303/631] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:52.032572 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d808dfe-e51f-4f38-881f-60a91174abc1 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.034928 Aug 29 15:39:52.033151 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 329/632] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:51 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.052670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-035e973e-5d52-4066-a7bf-f445e5f080e9 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1325750415", "id": 1346211617, "os-flavor-access:is_public": "False"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:52.070901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-035e973e-5d52-4066-a7bf-f445e5f080e9 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.022816 Aug 29 15:39:52.071555 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 304/633] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:39:52 2022] POST /compute/v2.1/flavors => generated 431 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:52.083987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5c65c1f-60d9-4be7-b20a-5c206ec321e7 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.096316 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5c65c1f-60d9-4be7-b20a-5c206ec321e7 tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/1346211617/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.017003 Aug 29 15:39:52.096857 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 330/634] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/flavors/1346211617/os-flavor-access => generated 21 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:52.106861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44120a98-7ca0-43a5-bf70-11803e09b49b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.124751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44120a98-7ca0-43a5-bf70-11803e09b49b tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1346211617" status: 202 len: 0 microversion: 2.1 time: 0.021704 Aug 29 15:39:52.125322 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 305/635] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:39:52 2022] DELETE /compute/v2.1/flavors/1346211617 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:52.134458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f63af1b1-fe92-469b-aa0b-f5ed252db8ac tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.156632 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f63af1b1-fe92-469b-aa0b-f5ed252db8ac tempest-FlavorsAccessTestJSON-1967575676 tempest-FlavorsAccessTestJSON-1967575676-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.026725 Aug 29 15:39:52.156834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.157315 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 331/636] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:52.157510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.164357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.164974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.165538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.166337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.166897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.167444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.308371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.316105 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-05cf21ca-17e3-4d74-be7b-a95f615e2e29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.164015 Aug 29 15:39:52.316673 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 306/637] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:52.678269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.678766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.685567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.686111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.686486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.687224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.687673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.688093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.828939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.837585 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4cdabf1-ed77-44d2-8d0a-ce5b88efc6bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.163475 Aug 29 15:39:52.838142 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 332/638] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:52.883799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.884549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.895166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.895973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.896479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.897078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:52.897596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.898129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:52.898478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.899074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.905703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.906346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.907012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.908073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:52.908728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:52.909351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:52.985994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:52.995685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-140d0489-97b0-499b-a056-a9ecc0acf910 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1266 microversion: 2.1 time: 0.117699 Aug 29 15:39:52.996553 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 307/639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:53.021168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.022731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.025199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:53.034868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.036359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.037565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.038528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.039647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.040303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.120301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.123842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.129732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.131380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.132576 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e24fd10-89a2-43f0-8537-51338b4940a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1313 microversion: 2.25 time: 0.117280 Aug 29 15:39:53.132751 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b018c23e-5da5-4fda-a6d8-68bd0e4b3bdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.241447 Aug 29 15:39:53.133500 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 333/640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:52 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:53.140300 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 308/641] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1313 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:39:53.140300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.140300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.152127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.152617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.153344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.154309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.154763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.155287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.306600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.315728 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b3eb0d0-3582-4f01-9f0a-af6051200040 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.180700 Aug 29 15:39:53.318097 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 309/642] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:53.341471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.342262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.348404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.349093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.349969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.350996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.351661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.352235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.503628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:53.514161 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d8794e8-9272-42cd-bd7d-abb2d4f0506e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.175019 Aug 29 15:39:53.514161 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 334/643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:53.668050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2e21cf19-f867-4ad9-98d3-47466d9ba72b req-c7593173-a0f3-488a-9546-02015b87515c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be3f8db-e1cc-464f-a8a6-2c6db7509cc6", "name": "network-vif-plugged", "status": "completed", "tag": "b1ef1508-7946-4d7e-9dfe-e71ca18740e6"}, {"server_uuid": "f2f4e3dc-31bd-4a4c-9227-6f82b15689dd", "name": "network-vif-plugged", "status": "completed", "tag": "8ef28b6f-7fba-4c28-abcf-33308d70c8af"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:53.681235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2e21cf19-f867-4ad9-98d3-47466d9ba72b req-c7593173-a0f3-488a-9546-02015b87515c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.681800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2e21cf19-f867-4ad9-98d3-47466d9ba72b req-c7593173-a0f3-488a-9546-02015b87515c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.682467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2e21cf19-f867-4ad9-98d3-47466d9ba72b req-c7593173-a0f3-488a-9546-02015b87515c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.696393 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2e21cf19-f867-4ad9-98d3-47466d9ba72b req-c7593173-a0f3-488a-9546-02015b87515c service nova] Creating event network-vif-plugged:b1ef1508-7946-4d7e-9dfe-e71ca18740e6 for instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 on n-h1-836830-13 Aug 29 15:39:53.696901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2e21cf19-f867-4ad9-98d3-47466d9ba72b req-c7593173-a0f3-488a-9546-02015b87515c service nova] Creating event network-vif-plugged:8ef28b6f-7fba-4c28-abcf-33308d70c8af for instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd on n-h2-836830-13 Aug 29 15:39:53.705769 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2e21cf19-f867-4ad9-98d3-47466d9ba72b req-c7593173-a0f3-488a-9546-02015b87515c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042596 Aug 29 15:39:53.706364 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 310/644] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:53.858063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:53.859276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:53.862972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:53.867941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.868486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.869005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:53.870259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:53.870711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:53.871711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.005839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.015385 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2283775-f562-40e8-87c5-0081a81d9b78 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.161082 Aug 29 15:39:54.016295 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 335/645] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:53 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:54.020155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.021485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:54.028507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.028999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.029548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.030125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.030580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.031004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.094899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.103129 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcf8d413-191a-47d7-84f8-2ceaf87ad0a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1266 microversion: 2.1 time: 0.089956 Aug 29 15:39:54.103769 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 311/646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:54.154302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.154986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:54.157355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.158424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:54.161747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.162609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.163192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.163978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.164089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.164476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.164712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.164908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.165303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.165732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.166313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.167170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.230949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.239610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.241221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.242484 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b24b4fc2-f85e-455e-b51f-b8f13c5c53f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1313 microversion: 2.25 time: 0.090041 Aug 29 15:39:54.243165 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 312/647] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:39:54.321346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.328958 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c3879d35-4925-47e8-a921-a78c1a7952d3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.178624 Aug 29 15:39:54.329523 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 336/648] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:54.339179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.339865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:54.348127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.348934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.349384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.350202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.350821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.351341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.525270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.535434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.535928 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1314 microversion: 2.1 time: 0.201601 Aug 29 15:39:54.549485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 313/649] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:54.550669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:54.557776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.558244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.558726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.559377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:54.559908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:54.560249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:54.701084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:54.710912 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15fd0983-738f-4493-8f4e-0bdb7d8ade5b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.180043 Aug 29 15:39:54.712164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 337/650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:54.965010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:54.965979 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c33f1669-86df-41f6-840e-1c1164863702 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001307 Aug 29 15:39:54.971199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 314/651] 10.222.0.83 () {56 vars in 886 bytes} [Mon Aug 29 15:39:54 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:39:55.037515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.038279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.045193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.045803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.046351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.047157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.047611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.048155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.125590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.126199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.134525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.135030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.135477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.136179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.136634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.137051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.210919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.216748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.221395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cfc24082-2b0e-4fd0-82ef-b5c9806c1b51 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.187401 Aug 29 15:39:55.221977 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 338/652] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:55.226103 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e68c31fa-593e-4888-89e3-63b1de28f9e1 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1266 microversion: 2.1 time: 0.104273 Aug 29 15:39:55.227350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 315/653] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:55.266149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.267036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.275048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.275619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.276737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.277447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.277901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.278561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.344405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.346645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:55.350563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.351863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.355345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.356977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.358057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.358202 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-015d82e0-d112-4e63-9624-be6f1bfe06a1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1321 microversion: 2.25 time: 0.096391 Aug 29 15:39:55.358708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.359241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.361582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.362069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.362500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.371619 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 339/654] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1321 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:55.515201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.524263 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1676b15e-96c2-4947-9437-e1c0226d6f52 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.178194 Aug 29 15:39:55.525172 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 316/655] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:55.559409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.560028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.565942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.566426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.566890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.567961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.568415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.568843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.732665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:55.733377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:55.749040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.749586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.750097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.750955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:55.752642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:55.753232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:55.762183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:55.776059 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e017c0ed-646a-4a5e-9cfd-76770d56497c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1464 microversion: 2.1 time: 0.221673 Aug 29 15:39:55.791051 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 340/656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:55.912506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:55.995064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.005869 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a2cc95f8-4d56-44f2-a84c-81eb4c00c8ab tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.277463 Aug 29 15:39:56.006494 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 317/657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:56.126735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.132130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Searching by: {'deleted': False, 'project_id': '5deefbb32a254e42a6193ac0ff2d30b6'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:56.138126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.138609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.139072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.139791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.140241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.140660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.243104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.243715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:56.244323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e654b3a0-70dc-4151-89b2-d66d08902de1 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.446362 Aug 29 15:39:56.244993 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 341/658] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:55 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:56.251370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.251559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.252188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.252329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:56.252990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.253833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.254433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.255709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.261612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.261612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.261815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.262445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.262906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.263362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.339989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.347981 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e64f3962-ed2c-46d0-ab51-f40a3f40df85 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1266 microversion: 2.1 time: 0.101615 Aug 29 15:39:56.351065 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 342/659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:56.354146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.360267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Searching by: {'deleted': False} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:56.365675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.366190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.366615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.368163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.368163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.368383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.454469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.463854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bdf9234e-630e-416a-b68f-dac3fd2e7849 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.224567 Aug 29 15:39:56.464662 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 318/660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:56.469717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.470322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:56.476795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.477516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.477949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.478651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.478942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:39:56.479137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.479562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.557405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.570648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.572131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.573486 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-754d9cc1-fa00-43ab-81c0-0e6872a2c40d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1319 microversion: 2.25 time: 0.107759 Aug 29 15:39:56.574923 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 319/661] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1319 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:56.581000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:56.581813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:56.592494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.593461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.594182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.595418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.596276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.596849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.624303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:56.625374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:56.625374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:56.758842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:56.771431 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-071c3cd3-8209-4179-96b2-5a9dd9bf6169 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.191482 Aug 29 15:39:56.772214 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 320/662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:57.009094 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-084060b2-2f88-4f31-8332-5b8764f2a366 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15590 microversion: 2.1 time: 0.658404 Aug 29 15:39:57.010436 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 343/663] 10.222.0.83 () {58 vars in 1171 bytes} [Mon Aug 29 15:39:56 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15590 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:39:57.028774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.029992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.036655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.037477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.038128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.039078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.047619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.053026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.053476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.058043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Searching by: {'deleted': False, 'project_id': '5deefbb32a254e42a6193ac0ff2d30b6'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:57.070742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.071533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.072378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.073201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.073660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.074086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.104028 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-118c7c1b-ac4c-402e-92e9-4fe2a47800c9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/detail?tenant_id=068087b8e3274eb98dabdb60c8db2368" status: 200 len: 15 microversion: 2.1 time: 0.063059 Aug 29 15:39:57.104704 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 344/664] 10.222.0.83 () {58 vars in 1231 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/detail?tenant_id=068087b8e3274eb98dabdb60c8db2368 => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:57.123530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.129106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Searching by: {'tenant_id': '068087b8e3274eb98dabdb60c8db2368', 'deleted': False} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:57.134948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.135465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.135898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.136601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.137047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.137558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.171246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:39:57.312288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.312288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.312916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.313282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.322851 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ad19bfb-c65b-4268-b0dc-7e36652d2cf0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1366 microversion: 2.1 time: 0.294565 Aug 29 15:39:57.323528 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 321/665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:57.372664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.374228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.382629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.383464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.384368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.385659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.386227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.386731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.486339 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4d7fe85-f92c-4f99-ae10-aa467808b9de tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=068087b8e3274eb98dabdb60c8db2368" status: 200 len: 4833 microversion: 2.1 time: 0.366263 Aug 29 15:39:57.486957 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 345/666] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=068087b8e3274eb98dabdb60c8db2368 => generated 4833 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:57.513431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.514305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.523129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.523926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.525416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.526377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.527052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.527834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.786983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.795590 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e65ba26f-1b77-4405-b711-beb2c71eda95 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1274 microversion: 2.1 time: 0.429068 Aug 29 15:39:57.796925 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 322/667] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1274 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:57.802977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.812243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Searching by: {'tenant_id': '5deefbb32a254e42a6193ac0ff2d30b6', 'deleted': False} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:57.820322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.822087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.822755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.823999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.824680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.825555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.858573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:57.870848 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1f24955a-dd4b-43c5-8a47-6c5d5929ceeb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1312 microversion: 2.1 time: 0.370002 Aug 29 15:39:57.883490 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 346/668] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:57.883490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.883490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.905674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.906664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.907137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.907854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.908872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.909300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.968114 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb38f042-4e08-492a-a56d-a75ee310c70e tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5deefbb32a254e42a6193ac0ff2d30b6" status: 200 len: 15 microversion: 2.1 time: 0.169567 Aug 29 15:39:57.968893 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 323/669] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5deefbb32a254e42a6193ac0ff2d30b6 => generated 15 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:57.974384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:57.975310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:57.991640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.992784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.993300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:57.994093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:57.994655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:57.995198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.004270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:39:58.109586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.119966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.121477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.122659 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-720f9728-c1ff-424f-9e44-d56408f83147 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.246171 Aug 29 15:39:58.123445 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 347/670] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:58.127968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ccfb9f1b-de2a-47a2-84fd-00698f11596d tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.133741 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ccfb9f1b-de2a-47a2-84fd-00698f11596d tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009189 Aug 29 15:39:58.139069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 348/671] 10.222.0.83 () {58 vars in 1189 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:39:58.154966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:58.157165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.164615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.165353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.165663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.166483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.166826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.167332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.197258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.206278 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e4e3275-d397-4255-9cbb-efd1c82a1b22 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.236540 Aug 29 15:39:58.207621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 324/672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:57 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:58.259523 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59c88ff0-9d51-4268-a473-2ec40e73b5ff tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action" status: 202 len: 0 microversion: 2.1 time: 0.108452 Aug 29 15:39:58.263157 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 349/673] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:58 2022] POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:39:58.272490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.280583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:58.281920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '068087b8e3274eb98dabdb60c8db2368'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:39:58.290895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.291538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.291975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.292867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.293509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.293942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.352496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.355524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.417578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.418168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.418621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.419374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.419827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.420246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.429150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:39:58.538873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1b27fbd7-2671-447b-b06a-e19d3269a475 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.274074 Aug 29 15:39:58.539534 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 325/674] 10.222.0.83 () {58 vars in 1150 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:58.691934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eecd9430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.696212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.697036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.697690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.725070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.725940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.726581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.738014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.738871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.741721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.751404 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c454f7d9-51cb-4cf0-a128-1b31ebf9ca79 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.210548 Aug 29 15:39:58.752698 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 326/675] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:58.758832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:58.761741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.769044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.769920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.771487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.772753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.774196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.774891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.872016 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ccd4de8f-faa4-4af7-936d-c66ce752bfaa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action" status: 202 len: 0 microversion: 2.1 time: 0.117907 Aug 29 15:39:58.875835 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 327/676] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:39:58 2022] POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:39:58.878108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eebeca60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.880607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.881445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.881845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.901349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.901831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.902269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.916009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.916498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.916934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.925549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fd5e3a8-dbaa-4b10-9ec5-77662aec5ba5 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.049963 Aug 29 15:39:58.938638 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 328/677] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:58.938638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:58.938638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:58.938638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.938638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.939180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.940476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:58.940476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:58.940683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:58.996298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.005947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-813e7986-94aa-4b97-bd30-78abee345712 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1556 microversion: 2.1 time: 0.665244 Aug 29 15:39:59.007359 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 350/678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1556 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:39:59.023207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.025040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.035932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.037313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.038001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.039111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.040005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.040813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.052411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.062335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d10f58a-0580-49f1-b067-e0a088e00cf5 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1272 microversion: 2.1 time: 0.134816 Aug 29 15:39:59.068008 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 329/679] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:58 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:59.072829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.073457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.085554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.087050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.087050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.087419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.087769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.088444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.303914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc07ec15-fcd7-40e0-9a43-c050050f51fa tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1617 microversion: 2.1 time: 0.295873 Aug 29 15:39:59.305866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 351/680] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1617 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:59.313852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.327846 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f54776ea-b12c-4174-9655-4e3fe8173850 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1461 microversion: 2.1 time: 0.263791 Aug 29 15:39:59.330712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eeba6ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.331815 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 330/681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1461 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:59.340522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.345086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.346036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.346791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.347598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.368148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.368959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.369596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.370454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.371331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.371794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.372364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.372571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.373010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.384773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.385360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.385874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.393316 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5da8db02-2a56-4b9b-8adf-99d000d617f2 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.086055 Aug 29 15:39:59.394580 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 352/682] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:59.407869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.409216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.417056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.417831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.418935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.420125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.420990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.421811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.470514 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49f92431-4a5a-4ffa-b357-11d30af4220f tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137301 Aug 29 15:39:59.471255 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 331/683] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:39:59.477710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.478322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.485394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.486078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.486513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.487535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.487982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.488587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.804736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.813801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.815309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.816611 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2d4ac140-7e0e-48c4-9151-d9c509a0d8fb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.420999 Aug 29 15:39:59.817161 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 353/684] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:39:59.832253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:39:59.832253 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25dd335d-fe72-45e9-b316-6e041e9a487c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.359175 Aug 29 15:39:59.832666 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 332/685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:39:59.845124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-aedeab0e-2565-469a-8d4d-500f838cc418 req-02bff44a-5a75-4133-98cf-b7bcd23af6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be7a738-71fb-4b02-90d4-497b04cb438c", "tag": "497ace04-4c82-46cf-ba04-0cba678d10fe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:39:59.847578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:39:59.852171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:39:59.862456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.862949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.863441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.867239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.867784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.868216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.873732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-aedeab0e-2565-469a-8d4d-500f838cc418 req-02bff44a-5a75-4133-98cf-b7bcd23af6c4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:39:59.874282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-aedeab0e-2565-469a-8d4d-500f838cc418 req-02bff44a-5a75-4133-98cf-b7bcd23af6c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:39:59.874715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-aedeab0e-2565-469a-8d4d-500f838cc418 req-02bff44a-5a75-4133-98cf-b7bcd23af6c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:39:59.890000 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-aedeab0e-2565-469a-8d4d-500f838cc418 req-02bff44a-5a75-4133-98cf-b7bcd23af6c4 service nova] Creating event network-changed:497ace04-4c82-46cf-ba04-0cba678d10fe for instance 5be7a738-71fb-4b02-90d4-497b04cb438c on n-h2-836830-13 Aug 29 15:39:59.896618 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-aedeab0e-2565-469a-8d4d-500f838cc418 req-02bff44a-5a75-4133-98cf-b7bcd23af6c4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060630 Aug 29 15:39:59.897446 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 333/686] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:00.021324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.022342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.030308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.030807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.031308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.032158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.032619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.033191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.222285 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-65cc6af8-629a-4904-bd90-422629ad71b9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1617 microversion: 2.1 time: 0.386335 Aug 29 15:40:00.222987 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 354/687] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1617 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:00.227622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eebf3280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.229574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.230159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.230709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.247524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.248794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.249246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.257593 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2597841-0b73-4596-8c79-00d301bf7775 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.033412 Aug 29 15:40:00.258436 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 355/688] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:00.263304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-df1a9329-ebbb-4098-a6c7-aada91d8ac26 req-95ce0324-158f-41ff-a9c5-e5c0f1d93c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb03030-409e-4060-8428-d865da5f212f", "name": "network-vif-plugged", "status": "completed", "tag": "e137ebac-7c12-45fe-b69b-ca4fed9d7199"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:00.275551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-df1a9329-ebbb-4098-a6c7-aada91d8ac26 req-95ce0324-158f-41ff-a9c5-e5c0f1d93c3a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.276171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-df1a9329-ebbb-4098-a6c7-aada91d8ac26 req-95ce0324-158f-41ff-a9c5-e5c0f1d93c3a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.277174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-df1a9329-ebbb-4098-a6c7-aada91d8ac26 req-95ce0324-158f-41ff-a9c5-e5c0f1d93c3a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.282603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:00.293079 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-df1a9329-ebbb-4098-a6c7-aada91d8ac26 req-95ce0324-158f-41ff-a9c5-e5c0f1d93c3a service nova] Creating event network-vif-plugged:e137ebac-7c12-45fe-b69b-ca4fed9d7199 for instance 7eb03030-409e-4060-8428-d865da5f212f on n-h2-836830-13 Aug 29 15:40:00.301099 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-df1a9329-ebbb-4098-a6c7-aada91d8ac26 req-95ce0324-158f-41ff-a9c5-e5c0f1d93c3a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040859 Aug 29 15:40:00.302559 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 356/689] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:00.309022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.309847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.318412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.318982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.319681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.320921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.321443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.321900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.528848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.544030 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09e54865-d62b-4c98-b7ab-06164f24bca2 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.239962 Aug 29 15:40:00.558497 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 357/690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:00.558497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.561007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Searching by: {'host': 'n-h1-836830-13', 'deleted': False} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:40:00.566836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.567417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.568415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.569136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.569633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.570053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.645266 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-df4b31a2-0907-4456-a93e-79938cc251a3 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1614 microversion: 2.1 time: 0.746459 Aug 29 15:40:00.646429 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 334/691] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:39:59 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1614 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:00.651262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40606443-1f0d-4e58-864e-75aa8cce3c86 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eec9fb80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.653142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40606443-1f0d-4e58-864e-75aa8cce3c86 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.653780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40606443-1f0d-4e58-864e-75aa8cce3c86 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.654369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40606443-1f0d-4e58-864e-75aa8cce3c86 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.669720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:40:00.672755 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40606443-1f0d-4e58-864e-75aa8cce3c86 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 266 microversion: 2.1 time: 0.024819 Aug 29 15:40:00.673522 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 335/692] 10.222.0.83 () {58 vars in 1179 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 266 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:00.678369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:00.679155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.685687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.686179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.686611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.687354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.687804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.688420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.757241 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46d9c090-88cd-44b2-8e0a-501e668e4c13 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers?host=n-h1-836830-13&all_tenants=1" status: 200 len: 1663 microversion: 2.1 time: 0.211179 Aug 29 15:40:00.758131 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 358/693] 10.222.0.83 () {58 vars in 1192 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers?host=n-h1-836830-13&all_tenants=1 => generated 1663 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:00.769256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eebf3430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.771501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.771858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'daf5d8de71074057871a3091617bda2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4d01c4eddd43e09ec8e7efc2bdc2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:00.771986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.772403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.772520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] flavor_id is None. Assuming migration. {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:40:00.772868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:40:00.787416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.787867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.788466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.803775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.804249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.804933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.812325 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a5ece274-71b1-4179-84e5-c470840a7673 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.052219 Aug 29 15:40:00.812916 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 359/694] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:00.818380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.824890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:40:00.830014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.830561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.831095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.831897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.832520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.832961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.856268 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4223cddd-457a-4d58-8ba4-60fe70c39168 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.041971 Aug 29 15:40:00.856950 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 360/695] 10.222.0.83 () {58 vars in 1196 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:40:00.862370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eebd48b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.865004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.865915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.866519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.884779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.885524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.886110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.893392 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d992d117-bc50-4033-9ad6-027c1daf5c92 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.035203 Aug 29 15:40:00.894728 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 361/696] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:00.899594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.900385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:00.907600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.908116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.908525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.909217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:00.909665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:00.910083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:00.978651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-134b7b42-0abe-41f5-8932-2b04f9066bcf tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859/action" status: 202 len: 0 microversion: 2.1 time: 0.303714 Aug 29 15:40:00.979521 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 336/697] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:00 2022] POST /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:00.994254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:00.998301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.010358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.010571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.010933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.011778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.012230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.012972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.080104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.090393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.091912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.098311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5240480-0c2e-4827-b023-eeaab8fcda2a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.202341 Aug 29 15:40:01.099542 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 362/698] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:01.113882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:01.116968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.126030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.126527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.126966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.127703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.128160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.128580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.222928 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1f37f50c-c7ce-4650-883c-f6666b449e0a tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action" status: 202 len: 0 microversion: 2.1 time: 0.121124 Aug 29 15:40:01.225023 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 363/699] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:01 2022] POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:01.232339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32ee9844c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.235834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.236652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.237790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.398143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.420444 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e76c5f3-d1cf-4baf-bbe3-00d53cb70b13 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.435761 Aug 29 15:40:01.436219 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 337/700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:00 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:01.436501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.436997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.437616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.442980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.445163 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-066646b8-0056-4d3c-ab34-7732c8a36e0a tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.218403 Aug 29 15:40:01.445651 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 364/701] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:01.446252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.453316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.453879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.454516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.455454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.456209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.456817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.459323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:01.463526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.470614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.471144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.471579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.472275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.473064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.473494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.590070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:01.591286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:01.591959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:01.592433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:01.593062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:01.620937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:01.631291 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec156c95-bc9d-418f-838f-642de6e5232f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1470 microversion: 2.1 time: 0.197559 Aug 29 15:40:01.632496 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 338/702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:01.637468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Calling method '.version_select at 0x7f32eec9f3a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.639648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.640131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.640567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.644553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:01.672250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.673549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.674895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.687638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.695590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.696101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.696750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.702617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.702617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.702617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.710239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.710751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.711231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.731195 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37ce2864-d92b-4df9-9b27-9e13c8eeccd1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action" status: 202 len: 1068 microversion: 2.1 time: 0.277343 Aug 29 15:40:01.732058 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 365/703] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:01 2022] POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action => generated 1068 bytes in 286 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:40:01.754457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.760533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.767516 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62542608-a358-4d01-8003-0ff345cdd449 tempest-HypervisorAdminTestJSON-2095248190 tempest-HypervisorAdminTestJSON-2095248190-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.133208 Aug 29 15:40:01.775877 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 339/704] 10.222.0.83 () {58 vars in 1173 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:01.778395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.779243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.779808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.780766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.781521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.782056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.783462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:01.784333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:01.794380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.795275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.797431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.798376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:01.799129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:01.799875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:01.992360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.027252 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18438b7e-e22c-479b-badf-974da4f63ce0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.262772 Aug 29 15:40:02.028249 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 366/705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:02.032982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0fbfe94d-7162-4897-87d4-46e2da4d7c99 req-fe2e1f1f-10fd-4076-be04-facd8d64c0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f4e3dc-31bd-4a4c-9227-6f82b15689dd", "tag": "8ef28b6f-7fba-4c28-abcf-33308d70c8af"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:02.053292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0fbfe94d-7162-4897-87d4-46e2da4d7c99 req-fe2e1f1f-10fd-4076-be04-facd8d64c0f2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.053771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0fbfe94d-7162-4897-87d4-46e2da4d7c99 req-fe2e1f1f-10fd-4076-be04-facd8d64c0f2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.054212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0fbfe94d-7162-4897-87d4-46e2da4d7c99 req-fe2e1f1f-10fd-4076-be04-facd8d64c0f2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.073237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.085316 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0fbfe94d-7162-4897-87d4-46e2da4d7c99 req-fe2e1f1f-10fd-4076-be04-facd8d64c0f2 service nova] Creating event network-changed:8ef28b6f-7fba-4c28-abcf-33308d70c8af for instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd on n-h2-836830-13 Aug 29 15:40:02.089147 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1855bc38-faed-4dc8-a2cf-f0fd7c37bb43 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1472 microversion: 2.1 time: 0.311381 Aug 29 15:40:02.089954 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 340/706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:01 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:02.104943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0fbfe94d-7162-4897-87d4-46e2da4d7c99 req-fe2e1f1f-10fd-4076-be04-facd8d64c0f2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075402 Aug 29 15:40:02.105606 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 367/707] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:02.123591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:02.124516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:02.138670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.139629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.141031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.141031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.141331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.141972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.328759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.339710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.341276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.342546 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-695c8e2f-c83b-4c4c-a21c-6dd6d76eb086 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.224367 Aug 29 15:40:02.343508 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 341/708] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:02 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:02.446976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:02.447704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:02.454678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.455664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.456340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.457323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.460484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.461241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.657578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:02.658476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:02.662261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.670395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20cae2da-1e6f-4621-a931-df79685606cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.229269 Aug 29 15:40:02.670970 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 368/709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:02 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:02.683345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.683345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.683345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.683345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:02.684162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:02.684162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:02.849524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:02.857783 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a481929-bfc3-4a28-9121-841ca7562757 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1470 microversion: 2.1 time: 0.206274 Aug 29 15:40:02.858701 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 342/710] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:02 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:03.048810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.049958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.056894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.057382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.057816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.058500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.058959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.059459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.113341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.113952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.120538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.121022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.121455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.122166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.122617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.123053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.246664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.256069 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-40c7a656-f7e6-4097-ab51-2eb23d9690e3 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.211276 Aug 29 15:40:03.256672 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 369/711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:03.259666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.268354 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-189a38d2-c1ca-49ac-bcbd-1f6a1f29a282 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1472 microversion: 2.1 time: 0.159279 Aug 29 15:40:03.279801 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 343/712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:03.365650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.366593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.375763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.376297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.376686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.377392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.377845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.378461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.685529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.692822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.694060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.705823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.706331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.707132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.707498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.711677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.712473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.712967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.716801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.720416 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ff05395-a1f6-4c9a-bcb2-7aaadf5d71d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.359597 Aug 29 15:40:03.721860 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 370/713] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:03.881424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:03.882755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:03.891892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.892608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.893381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.894806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:03.895312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:03.896720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:03.904824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:03.913771 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7bd6ac78-e1ed-486e-9433-65c2a3556d00 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.225070 Aug 29 15:40:03.928582 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 344/714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:04.198820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.205023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:04.228325 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f3c15cb-3d4d-4fa9-ab0d-cbcabe71bf04 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1470 microversion: 2.1 time: 0.352979 Aug 29 15:40:04.229094 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 371/715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:03 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:04.246720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2a605d5a-c13d-43d4-a524-973a0068c0e8 req-65bfd306-004a-4158-9c54-43745cf2c610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a127823-5e1e-49d5-b297-6f6e5a991242", "tag": "8dfe7249-ce52-4424-8ee2-7157982a7306"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:04.260204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a605d5a-c13d-43d4-a524-973a0068c0e8 req-65bfd306-004a-4158-9c54-43745cf2c610 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.261721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a605d5a-c13d-43d4-a524-973a0068c0e8 req-65bfd306-004a-4158-9c54-43745cf2c610 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.262379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a605d5a-c13d-43d4-a524-973a0068c0e8 req-65bfd306-004a-4158-9c54-43745cf2c610 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.280918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.282254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.290716 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2a605d5a-c13d-43d4-a524-973a0068c0e8 req-65bfd306-004a-4158-9c54-43745cf2c610 service nova] Creating event network-changed:8dfe7249-ce52-4424-8ee2-7157982a7306 for instance 6a127823-5e1e-49d5-b297-6f6e5a991242 on n-h2-836830-13 Aug 29 15:40:04.296570 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2a605d5a-c13d-43d4-a524-973a0068c0e8 req-65bfd306-004a-4158-9c54-43745cf2c610 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053698 Aug 29 15:40:04.300241 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 345/716] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:04.301930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.302436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.302877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.303606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.304065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.304527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.306292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.307101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.314091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.314626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.315280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.316042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.316505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.316936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.477232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.486171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1010280d-90e8-4d07-834b-a7203d3b756b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.211475 Aug 29 15:40:04.487059 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 372/717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:04.579742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.588345 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f7b670ff-2ee4-4ba0-b720-f38801a34573 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1472 microversion: 2.1 time: 0.286915 Aug 29 15:40:04.599469 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 346/718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:04.746228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.746836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.752991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.753493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.753922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.754639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.755640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.756077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.921002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.932401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.933750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:04.934201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:04.934461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:04.941997 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5892b992-a356-4f65-ba52-2f153a1a757d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.193017 Aug 29 15:40:04.955047 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 373/719] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:04.964042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.964799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.965487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:04.966766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:04.967482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:04.968129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.249118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.249995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.256919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.257715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.258301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.259227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.259843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.260448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.370654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.380033 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb340e63-8dcf-4239-90a2-b4b1794048d4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1308 microversion: 2.1 time: 0.449869 Aug 29 15:40:05.380752 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 347/720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:04 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1308 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:05.518930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Calling method '.version_select at 0x7f32eeedae50>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.521576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.522273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.522867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.542118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.543220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.543823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.558905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.559565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.560115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.568910 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-557892bf-1646-44ae-8cb2-4475f428184d tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.179916 Aug 29 15:40:05.575877 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 348/721] 10.222.0.83 () {60 vars in 1187 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:05.579996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.580620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.587552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.588353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.589002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.589917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.590593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.591304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.844753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.854807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ba6b58d-fadf-43c1-a205-fa13b17c02ae tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1470 microversion: 2.1 time: 0.609484 Aug 29 15:40:05.855921 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 374/722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1470 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:05.861380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Calling method '.version_select at 0x7f32ef2864c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.863702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.865117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.865894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.881051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.881548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.881984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.889576 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-65a56b28-cfc0-42ca-98d8-5388aee1cb52 tempest-HypervisorAdminV228Test-1030088645 tempest-HypervisorAdminV228Test-1030088645-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.032394 Aug 29 15:40:05.889994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:05.900011 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 375/723] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:05.900011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.900011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.900353 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0df0032e-32db-40f0-81a0-a0da79d6df20 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.322457 Aug 29 15:40:05.902040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.902607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.903138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.904066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.904752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.905853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.911801 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 349/724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:05.969324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:05.970730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:05.978987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.979810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.980473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:05.981373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:05.982137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:05.983007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.152203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.163792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.165525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.166657 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c6da10a5-ff5f-4662-8732-13fb8f6134cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.201335 Aug 29 15:40:06.167706 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 350/725] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:06.172335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.182443 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6fae1d1a-0cdf-4dce-b947-a2ceb8bf8fb9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1472 microversion: 2.1 time: 0.291126 Aug 29 15:40:06.183285 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 376/726] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:05 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:06.404446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:06.405369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:06.413309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.414044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.414549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.415525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.416253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.416869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.599979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.607914 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07096b5f-d0ad-4ea1-bbb2-bc507ec3e574 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1488 microversion: 2.1 time: 0.207520 Aug 29 15:40:06.608493 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 351/727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:06 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:06.628972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:06.629525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:06.636465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.636957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.637397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.638093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.638787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.638973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.712959 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9f5e2635-3e14-4866-bfe8-9c13d719d4a6 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f/action" status: 202 len: 0 microversion: 2.1 time: 0.087681 Aug 29 15:40:06.714333 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 377/728] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:06 2022] POST /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:06.723425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:06.724402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:06.730932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.731639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.731886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.733081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.733529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.733943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.875503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:06.877422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:06.878132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:06.883869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:06.885953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.886097 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-759b4e8a-2143-44eb-9595-46f20d3aadf7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1493 microversion: 2.1 time: 0.167759 Aug 29 15:40:06.886444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.886853 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 352/729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:06 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1493 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:06.886974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.887752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.888267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.888695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.920697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:06.921313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:06.927653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.928144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.928574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:06.929550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:06.930056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:06.930773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.037067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.045187 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-16ac2fa8-54f2-4bb1-9e67-5c53d8a18202 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.171950 Aug 29 15:40:07.045757 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 378/730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:06 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:07.116845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.125596 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7bef98ad-27e9-4bae-a496-ae83bd6660b7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.209285 Aug 29 15:40:07.126171 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 353/731] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:06 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:07.190630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:07.191272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:07.198381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.198381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.198670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.199306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.199760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.200183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.203851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:07.215085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:07.221138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:07.227838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.228571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.229022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.229734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.230197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.230623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.292041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=19 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:07.378694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.388275 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2c625aab-ee5c-4221-bcdf-da4ee86131c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1472 microversion: 2.1 time: 0.188408 Aug 29 15:40:07.388952 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 354/732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:07 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:07.397387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.405925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.408162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:07.410112 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87e942ab-d6c6-4efc-be7b-8ae4faa44274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.223676 Aug 29 15:40:07.419263 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 379/733] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:07 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:07.718477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9ef84101-e5ad-4362-99db-d0beed5dd807 req-cfe8dafe-c5ef-4b70-bfcd-ec537298a4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be7a738-71fb-4b02-90d4-497b04cb438c", "name": "network-vif-plugged", "status": "completed", "tag": "497ace04-4c82-46cf-ba04-0cba678d10fe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:07.730785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9ef84101-e5ad-4362-99db-d0beed5dd807 req-cfe8dafe-c5ef-4b70-bfcd-ec537298a4e3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.731322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9ef84101-e5ad-4362-99db-d0beed5dd807 req-cfe8dafe-c5ef-4b70-bfcd-ec537298a4e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.731736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9ef84101-e5ad-4362-99db-d0beed5dd807 req-cfe8dafe-c5ef-4b70-bfcd-ec537298a4e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.744492 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9ef84101-e5ad-4362-99db-d0beed5dd807 req-cfe8dafe-c5ef-4b70-bfcd-ec537298a4e3 service nova] Creating event network-vif-plugged:497ace04-4c82-46cf-ba04-0cba678d10fe for instance 5be7a738-71fb-4b02-90d4-497b04cb438c on n-h2-836830-13 Aug 29 15:40:07.753478 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9ef84101-e5ad-4362-99db-d0beed5dd807 req-cfe8dafe-c5ef-4b70-bfcd-ec537298a4e3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038752 Aug 29 15:40:07.754080 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 355/734] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:07.907953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:07.908558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:07.916669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.917164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.917594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:07.918625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:07.919109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:07.919532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.060927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.066963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:08.068044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:08.075060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5fa89c2f-0441-4632-b056-dd01ac6fe714 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1493 microversion: 2.1 time: 0.170263 Aug 29 15:40:08.075334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.075434 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 380/735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:07 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1493 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:08.075513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.075916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.076783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.077253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.077884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.147185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:08.147750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:08.153830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.154317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.154782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.155503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.156184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.156609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.221808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.231493 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2f42da04-46b8-4b9e-a796-0bd9b5827ade tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.169033 Aug 29 15:40:08.232075 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 356/736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:08 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:08.299550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.307869 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3092c6cf-d43a-418a-90b4-badc5b190673 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.165995 Aug 29 15:40:08.308439 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 381/737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:08 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:08.411870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:08.412564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:08.414524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:08.419936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.420429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.420866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.421592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.422046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.422476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.433533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:08.434144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:08.437213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:08.441970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.443450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.444161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.444891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:08.445364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:08.445742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:08.585642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.594347 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e06bfbb-261e-49f3-b79a-23bc17b64d49 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1472 microversion: 2.1 time: 0.186715 Aug 29 15:40:08.594925 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 357/738] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:08 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:08.598981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.605163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.607208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:08.607907 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e18cc05-34fc-4a8c-85e9-521e657cb6d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.178197 Aug 29 15:40:08.608455 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 382/739] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:08 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:09.052815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Action: 'update', calling method: .version_select at 0x7f32eeeda1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:09.096020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.096625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.103486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.103966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.104393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.105077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.105519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.105938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.113549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.114039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.115169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.115876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.116331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.116790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.169516 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-286f3e6c-5037-4f2b-9136-21d4b8b4a57d tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838" status: 200 len: 240 microversion: 2.36 time: 0.230503 Aug 29 15:40:09.170057 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 358/740] 10.222.0.83 () {62 vars in 1303 bytes} [Mon Aug 29 15:40:08 2022] PUT /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838 => generated 240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:09.181536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Calling method '.version_select at 0x7f32ef163c10>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.242550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.243189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.243494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.243592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.244225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.244685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.245154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.253113 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71198237-df79-48e3-91a6-7215e0723ee4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1493 microversion: 2.1 time: 0.160975 Aug 29 15:40:09.253708 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 383/741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1493 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:09.266246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.267776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.274440 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d6e72cf-d8d1-4b25-bd22-4434b383ea38 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838/detail" status: 200 len: 672 microversion: 2.36 time: 0.097313 Aug 29 15:40:09.275086 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 359/742] 10.222.0.83 () {60 vars in 1304 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838/detail => generated 672 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 15:40:09.275328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.275741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.276402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.277107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.277560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.277982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.330482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.331156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.337785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.338320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.338716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.339448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.339906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.340329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.443139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.451721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-915cae54-d7f4-4319-a1ba-55ddd30dc958 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.196977 Aug 29 15:40:09.452283 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 384/743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:09.457782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Action: 'update', calling method: .version_select at 0x7f32eec3a670>, body: {"quota_set": {"ram": "2048"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:09.512888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.521378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76f69376-cf37-469a-b2eb-fcf084937336 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.195535 Aug 29 15:40:09.522088 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 360/744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:09.529920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.530415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.530845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.531605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.532061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.532488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.540499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=27 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:09.569051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.569528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.569961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.570686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.571163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.571583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.616340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.616945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.623115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.623610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.624048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.624154 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4da53475-e43d-4ca8-8d4f-8b379fbe7d2b tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838?user_id=7d2dbf14950840a88ee59c39edef04fd" status: 200 len: 240 microversion: 2.36 time: 0.170470 Aug 29 15:40:09.630685 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 385/745] 10.222.0.83 () {62 vars in 1384 bytes} [Mon Aug 29 15:40:09 2022] PUT /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838?user_id=7d2dbf14950840a88ee59c39edef04fd => generated 240 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:09.630841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.630841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.630841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.635629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.636245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:09.643284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.644289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.645152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.645492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:09.645946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:09.646377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:09.777951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.786961 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab5cdc35-cb08-4570-b834-2de851f6e37b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1478 microversion: 2.1 time: 0.174113 Aug 29 15:40:09.787642 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 361/746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1478 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:09.792311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-48b1821d-57a9-48d6-b28d-6ec6e93a76e5 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] Calling method '.version_select at 0x7f32eecdcca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:09.853534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.862014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.863498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:09.865250 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-84e3036a-1a00-47dd-a03d-6e6ae8a3bdf9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.232931 Aug 29 15:40:09.865389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-48b1821d-57a9-48d6-b28d-6ec6e93a76e5 tempest-QuotasAdminTestV236-1159183367 tempest-QuotasAdminTestV236-1159183367-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838?user_id=7d2dbf14950840a88ee59c39edef04fd" status: 200 len: 282 microversion: 2.36 time: 0.076630 Aug 29 15:40:09.865811 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 386/747] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:09.867065 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 362/748] 10.222.0.83 () {60 vars in 1364 bytes} [Mon Aug 29 15:40:09 2022] GET /compute/v2.1/os-quota-sets/fe9e5f1fc7494458b7eeaa8f50a51838?user_id=7d2dbf14950840a88ee59c39edef04fd => generated 282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:10.276383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.277006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.283480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.283990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.284429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.285118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.285572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.285999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.421156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:10.424586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:10.430476 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-267a55ff-78dc-4c45-bbf0-00d24d5411db tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 200 len: 1473 microversion: 2.1 time: 0.157893 Aug 29 15:40:10.431071 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 387/749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 1473 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:10.451810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-943208699"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:10.454265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.465329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.466146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.467139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.468190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.469376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.470316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.474302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.474922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.482018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.482497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.482926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.483840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.484358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.484960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.689586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:10.699575 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb5fe5a6-049f-449d-97b9-639b89324284 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.229665 Aug 29 15:40:10.712533 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 388/750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:10.718933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.719580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.720826 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff09c9e4-7ae4-4af0-a02d-383a4aae9770 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f/action" status: 202 len: 0 microversion: 2.1 time: 0.272799 Aug 29 15:40:10.721544 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 363/751] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:10 2022] POST /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:40:10.732050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.732674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.733202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38f54e31-9e81-4596-acda-d6aca62fee1c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ef0b74c0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.733320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.734114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.734747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.735368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.782724 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38f54e31-9e81-4596-acda-d6aca62fee1c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.053856 Aug 29 15:40:10.783428 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 364/752] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:10.809033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.809982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.818160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.818728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.819283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.820163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.820627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.821091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.899847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:10.907900 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4214f16a-419a-49ba-8ca2-c1af91012878 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.195109 Aug 29 15:40:10.908448 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 389/753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:10.914203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:10.914809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:10.921385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.921939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.922372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:10.923090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:10.923540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:10.923958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.009255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:11.021428 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-403c3fc8-493c-4ebc-8e34-25457ff172d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1478 microversion: 2.1 time: 0.216445 Aug 29 15:40:11.035166 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 365/754] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1478 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:11.066676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:11.077427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:11.078875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:11.080565 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ece57d9-56aa-474f-8a1c-13e66f0bdd9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1361 microversion: 2.25 time: 0.170730 Aug 29 15:40:11.081068 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 390/755] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:10 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:11.721425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:11.722155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:11.729358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.730336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.730828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.731657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.732170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.732866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.822432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a11bdef-17d0-41f8-b39d-13dc6e1ec6f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eec6d8b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:11.902785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a11bdef-17d0-41f8-b39d-13dc6e1ec6f3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.107076 Aug 29 15:40:11.908948 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 391/756] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:11 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:11.933523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:11.934651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:11.948228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.949637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.950792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.952374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:11.953212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:11.953977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:11.990089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.006085 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11bb88f4-4856-4b22-aae9-0583b1ca46fc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.288054 Aug 29 15:40:12.011089 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 366/757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:11 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:12.045201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.049350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.056781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.057511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.058755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.059582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.060216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.061493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.147006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.155747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8427eebc-61b1-4fe0-a60a-9b7b11ccf328 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.229161 Aug 29 15:40:12.159073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 392/758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:11 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:12.162508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.163145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.170255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.170742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.171198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.171890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.172335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.172749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.219354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.230196 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-03060af6-56a8-4e2a-b112-ea0ea88f125f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1478 microversion: 2.1 time: 0.190928 Aug 29 15:40:12.231133 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 367/759] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1478 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:12.326699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.336320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.337757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:12.338931 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75bb4145-ae46-49e8-9480-d6901eabb9f5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1557 microversion: 2.25 time: 0.181569 Aug 29 15:40:12.339517 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 393/760] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:12.360571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.361398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.368249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.368736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.369176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.369862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.370314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.370735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.509923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 5be7a738-71fb-4b02-90d4-497b04cb438c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:12.523347 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a134e97a-ba72-4526-8713-187df25fca60 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 2051 microversion: 2.25 time: 0.166410 Aug 29 15:40:12.523915 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 368/761] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 2051 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:12.545677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.546276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.553074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.553571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.554000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.554682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.555154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.555574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.731000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 5be7a738-71fb-4b02-90d4-497b04cb438c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:12.752497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b30c5a0-0fd4-4e86-9fe7-7babb3f08c1c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 2051 microversion: 2.25 time: 0.210806 Aug 29 15:40:12.753083 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 394/762] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 2051 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:12.774898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.778965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.779490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.779951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.780671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.781132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.781567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.808164 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29aab651-291f-49e8-9322-c00f962ee6bf tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.037090 Aug 29 15:40:12.808788 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 369/763] 10.222.0.83 () {60 vars in 1217 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:12.820768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:12.821288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.827261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.827863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.828174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.828867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.829317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.829813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.904179 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-670c8a08-cfdf-4ecd-8c0c-b36782c16086 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c/action" status: 202 len: 0 microversion: 2.25 time: 0.087492 Aug 29 15:40:12.904837 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 395/764] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:40:12 2022] POST /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:12.914854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.915693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:12.925560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.927385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6649509d-e8b2-4cd3-b9ee-1fe265b32a18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eeeaa4c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:12.928424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.929218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:12.930191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:12.930982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:12.931609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.010124 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6649509d-e8b2-4cd3-b9ee-1fe265b32a18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.087501 Aug 29 15:40:13.011243 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 396/765] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:13.028344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:13.029241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:13.036992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.037668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.037993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.038863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.039575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.040491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.137065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 5be7a738-71fb-4b02-90d4-497b04cb438c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:13.152042 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed4ea5a7-013f-4262-b26c-58beddded482 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 2056 microversion: 2.25 time: 0.242969 Aug 29 15:40:13.153241 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 370/766] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:12 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 2056 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:13.158394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:13.159062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:13.166302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.167094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.167686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.168545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.169165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.169594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.203429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:13.243612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:13.255528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6a92eba-aae5-4168-98d4-a5598232df68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.230058 Aug 29 15:40:13.256180 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 397/767] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:13 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:13.276324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:13.282117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:13.289867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.290384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.290789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.292004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.292004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.292365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.318458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8afb3133-c164-4da2-9efb-ef6d47345002 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 204 len: 0 microversion: 2.1 time: 0.162900 Aug 29 15:40:13.319464 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 371/768] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:13 2022] DELETE /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:13.326326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-24cde49b-f741-43e4-adeb-f534333e3efd req-f481f826-fe13-40ee-9cb2-3b8c2999adba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ecae4f-8a73-4f39-be3f-da87823b9d94", "name": "network-vif-unplugged", "status": "completed", "tag": "0e4dbec9-a639-455d-9630-3a4e82a180c1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:13.336876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-24cde49b-f741-43e4-adeb-f534333e3efd req-f481f826-fe13-40ee-9cb2-3b8c2999adba service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.337512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-24cde49b-f741-43e4-adeb-f534333e3efd req-f481f826-fe13-40ee-9cb2-3b8c2999adba service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.338068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-24cde49b-f741-43e4-adeb-f534333e3efd req-f481f826-fe13-40ee-9cb2-3b8c2999adba service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.352160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-24cde49b-f741-43e4-adeb-f534333e3efd req-f481f826-fe13-40ee-9cb2-3b8c2999adba service nova] Creating event network-vif-unplugged:0e4dbec9-a639-455d-9630-3a4e82a180c1 for instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 on n-h1-836830-13 Aug 29 15:40:13.358290 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-24cde49b-f741-43e4-adeb-f534333e3efd req-f481f826-fe13-40ee-9cb2-3b8c2999adba service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037174 Aug 29 15:40:13.359370 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 372/769] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:13.366009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:13.366817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:13.374513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.375003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.375585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.376559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.377977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.377977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.447859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:13.456086 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9c0af06-1ae3-49d5-b1ae-8bf8f880b9e0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.198915 Aug 29 15:40:13.456776 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 398/770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:13 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:13.523306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:13.530969 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d263c76-678a-49b7-91e9-ad2edd735b30 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1478 microversion: 2.1 time: 0.169944 Aug 29 15:40:13.531568 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 373/771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:13 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:13.536786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:13.537424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:13.543477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.544443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.544443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.545067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.545526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.545946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.582195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19051806-4fea-4d16-90b5-9cac1ab5857d tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Calling method '.version_select at 0x7f32eef33670>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:13.657154 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19051806-4fea-4d16-90b5-9cac1ab5857d tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 371 microversion: 2.1 time: 0.199245 Aug 29 15:40:13.657739 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 399/772] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:40:13 2022] GET /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:13.671200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Action: 'update', calling method: .version_select at 0x7f32eee18310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:13.702742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:13.709685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:13.713375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-985d0754-bb94-4f21-83a8-49eda919516e tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1710 microversion: 2.1 time: 0.180600 Aug 29 15:40:13.714275 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 374/773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:13 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1710 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:13.742576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.743448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.744120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.745073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:13.747676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:13.748396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:13.797281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa4743b1-da6c-4a44-9361-555e2d0f35fd tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 328 microversion: 2.1 time: 0.129916 Aug 29 15:40:13.798071 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 400/774] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:40:13 2022] PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:13.958926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-375516703", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:14.013787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:14.028110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cfb3081e-0f1d-4e09-b19e-cb1a5262fce3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebf31f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.076442 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cfb3081e-0f1d-4e09-b19e-cb1a5262fce3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.052711 Aug 29 15:40:14.077242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 401/775] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:14.176576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.177873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.184736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.185225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.185662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.186354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.186815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.187263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.216588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:14.217045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:14.217523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:14.217934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:14.218378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:14.228002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.228491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.228929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.229662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.230123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.230557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.248312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Getting quotas for project 30fdd0aadd2645a7924a9df2812307c8. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:14.253462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Getting quotas for user 408d9bbcf4c44fd294f4db903fb99df5 and project 30fdd0aadd2645a7924a9df2812307c8. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:14.267751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.utils [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] cores quota exceeded for 30fdd0aadd2645a7924a9df2812307c8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129132) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:40:14.268568 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Request method failure captured: Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 144 Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN3cjB_ntgTMocqyzEJUO-oEii7pIlzhwhe93TVjZSjQv5Hrwty-R4nlCMSJMK3Gh94XUqIlN9Jc18wHcxr1ItxMKuFSXNlNxxViw1Lx8X3yxLypSV9rLyQpEJ57T6tmCzOWjyJo6PZbF0WILfeLH6GOzeTAQnIBr2-Z6h9KoEIWGmI Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:40:14.272419 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_30fdd0aadd2645a7924a9df2812307c8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/30fdd0aadd2645a7924a9df2812307c8"}]}] Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 408d9bbcf4c44fd294f4db903fb99df5 Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-375516703", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} Aug 29 15:40:14.273974 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-375516703', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452'}}} Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:40:14.274780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:14.276107 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:14.278782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-744da063-1e84-4ebc-a596-9323a516e2e3 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.373134 Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 375/776] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:13 2022] POST /compute/v2.1/servers => generated 111 bytes in 374 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:14.282514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.284385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.291714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.292209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.292646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.293358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.293821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.294249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.331385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 5be7a738-71fb-4b02-90d4-497b04cb438c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:14.345321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e9008d9-2efe-40f7-ba6b-2d79cb716987 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 2036 microversion: 2.25 time: 0.172474 Aug 29 15:40:14.345905 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 402/777] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 2036 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:14.359496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Action: 'update', calling method: .version_select at 0x7f32ef2864c0>, body: {"quota_set": {"cores": 20}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:14.429120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.429952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.430585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.431782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.432894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.433583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.451969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:14.461340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-733f1979-5d2f-4989-b190-68410db1a2c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.185573 Aug 29 15:40:14.462099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 376/778] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:14.467639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-13", "block_migration": "auto"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:14.471715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.481228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.482067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.482680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.483500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.483986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.484433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.500138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54b473c0-db87-40d1-8a08-b84e6d0efb3e tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 329 microversion: 2.1 time: 0.152906 Aug 29 15:40:14.500734 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 403/779] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:40:14 2022] PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 329 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:14.510939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.510939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.512452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'flavor' on Instance uuid 5be7a738-71fb-4b02-90d4-497b04cb438c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:14.519783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.520271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.520804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.521484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.521998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.522482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.525620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Going to try to live migrate instance to n-h1-836830-13 {{(pid=129132) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:40:14.675515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:14.685170 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e1297df-3f32-4147-82ee-6aa709556396 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.180661 Aug 29 15:40:14.686137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 404/780] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:14.691390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8fce3530-2fd0-4dea-8718-bf8675904d85 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Calling method '.version_select at 0x7f32eec6dc10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.778923 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8fce3530-2fd0-4dea-8718-bf8675904d85 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 371 microversion: 2.1 time: 0.091786 Aug 29 15:40:14.780412 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 405/781] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:14.785159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.785784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.789474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:14.795207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.795847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.796315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.797018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.797597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.798003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.942130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:14.950639 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0bb73562-0c42-4edc-ac53-1485871271f9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1478 microversion: 2.1 time: 0.169267 Aug 29 15:40:14.952280 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 406/782] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1478 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:14.957485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:14.958822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:14.965314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.965826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.966284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:14.967189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:14.967649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:14.968075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.125813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:15.135517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3801d766-88c4-4e04-8c61-ff12d93ace97 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1710 microversion: 2.1 time: 0.182176 Aug 29 15:40:15.136410 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 407/783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:14 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:15.140956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Action: 'update', calling method: .version_select at 0x7f32eebf3d30>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:15.214985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.215502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.216886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.217988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.218456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.218885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.276915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b3b1556-5390-48d7-a16e-963949491e64 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 328 microversion: 2.1 time: 0.139353 Aug 29 15:40:15.277706 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 408/784] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:40:15 2022] PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:15.282190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa039dda-a448-4bc4-8662-a5446afc70c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eee614c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:15.339145 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa039dda-a448-4bc4-8662-a5446afc70c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.059916 Aug 29 15:40:15.344685 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 409/785] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:15 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:15.378795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7d5de6ed-ba6d-4fc2-9bd5-034825be319e req-e115d8d8-2402-4b3e-89c6-c37cd1f4d3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a127823-5e1e-49d5-b297-6f6e5a991242", "name": "network-vif-plugged", "status": "completed", "tag": "8dfe7249-ce52-4424-8ee2-7157982a7306"}, {"server_uuid": "79ecae4f-8a73-4f39-be3f-da87823b9d94", "name": "network-vif-plugged", "status": "completed", "tag": "0e4dbec9-a639-455d-9630-3a4e82a180c1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:15.390369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7d5de6ed-ba6d-4fc2-9bd5-034825be319e req-e115d8d8-2402-4b3e-89c6-c37cd1f4d3c5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.390843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7d5de6ed-ba6d-4fc2-9bd5-034825be319e req-e115d8d8-2402-4b3e-89c6-c37cd1f4d3c5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.391295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7d5de6ed-ba6d-4fc2-9bd5-034825be319e req-e115d8d8-2402-4b3e-89c6-c37cd1f4d3c5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.407059 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7d5de6ed-ba6d-4fc2-9bd5-034825be319e req-e115d8d8-2402-4b3e-89c6-c37cd1f4d3c5 service nova] Creating event network-vif-plugged:8dfe7249-ce52-4424-8ee2-7157982a7306 for instance 6a127823-5e1e-49d5-b297-6f6e5a991242 on n-h2-836830-13 Aug 29 15:40:15.407558 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7d5de6ed-ba6d-4fc2-9bd5-034825be319e req-e115d8d8-2402-4b3e-89c6-c37cd1f4d3c5 service nova] Creating event network-vif-plugged:0e4dbec9-a639-455d-9630-3a4e82a180c1 for instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 on n-h1-836830-13 Aug 29 15:40:15.416417 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7d5de6ed-ba6d-4fc2-9bd5-034825be319e req-e115d8d8-2402-4b3e-89c6-c37cd1f4d3c5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041221 Aug 29 15:40:15.417227 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 410/786] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:15.422572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1038897225", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:15.506749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:15.880638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:15.881175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:15.881778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:15.882189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:15.882604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:15.894387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.895277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.895856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.896588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.897052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.897482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.916646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Getting quotas for project 30fdd0aadd2645a7924a9df2812307c8. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:15.921418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Getting quotas for user 408d9bbcf4c44fd294f4db903fb99df5 and project 30fdd0aadd2645a7924a9df2812307c8. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:15.937993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.utils [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] instances quota exceeded for 30fdd0aadd2645a7924a9df2812307c8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129133) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:40:15.938722 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Request method failure captured: Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 145 Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3cjB_ntgTMocqyzEJUO-oEii7pIlzhwhe93TVjZSjQv5Hrwty-R4nlCMSJMK3Gh94XUqIlN9Jc18wHcxr1ItxMKuFSXNlNxxViw1Lx8X3yxLypSV9rLyQpEJ57T6tmCzOWjyJo6PZbF0WILfeLH6GOzeTAQnIBr2-Z6h9KoEIWGmI Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:40:15.942648 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_30fdd0aadd2645a7924a9df2812307c8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/30fdd0aadd2645a7924a9df2812307c8"}]}] Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 408d9bbcf4c44fd294f4db903fb99df5 Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1038897225", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} Aug 29 15:40:15.944711 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1038897225', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452'}}} Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:40:15.945481 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:15.946535 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:15.947777 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec1611a0-8d51-472d-9c75-174e66536943 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.525737 Aug 29 15:40:15.949557 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 411/787] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:15 2022] POST /compute/v2.1/servers => generated 119 bytes in 527 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:15.950191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:15.950489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:15.958578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.959068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.960123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.960123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:15.960849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:15.961283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:15.967476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:16.117900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.126428 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-43da13a3-5318-4d27-bef1-fc0cacd6223f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.180314 Aug 29 15:40:16.127121 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 412/788] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:15 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.138417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.139835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.149165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.149409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44c855eb-8a67-49e3-884e-1866a2d0893b tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c/action" status: 202 len: 0 microversion: 2.25 time: 1.685812 Aug 29 15:40:16.149875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.150159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.151111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.151578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.152006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.153363 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 377/789] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:40:14 2022] POST /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c/action => generated 0 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:16.158645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Action: 'update', calling method: .version_select at 0x7f32ee8eb3a0>, body: {"quota_set": {"instances": 10}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:16.242983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.243511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.243948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.244677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.245127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.245551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.306472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.314994 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6f79726f-823f-477b-800b-0eac75071a6a tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.186919 Aug 29 15:40:16.315807 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 413/790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.322827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.324086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.328402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:16.332854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fefca1f0-16a1-41a4-8d6d-1a5fe778fef1 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 329 microversion: 2.1 time: 0.178126 Aug 29 15:40:16.333481 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 378/791] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:40:16 2022] PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 329 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:16.334051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.334857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.335707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.336639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.337542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.338475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.346202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.346817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.358388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.359394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.360031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.360923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.361697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.362308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.557646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.568710 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f775dc9a-3498-4fc1-8f2a-a321fa6d4234 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1478 microversion: 2.1 time: 0.251050 Aug 29 15:40:16.581823 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 414/792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1478 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.581823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.581823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:16.588336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.588843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.589279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.589987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.590724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.590893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.603976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.613369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.614996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.616299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eb60df2f-ed3c-434e-8758-e99d537074f7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.274086 Aug 29 15:40:16.631693 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 379/793] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:16.637335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8a50d305-5600-4ed6-917c-5220a151a0b1 req-8787e21c-6131-407b-bf1f-d831083a1ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d", "name": "network-vif-deleted", "tag": "8d30ed14-51e2-4054-870b-8855250723d8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:16.648604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8a50d305-5600-4ed6-917c-5220a151a0b1 req-8787e21c-6131-407b-bf1f-d831083a1ec0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.649094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8a50d305-5600-4ed6-917c-5220a151a0b1 req-8787e21c-6131-407b-bf1f-d831083a1ec0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.649528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8a50d305-5600-4ed6-917c-5220a151a0b1 req-8787e21c-6131-407b-bf1f-d831083a1ec0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.662504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8a50d305-5600-4ed6-917c-5220a151a0b1 req-8787e21c-6131-407b-bf1f-d831083a1ec0 service nova] Creating event network-vif-deleted:8d30ed14-51e2-4054-870b-8855250723d8 for instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d on n-h1-836830-13 Aug 29 15:40:16.668444 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8a50d305-5600-4ed6-917c-5220a151a0b1 req-8787e21c-6131-407b-bf1f-d831083a1ec0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035111 Aug 29 15:40:16.670111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 380/794] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:16.676061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d821966-7f73-4d43-bfa4-1b110f281171 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Calling method '.version_select at 0x7f32ee993f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.698199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06856f1488e44bde85de23a5effddbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab5abb97d5e40b0a4dea82546dcb92c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:16.707507 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-805a7c67-4e8e-4693-b788-f0a6734d0a5d tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 200 len: 1346 microversion: 2.1 time: 0.136928 Aug 29 15:40:16.708095 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 415/795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.718910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aaf2b94f-dbdd-4598-beeb-68c7ec80ae30 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebd4160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:16.794442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d821966-7f73-4d43-bfa4-1b110f281171 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 371 microversion: 2.1 time: 0.122971 Aug 29 15:40:16.795292 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 381/796] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:16.799181 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aaf2b94f-dbdd-4598-beeb-68c7ec80ae30 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.086199 Aug 29 15:40:16.799181 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 416/797] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:16 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:16.807792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Action: 'update', calling method: .version_select at 0x7f32eef17d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:16.892339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.892927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.893478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.894206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:16.895635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:16.896608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:16.960576 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75b4cb11-2f7d-4528-9b30-469066c9dc59 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 325 microversion: 2.1 time: 0.157343 Aug 29 15:40:16.963075 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 417/798] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:40:16 2022] PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 325 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:17.016378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-784478599", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:17.097097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:17.150190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.151294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.158793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.159533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.160127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.161537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.162661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.173724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.361017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:17.370803 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-795c15ec-1a6c-4cc2-be3a-c6dec7936ab2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.225994 Aug 29 15:40:17.371513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 418/799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:17.376072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.377006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.383822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.384662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.385304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.386579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.387355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.387854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.553294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:17.567546 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ec1698a-ce25-4152-8898-d3f3ba326511 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1314 microversion: 2.1 time: 0.194845 Aug 29 15:40:17.568964 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 419/800] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:17.594707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.595679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.604977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.605787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.606408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.607489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.608201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.608773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.655219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:17.657425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:17.658141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:17.658852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:17.659467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:17.671275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.671952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.672547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.673754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.675006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.675649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.711130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Getting quotas for project 30fdd0aadd2645a7924a9df2812307c8. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:17.716680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Getting quotas for user 408d9bbcf4c44fd294f4db903fb99df5 and project 30fdd0aadd2645a7924a9df2812307c8. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:17.737038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.utils [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] ram quota exceeded for 30fdd0aadd2645a7924a9df2812307c8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=129132) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 29 15:40:17.737601 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Request method failure captured: Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 144 Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN3cjB_ntgTMocqyzEJUO-oEii7pIlzhwhe93TVjZSjQv5Hrwty-R4nlCMSJMK3Gh94XUqIlN9Jc18wHcxr1ItxMKuFSXNlNxxViw1Lx8X3yxLypSV9rLyQpEJ57T6tmCzOWjyJo6PZbF0WILfeLH6GOzeTAQnIBr2-Z6h9KoEIWGmI Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:40:17.740350 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_30fdd0aadd2645a7924a9df2812307c8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/30fdd0aadd2645a7924a9df2812307c8"}]}] Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 408d9bbcf4c44fd294f4db903fb99df5 Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-784478599", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} Aug 29 15:40:17.741744 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-784478599', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452'}}} Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 15:40:17.742503 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:17.743904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.745202 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0171417a-3d04-43fd-b3fa-29d1c245e783 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.733455 Aug 29 15:40:17.746530 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 382/801] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:17 2022] POST /compute/v2.1/servers => generated 110 bytes in 735 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:40:17.756126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.757387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.763876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.764363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.764793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.765483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.765926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.766533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.783478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:17.791656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-63939b50-da02-441a-af1a-a7caa0ac2e94 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1464 microversion: 2.1 time: 0.205162 Aug 29 15:40:17.792242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 420/802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:17.796926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:17.797546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:17.803980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.804458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.804878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.807559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.808341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.808845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.824042 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] HTTP exception thrown: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Request method failure captured: Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d HTTP/1.1 Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1XrmrMvIhyeXgNV9dZYYtpDaoDQzumpRZkvpNbbEV0xWPIdtxU3qVj0qsZWF4PfXhuKzGEW--1l_8_ICDD9ZceR_tZk0lJBFLxQ-IhOSZSYdnEZkdX5197uZr77dlhNQeiKQXEZQsDxLNEb-637VHU3iK3yCcI4GVjijmlivn8oqI Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:40:17.825677 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3ab5abb97d5e40b0a4dea82546dcb92c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3ab5abb97d5e40b0a4dea82546dcb92c"}]}] Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 06856f1488e44bde85de23a5effddbdd Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:17.827204 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d'} Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:17.828029 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:17.829284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:17.830340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Returning 404 to user: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:17.830340 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f232c4b-a528-4bb7-a886-0d7e2e62fd2c tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 404 len: 111 microversion: 2.1 time: 0.034692 Aug 29 15:40:17.830340 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 421/803] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:17.834908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Action: 'update', calling method: .version_select at 0x7f32eebf31f0>, body: {"quota_set": {"ram": 51200}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:17.900524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.901004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.901427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.902133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:17.902577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:17.902993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:17.961089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cbcf33c-8d49-4518-a59f-75766e248d84 tempest-QuotasAdminNegativeTest-276647522 tempest-QuotasAdminNegativeTest-276647522-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 200 len: 329 microversion: 2.1 time: 0.131227 Aug 29 15:40:17.961828 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 422/804] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:40:17 2022] PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 329 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:17.976092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5066fe42-d7df-492e-ba0e-158236673115 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eeba61f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.010253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.018878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.020458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.021943 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-173829eb-c3c2-4377-84c9-341a04a1b347 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.274612 Aug 29 15:40:18.022697 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 383/805] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:18.025361 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5066fe42-d7df-492e-ba0e-158236673115 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.062228 Aug 29 15:40:18.026159 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 423/806] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:17 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:18.027469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.028087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.030808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.031362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.038336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.038809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.039478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.040346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.040957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.041534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.048808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.049955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.050994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.052522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.053404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.054188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.055740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] HTTP exception thrown: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Request method failure captured: Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb HTTP/1.1 Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1XrmrMvIhyeXgNV9dZYYtpDaoDQzumpRZkvpNbbEV0xWPIdtxU3qVj0qsZWF4PfXhuKzGEW--1l_8_ICDD9ZceR_tZk0lJBFLxQ-IhOSZSYdnEZkdX5197uZr77dlhNQeiKQXEZQsDxLNEb-637VHU3iK3yCcI4GVjijmlivn8oqI Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:40:18.057311 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3ab5abb97d5e40b0a4dea82546dcb92c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3ab5abb97d5e40b0a4dea82546dcb92c"}]}] Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 06856f1488e44bde85de23a5effddbdd Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.058533 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '180653fe-00d9-440b-b260-5e6c16dbabfb'} Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:18.059276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.061145 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.062431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Returning 404 to user: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:18.062431 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5289885-b0c6-45f8-a387-43b7244aae17 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 404 len: 111 microversion: 2.1 time: 0.031487 Aug 29 15:40:18.062431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 424/807] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:18 2022] DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:18.070345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-681d8425-03e9-4842-ba8c-035860ada3c8 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Action: 'update', calling method: .version_select at 0x7f32ee96e4c0>, body: {"quota_set": {"ram": 0}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:18.076225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-681d8425-03e9-4842-ba8c-035860ada3c8 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '408d9bbcf4c44fd294f4db903fb99df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30fdd0aadd2645a7924a9df2812307c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-681d8425-03e9-4842-ba8c-035860ada3c8 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Request method failure captured: Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 HTTP/1.1 Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 25 Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3cjB_ntgTMocqyzEJUO-oEii7pIlzhwhe93TVjZSjQv5Hrwty-R4nlCMSJMK3Gh94XUqIlN9Jc18wHcxr1ItxMKuFSXNlNxxViw1Lx8X3yxLypSV9rLyQpEJ57T6tmCzOWjyJo6PZbF0WILfeLH6GOzeTAQnIBr2-Z6h9KoEIWGmI Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:40:18.079978 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_30fdd0aadd2645a7924a9df2812307c8", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30fdd0aadd2645a7924a9df2812307c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/30fdd0aadd2645a7924a9df2812307c8"}]}] Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 30fdd0aadd2645a7924a9df2812307c8 Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-66497066 Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 408d9bbcf4c44fd294f4db903fb99df5 Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-QuotasAdminNegativeTest-66497066-project Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: {"quota_set": {"ram": 0}} Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:40:18.081507 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '30fdd0aadd2645a7924a9df2812307c8', 'body': {'quota_set': {'ram': 0}}} Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:18.082578 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.086259 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-681d8425-03e9-4842-ba8c-035860ada3c8 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-681d8425-03e9-4842-ba8c-035860ada3c8 tempest-QuotasAdminNegativeTest-66497066 tempest-QuotasAdminNegativeTest-66497066-project] 10.222.0.83 "PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8" status: 403 len: 116 microversion: 2.1 time: 0.018475 Aug 29 15:40:18.088960 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 425/808] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:40:18 2022] PUT /compute/v2.1/os-quota-sets/30fdd0aadd2645a7924a9df2812307c8 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:18.091677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.091677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.093160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.093650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.094085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.094815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.095264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.095692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.111168 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] HTTP exception thrown: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Request method failure captured: Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb HTTP/1.1 Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN1XrmrMvIhyeXgNV9dZYYtpDaoDQzumpRZkvpNbbEV0xWPIdtxU3qVj0qsZWF4PfXhuKzGEW--1l_8_ICDD9ZceR_tZk0lJBFLxQ-IhOSZSYdnEZkdX5197uZr77dlhNQeiKQXEZQsDxLNEb-637VHU3iK3yCcI4GVjijmlivn8oqI Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:40:18.112880 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3ab5abb97d5e40b0a4dea82546dcb92c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3ab5abb97d5e40b0a4dea82546dcb92c"}]}] Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 06856f1488e44bde85de23a5effddbdd Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.115742 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '180653fe-00d9-440b-b260-5e6c16dbabfb'} Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:18.116678 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:18.118079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:18.119380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Returning 404 to user: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:18.119380 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c8fdb25-c4ff-4de9-a675-5259e320a937 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 404 len: 111 microversion: 2.1 time: 0.033662 Aug 29 15:40:18.119380 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 426/809] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:18.124700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4eede582-f03b-40ac-b112-4ed5922a8bc0 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '.version_select at 0x7f32ee96eaf0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.165304 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4eede582-f03b-40ac-b112-4ed5922a8bc0 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622685922" status: 202 len: 0 microversion: 2.1 time: 0.043785 Aug 29 15:40:18.172140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 427/810] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622685922 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:18.288519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.304177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-650ab49b-ffef-45f3-aa61-f717225dc27b tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1464 microversion: 2.1 time: 0.280002 Aug 29 15:40:18.305249 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 384/811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1464 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:18.325704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:18.328617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.336674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.337441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.337977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.338806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.339403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.340094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.392811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.393453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.424579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.425081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.428683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.429600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.431599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.432536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.471170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:18.471640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:18.472262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:18.472670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:18.473215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:18.563334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.570926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.571446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.572107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.572832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.573303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.573717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.623190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b9013ae-5d9d-442c-b3e8-4fa48553f8a1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action" status: 202 len: 1068 microversion: 2.1 time: 0.299651 Aug 29 15:40:18.624224 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 428/812] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:18 2022] POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action => generated 1068 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:40:18.634213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.635699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.644502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.646606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.648008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.649037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.649672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.650318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.762044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:18.777979 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4c68c596-d421-428f-a410-5d462a8c23ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.389188 Aug 29 15:40:18.791138 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 385/813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:18.791138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:18.791138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:18.810096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.810762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.811492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:18.816726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:18.817909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:18.818467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.055680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:19.066155 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-299d8e0d-e65b-47f6-9bdf-468c76c2d323 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.286243 Aug 29 15:40:19.066963 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 386/814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.079291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b7dddb1c-d38a-48df-be54-8fb7daceba3c req-deb96db1-abb1-4b16-a1a1-40d917252006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb03030-409e-4060-8428-d865da5f212f", "name": "network-vif-plugged", "status": "completed", "tag": "e137ebac-7c12-45fe-b69b-ca4fed9d7199"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:19.093884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7dddb1c-d38a-48df-be54-8fb7daceba3c req-deb96db1-abb1-4b16-a1a1-40d917252006 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.094382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7dddb1c-d38a-48df-be54-8fb7daceba3c req-deb96db1-abb1-4b16-a1a1-40d917252006 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.094821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7dddb1c-d38a-48df-be54-8fb7daceba3c req-deb96db1-abb1-4b16-a1a1-40d917252006 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.107609 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b7dddb1c-d38a-48df-be54-8fb7daceba3c req-deb96db1-abb1-4b16-a1a1-40d917252006 service nova] Creating event network-vif-plugged:e137ebac-7c12-45fe-b69b-ca4fed9d7199 for instance 7eb03030-409e-4060-8428-d865da5f212f on n-h2-836830-13 Aug 29 15:40:19.116288 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b7dddb1c-d38a-48df-be54-8fb7daceba3c req-deb96db1-abb1-4b16-a1a1-40d917252006 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043472 Aug 29 15:40:19.116887 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 387/815] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:19.124221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-284ec4e0-5bcc-4bcd-921f-1b2ae76dc456 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee993160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.154549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:19.165744 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b422ef84-4433-45ac-8647-216b29db3d2f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1463 microversion: 2.1 time: 0.540042 Aug 29 15:40:19.166415 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 429/816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:18 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1463 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.172768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.174097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.182022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.183477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.184136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.185061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.186982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.187675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.189541 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-284ec4e0-5bcc-4bcd-921f-1b2ae76dc456 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.070438 Aug 29 15:40:19.190191 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 388/817] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.198634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-988bad1c-dfba-4fbb-97a7-c4c6a742e528 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.226785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-988bad1c-dfba-4fbb-97a7-c4c6a742e528 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1877773698" status: 202 len: 0 microversion: 2.1 time: 0.035311 Aug 29 15:40:19.230379 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 389/818] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:40:19 2022] DELETE /compute/v2.1/flavors/1877773698 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:19.394594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:19.404732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:19.406290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:19.407476 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-427d50ea-0555-422c-9e83-a5615914bb22 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.239828 Aug 29 15:40:19.408158 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 430/819] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:19.414330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2c037a1d-0646-42af-90d0-0fdf35c610b5 req-9262117f-b40f-4eb8-a075-4693273f37b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be7a738-71fb-4b02-90d4-497b04cb438c", "name": "network-vif-unplugged", "status": "completed", "tag": "497ace04-4c82-46cf-ba04-0cba678d10fe"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:19.425220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c037a1d-0646-42af-90d0-0fdf35c610b5 req-9262117f-b40f-4eb8-a075-4693273f37b9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.425904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c037a1d-0646-42af-90d0-0fdf35c610b5 req-9262117f-b40f-4eb8-a075-4693273f37b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.426529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c037a1d-0646-42af-90d0-0fdf35c610b5 req-9262117f-b40f-4eb8-a075-4693273f37b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.439082 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2c037a1d-0646-42af-90d0-0fdf35c610b5 req-9262117f-b40f-4eb8-a075-4693273f37b9 service nova] Creating event network-vif-unplugged:497ace04-4c82-46cf-ba04-0cba678d10fe for instance 5be7a738-71fb-4b02-90d4-497b04cb438c on n-h2-836830-13 Aug 29 15:40:19.446280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Calling method '.version_select at 0x7f32ee8ff0d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.455277 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2c037a1d-0646-42af-90d0-0fdf35c610b5 req-9262117f-b40f-4eb8-a075-4693273f37b9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045579 Aug 29 15:40:19.456362 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 431/820] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:19.461914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.462404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.462838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.463634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-61ea0eb9-e788-41d8-9a29-5d2fe4324423 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.483007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.483771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.484385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.493073 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-61ea0eb9-e788-41d8-9a29-5d2fe4324423 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.035389 Aug 29 15:40:19.493915 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 432/821] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.510079 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d2550fc7-df50-41f4-b46a-b1b71521fabc tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] 10.222.0.83 "GET /compute/v2.1/os-simple-tenant-usage/90d10fdad3184fc4b6813a8575069bc9?start=2022-08-28T15%3A40%3A19.183593&end=2022-08-30T15%3A40%3A19.183593" status: 200 len: 696 microversion: 2.1 time: 0.281292 Aug 29 15:40:19.511865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-26dfefb6-2801-4888-8dcd-3eb98f291cbc tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.514962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:19.519619 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 390/822] 10.222.0.83 () {58 vars in 1412 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/os-simple-tenant-usage/90d10fdad3184fc4b6813a8575069bc9?start=2022-08-28T15%3A40%3A19.183593&end=2022-08-30T15%3A40%3A19.183593 => generated 696 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:19.531437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '.version_select at 0x7f32eea9fb80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.536507 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-26dfefb6-2801-4888-8dcd-3eb98f291cbc tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/975624358" status: 202 len: 0 microversion: 2.1 time: 0.028123 Aug 29 15:40:19.542351 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 433/823] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:40:19 2022] DELETE /compute/v2.1/flavors/975624358 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:40:19.547079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.547526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d1ff33ef-13a4-4c4f-88f3-b2885aeaab49 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.547685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.548292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.558870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.559604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.560210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.572600 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d1ff33ef-13a4-4c4f-88f3-b2885aeaab49 tempest-ServersWithSpecificFlavorTestJSON-1195694678 tempest-ServersWithSpecificFlavorTestJSON-1195694678-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028757 Aug 29 15:40:19.573145 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef4c871b-e1e3-4ef2-9b54-2a4435b87b8b tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/os-simple-tenant-usage/90d10fdad3184fc4b6813a8575069bc9?start=2022-08-28T15%3A40%3A19.183593&end=2022-08-30T15%3A40%3A19.183593" status: 200 len: 695 microversion: 2.1 time: 0.047379 Aug 29 15:40:19.573949 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 391/824] 10.222.0.83 () {58 vars in 1412 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/os-simple-tenant-usage/90d10fdad3184fc4b6813a8575069bc9?start=2022-08-28T15%3A40%3A19.183593&end=2022-08-30T15%3A40%3A19.183593 => generated 695 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:40:19.575134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 434/825] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.590078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Calling method '.version_select at 0x7f32eee18dc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.606762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.608244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.612637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.613690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.614717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.624458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.624966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.625573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.626450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.627114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.627696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.634266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.634760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.635231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.646766 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] HTTP exception thrown: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Request method failure captured: Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d HTTP/1.1 Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1XrmrMvIhyeXgNV9dZYYtpDaoDQzumpRZkvpNbbEV0xWPIdtxU3qVj0qsZWF4PfXhuKzGEW--1l_8_ICDD9ZceR_tZk0lJBFLxQ-IhOSZSYdnEZkdX5197uZr77dlhNQeiKQXEZQsDxLNEb-637VHU3iK3yCcI4GVjijmlivn8oqI Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:40:19.648717 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3ab5abb97d5e40b0a4dea82546dcb92c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3ab5abb97d5e40b0a4dea82546dcb92c"}]}] Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 06856f1488e44bde85de23a5effddbdd Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.649973 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d'} Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:19.650680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.651921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.653056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Returning 404 to user: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:19.653056 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0aef77fc-54e3-4ed4-99ea-7d01d9db9de6 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 404 len: 111 microversion: 2.1 time: 0.050442 Aug 29 15:40:19.653620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 392/826] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:19 2022] DELETE /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:19.673160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.674486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.687090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.687090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.687402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.688817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.689853 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af86bac3-096c-4526-bdd2-3271f381fe72 tempest-TenantUsagesTestJSON-662784371 tempest-TenantUsagesTestJSON-662784371-project-admin] 10.222.0.83 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A40%3A19.183593&end=2022-08-30T15%3A40%3A19.183593&detailed=1" status: 200 len: 9933 microversion: 2.1 time: 0.099560 Aug 29 15:40:19.691135 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 435/827] 10.222.0.83 () {58 vars in 1335 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A40%3A19.183593&end=2022-08-30T15%3A40%3A19.183593&detailed=1 => generated 9933 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:19.695601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.702144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.722518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.724411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.726535 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] HTTP exception thrown: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Request method failure captured: Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d HTTP/1.1 Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1XrmrMvIhyeXgNV9dZYYtpDaoDQzumpRZkvpNbbEV0xWPIdtxU3qVj0qsZWF4PfXhuKzGEW--1l_8_ICDD9ZceR_tZk0lJBFLxQ-IhOSZSYdnEZkdX5197uZr77dlhNQeiKQXEZQsDxLNEb-637VHU3iK3yCcI4GVjijmlivn8oqI Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:40:19.728117 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3ab5abb97d5e40b0a4dea82546dcb92c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3ab5abb97d5e40b0a4dea82546dcb92c"}]}] Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 06856f1488e44bde85de23a5effddbdd Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.729388 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d'} Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:19.730147 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. Aug 29 15:40:19.731313 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.732370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Returning 404 to user: Instance c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:19.732370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08fc4cd0-482b-4e7c-aa95-aaef295e5f4b tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d" status: 404 len: 111 microversion: 2.1 time: 0.071243 Aug 29 15:40:19.732370 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 393/828] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/servers/c79a5e4a-fc4f-4ad8-b8bb-08ab4039336d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:19.737287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.737873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.738375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.739686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.739899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.740465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.740902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.741572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.749211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.749931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.750370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.751133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.751642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.752078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.768396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] HTTP exception thrown: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Request method failure captured: Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb HTTP/1.1 Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1XrmrMvIhyeXgNV9dZYYtpDaoDQzumpRZkvpNbbEV0xWPIdtxU3qVj0qsZWF4PfXhuKzGEW--1l_8_ICDD9ZceR_tZk0lJBFLxQ-IhOSZSYdnEZkdX5197uZr77dlhNQeiKQXEZQsDxLNEb-637VHU3iK3yCcI4GVjijmlivn8oqI Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:40:19.770111 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3ab5abb97d5e40b0a4dea82546dcb92c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3ab5abb97d5e40b0a4dea82546dcb92c"}]}] Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 06856f1488e44bde85de23a5effddbdd Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.772176 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '180653fe-00d9-440b-b260-5e6c16dbabfb'} Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:19.773470 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.774908 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.776438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Returning 404 to user: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:19.776438 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8ecf032-845d-4138-a1b5-61bb7ead3610 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 404 len: 111 microversion: 2.1 time: 0.038055 Aug 29 15:40:19.776438 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 394/829] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:19 2022] DELETE /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:40:19.778789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:19.783318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.784171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] [instance: 180653fe-00d9-440b-b260-5e6c16dbabfb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.792755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.793245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.794035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.795123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.797302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.797758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.819185 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] HTTP exception thrown: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Request method failure captured: Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb HTTP/1.1 Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN1XrmrMvIhyeXgNV9dZYYtpDaoDQzumpRZkvpNbbEV0xWPIdtxU3qVj0qsZWF4PfXhuKzGEW--1l_8_ICDD9ZceR_tZk0lJBFLxQ-IhOSZSYdnEZkdX5197uZr77dlhNQeiKQXEZQsDxLNEb-637VHU3iK3yCcI4GVjijmlivn8oqI Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:40:19.821149 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3ab5abb97d5e40b0a4dea82546dcb92c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3ab5abb97d5e40b0a4dea82546dcb92c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3ab5abb97d5e40b0a4dea82546dcb92c"}]}] Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3ab5abb97d5e40b0a4dea82546dcb92c Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199 Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 06856f1488e44bde85de23a5effddbdd Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-767429199-project Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.822378 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '180653fe-00d9-440b-b260-5e6c16dbabfb'} Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:19.823113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. Aug 29 15:40:19.824340 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:19.825362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] Returning 404 to user: Instance 180653fe-00d9-440b-b260-5e6c16dbabfb could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:19.825362 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce2938a1-f3cb-4927-afd1-771bd32f8868 tempest-ServersWithSpecificFlavorTestJSON-767429199 tempest-ServersWithSpecificFlavorTestJSON-767429199-project] 10.222.0.83 "GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb" status: 404 len: 111 microversion: 2.1 time: 0.045069 Aug 29 15:40:19.825362 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 395/830] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/servers/180653fe-00d9-440b-b260-5e6c16dbabfb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:19.838047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.838671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.854050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.854548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.855017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.855741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.856233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.856649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.871713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:19.915337 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c1360d6-b1d0-420b-a4f1-30f864af8288 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 204 len: 0 microversion: 2.1 time: 0.203269 Aug 29 15:40:19.915981 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 436/831] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:19 2022] DELETE /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:19.925277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:19.926371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:19.935753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.937184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.937781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:19.938719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:19.939367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:19.940280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.080534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.091079 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33ad96de-1bee-4061-92aa-2c183c8232eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.265634 Aug 29 15:40:20.103527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 396/832] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:20.103527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:20.103527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:20.103795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.104192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.107492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.110479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.111600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.112180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.336821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.373852 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c68bb96d-0ea2-412e-a28c-15a718f56f54 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.280380 Aug 29 15:40:20.375371 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 397/833] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:20 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:20.393461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12dd3d5f-849e-4f16-8fea-5690f32ef21a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee9f3040>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:20.446805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.457739 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-86bfc6b5-e642-4c12-82d3-4e0288a185a0 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1469 microversion: 2.1 time: 0.536812 Aug 29 15:40:20.461001 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 437/834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:19 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1469 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:20.465621 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-12dd3d5f-849e-4f16-8fea-5690f32ef21a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.082566 Aug 29 15:40:20.466202 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 398/835] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:20 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:20.468229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:20.468846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:20.487529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.489728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.491274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.493473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:20.494667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:20.495822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:20.958492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.967646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.969355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:20.970714 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b78ff5fb-02a0-40f5-9d17-0a3ebc69aaf8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.508745 Aug 29 15:40:20.990247 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 438/836] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:20 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:21.120329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.121558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:21.130335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.131137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.132059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.133079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.133745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.134485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.309411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:21.318704 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad359622-892a-42b9-81fe-7350d24c30e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.205019 Aug 29 15:40:21.319636 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 399/837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:21.397181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.397787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:21.410294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.412785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.413440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.414356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.414995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.415642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.472778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-0e55ee73-1845-4340-a24d-4dc7196862d0 req-6d63529c-9f4e-406f-b369-c00c068e1dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be7a738-71fb-4b02-90d4-497b04cb438c", "tag": "497ace04-4c82-46cf-ba04-0cba678d10fe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:21.488339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0e55ee73-1845-4340-a24d-4dc7196862d0 req-6d63529c-9f4e-406f-b369-c00c068e1dd2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.489038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0e55ee73-1845-4340-a24d-4dc7196862d0 req-6d63529c-9f4e-406f-b369-c00c068e1dd2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.490199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0e55ee73-1845-4340-a24d-4dc7196862d0 req-6d63529c-9f4e-406f-b369-c00c068e1dd2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.501865 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-0e55ee73-1845-4340-a24d-4dc7196862d0 req-6d63529c-9f4e-406f-b369-c00c068e1dd2 service nova] Creating event network-changed:497ace04-4c82-46cf-ba04-0cba678d10fe for instance 5be7a738-71fb-4b02-90d4-497b04cb438c on n-h2-836830-13 Aug 29 15:40:21.507732 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-0e55ee73-1845-4340-a24d-4dc7196862d0 req-6d63529c-9f4e-406f-b369-c00c068e1dd2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038580 Aug 29 15:40:21.509084 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 400/838] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:21.515933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.516995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:21.525021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.526512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.527226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.528404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:21.529058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:21.529687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:21.546066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:21.628671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:21.639273 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ed2c994-b748-4dce-aa92-9791b5e97fd8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.245846 Aug 29 15:40:21.639856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 439/839] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:21.650701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae3a874b-16b4-48dc-ba53-2c33adbe26df tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebd4c10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.719995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:21.732923 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47437900-d58b-4153-a7d7-8c7341dae30f tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1469 microversion: 2.1 time: 0.222477 Aug 29 15:40:21.734718 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 401/840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:21.740292 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae3a874b-16b4-48dc-ba53-2c33adbe26df tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.096291 Aug 29 15:40:21.750470 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 440/841] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:21.996997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:21.997932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.005521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.006020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.006461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.012218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.012821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.013272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.265021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.279485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.293739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.298480 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99d78f33-bbe2-48f3-b586-187add45ad95 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.304896 Aug 29 15:40:22.300378 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 402/842] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:21 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:22.343924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:22.344972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.358657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.363693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.367679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.368710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.369384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.370078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.667592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:22.668303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.687169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.687997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.688519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.689299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.689995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.690599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.762137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:22.779568 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33af0ce3-786c-488f-bbc5-3a8526c01da8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.439987 Aug 29 15:40:22.791052 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 441/843] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:22 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:22.791052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e70fcb5-68c3-4c2b-935d-aea6556d0bc8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eee18d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:22.849879 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e70fcb5-68c3-4c2b-935d-aea6556d0bc8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.068015 Aug 29 15:40:22.858376 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 442/844] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:22 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:22.864722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:22.865758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:22.874846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.875709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.876361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:22.877275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:22.879016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:22.880844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.132893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.144333 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a2963d0a-8958-4b02-ab4a-994f039a91cd tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.482952 Aug 29 15:40:23.147433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 403/845] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:22 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:23.327391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.328886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.345786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.352264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.353064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.356317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.358128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.358853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.400279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.412064 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f371558c-4cb1-48cd-8e05-799e2437e118 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1469 microversion: 2.1 time: 0.552190 Aug 29 15:40:23.416445 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 443/846] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:22 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1469 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:23.683790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.708250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.709730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:23.716744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6dd7d749-d3b6-4f54-972c-7843d0f098c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.393375 Aug 29 15:40:23.721348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 404/847] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:23 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:23.810189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.812257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:23.830045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.830907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.832620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.834964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:23.836582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:23.837937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:23.868530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79c79a3c-2de3-4a50-9030-606fb0e6a65a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee99cee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:23.972065 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79c79a3c-2de3-4a50-9030-606fb0e6a65a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.109767 Aug 29 15:40:23.983111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 405/848] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:23 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:24.166966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:24.167643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:24.183355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.184122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.184731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.185595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.186200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.188337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.349458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:24.361458 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f972dad0-d4ac-4f56-acc4-738f11d3c914 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.559522 Aug 29 15:40:24.362048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 444/849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:23 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:24.438885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:24.439659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:24.450927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.453199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.453655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.455510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.456001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.459596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.644719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:24.668781 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-239c7b0d-85ae-4132-a01b-0b0c737d46a4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1427 microversion: 2.1 time: 0.234969 Aug 29 15:40:24.685001 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 445/850] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:24 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1427 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:24.741352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:24.741352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:24.754602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.755459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.755889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.756610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.757074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.757504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:24.900995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:24.930072 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b321ff8-3f6a-4ad5-9eb3-50286379a75f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.766681 Aug 29 15:40:24.932874 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 406/851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:24 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:24.947578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d0747e7b-9808-493a-b4e3-3fc05aa6b89a req-514dd4ea-36cc-40e5-9675-d4d38ded3b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a127823-5e1e-49d5-b297-6f6e5a991242", "name": "network-vif-deleted", "tag": "8dfe7249-ce52-4424-8ee2-7157982a7306"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:24.979979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d0747e7b-9808-493a-b4e3-3fc05aa6b89a req-514dd4ea-36cc-40e5-9675-d4d38ded3b48 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:24.983811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d0747e7b-9808-493a-b4e3-3fc05aa6b89a req-514dd4ea-36cc-40e5-9675-d4d38ded3b48 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:24.984481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d0747e7b-9808-493a-b4e3-3fc05aa6b89a req-514dd4ea-36cc-40e5-9675-d4d38ded3b48 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.011395 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d0747e7b-9808-493a-b4e3-3fc05aa6b89a req-514dd4ea-36cc-40e5-9675-d4d38ded3b48 service nova] Creating event network-vif-deleted:8dfe7249-ce52-4424-8ee2-7157982a7306 for instance 6a127823-5e1e-49d5-b297-6f6e5a991242 on n-h2-836830-13 Aug 29 15:40:25.038220 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d0747e7b-9808-493a-b4e3-3fc05aa6b89a req-514dd4ea-36cc-40e5-9675-d4d38ded3b48 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092206 Aug 29 15:40:25.039879 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 407/852] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:25.070703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f4d925a-6058-4dda-a500-5534a2eb8026 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee8eb550>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.113307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.134751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.139105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.145388 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-748fa14d-4b42-4cf3-9773-ce7be2e94f70 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.409144 Aug 29 15:40:25.149288 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 446/853] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:24 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:25.203323 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f4d925a-6058-4dda-a500-5534a2eb8026 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.161965 Aug 29 15:40:25.217947 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 408/854] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:25.384423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.385340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:25.393159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.394547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.401608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.402719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.404726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.405708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.643435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.652321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6852b12b-870a-42a7-95f8-24e6eb754859 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.272994 Aug 29 15:40:25.652924 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 447/855] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:25.706550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.708746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:25.724642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.726919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.727931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.729315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.730604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.731293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.828565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.829637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.830253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.830891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lazy-loading 'fault' on Instance uuid 6a127823-5e1e-49d5-b297-6f6e5a991242 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:25.951174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa00248ff214f93bcc67dd0d1a04c61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d10fdad3184fc4b6813a8575069bc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:25.963735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:25.964362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:25.982725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.985770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.986612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:25.987608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:25.990035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:25.992485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.013796 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5ddd7cc2-4951-444a-8a20-3b959d266aa7 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 200 len: 1304 microversion: 2.1 time: 0.320460 Aug 29 15:40:26.047115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 409/856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 1304 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:26.197868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:26.198831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:26.218358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.220488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.224918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.228465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.230200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.231541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.436244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:26.451584 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57ed0eed-52d8-41e4-ad28-31fa0bb0a8ea tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.494061 Aug 29 15:40:26.452564 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 448/857] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:25 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:26.468147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5058a266-a5b3-4230-9411-01e0a2088e4a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee82d040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:26.576052 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5058a266-a5b3-4230-9411-01e0a2088e4a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.121881 Aug 29 15:40:26.579361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 449/858] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:26.664134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:26.675910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:26.676552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:26.678389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:26.680252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:26.686306 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d5afd4d-e8f6-4107-9e3f-7b70bbf98c64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.502126 Aug 29 15:40:26.689143 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 410/859] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:26.705635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.706255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.707324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:26.707462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:26.713818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:26.714248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.051819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.052466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] [instance: 6a127823-5e1e-49d5-b297-6f6e5a991242] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.070542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.071779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.072405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.073924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.074541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.075148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.111333 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] HTTP exception thrown: Instance 6a127823-5e1e-49d5-b297-6f6e5a991242 could not be found. Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Request method failure captured: Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 HTTP/1.1 Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN3E6gjoTiXfJ6_CR-9UV_dtR577d0rhU86u6RcshM9Vt2PEu7bpQfwzTyvhSLTxaQuMbNJYzaCzM4AkHeax9uDn7Kj7qkiPeeveGrcmAq28vsElXj7PaWgzV3JQgMQNfKqNI42rGQ5AIQSuVIfjTj9FVtJLlaQq1vbnK9bPr713KPI Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 90d10fdad3184fc4b6813a8575069bc9 Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TenantUsagesTestJSON-1024091696 Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:40:27.114329 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/90d10fdad3184fc4b6813a8575069bc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_90d10fdad3184fc4b6813a8575069bc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/90d10fdad3184fc4b6813a8575069bc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/90d10fdad3184fc4b6813a8575069bc9"}]}] Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TenantUsagesTestJSON-1024091696 Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 90d10fdad3184fc4b6813a8575069bc9 Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1024091696 Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TenantUsagesTestJSON-1024091696-project Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 1fa00248ff214f93bcc67dd0d1a04c61 Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TenantUsagesTestJSON-1024091696-project Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 6a127823-5e1e-49d5-b297-6f6e5a991242 could not be found. Aug 29 15:40:27.116045 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6a127823-5e1e-49d5-b297-6f6e5a991242'} Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a127823-5e1e-49d5-b297-6f6e5a991242 could not be found. Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:27.116967 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a127823-5e1e-49d5-b297-6f6e5a991242 could not be found. Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a127823-5e1e-49d5-b297-6f6e5a991242 could not be found. Aug 29 15:40:27.118414 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:40:27.119753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] Returning 404 to user: Instance 6a127823-5e1e-49d5-b297-6f6e5a991242 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:27.124055 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b41b735-a450-4290-8075-915162971bb4 tempest-TenantUsagesTestJSON-1024091696 tempest-TenantUsagesTestJSON-1024091696-project] 10.222.0.83 "GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242" status: 404 len: 111 microversion: 2.1 time: 0.076806 Aug 29 15:40:27.131122 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 411/860] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/servers/6a127823-5e1e-49d5-b297-6f6e5a991242 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:40:27.296410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:27.310268 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7aec14e9-39cf-42a4-8863-d5ee7ee0ba81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.637572 Aug 29 15:40:27.341993 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 450/861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:26 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:27.474594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.475273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.483626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.484322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.484941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.485790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.486399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.486976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.597242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e18337af-2ab8-493b-b2ac-0857ebe208ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee99ddc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.731621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=36 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:27.773574 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e18337af-2ab8-493b-b2ac-0857ebe208ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.181760 Aug 29 15:40:27.781997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 451/862] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:27.796193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:27.798899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:27.821415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.831656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.834527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.835945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:27.838433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:27.841501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:27.954748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=62 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:28.065911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.078709 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-adb80593-b76b-444d-afc9-181a17c6f59d tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.608521 Aug 29 15:40:28.096479 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 412/863] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:28.336048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:28.337088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:28.355700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.358720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.359752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.361348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:28.365377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:28.368965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:28.575636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.584408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.601259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:28.607224 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7e70b1f3-886b-4e99-9af6-1274778fae52 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1567 microversion: 2.25 time: 0.823037 Aug 29 15:40:28.608950 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 452/864] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:27 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1567 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:28.802685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5146f93d-cd96-41dd-a6b5-0cf410708f90 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee96e8b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:28.884986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5146f93d-cd96-41dd-a6b5-0cf410708f90 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.087401 Aug 29 15:40:28.885878 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 453/865] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:28 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.005242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:29.015328 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-70398b02-110d-4f76-b2ad-7df0ac8344ba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.685691 Aug 29 15:40:29.027925 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 413/866] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:28 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.104286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.104822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.113599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.114227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.114792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.127812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.129948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.132852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.462346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:29.474375 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e91b0108-4002-4b5e-8818-5acbcd131aaf tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.371955 Aug 29 15:40:29.476753 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 454/867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:29.636363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:29.636991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:29.639994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:29.657824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.658620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.665657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.666630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:29.667228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:29.667670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:29.897422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=18 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:29.900973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0bb9ed3-1c31-44a1-96c8-a0c7e6015253 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eef17670>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.008381 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0bb9ed3-1c31-44a1-96c8-a0c7e6015253 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.112954 Aug 29 15:40:30.009295 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 455/868] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:30.038866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.039512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.059400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.059906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.060347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.061062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.061551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.072087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.335640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.347312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.350792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.362387 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fd82f304-9983-4db4-88ac-8519482af193 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1542 microversion: 2.25 time: 0.730239 Aug 29 15:40:30.383549 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 414/869] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:29 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1542 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:30.396138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be53ff0d-47e9-4e9d-a04c-d984fde769fa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '.version_select at 0x7f32ee8ff310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.413636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be53ff0d-47e9-4e9d-a04c-d984fde769fa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.414524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be53ff0d-47e9-4e9d-a04c-d984fde769fa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.415309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be53ff0d-47e9-4e9d-a04c-d984fde769fa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.466017 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be53ff0d-47e9-4e9d-a04c-d984fde769fa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 1536 microversion: 2.25 time: 0.074951 Aug 29 15:40:30.485651 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 415/870] 10.222.0.83 () {60 vars in 1184 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/os-migrations => generated 1536 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:30.506452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.511923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.534639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.535164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.537172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.541179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.541832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.542446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.542661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.550637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fa4a1eb5-9b9e-4320-b938-0aab4aa7d5d2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.516699 Aug 29 15:40:30.574530 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 456/871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:30.586191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:30.600664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:30.622234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.626804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.628720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.632378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:30.635752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:30.638741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:30.839292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 5be7a738-71fb-4b02-90d4-497b04cb438c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:30.868178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-faff0efa-dfe2-4871-8bc1-38f1c5a24780 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 2036 microversion: 2.25 time: 0.381494 Aug 29 15:40:30.870281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 416/872] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 2036 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:30.906370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-85129e96-a60c-405c-a442-a8995a1be1c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Action: 'create', calling method: .version_select at 0x7f32ee993ca0>, body: {"keypair": {"name": "tempest-keypair-1132406724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpREEV4gCodKwteVlIbd2BbuEgCj+nNR0KUDlugN6kYyYBWTI61XBVSGaU2zAnUpGDavX21SoDF5fhoO+s/Qk5Lm60r4x9jGntPtxPscnD96BaZxwZd5n8V27/IiakUfg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:30.948979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-85129e96-a60c-405c-a442-a8995a1be1c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for project 70d66d1258d14a39b174734f9865c070. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:30.973924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-85129e96-a60c-405c-a442-a8995a1be1c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for user f12698b45a114720af9c98b163077f59 and project 70d66d1258d14a39b174734f9865c070. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:30.981269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:30.993679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec0c956b-87f5-4873-b794-87b8e64067df tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.415150 Aug 29 15:40:31.005159 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 457/873] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:30 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:31.025213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d983a84f-e682-460b-afe8-4efa23b4a045 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebf3820>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.035534 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-85129e96-a60c-405c-a442-a8995a1be1c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.135874 Aug 29 15:40:31.037481 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 417/874] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 15:40:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:40:31.126229 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d983a84f-e682-460b-afe8-4efa23b4a045 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.105976 Aug 29 15:40:31.127858 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 458/875] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:31.582288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:31.583680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:31.617670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.626173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.626886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:31.627900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:31.631726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:31.634386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.016616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1203526619", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:32.057915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:32.151941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:32.356498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:32.370037 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-47a54cc6-6e76-4ca8-9aa1-22c1670c8ccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.791826 Aug 29 15:40:32.373196 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 459/876] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:31 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:32.385555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:32.386273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:32.415362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.417228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.421550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.425061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.429570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.433737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.496377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:32.738651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:32.768782 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5fd7c192-6e67-4a74-a285-dcd85e67f7d8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.393515 Aug 29 15:40:32.771712 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 460/877] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:32 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:32.782685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-38fa9279-3c39-483f-8c76-9fa2a6c18c83 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eecefb80>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:32.825689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:32.826266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:32.827321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:32.827963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:32.829129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:32.853654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.854512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.855479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.856739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:32.857427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:32.858099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:32.873062 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-38fa9279-3c39-483f-8c76-9fa2a6c18c83 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.098749 Aug 29 15:40:32.888035 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 461/878] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:32 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:32.934684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Getting quotas for project 936fa60fa7e24fd9b9014521544670dc. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:32.941473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Getting quotas for user cd46d7afd06f41c2a09132a349aa3fd4 and project 936fa60fa7e24fd9b9014521544670dc. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:32.999211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:33.001604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:33.071594 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b101e67-055d-4568-950a-c7246ee1ba88 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506001 Aug 29 15:40:33.078666 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 418/879] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:40:33.085458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-790d04a4-f36b-40b5-a53b-faa603c975b7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.086448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-790d04a4-f36b-40b5-a53b-faa603c975b7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.315772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-790d04a4-f36b-40b5-a53b-faa603c975b7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.330488 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-790d04a4-f36b-40b5-a53b-faa603c975b7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1222 microversion: 2.1 time: 0.250429 Aug 29 15:40:33.335480 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 462/880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:33.394578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.396198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.405483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.405982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.406425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.418166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.420280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.422564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.795812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.796494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:33.805283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:33.817435 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36678b8a-f7dd-4c74-8bf3-020fd9d8a1d3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.427172 Aug 29 15:40:33.818863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.820257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.821246 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 419/881] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:33.823988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.826047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:33.827623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:33.828173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:33.903422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5e13ffb-29bc-42a8-9947-f23c89767913 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee993ca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:33.991940 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5e13ffb-29bc-42a8-9947-f23c89767913 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.091933 Aug 29 15:40:33.992855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 420/882] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:34.169992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-663083808", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "ebc91776-3d70-481a-8f9a-8935c9cd12b8"}], "security_groups": [{"name": "tempest-securitygroup--1955658963"}], "key_name": "tempest-keypair-1132406724", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:34.370535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] validate_networks() for [('ebc91776-3d70-481a-8f9a-8935c9cd12b8', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:34.553908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:34.570183 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d506e5f-7c92-4125-bca9-d4af6bbe87da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.778307 Aug 29 15:40:34.584718 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 463/883] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:33 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:34.598197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.599616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.611394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.613066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.615897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.617140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.618443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.620807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.747613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:34.756562 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b0fccd5-40c8-4e51-b17d-c5a088d04417 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1274 microversion: 2.1 time: 0.170648 Aug 29 15:40:34.757929 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 464/884] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:34.842102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:34.844072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:34.851839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.853384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.854362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:34.855348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:34.856029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:34.856847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.144207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:35.144623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:35.145090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:35.146046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:35.146544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:35.163446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.163945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.164386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.165133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.165587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.170214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.228377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:35.241830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for user f12698b45a114720af9c98b163077f59 and project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:35.262058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.273520 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57825684-4c66-4641-b196-6869ada95e63 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.435420 Aug 29 15:40:35.278137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 465/885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:34 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:35.292139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33bdfb4d-89ec-49c1-8151-f20fc9f0951d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee82d040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.297971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:35.315224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:35.370954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33bdfb4d-89ec-49c1-8151-f20fc9f0951d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.091644 Aug 29 15:40:35.372064 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 466/886] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:35.484264 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5199733-f9df-4361-906b-012c2df8d37c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.318123 Aug 29 15:40:35.493220 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 421/887] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:40:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:40:35.501631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d18c0913-4f0b-411b-93aa-c6668b1cd274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.502410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d18c0913-4f0b-411b-93aa-c6668b1cd274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.590502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d18c0913-4f0b-411b-93aa-c6668b1cd274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.595654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.598081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.605966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d18c0913-4f0b-411b-93aa-c6668b1cd274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.607875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d18c0913-4f0b-411b-93aa-c6668b1cd274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:35.610122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.610675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.611184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.611977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.612423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.612614 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d18c0913-4f0b-411b-93aa-c6668b1cd274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1285 microversion: 2.25 time: 0.114328 Aug 29 15:40:35.631127 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 467/888] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:35.633319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.780301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:35.781428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:35.796126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.796669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.799320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:35.802912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:35.803455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:35.803892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.209417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.224942 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bbdebeb3-8d1e-419e-ad30-76195a347e5e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1292 microversion: 2.1 time: 0.446826 Aug 29 15:40:36.226991 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 468/889] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1292 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:36.300632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.301416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.314371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.315301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.315894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.316755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.318345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.320338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.472097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.492852 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a91cf68-6cd4-4c40-8377-33acfa8196c2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.895175 Aug 29 15:40:36.493796 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 422/890] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:35 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:36.504556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a80cde61-ab2c-4900-98c2-a4eef5821b8f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee8c59d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.596663 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a80cde61-ab2c-4900-98c2-a4eef5821b8f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.100466 Aug 29 15:40:36.604436 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 423/891] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:36.636844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:36.637821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:36.650875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.651676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.652404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.653063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:36.653539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:36.654180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:36.654795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:36.663805 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6fd07370-adba-4740-b487-5f89181e0c0d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.368819 Aug 29 15:40:36.665020 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 469/892] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:37.143475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.155273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.166438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.167863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fca8b97b-f9f9-461b-b9ff-cfa8a9b413e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1281 microversion: 2.25 time: 0.534859 Aug 29 15:40:37.191753 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 424/893] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:36 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1281 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:37.247804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.249177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:37.270055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.271347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.274115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.276117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.276929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.278061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.419135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:37.429528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-64b435db-8c1c-4be6-8212-4954ed115f6e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1280 microversion: 2.1 time: 0.186096 Aug 29 15:40:37.430720 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 470/894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1280 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:37.520175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.522192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:37.542634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.543206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.543625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.544500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.545144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.545870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.620220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f2495d25-928a-4e46-87ab-d7a7281c4830 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ef2084c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.722014 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f2495d25-928a-4e46-87ab-d7a7281c4830 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.105865 Aug 29 15:40:37.724097 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 471/895] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:37.731936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:37.732953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:37.747686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.748946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.749898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:37.750857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:37.751526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:37.752106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.179138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.201076 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3002b31a-742f-4639-8c26-2e639ae6127c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.475474 Aug 29 15:40:38.202769 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 472/896] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.216984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.220855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.238007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.241544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.242317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.243941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.246241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.250529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.338555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.346700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:38.350535 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fca006fa-fc97-4b4f-bc1e-e2c65dfef9da tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.834491 Aug 29 15:40:38.351491 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 425/897] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:37 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:38.437642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.449353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.451335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.452430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.452970 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-363d3968-ed9c-4593-95f1-7847a9084322 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1343 microversion: 2.25 time: 0.246402 Aug 29 15:40:38.453086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:38.454202 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 473/898] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1343 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:38.464483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.464996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.465417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.474040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:38.474811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:38.475688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:38.657371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:38.667269 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be19d1d4-f402-4feb-b4a3-cdcf4f0f5623 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1280 microversion: 2.1 time: 0.219095 Aug 29 15:40:38.682040 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 426/899] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1280 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:38.745476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f70b9905-eb2c-4261-81ac-f68618217874 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebd48b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:38.822683 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f70b9905-eb2c-4261-81ac-f68618217874 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.087743 Aug 29 15:40:38.823562 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 474/900] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:38 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:39.226666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.232336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.247894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.248289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.248722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.249403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.249931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.250252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.372975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.373595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.392952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.393565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.394012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.397472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.397989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.398419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.757629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:39.766602 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0deb667-985a-427e-9a8d-9a47b0b39719 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1475 microversion: 2.1 time: 0.546911 Aug 29 15:40:39.767223 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 427/901] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1475 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:39.804000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.807614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.812344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:39.841462 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6c8afdf-9669-4eb1-bfda-7ba9bb81e518 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.463387 Aug 29 15:40:39.845166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.845680 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 475/902] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:39.848225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.853169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.853939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.857307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.859290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:39.860106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.870944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:39.881389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.882401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.884823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:39.889605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:39.891627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:39.894184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.699382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:40.709597 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b61315c7-21e9-4141-912b-dbf20dd84a1c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.861225 Aug 29 15:40:40.715806 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 476/903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.725681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56b22e81-dad3-45b2-9360-8a3cb0dbeaaa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebd4c10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.818563 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-56b22e81-dad3-45b2-9360-8a3cb0dbeaaa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.099344 Aug 29 15:40:40.820414 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 477/904] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:40.825621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:40.827241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:40.837812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.838814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.840047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:40.841095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:40.841778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:40.842430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.393950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.410771 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-803c9a35-354b-4dd0-b1b3-f848e59157a7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1474 microversion: 2.1 time: 0.588139 Aug 29 15:40:41.410771 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 478/905] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:40 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1474 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:41.454965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.455620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.490155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.490743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.491276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.499443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.501370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.503622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.547587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.560663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.571611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.573100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-86d89dc6-1441-4dc4-a973-332b2537dfe6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1411 microversion: 2.25 time: 1.793300 Aug 29 15:40:41.576636 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 428/906] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:39 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1411 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:41.827152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:41.854437 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-044e3512-d3c8-473d-90f7-21dcc4bbc8c1 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.409905 Aug 29 15:40:41.855485 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 479/907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:41.871120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:41.872594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:41.892009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.893206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.895594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.896650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:41.899257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:41.900007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:41.916639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9922e212-69a4-4f0e-b6e7-4ff728f01008 tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-665504322", "id": 253771354, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:41.985978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9922e212-69a4-4f0e-b6e7-4ff728f01008 tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.288709 Aug 29 15:40:41.990702 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 429/908] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:40:41 2022] POST /compute/v2.1/flavors => generated 467 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:42.021952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f4eb5cad-3cfc-416e-8463-25cea94a954d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee8ee4c0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.089812 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f4eb5cad-3cfc-416e-8463-25cea94a954d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1413 microversion: 2.1 time: 0.095916 Aug 29 15:40:42.090882 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 430/909] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:42.097833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b230233f-0ed5-4604-a696-3f6d0f9ba1ef tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:42.316024 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b230233f-0ed5-4604-a696-3f6d0f9ba1ef tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors/253771354/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.222919 Aug 29 15:40:42.316972 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 431/910] 10.222.0.83 () {62 vars in 1262 bytes} [Mon Aug 29 15:40:42 2022] POST /compute/v2.1/flavors/253771354/os-extra_specs => generated 62 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:42.326071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e259ac95-6434-4222-9c11-ab4d8de406e5 req-6183a9c1-4810-4eb3-b743-c28a10acb4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e266eab-6b47-440b-bb3b-cd7801c3d859", "name": "network-vif-unplugged", "status": "completed", "tag": "88188c6a-a8cf-4565-990b-5ba98a2ea997"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:42.339776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e259ac95-6434-4222-9c11-ab4d8de406e5 req-6183a9c1-4810-4eb3-b743-c28a10acb4ce service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.340632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e259ac95-6434-4222-9c11-ab4d8de406e5 req-6183a9c1-4810-4eb3-b743-c28a10acb4ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.341297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e259ac95-6434-4222-9c11-ab4d8de406e5 req-6183a9c1-4810-4eb3-b743-c28a10acb4ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.353879 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e259ac95-6434-4222-9c11-ab4d8de406e5 req-6183a9c1-4810-4eb3-b743-c28a10acb4ce service nova] Creating event network-vif-unplugged:88188c6a-a8cf-4565-990b-5ba98a2ea997 for instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 on n-h1-836830-13 Aug 29 15:40:42.362761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-e259ac95-6434-4222-9c11-ab4d8de406e5 req-6183a9c1-4810-4eb3-b743-c28a10acb4ce service nova] Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:40:42.377902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e259ac95-6434-4222-9c11-ab4d8de406e5 req-6183a9c1-4810-4eb3-b743-c28a10acb4ce service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055494 Aug 29 15:40:42.379473 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 432/911] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:42.385761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d8e12af-c39c-4f87-9d41-4db1ce3f5840 tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.421376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d8e12af-c39c-4f87-9d41-4db1ce3f5840 tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/253771354" status: 202 len: 0 microversion: 2.86 time: 0.035247 Aug 29 15:40:42.422062 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 433/912] 10.222.0.83 () {60 vars in 1199 bytes} [Mon Aug 29 15:40:42 2022] DELETE /compute/v2.1/flavors/253771354 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:42.432213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29de37f9-2fc9-4980-b1a2-8ab2e5006c99 tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.464857 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29de37f9-2fc9-4980-b1a2-8ab2e5006c99 tempest-FlavorMetadataValidation-1274541177 tempest-FlavorMetadataValidation-1274541177-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.036696 Aug 29 15:40:42.466436 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 434/913] 10.222.0.83 () {60 vars in 1187 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:42.472813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.476407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:42.485990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.486937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.487770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.488783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.491361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.493043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.797367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:42.816190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-803ce33f-f882-4d0f-91ee-ab0a52af3d34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.959327 Aug 29 15:40:42.819271 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 480/914] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:41 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:42.832235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b573c708-a14b-46e0-a711-31370a27de48 req-c7879626-c1d8-49a3-92ef-660ef2219ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36742e72-c374-4c67-82eb-e6dd5a601e99", "tag": "15a54a03-347a-46bd-bbe5-7a555d14444e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:42.885967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b573c708-a14b-46e0-a711-31370a27de48 req-c7879626-c1d8-49a3-92ef-660ef2219ee6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:42.888258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b573c708-a14b-46e0-a711-31370a27de48 req-c7879626-c1d8-49a3-92ef-660ef2219ee6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:42.889160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b573c708-a14b-46e0-a711-31370a27de48 req-c7879626-c1d8-49a3-92ef-660ef2219ee6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:42.950168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:42.960476 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6aac9d5-9c6b-4a72-af32-7cfa5a9ab0eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1474 microversion: 2.1 time: 0.492576 Aug 29 15:40:42.962958 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b573c708-a14b-46e0-a711-31370a27de48 req-c7879626-c1d8-49a3-92ef-660ef2219ee6 service nova] Creating event network-changed:15a54a03-347a-46bd-bbe5-7a555d14444e for instance 36742e72-c374-4c67-82eb-e6dd5a601e99 on n-h1-836830-13 Aug 29 15:40:42.964062 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 435/915] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1474 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:42.970644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:42.978099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:42.982038 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b573c708-a14b-46e0-a711-31370a27de48 req-c7879626-c1d8-49a3-92ef-660ef2219ee6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160028 Aug 29 15:40:42.988697 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 481/916] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:42.996294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.003308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.004064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.005695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.006571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.007355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.029657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.045113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.062184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.063756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.065382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.066386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.067132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.068504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.316448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.330301 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff08d1f1-3c00-4a2b-a743-c57fdf7b0efb tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.339129 Aug 29 15:40:43.345043 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 482/917] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.353848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7118f37a-3233-48f6-a0bf-a37f7142e3ca tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebf38b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.410841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7118f37a-3233-48f6-a0bf-a37f7142e3ca tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1422 microversion: 2.1 time: 0.067232 Aug 29 15:40:43.413822 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 483/918] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1422 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.428131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10a5298b-6613-4d74-9206-bf9ceacf6fef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee82d820>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.493901 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10a5298b-6613-4d74-9206-bf9ceacf6fef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 200 len: 1422 microversion: 2.1 time: 0.072413 Aug 29 15:40:43.494515 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 484/919] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:43.508467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57907e8b-611b-45ea-987b-81c44956f56b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebf3790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.596593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.608099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.610399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:43.611846 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc11fa62-69d5-40b2-b9a2-e3b16936db6f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1411 microversion: 2.25 time: 0.645021 Aug 29 15:40:43.628800 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 436/920] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:42 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1411 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:43.839522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:43.843606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:43.862347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.864755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.867363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:43.870239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:43.872062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:43.875941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.331396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:44.370011 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3c7c01b2-9328-456a-8d96-422fb7810d1e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.535512 Aug 29 15:40:44.376329 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 437/921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:44.383757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.407533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.421617 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57907e8b-611b-45ea-987b-81c44956f56b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 204 len: 0 microversion: 2.1 time: 0.917405 Aug 29 15:40:44.422194 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 485/922] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:43 2022] DELETE /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 0 bytes in 919 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:40:44.429748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.430385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.430801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.433391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.434315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.435893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.439286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.440025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.440398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.441892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.444606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.449620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.451954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.454439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.617093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:44.628095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2294548f-3b18-4b22-85fe-5c82ef55352e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1474 microversion: 2.1 time: 0.249729 Aug 29 15:40:44.644479 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 438/923] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1474 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:44.655441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.656157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.665659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.666912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.668557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.669739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.670484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.671542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.705143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:44.828729 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-380829d9-d9e0-4bf3-bb28-4f13a0ee190a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 204 len: 0 microversion: 2.1 time: 0.181518 Aug 29 15:40:44.829977 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 439/924] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:44 2022] DELETE /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:44.837303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d305b112-5285-4873-85ce-040157c62708", "tag": "7d83dfb5-6b01-4fe3-ab0a-d7a7fa09ed52"}, {"name": "network-changed", "server_uuid": "9e266eab-6b47-440b-bb3b-cd7801c3d859", "tag": "88188c6a-a8cf-4565-990b-5ba98a2ea997"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:44.851172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.852080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.852722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.871045 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] Creating event network-changed:7d83dfb5-6b01-4fe3-ab0a-d7a7fa09ed52 for instance d305b112-5285-4873-85ce-040157c62708 on n-h2-836830-13 Aug 29 15:40:44.871676 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] Creating event network-changed:88188c6a-a8cf-4565-990b-5ba98a2ea997 for instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 on n-h1-836830-13 Aug 29 15:40:44.879193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:40:44.896507 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4031da06-5435-4b8c-ab67-a1931593d438 req-3cf3df10-1a74-49be-b10e-c12ff9d2caae service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064319 Aug 29 15:40:44.897613 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 440/925] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:44.904173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:44.905196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:44.914968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.915868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.916618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.918003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:44.918671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:44.919444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:44.997051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.008788 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-131989a0-2591-484f-9f83-a7e57946fce2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1473 microversion: 2.1 time: 0.585332 Aug 29 15:40:45.024031 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 486/926] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1473 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:45.060627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1698120795", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "10e124fc-0fc1-4d6c-9bea-015d572a2eb7"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:45.151841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] validate_networks() for [('10e124fc-0fc1-4d6c-9bea-015d572a2eb7', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:45.194891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:45.285405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:45.556227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.607698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:45.632901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.635942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.638909 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b11da64-264b-4d16-8669-d200c60875fc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1411 microversion: 2.25 time: 0.738489 Aug 29 15:40:45.641785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 441/927] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:44 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1411 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:45.650472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.651790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:45.669035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.669969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.670634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.672808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.673673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.674700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.949497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:45.957841 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4934d7fd-acf8-4643-b6f9-d7c9c746c0d5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.314624 Aug 29 15:40:45.974671 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 442/928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:45 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:45.984673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:45.985309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:45.992621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.993110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.993545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:45.994248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:45.995461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:45.995893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.119150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:46.120586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:46.121381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:46.121955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:46.122686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:46.143534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.144007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.144524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.148148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.148995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.149525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.168307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:46.178932 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46c45569-cd63-41fc-a739-87bd77d9e2b0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1474 microversion: 2.1 time: 0.202239 Aug 29 15:40:46.184504 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 443/929] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:45 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1474 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:46.191062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.192727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:46.193515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:46.196132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:46.201314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.201961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.202394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.203219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.203664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.204251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.210330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for user 09663bec61af43278da1d69c37594558 and project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:46.239758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:46.245610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:46.320450 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-62e9fe51-0b44-4f52-96ed-46f7153b3585 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264230 Aug 29 15:40:46.321646 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 487/930] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:40:46.334154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d123f4c-e445-4948-8156-e2404a2c62f9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.338968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7d123f4c-e445-4948-8156-e2404a2c62f9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:46.515919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:46.525705 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f840c0fa-1e1d-46e5-8aca-72c5addbcbf3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1479 microversion: 2.1 time: 0.339811 Aug 29 15:40:46.526284 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 444/931] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1479 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:46.543530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7d123f4c-e445-4948-8156-e2404a2c62f9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:46.550947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7d123f4c-e445-4948-8156-e2404a2c62f9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1208 microversion: 2.1 time: 0.222820 Aug 29 15:40:46.551639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 488/932] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1208 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:46.665958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.666596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:46.674792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:46.694309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.694816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.695323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.696043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:46.696506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:46.696936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:46.983001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:46.985004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.006495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.007271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.007882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.017464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.021230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.022277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.072039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:47.337452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.351877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.355999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.360065 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-995c5e8e-a78f-43b1-bd3a-4a04184fc31a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1411 microversion: 2.25 time: 0.698140 Aug 29 15:40:47.361709 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 445/933] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1411 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:40:47.437439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.450882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4563b70c-4e52-46ce-8c1d-ce96b1457f5c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.475202 Aug 29 15:40:47.453716 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 489/934] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:46 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:47.469162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:47.479947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.492523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.493288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.493899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.494780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.495269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.501305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.750372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:47.759865 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7c226a0-482d-4391-9668-4508ba4ff9b9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1474 microversion: 2.1 time: 0.304069 Aug 29 15:40:47.761631 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 490/935] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:47 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:47.773462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e0b2a6a6-d887-4cc4-85de-8e520e32b5a1 req-885daf45-4e7b-41b1-b0c1-0fb56bcab4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb03030-409e-4060-8428-d865da5f212f", "name": "network-vif-unplugged", "status": "completed", "tag": "e137ebac-7c12-45fe-b69b-ca4fed9d7199"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:47.813941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e0b2a6a6-d887-4cc4-85de-8e520e32b5a1 req-885daf45-4e7b-41b1-b0c1-0fb56bcab4d2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.814729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e0b2a6a6-d887-4cc4-85de-8e520e32b5a1 req-885daf45-4e7b-41b1-b0c1-0fb56bcab4d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.815583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e0b2a6a6-d887-4cc4-85de-8e520e32b5a1 req-885daf45-4e7b-41b1-b0c1-0fb56bcab4d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.841321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e0b2a6a6-d887-4cc4-85de-8e520e32b5a1 req-885daf45-4e7b-41b1-b0c1-0fb56bcab4d2 service nova] Creating event network-vif-unplugged:e137ebac-7c12-45fe-b69b-ca4fed9d7199 for instance 7eb03030-409e-4060-8428-d865da5f212f on n-h2-836830-13 Aug 29 15:40:47.850076 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e0b2a6a6-d887-4cc4-85de-8e520e32b5a1 req-885daf45-4e7b-41b1-b0c1-0fb56bcab4d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085098 Aug 29 15:40:47.851401 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 491/936] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:47.861990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:47.863130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:47.871855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.872354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.872786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.873492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:47.873946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:47.874369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:47.950036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-063d0dbf-e16e-4517-a543-38434e01a417 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Action: 'create', calling method: .version_select at 0x7f32ee8a7940>, body: {"pool": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:48.386496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.401174 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d05209f-52af-4bbd-941b-d96772de5625 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1479 microversion: 2.1 time: 0.547937 Aug 29 15:40:48.401923 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 492/937] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:47 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1479 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:48.421737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.422666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.429864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.430714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.431355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.432265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.432875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.433454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.506923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.516688 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd5d8e35-ecb6-4a90-af56-fbba3bf1cdd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1212 microversion: 2.1 time: 0.099148 Aug 29 15:40:48.517608 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 493/938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1212 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:48.662160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Calling method '.version_select at 0x7f32eecefdc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.664724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.665620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.666429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.682824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.683454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.683994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.696781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.697590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.698033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.706202 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3ff5a294-6250-4f7d-8c69-0a008b002c2d tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.187063 Aug 29 15:40:48.706802 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 494/939] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:48.713282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.714099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.720624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.721195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.721719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.722488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.723050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.723672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.905087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.918694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.921488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:48.922980 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-793485ea-4ace-4681-b6e8-115d43e04b35 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1411 microversion: 2.25 time: 0.215001 Aug 29 15:40:48.924201 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 495/940] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1411 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:48.930580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:48.932439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:48.939483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.940807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.941620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:48.943272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:48.944321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:48.945055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.106902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:49.117080 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54878fab-a7c4-4cd3-9f61-79c57586e507 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.191364 Aug 29 15:40:49.117516 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 496/941] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:48 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:49.250664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c038847-1eb7-4b74-9386-ef954c6dde34 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Calling method '.version_select at 0x7f32ee852b80>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.261906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c038847-1eb7-4b74-9386-ef954c6dde34 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '050dba5d1d4a4ba39819ea9d5914841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19418605190247a2ac94c09904361c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c038847-1eb7-4b74-9386-ef954c6dde34 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Request method failure captured: Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hypervisors/n-h1-836830-13/search HTTP/1.1 Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3_ncNINybc1_81G5HaG2Z0c_sI2W8TpVuPrylMXtStPPN-p3BGHB0U2hHkTISkcDEOeYYO0Dhq9jRx5_CUaukcG3GUETB1JNGQ5pldm_7qVoj8sQC-iXxzikRTdkE60pleozUlosOKgFaHWqDC-l52a6BqOR-9Pf0vSQAC5NxlPN0 Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 19418605190247a2ac94c09904361c36 Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-279029295 Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:40:49.265635 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/19418605190247a2ac94c09904361c36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_19418605190247a2ac94c09904361c36", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/19418605190247a2ac94c09904361c36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/19418605190247a2ac94c09904361c36"}]}] Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-279029295 Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 19418605190247a2ac94c09904361c36 Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-279029295 Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-279029295-project Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 050dba5d1d4a4ba39819ea9d5914841f Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-279029295-project Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:40:49.267057 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'n-h1-836830-13'} Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:40:49.268104 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 29 15:40:49.269284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:49.291647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c038847-1eb7-4b74-9386-ef954c6dde34 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:49.295561 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c038847-1eb7-4b74-9386-ef954c6dde34 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/n-h1-836830-13/search" status: 403 len: 117 microversion: 2.1 time: 0.176803 Aug 29 15:40:49.297022 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 497/942] 10.222.0.83 () {58 vars in 1212 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/os-hypervisors/n-h1-836830-13/search => generated 117 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:49.305723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.313160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:49.330380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.331475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.332057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.336039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.336948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.337382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.667837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:49.686693 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-810b257a-8d0e-4520-87c6-fb00f7c21a52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1472 microversion: 2.1 time: 0.388399 Aug 29 15:40:49.688632 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 498/943] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:49.696145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Calling method '.version_select at 0x7f32eebd48b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.698701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.699447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.701845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.718149 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Request method failure captured: Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN4AZ7JRPxP2FjJXyBQHh4MVRKOdxz5Tcy7JsM9LXgdYyf-6_pe-qpeCLXKN6JWgtNR40dOG92w0BN9a4kqiFa2EWWxt-GJSPs5GSooT9DZXRABqO8Xw4OjApw4fbIAwoffOjLBjKaaw6EckzJ9mymNcIh2NHx61kcOz9BgwtAkYWqA Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 80ba92878ca0463e8d4ee6084f1295bc Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1431957460 Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:40:49.720439 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/80ba92878ca0463e8d4ee6084f1295bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_80ba92878ca0463e8d4ee6084f1295bc", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/80ba92878ca0463e8d4ee6084f1295bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/80ba92878ca0463e8d4ee6084f1295bc"}]}] Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1431957460 Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 80ba92878ca0463e8d4ee6084f1295bc Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1431957460 Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c638559486414397a4a1208d92f2dc5a Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:40:49.721775 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:49.722533 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:49.724357 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:49.724357 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:49.724357 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:49.724357 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 29 15:40:49.724357 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:49.727229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:49.729386 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5178e274-ec5d-4dde-97ec-ec248c2f08b4 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.039236 Aug 29 15:40:49.731691 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 499/944] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:49.745349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.748303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:49.759370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.760468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.761320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.764386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.765054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.765877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.926369 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-063d0dbf-e16e-4517-a543-38434e01a417 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.543714 Aug 29 15:40:49.928453 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 446/945] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:49.935133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:49.936047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:49.943490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.944270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.944924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.945841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:49.947276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:49.947901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:49.970870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:50.044457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.055863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac97334d-3c19-4efe-b1f3-6d50f972282a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1260 microversion: 2.1 time: 0.124480 Aug 29 15:40:50.057093 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 447/946] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1260 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:50.062779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Calling method '.version_select at 0x7f32ee8df280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:50.065227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.066174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.066839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.087983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.088856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.090231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.108368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.108865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.109473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.119505 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3b032750-44bc-4fd2-91bb-8bd43642db88 tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.059924 Aug 29 15:40:50.121098 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 448/947] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:40:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:50.146197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22e8fc88-17d6-42f2-b1ea-f828230a06ae tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Action: 'create', calling method: .version_select at 0x7f32ee99c790>, body: {"pool": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:50.189606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.208818 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4d922f1-cd4d-498a-a2e8-f772f6ef2901 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1479 microversion: 2.1 time: 0.472665 Aug 29 15:40:50.209415 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 500/948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:49 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1479 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:50.214153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:50.215073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:50.222891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.223843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.224559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.225540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.226227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.226870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.656937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.670966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.674015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.691239 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-abc9302b-fb20-4ff8-ba37-8af72a337d0a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1411 microversion: 2.25 time: 0.465565 Aug 29 15:40:50.694153 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 501/949] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:50 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1411 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:50.738666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-209910e2-cb34-4a2c-8b9a-6e56c49d2a5b req-dc26b6ba-09ab-42dd-8ceb-113d7fdd6875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36742e72-c374-4c67-82eb-e6dd5a601e99", "name": "network-vif-plugged", "status": "completed", "tag": "15a54a03-347a-46bd-bbe5-7a555d14444e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:50.764349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-209910e2-cb34-4a2c-8b9a-6e56c49d2a5b req-dc26b6ba-09ab-42dd-8ceb-113d7fdd6875 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.765145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-209910e2-cb34-4a2c-8b9a-6e56c49d2a5b req-dc26b6ba-09ab-42dd-8ceb-113d7fdd6875 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.765935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-209910e2-cb34-4a2c-8b9a-6e56c49d2a5b req-dc26b6ba-09ab-42dd-8ceb-113d7fdd6875 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.791213 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-209910e2-cb34-4a2c-8b9a-6e56c49d2a5b req-dc26b6ba-09ab-42dd-8ceb-113d7fdd6875 service nova] Creating event network-vif-plugged:15a54a03-347a-46bd-bbe5-7a555d14444e for instance 36742e72-c374-4c67-82eb-e6dd5a601e99 on n-h1-836830-13 Aug 29 15:40:50.800399 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-209910e2-cb34-4a2c-8b9a-6e56c49d2a5b req-dc26b6ba-09ab-42dd-8ceb-113d7fdd6875 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102838 Aug 29 15:40:50.805703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 502/950] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:50.852828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d3c08f2-6d2a-4b27-9222-59aef1adb6a4 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Calling method '.version_select at 0x7f32ee82d940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:50.897242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d3c08f2-6d2a-4b27-9222-59aef1adb6a4 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '050dba5d1d4a4ba39819ea9d5914841f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19418605190247a2ac94c09904361c36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d3c08f2-6d2a-4b27-9222-59aef1adb6a4 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Request method failure captured: Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3_ncNINybc1_81G5HaG2Z0c_sI2W8TpVuPrylMXtStPPN-p3BGHB0U2hHkTISkcDEOeYYO0Dhq9jRx5_CUaukcG3GUETB1JNGQ5pldm_7qVoj8sQC-iXxzikRTdkE60pleozUlosOKgFaHWqDC-l52a6BqOR-9Pf0vSQAC5NxlPN0 Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 19418605190247a2ac94c09904361c36 Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-279029295 Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:40:50.899008 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/19418605190247a2ac94c09904361c36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_19418605190247a2ac94c09904361c36", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/19418605190247a2ac94c09904361c36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/19418605190247a2ac94c09904361c36"}]}] Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-279029295 Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 19418605190247a2ac94c09904361c36 Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-279029295 Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-279029295-project Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 050dba5d1d4a4ba39819ea9d5914841f Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-279029295-project Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:40:50.900441 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '1'} Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:40:50.901237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 29 15:40:50.902909 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:50.904134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d3c08f2-6d2a-4b27-9222-59aef1adb6a4 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:50.904134 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d3c08f2-6d2a-4b27-9222-59aef1adb6a4 tempest-HypervisorAdminNegativeUnderV252Test-279029295 tempest-HypervisorAdminNegativeUnderV252Test-279029295-project] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.093328 Aug 29 15:40:50.904134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 503/951] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:40:50 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 94 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:50.915119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:50.915859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:50.927504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.932447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.933207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:50.934162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:50.934783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:50.935400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.408582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:51.429950 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3fbc6f6c-d608-4b31-a12f-12bf3c65e3a0 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.527929 Aug 29 15:40:51.432003 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 504/952] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:50 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:51.446574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:51.448369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:51.463182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.465225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.466051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.467054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.467752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.468391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.820056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:51.841067 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-63df9adc-1d2b-46eb-b33d-2dca1d83e68b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1469 microversion: 2.1 time: 0.404452 Aug 29 15:40:51.842722 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 505/953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:51 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1469 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:51.847984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Calling method '.version_select at 0x7f32eebf3790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:51.851429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.853871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.855228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.868828 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] HTTP exception thrown: No hypervisor matching 'ff15c737-6c4f-4a11-9696-7b6d5c76bd6d' could be found. Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Request method failure captured: Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-hypervisors/ff15c737-6c4f-4a11-9696-7b6d5c76bd6d/servers HTTP/1.1 Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN4AZ7JRPxP2FjJXyBQHh4MVRKOdxz5Tcy7JsM9LXgdYyf-6_pe-qpeCLXKN6JWgtNR40dOG92w0BN9a4kqiFa2EWWxt-GJSPs5GSooT9DZXRABqO8Xw4OjApw4fbIAwoffOjLBjKaaw6EckzJ9mymNcIh2NHx61kcOz9BgwtAkYWqA Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 80ba92878ca0463e8d4ee6084f1295bc Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1431957460 Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:40:51.871768 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/80ba92878ca0463e8d4ee6084f1295bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_80ba92878ca0463e8d4ee6084f1295bc", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/80ba92878ca0463e8d4ee6084f1295bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/80ba92878ca0463e8d4ee6084f1295bc"}]}] Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1431957460 Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 80ba92878ca0463e8d4ee6084f1295bc Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1431957460 Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c638559486414397a4a1208d92f2dc5a Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: exception: No hypervisor matching 'ff15c737-6c4f-4a11-9696-7b6d5c76bd6d' could be found. Aug 29 15:40:51.873401 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ff15c737-6c4f-4a11-9696-7b6d5c76bd6d'} Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'ff15c737-6c4f-4a11-9696-7b6d5c76bd6d' could be found. Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:51.874276 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:51.875597 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:51.875597 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:51.875597 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:51.875597 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:51.875597 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'ff15c737-6c4f-4a11-9696-7b6d5c76bd6d' could be found. Aug 29 15:40:51.875597 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:51.877300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] Returning 404 to user: No hypervisor matching 'ff15c737-6c4f-4a11-9696-7b6d5c76bd6d' could be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:51.878381 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ce7ab58-2c14-4d19-a6c5-fb0fe4aefabf tempest-HypervisorAdminNegativeUnderV252Test-1431957460 tempest-HypervisorAdminNegativeUnderV252Test-1431957460-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors/ff15c737-6c4f-4a11-9696-7b6d5c76bd6d/servers" status: 404 len: 123 microversion: 2.1 time: 0.034478 Aug 29 15:40:51.879203 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 506/954] 10.222.0.83 () {58 vars in 1281 bytes} [Mon Aug 29 15:40:51 2022] GET /compute/v2.1/os-hypervisors/ff15c737-6c4f-4a11-9696-7b6d5c76bd6d/servers => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:40:51.888982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:51.889822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:51.897995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.898777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.899456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:51.900529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:51.901165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:51.901765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:52.383793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:52.407411 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8442d8b-a95a-4756-a7d4-94b8473919e7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.522569 Aug 29 15:40:52.409285 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 507/955] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:51 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:52.431562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:52.432302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:52.462122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:52.464650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:52.465136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:52.467148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:52.467626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:52.468060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.156003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.177567 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b2bc4b59-03ae-45b4-9338-ffba31010dda tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1479 microversion: 2.1 time: 0.762183 Aug 29 15:40:53.195316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 508/956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:52 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1479 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.195316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d4d0cb10-8862-4ad0-84d2-f225c4e8135d req-7b9048b8-8afb-4e12-8e13-15a2cc1bbfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb03030-409e-4060-8428-d865da5f212f", "name": "network-vif-deleted", "tag": "e137ebac-7c12-45fe-b69b-ca4fed9d7199"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:53.202047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4d0cb10-8862-4ad0-84d2-f225c4e8135d req-7b9048b8-8afb-4e12-8e13-15a2cc1bbfab service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.202646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4d0cb10-8862-4ad0-84d2-f225c4e8135d req-7b9048b8-8afb-4e12-8e13-15a2cc1bbfab service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.203189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4d0cb10-8862-4ad0-84d2-f225c4e8135d req-7b9048b8-8afb-4e12-8e13-15a2cc1bbfab service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.216515 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d4d0cb10-8862-4ad0-84d2-f225c4e8135d req-7b9048b8-8afb-4e12-8e13-15a2cc1bbfab service nova] Creating event network-vif-deleted:e137ebac-7c12-45fe-b69b-ca4fed9d7199 for instance 7eb03030-409e-4060-8428-d865da5f212f on n-h2-836830-13 Aug 29 15:40:53.222018 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d4d0cb10-8862-4ad0-84d2-f225c4e8135d req-7b9048b8-8afb-4e12-8e13-15a2cc1bbfab service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036266 Aug 29 15:40:53.222615 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 509/957] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:53.237661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.240944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.249084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.249807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.252006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.253090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.253704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.254279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.296462 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-22e8fc88-17d6-42f2-b1ea-f828230a06ae tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.157830 Aug 29 15:40:53.314816 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 449/958] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:53.322746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:53.327953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.338376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.339191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.339811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.340787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.341407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.342003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.420363 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d1ce390-4e93-42e1-8539-c3735463c84c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859/action" status: 204 len: 0 microversion: 2.1 time: 0.109821 Aug 29 15:40:53.421452 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 450/959] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:53 2022] POST /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859/action => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:53.430390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.431146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.437906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.438388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.439142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.440161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.440631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.441068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.550422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.561081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.562969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.564465 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6986c6b5-ed7f-41df-be5b-c85ba77087b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1608 microversion: 2.25 time: 0.340019 Aug 29 15:40:53.565250 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 510/960] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1608 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:40:53.570942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9a8372fa-5dc0-44fb-be53-1d64780ded76 req-775ca8fa-6fb2-4155-9fee-7a93b74ff3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d305b112-5285-4873-85ce-040157c62708", "name": "network-vif-plugged", "status": "completed", "tag": "7d83dfb5-6b01-4fe3-ab0a-d7a7fa09ed52"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:53.581294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9a8372fa-5dc0-44fb-be53-1d64780ded76 req-775ca8fa-6fb2-4155-9fee-7a93b74ff3e4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.582093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9a8372fa-5dc0-44fb-be53-1d64780ded76 req-775ca8fa-6fb2-4155-9fee-7a93b74ff3e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.582994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9a8372fa-5dc0-44fb-be53-1d64780ded76 req-775ca8fa-6fb2-4155-9fee-7a93b74ff3e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.597597 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9a8372fa-5dc0-44fb-be53-1d64780ded76 req-775ca8fa-6fb2-4155-9fee-7a93b74ff3e4 service nova] Creating event network-vif-plugged:7d83dfb5-6b01-4fe3-ab0a-d7a7fa09ed52 for instance d305b112-5285-4873-85ce-040157c62708 on n-h2-836830-13 Aug 29 15:40:53.603862 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9a8372fa-5dc0-44fb-be53-1d64780ded76 req-775ca8fa-6fb2-4155-9fee-7a93b74ff3e4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037208 Aug 29 15:40:53.605085 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 511/961] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:53.613174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:53.621910 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f51819eb-416f-4a82-9582-2a053ebdfc10 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.198417 Aug 29 15:40:53.626738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9f354d6a-8b20-470d-a583-4e93dbad011b tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Action: 'create', calling method: .version_select at 0x7f32ee96ec10>, body: {"pool": null} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:53.632737 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 451/962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:53.641948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:53.647250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:53.655259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.655755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.656303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:53.657016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:53.657471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:53.657899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.011444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:54.024321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1be6065c-e7e2-44b1-b412-fbd412dbee6d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1469 microversion: 2.1 time: 0.390344 Aug 29 15:40:54.025487 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 452/963] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:53 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:54.039775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.040609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.054168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.055002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.055642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.056506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.057108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.057695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.236769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:54.246277 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0659a66a-c4b8-4891-90de-9c8058683311 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.219468 Aug 29 15:40:54.247060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 453/964] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:54.259279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.259279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.261254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.261924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.262663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.263456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.264035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.264574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.360795 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e66c278b-a5c3-4d95-9b14-e1ab20575ae9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.112356 Aug 29 15:40:54.361422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 454/965] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:40:54.374632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.375367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.383292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.384121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.384744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.385681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.386353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.386967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.838726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:54.847479 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-89b7eacd-11c5-4c20-8ae3-9fc83b5316c8 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1479 microversion: 2.1 time: 0.476809 Aug 29 15:40:54.849319 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 455/966] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1479 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:54.857992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:54.859802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:54.868452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.869730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.870379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:54.871298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:54.871908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:54.872489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.185773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:55.195314 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa27d8a3-38fa-4589-8e9c-6e3333a3e1d8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1322 microversion: 2.1 time: 0.343855 Aug 29 15:40:55.205946 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 456/967] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:54 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:55.213950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:55.214721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:55.221902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.222535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.223210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.224980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.225592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.226422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.856047 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9f354d6a-8b20-470d-a583-4e93dbad011b tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.249537 Aug 29 15:40:55.857404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 512/968] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:55.861791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:55.862637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:55.872935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.873719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.874313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.875206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:55.875842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:55.876428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:55.882359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:56.022573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.026304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.034806 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15aad81f-fd99-4b48-869b-907b85a2bfa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.176581 Aug 29 15:40:56.034987 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02d6bfe9-2362-426c-bd7e-c3c55c28981e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1469 microversion: 2.1 time: 0.827923 Aug 29 15:40:56.036896 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 457/969] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:55 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1469 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.046837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-92acbaad-cdfb-4b63-8ad5-394927cfe6b2 req-fab49907-7b65-4c64-99c9-250444c804e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a5660c-ddba-4fd7-a7e8-a87e38ea1f40", "tag": "08dab329-5c8b-412e-87cf-d371e5f22396"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:56.048036 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 513/970] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:55 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.054440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ecae4f-8a73-4f39-be3f-da87823b9d94", "name": "network-vif-plugged", "status": "completed", "tag": "0e4dbec9-a639-455d-9630-3a4e82a180c1"}, {"server_uuid": "9e266eab-6b47-440b-bb3b-cd7801c3d859", "name": "network-vif-plugged", "status": "completed", "tag": "88188c6a-a8cf-4565-990b-5ba98a2ea997"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:56.060081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-92acbaad-cdfb-4b63-8ad5-394927cfe6b2 req-fab49907-7b65-4c64-99c9-250444c804e7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.060566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-92acbaad-cdfb-4b63-8ad5-394927cfe6b2 req-fab49907-7b65-4c64-99c9-250444c804e7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.061165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-92acbaad-cdfb-4b63-8ad5-394927cfe6b2 req-fab49907-7b65-4c64-99c9-250444c804e7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.065286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.065769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.066313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.074113 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-92acbaad-cdfb-4b63-8ad5-394927cfe6b2 req-fab49907-7b65-4c64-99c9-250444c804e7 service nova] Creating event network-changed:08dab329-5c8b-412e-87cf-d371e5f22396 for instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 on n-h2-836830-13 Aug 29 15:40:56.079944 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-92acbaad-cdfb-4b63-8ad5-394927cfe6b2 req-fab49907-7b65-4c64-99c9-250444c804e7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041706 Aug 29 15:40:56.080606 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] Creating event network-vif-plugged:0e4dbec9-a639-455d-9630-3a4e82a180c1 for instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 on n-h1-836830-13 Aug 29 15:40:56.080891 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 458/971] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:56.081254 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] Creating event network-vif-plugged:88188c6a-a8cf-4565-990b-5ba98a2ea997 for instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 on n-h1-836830-13 Aug 29 15:40:56.087764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57524851-8c6b-4d6e-8ae6-df8b60063689 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Action: 'create', calling method: .version_select at 0x7f32ee8ff4c0>, body: {"pool": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:56.090558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:40:56.104424 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d5519d1f-15a4-49c4-9d81-729e0d1efcc7 req-4d906919-f078-4e44-b5ab-a79410eb40a2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055023 Aug 29 15:40:56.109699 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 514/972] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:56.115983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.116702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.130678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.131747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.132398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.134030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.134642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.137275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.162182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:56.318822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.328429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7d353088-11e2-4cee-8b76-cee02ae2aac2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1479 microversion: 2.1 time: 0.217332 Aug 29 15:40:56.329251 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 515/973] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1479 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:56.338487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:56.339404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:56.346237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.346730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.347443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.348151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:56.349874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:56.349874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:56.550312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:56.675422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:56.686779 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4066dfa9-d513-4c07-bbd1-4cefa785edc8 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1472 microversion: 2.1 time: 0.356087 Aug 29 15:40:56.689710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 516/974] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:56 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:57.042759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92b9a0c1-6da8-4864-8b3f-f946c160dd7f tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:57.043461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92b9a0c1-6da8-4864-8b3f-f946c160dd7f tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] [instance: 4d3f5657-7186-4dd1-8dd0-f602c3134938] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.054892 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-92b9a0c1-6da8-4864-8b3f-f946c160dd7f tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] HTTP exception thrown: Instance 4d3f5657-7186-4dd1-8dd0-f602c3134938 could not be found. Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92b9a0c1-6da8-4864-8b3f-f946c160dd7f tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Request method failure captured: Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/4d3f5657-7186-4dd1-8dd0-f602c3134938/action HTTP/1.1 Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 15 Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3vyG48bZEz0y3aVs4cWiGm8pCllzfcnKDxRL6APl0up6jwzJgw9BrX8hshxPePpcLNa_WWZO7ObhKa4aUKaYv8bkVfppp5GnN5KPegoAwxxPF_CIr16us-XItlxX_IcG4_GK8V06TlVBryfwZfFd0mpQAYKb6fVtBnOtZhcpaj5uM Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:40:57.055336 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b85774c4058e41039e37bf970208d1df", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b85774c4058e41039e37bf970208d1df"}]}] Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: b707e515afc149219025d224fe1df8e0 Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: {"migrate": {}} Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:40:57.056910 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 4d3f5657-7186-4dd1-8dd0-f602c3134938 could not be found. Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '4d3f5657-7186-4dd1-8dd0-f602c3134938', 'body': {'migrate': {}}} Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d3f5657-7186-4dd1-8dd0-f602c3134938 could not be found. Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:40:57.057870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d3f5657-7186-4dd1-8dd0-f602c3134938 could not be found. Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d3f5657-7186-4dd1-8dd0-f602c3134938 could not be found. Aug 29 15:40:57.059179 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:40:57.061077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92b9a0c1-6da8-4864-8b3f-f946c160dd7f tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Returning 404 to user: Instance 4d3f5657-7186-4dd1-8dd0-f602c3134938 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:40:57.061077 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92b9a0c1-6da8-4864-8b3f-f946c160dd7f tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/4d3f5657-7186-4dd1-8dd0-f602c3134938/action" status: 404 len: 111 microversion: 2.1 time: 0.349508 Aug 29 15:40:57.067996 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 517/975] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:56 2022] POST /compute/v2.1/servers/4d3f5657-7186-4dd1-8dd0-f602c3134938/action => generated 111 bytes in 361 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:40:57.072802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-14bbc15a-216b-4d7f-9b07-9fa2898769ab req-5248dc67-1cd6-4788-8b58-df8f3fc27779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36742e72-c374-4c67-82eb-e6dd5a601e99", "tag": "15a54a03-347a-46bd-bbe5-7a555d14444e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:57.089463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-14bbc15a-216b-4d7f-9b07-9fa2898769ab req-5248dc67-1cd6-4788-8b58-df8f3fc27779 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.089946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-14bbc15a-216b-4d7f-9b07-9fa2898769ab req-5248dc67-1cd6-4788-8b58-df8f3fc27779 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.090370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-14bbc15a-216b-4d7f-9b07-9fa2898769ab req-5248dc67-1cd6-4788-8b58-df8f3fc27779 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.102861 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-14bbc15a-216b-4d7f-9b07-9fa2898769ab req-5248dc67-1cd6-4788-8b58-df8f3fc27779 service nova] Creating event network-changed:15a54a03-347a-46bd-bbe5-7a555d14444e for instance 36742e72-c374-4c67-82eb-e6dd5a601e99 on n-h1-836830-13 Aug 29 15:40:57.111250 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-14bbc15a-216b-4d7f-9b07-9fa2898769ab req-5248dc67-1cd6-4788-8b58-df8f3fc27779 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041799 Aug 29 15:40:57.112259 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 518/976] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:57.117926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:57.118618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.127061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.127605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.128135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.128835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.129442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.130424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.329564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:57.338129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f1a0803a-38e9-4be0-bf6a-cbc05ded5464 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1469 microversion: 2.1 time: 0.224627 Aug 29 15:40:57.339286 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 519/977] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:57 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:57.344400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:57.345355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:57.351939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.352625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.353456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.354438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:57.355232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:57.355898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:57.588395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:57.596527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b75abdee-d26c-4e7c-a370-6d3745b376a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.255655 Aug 29 15:40:57.597545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 520/978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:57 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:57.737832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57524851-8c6b-4d6e-8ae6-df8b60063689 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.655373 Aug 29 15:40:57.738645 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 459/979] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:40:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:57.743830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1806421157", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:57.771143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5348753b-e408-4760-a2bc-d0726c905a93 tempest-NetworksTest-1724921403 tempest-NetworksTest-1724921403-project-admin] Calling method '.version_select at 0x7f32eee18160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:57.848214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:40:58.009914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5348753b-e408-4760-a2bc-d0726c905a93 tempest-NetworksTest-1724921403 tempest-NetworksTest-1724921403-project-admin] 10.222.0.83 "GET /compute/v2.1/os-networks" status: 200 len: 6056 microversion: 2.1 time: 0.411124 Aug 29 15:40:58.010636 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 521/980] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:40:57 2022] GET /compute/v2.1/os-networks => generated 6056 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.025679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.028116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.035287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.036074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.036687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.037714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.038694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.039319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.138473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:40:58.138888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:40:58.139797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:40:58.140400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:40:58.140994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:40:58.152955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.153472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.153912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.154645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.155137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.155628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.177678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Getting quotas for project 936fa60fa7e24fd9b9014521544670dc. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:40:58.183313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Getting quotas for user cd46d7afd06f41c2a09132a349aa3fd4 and project 936fa60fa7e24fd9b9014521544670dc. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:40:58.197168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:40:58.200203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:40:58.261720 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d93d570-2ed3-438b-922e-558853a050c7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521504 Aug 29 15:40:58.263299 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 460/981] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:40:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:40:58.271454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f670639-fd3a-45b6-a2d4-bc03dfbd75ef tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Calling method '.version_select at 0x7f32ee8a7670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.281650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.295522 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c39976b8-a8c6-4662-b9b8-bb3343c678a2 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1464 microversion: 2.1 time: 0.274375 Aug 29 15:40:58.297495 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 522/982] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1464 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.304785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-812536f6-a746-4799-b372-dc2996216bf6 tempest-NetworksTest-1724921403 tempest-NetworksTest-1724921403-project-admin] Calling method '.version_select at 0x7f32eef17d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.432978 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-812536f6-a746-4799-b372-dc2996216bf6 tempest-NetworksTest-1724921403 tempest-NetworksTest-1724921403-project-admin] 10.222.0.83 "GET /compute/v2.1/os-networks/b651865a-1c0e-419b-b2e5-5ce156b625c8" status: 200 len: 652 microversion: 2.1 time: 0.134191 Aug 29 15:40:58.433703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 523/983] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/os-networks/b651865a-1c0e-419b-b2e5-5ce156b625c8 => generated 652 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:58.440304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3062bbef-685a-40a7-98d7-4e5887b808b1 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.440916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3062bbef-685a-40a7-98d7-4e5887b808b1 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.487718 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2f670639-fd3a-45b6-a2d4-bc03dfbd75ef tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips/84562a33-c59a-43c6-85c9-8df5a13bb9d7" status: 200 len: 141 microversion: 2.1 time: 0.218021 Aug 29 15:40:58.488487 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 461/984] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/os-floating-ips/84562a33-c59a-43c6-85c9-8df5a13bb9d7 => generated 141 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:40:58.494171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:58.496516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.502475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3062bbef-685a-40a7-98d7-4e5887b808b1 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.503357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.503848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.504282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.505326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.505999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.506511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.509496 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3062bbef-685a-40a7-98d7-4e5887b808b1 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1222 microversion: 2.1 time: 0.074659 Aug 29 15:40:58.510230 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 524/985] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1222 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.515060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.515830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.523622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.524116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.524551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.525248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.525700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.526127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.595784 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-942e14be-83cb-4d8d-8c4a-4ce76b26d157 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action" status: 202 len: 0 microversion: 2.1 time: 0.104878 Aug 29 15:40:58.597106 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 462/986] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:58 2022] POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:58.604358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25da0cb9-ac58-4b2a-928f-a8705d15cff0 tempest-NetworksTest-1724921403 tempest-NetworksTest-1724921403-project-admin] Calling method '.version_select at 0x7f32eec99430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.697573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:58.707785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82cbefdb-c5c5-4d2e-8b4f-1e790ffaf527 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1469 microversion: 2.1 time: 0.196269 Aug 29 15:40:58.708837 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 525/987] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.713612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01127ca4-54ae-4827-9bef-4cd696706154 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Calling method '.version_select at 0x7f32ee7f2ca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.744915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25da0cb9-ac58-4b2a-928f-a8705d15cff0 tempest-NetworksTest-1724921403 tempest-NetworksTest-1724921403-project-admin] 10.222.0.83 "GET /compute/v2.1/os-networks" status: 200 len: 6056 microversion: 2.1 time: 0.146138 Aug 29 15:40:58.746196 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 463/988] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/os-networks => generated 6056 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.751979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.752800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.762139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.763380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.764438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.765585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.766327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.766967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.812408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.813434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.813801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.814429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lazy-loading 'fault' on Instance uuid 79ecae4f-8a73-4f39-be3f-da87823b9d94 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:40:58.934468 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a27c011-21e4-4ecf-90ad-1909b824d3e9 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1600 microversion: 2.1 time: 0.186671 Aug 29 15:40:58.950348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 464/989] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1600 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:58.955622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:58.956406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:58.965340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.966252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.967217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:58.967400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:58.967848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:58.968263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.115685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:59.124797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54b05495-166f-4179-86fd-ced1af27048b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.172893 Aug 29 15:40:59.125983 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 465/990] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:58 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:59.140876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:40:59.143636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.152002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.152566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.153245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.154005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.154551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.155093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.184762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:40:59.241361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a7d4040-198c-4700-9e8a-3aabfd28cdfd tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action" status: 202 len: 0 microversion: 2.1 time: 0.114176 Aug 29 15:40:59.242172 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 466/991] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:40:59 2022] POST /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:40:59.252362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.253122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.262987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.264036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.264036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.264979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.265549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.266225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.467302 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-297be6b3-25eb-45ae-8428-d302ddeed608 tempest-ServersAdminTestJSON-549831658 tempest-ServersAdminTestJSON-549831658-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1617 microversion: 2.1 time: 0.219969 Aug 29 15:40:59.469137 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 467/992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1617 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:40:59.491216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.491916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.499135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.500022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.500577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.501416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.501941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.502663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.545735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:40:59.649203 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a971e6a-009b-42a9-a25c-9c665cce2ac9 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 204 len: 0 microversion: 2.1 time: 0.164451 Aug 29 15:40:59.650170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 468/993] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:40:59 2022] DELETE /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:40:59.660476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.663907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.675484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.676258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.677405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.678429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.679251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.679944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.788551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:40:59.798109 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c042bd3-222c-47a7-b58d-14ae498b6605 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1274 microversion: 2.1 time: 0.146139 Aug 29 15:40:59.798952 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 469/994] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:40:59.803942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:40:59.804792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:40:59.823682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.824432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.825474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:40:59.826422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:40:59.827170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:40:59.830828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.006708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:00.013868 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01127ca4-54ae-4827-9bef-4cd696706154 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/84562a33-c59a-43c6-85c9-8df5a13bb9d7" status: 202 len: 0 microversion: 2.1 time: 1.303628 Aug 29 15:41:00.014589 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 526/995] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:40:58 2022] DELETE /compute/v2.1/os-floating-ips/84562a33-c59a-43c6-85c9-8df5a13bb9d7 => generated 0 bytes in 1305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:00.015655 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9642726a-c64a-4013-85e8-51120756351a tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1470 microversion: 2.1 time: 0.215482 Aug 29 15:41:00.016322 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 470/996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:40:59 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:00.032571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.033955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.034654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8afb71f7-b3fb-4a58-8bff-0894b4c26d37 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Calling method '.version_select at 0x7f32ee7f6310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.041753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.042446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.042876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.043671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.044122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.044554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.201322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:00.210371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10e7aaba-960d-4760-928a-610603c980e9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1469 microversion: 2.1 time: 0.194212 Aug 29 15:41:00.225367 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 527/997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:00.231811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.232972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.239663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.240410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.241003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.241877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.242500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.243272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.268355 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8afb71f7-b3fb-4a58-8bff-0894b4c26d37 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.239660 Aug 29 15:41:00.269487 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 471/998] 10.222.0.83 () {58 vars in 1164 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:00.280508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33ffd99c-0742-493d-b096-b55b1f75880d tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Calling method '.version_select at 0x7f32ee99c9d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.448890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:00.458716 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-255a497e-6d2b-4fa1-8900-3f8628c4b6a8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.231956 Aug 29 15:41:00.459506 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 528/999] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:00.825989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.826823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:00.834531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33ffd99c-0742-493d-b096-b55b1f75880d tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.557497 Aug 29 15:41:00.836485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 472/1000] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:00.847329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.849158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.850072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.850893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-add8961f-2bdc-4394-ab68-5a524b8523e2 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Calling method '.version_select at 0x7f32ee855a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:00.851253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:00.852087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:00.852869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:00.955809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:00.970163 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ee00e38b-8558-4242-91e4-ddc3c9d13872 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1292 microversion: 2.1 time: 0.149169 Aug 29 15:41:00.971092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 529/1001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:00 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1292 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:01.041349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.042094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.048291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.048780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.049275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.049988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.050447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.051110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.562485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.574889 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-94887a8d-c22b-44ed-9b12-67364ad73d66 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1470 microversion: 2.1 time: 0.537328 Aug 29 15:41:01.587073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 530/1002] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1470 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.587073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.587073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.594908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.594908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.594908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.594908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.595239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.595239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.881586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:01.895875 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49392e4c-87f1-4334-a9ec-4cf584e3d72c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1461 microversion: 2.1 time: 0.314066 Aug 29 15:41:01.896796 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 531/1003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1461 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:01.904459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:01.907242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:01.919779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.920562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.921552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:01.923001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:01.924218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:01.925469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.175958 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-add8961f-2bdc-4394-ab68-5a524b8523e2 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/7ae5f1c5-63cf-440f-8a92-759f160ad7e3" status: 202 len: 0 microversion: 2.1 time: 1.331115 Aug 29 15:41:02.177165 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 473/1004] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:00 2022] DELETE /compute/v2.1/os-floating-ips/7ae5f1c5-63cf-440f-8a92-759f160ad7e3 => generated 0 bytes in 1333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:41:02.181714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.182333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:02.194566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.195764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.196723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.198124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.199452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.200594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.212140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:02.228022 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e19d5aa-dbe2-4dd4-a2ab-efd0653329bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.324946 Aug 29 15:41:02.244715 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 532/1005] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:01 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.250050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.250872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:02.257274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.257766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.258380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.259278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.259883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.260469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.487504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:02.498444 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-810b005f-b0af-4bd3-8442-8bc8cec2389a tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.252248 Aug 29 15:41:02.504721 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 533/1006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.514329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea0b7a6a-21a4-4468-81be-c995bba1132a tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Calling method '.version_select at 0x7f32ee82d940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.569251 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c056dcbf-a1e3-4d5c-997d-298529fc2b0a tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1614 microversion: 2.1 time: 0.390816 Aug 29 15:41:02.569828 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 474/1007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1614 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.577870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1aa73bf7-9ed7-4a34-9682-9c7c26cee388 req-14440028-0d12-4ab1-83b5-9ca1ad085d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be3f8db-e1cc-464f-a8a6-2c6db7509cc6", "name": "network-vif-deleted", "tag": "b1ef1508-7946-4d7e-9dfe-e71ca18740e6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:02.615505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1aa73bf7-9ed7-4a34-9682-9c7c26cee388 req-14440028-0d12-4ab1-83b5-9ca1ad085d4c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.619752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1aa73bf7-9ed7-4a34-9682-9c7c26cee388 req-14440028-0d12-4ab1-83b5-9ca1ad085d4c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.627726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1aa73bf7-9ed7-4a34-9682-9c7c26cee388 req-14440028-0d12-4ab1-83b5-9ca1ad085d4c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.647776 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1aa73bf7-9ed7-4a34-9682-9c7c26cee388 req-14440028-0d12-4ab1-83b5-9ca1ad085d4c service nova] Creating event network-vif-deleted:b1ef1508-7946-4d7e-9dfe-e71ca18740e6 for instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 on n-h1-836830-13 Aug 29 15:41:02.659861 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1aa73bf7-9ed7-4a34-9682-9c7c26cee388 req-14440028-0d12-4ab1-83b5-9ca1ad085d4c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084484 Aug 29 15:41:02.663851 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 475/1008] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:02.677426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ddebc0a-0042-48b1-a56a-af8f8c5810e5 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '.version_select at 0x7f32ee8559d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.682581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ddebc0a-0042-48b1-a56a-af8f8c5810e5 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.686961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ddebc0a-0042-48b1-a56a-af8f8c5810e5 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.691365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ddebc0a-0042-48b1-a56a-af8f8c5810e5 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.717254 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2ddebc0a-0042-48b1-a56a-af8f8c5810e5 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 1189 microversion: 2.1 time: 0.051855 Aug 29 15:41:02.718512 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 476/1009] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/os-migrations => generated 1189 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:02.724822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:02.726051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:02.733630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.734492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.736105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.738485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.739592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.740265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.791332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:02.792038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:02.792641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:02.793245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lazy-loading 'fault' on Instance uuid 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:03.010127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:03.046826 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-138cf06a-65fb-48dc-b08c-cb8a0f7b64d3 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 200 len: 1304 microversion: 2.1 time: 0.326401 Aug 29 15:41:03.068023 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 477/1010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:02 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 1304 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:03.234851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32a4ed6e-2164-46bd-9221-1a567b4cc66a tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] Calling method '.version_select at 0x7f32ee8ebaf0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.251526 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32a4ed6e-2164-46bd-9221-1a567b4cc66a tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.182472 Aug 29 15:41:03.260453 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 478/1011] 10.222.0.83 () {58 vars in 1185 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:03.266321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-520730584", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:03.338379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:03.626272 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea0b7a6a-21a4-4468-81be-c995bba1132a tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/ebaf2808-953e-453d-add6-70dfcb4d651f" status: 202 len: 0 microversion: 2.1 time: 1.119569 Aug 29 15:41:03.630835 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 534/1012] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:02 2022] DELETE /compute/v2.1/os-floating-ips/ebaf2808-953e-453d-add6-70dfcb4d651f => generated 0 bytes in 1121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:03.632264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.632885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.639619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.640110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.640543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.641272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.641942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.642434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.710608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:03.711183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:03.711763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:03.712312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:03.712821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:03.721980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.722602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.723237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.724220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.724744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.725235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.753608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:03.759710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for user cc90d88d1e574a94858bbe2523855caa and project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:03.774445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:03.777634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:03.811490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:03.822540 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-913cc589-e2a6-4927-91e4-26adb9038ed4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.194484 Aug 29 15:41:03.823492 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 535/1013] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:03.828328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f219b5c3-7612-4967-b64d-bf074fbee978 tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] Action: 'update', calling method: .version_select at 0x7f32ee852040>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:03.839374 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2bf540fa-0b7d-4193-8fef-5a7aee8826df tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577404 Aug 29 15:41:03.840450 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 479/1014] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:41:03.846527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b5c85819-8a2a-4567-9377-768f802e555b req-28fbeee5-771f-48c6-913a-76e1f7470f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71066bd-e884-43f0-a85f-071adfa5c80f", "tag": "7b0821e2-5394-406e-a429-1524721547a3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:03.859518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b5c85819-8a2a-4567-9377-768f802e555b req-28fbeee5-771f-48c6-913a-76e1f7470f5f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.860360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b5c85819-8a2a-4567-9377-768f802e555b req-28fbeee5-771f-48c6-913a-76e1f7470f5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.861135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b5c85819-8a2a-4567-9377-768f802e555b req-28fbeee5-771f-48c6-913a-76e1f7470f5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.873433 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b5c85819-8a2a-4567-9377-768f802e555b req-28fbeee5-771f-48c6-913a-76e1f7470f5f service nova] Creating event network-changed:7b0821e2-5394-406e-a429-1524721547a3 for instance b71066bd-e884-43f0-a85f-071adfa5c80f on n-h2-836830-13 Aug 29 15:41:03.877295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:03.882389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b5c85819-8a2a-4567-9377-768f802e555b req-28fbeee5-771f-48c6-913a-76e1f7470f5f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039251 Aug 29 15:41:03.883879 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 480/1015] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:03.890080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:03.891145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:03.900368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.901268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.901959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:03.902858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:03.903519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:03.904305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.103911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f219b5c3-7612-4967-b64d-bf074fbee978 tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.279196 Aug 29 15:41:04.110908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 536/1016] 10.222.0.83 () {60 vars in 1206 bytes} [Mon Aug 29 15:41:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:04.117389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71276771-def2-4c38-9da2-f7b1854f8e53 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] Calling method '.version_select at 0x7f32ee7f2a60>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.148384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.160655 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1cbc83e-dda5-4cbf-9feb-be7ec7484e54 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.274822 Aug 29 15:41:04.161651 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 481/1017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:03 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.167441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ddbe53ba-3927-432a-9a12-fd9b5ef04e6c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.168077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ddbe53ba-3927-432a-9a12-fd9b5ef04e6c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.233404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ddbe53ba-3927-432a-9a12-fd9b5ef04e6c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.242463 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ddbe53ba-3927-432a-9a12-fd9b5ef04e6c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1212 microversion: 2.1 time: 0.079314 Aug 29 15:41:04.243693 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 482/1018] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.248522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.249396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.251630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:04.259009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.259533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.260316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.262005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.262667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.263362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.283539 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] HTTP exception thrown: Instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 could not be found. Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Request method failure captured: Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 HTTP/1.1 Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2ckOO7M1_76pr8Aq10HcWW-y0UNc37yQKGQGYcHDDeEi1-A0MvDXdGj4cKKUUTP9qryLMniQZJ8UWW_M3OGfQJDnVZpUNYHvUyGNtji1Nj9CjOU1ZsQHzGsyTHmoXc2b8D0irk_8mqOBOqc9dJ0nTdGQ3V1asLMPkIdJVvlQjnIt8 Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 068087b8e3274eb98dabdb60c8db2368 Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:04.285616 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/068087b8e3274eb98dabdb60c8db2368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_068087b8e3274eb98dabdb60c8db2368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/068087b8e3274eb98dabdb60c8db2368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/068087b8e3274eb98dabdb60c8db2368"}]}] Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 068087b8e3274eb98dabdb60c8db2368 Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersAdminTestJSON-2104095353-project Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 67701a88fc354d4c9ae7d16f8ee1355b Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersAdminTestJSON-2104095353-project Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 could not be found. Aug 29 15:41:04.286992 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1be3f8db-e1cc-464f-a8a6-2c6db7509cc6'} Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 could not be found. Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:04.287788 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 could not be found. Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 could not be found. Aug 29 15:41:04.288977 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:04.291968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Returning 404 to user: Instance 1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:04.292933 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7ba2a16-1d13-4446-a60b-b03feafa2374 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6" status: 404 len: 111 microversion: 2.1 time: 0.048123 Aug 29 15:41:04.293679 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 483/1019] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/servers/1be3f8db-e1cc-464f-a8a6-2c6db7509cc6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:04.302080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-05ae191f-39db-41d4-9b51-4dd7723b9e26 tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] Calling method '.version_select at 0x7f32ee8e4c10>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.314711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-05ae191f-39db-41d4-9b51-4dd7723b9e26 tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016788 Aug 29 15:41:04.315519 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 484/1020] 10.222.0.83 () {58 vars in 1185 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:04.320616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.321451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.332229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.333449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.334264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.334972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.335533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.336031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.366085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:04.477184 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5d75b87-d1df-47ca-beb9-eeeb76dffefc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "DELETE /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 204 len: 0 microversion: 2.1 time: 0.159904 Aug 29 15:41:04.478168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 485/1021] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:04 2022] DELETE /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:04.485451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fbd177d3-cbbd-4b8f-a119-bac5c0080456 tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] Action: 'update', calling method: .version_select at 0x7f32ee9f3af0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:04.606419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fbd177d3-cbbd-4b8f-a119-bac5c0080456 tempest-QuotaClassesAdminTestJSON-355984848 tempest-QuotaClassesAdminTestJSON-355984848-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.126177 Aug 29 15:41:04.615316 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 486/1022] 10.222.0.83 () {60 vars in 1206 bytes} [Mon Aug 29 15:41:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:04.615316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.615316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.619120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.619270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.619715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.620357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.621012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.621219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.799432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:04.808171 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4994e868-edad-4a4f-97a5-f75a7f7cb3de tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1469 microversion: 2.1 time: 0.200201 Aug 29 15:41:04.809058 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 487/1023] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:04.813890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1e8432b0-b633-411b-9b5f-753134c33844 req-80d7baa5-bb1a-474f-adc5-fdfe68723d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a5660c-ddba-4fd7-a7e8-a87e38ea1f40", "name": "network-vif-plugged", "status": "completed", "tag": "08dab329-5c8b-412e-87cf-d371e5f22396"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:04.825327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1e8432b0-b633-411b-9b5f-753134c33844 req-80d7baa5-bb1a-474f-adc5-fdfe68723d40 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.826030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1e8432b0-b633-411b-9b5f-753134c33844 req-80d7baa5-bb1a-474f-adc5-fdfe68723d40 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.826718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1e8432b0-b633-411b-9b5f-753134c33844 req-80d7baa5-bb1a-474f-adc5-fdfe68723d40 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.838760 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1e8432b0-b633-411b-9b5f-753134c33844 req-80d7baa5-bb1a-474f-adc5-fdfe68723d40 service nova] Creating event network-vif-plugged:08dab329-5c8b-412e-87cf-d371e5f22396 for instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 on n-h2-836830-13 Aug 29 15:41:04.848631 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1e8432b0-b633-411b-9b5f-753134c33844 req-80d7baa5-bb1a-474f-adc5-fdfe68723d40 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037783 Aug 29 15:41:04.849881 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 488/1024] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:04.856018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:04.856719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:04.862872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.863407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.864440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.865200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:04.865681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:04.866089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:04.870439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:05.030616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:05.038091 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71276771-def2-4c38-9da2-f7b1854f8e53 tempest-FloatingIPDetailsTestJSON-1153102196 tempest-FloatingIPDetailsTestJSON-1153102196-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/de0bb6f9-31be-4456-9881-0b842afe6882" status: 202 len: 0 microversion: 2.1 time: 0.931735 Aug 29 15:41:05.038674 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 537/1025] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:04 2022] DELETE /compute/v2.1/os-floating-ips/de0bb6f9-31be-4456-9881-0b842afe6882 => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:05.039852 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-567ce960-fd62-4aaa-a7de-242340be3aea tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.188532 Aug 29 15:41:05.046608 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 489/1026] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:04 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:05.181981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.182677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.189437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.189917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.190522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.191493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.192570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.193301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.264913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.265534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.272883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.273374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.273988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.274904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.275993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.275993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.351859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:05.361548 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0914d2a-4ebc-4873-9811-2c001b96e784 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1216 microversion: 2.1 time: 0.100437 Aug 29 15:41:05.363309 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 490/1027] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1216 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:05.389484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:05.400343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:05.403653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d1d69405-a797-4d2a-897a-c15e80c42114 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.225607 Aug 29 15:41:05.404295 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 538/1028] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:05.829980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:05.830994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:05.842861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.844142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.844656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:05.846019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:05.846539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:05.847061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.042195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.056809 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-265ec723-4c95-4b06-a457-f4f95e1b10dc tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1469 microversion: 2.1 time: 0.230517 Aug 29 15:41:06.057937 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 491/1029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:05 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:06.060980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.061592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.076270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.076774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.077214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.077918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.078560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.079210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.385485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.387437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.392336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.396970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.397715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.398364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.399123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.399578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.400194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.404516 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-535a5343-e7e4-4ca3-8035-b12efe6211ae tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.348169 Aug 29 15:41:06.409336 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 539/1030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:06 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:06.425457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:06.427677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:06.434601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.435579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.440006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.441173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:06.441840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:06.459602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:06.480585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:06.489913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aae1b319-215a-4559-9407-919bf5b71090 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1216 microversion: 2.1 time: 0.108652 Aug 29 15:41:06.503635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 492/1031] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:06 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:07.079832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.080756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.089762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.090304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.090759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.091592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.092056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.092562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.109539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.120250 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1670bf5-1fca-4ff3-963c-eaf989cbd2da tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.698709 Aug 29 15:41:07.121145 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 540/1032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:06 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:07.430286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.431102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.441629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.444266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.445559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.447754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.448966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.449469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.456440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.473821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b92c878a-b8ca-4f8f-b4ba-25f61035d6ac tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 200 len: 1469 microversion: 2.1 time: 0.399610 Aug 29 15:41:07.489935 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 493/1033] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:07.495035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1b7f9dc3-3f4e-4ba8-8a88-4a622954ddb8 req-d79c379c-6704-4b6e-aa66-23077dec7117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86e619ff-e04f-483a-bbb9-a229dc41fa28", "name": "network-vif-deleted", "tag": "a8f67aff-26f5-4d21-bd5c-7b7a7113cdb4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:07.505266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1b7f9dc3-3f4e-4ba8-8a88-4a622954ddb8 req-d79c379c-6704-4b6e-aa66-23077dec7117 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.506783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1b7f9dc3-3f4e-4ba8-8a88-4a622954ddb8 req-d79c379c-6704-4b6e-aa66-23077dec7117 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.507477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1b7f9dc3-3f4e-4ba8-8a88-4a622954ddb8 req-d79c379c-6704-4b6e-aa66-23077dec7117 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.524119 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1b7f9dc3-3f4e-4ba8-8a88-4a622954ddb8 req-d79c379c-6704-4b6e-aa66-23077dec7117 service nova] Creating event network-vif-deleted:a8f67aff-26f5-4d21-bd5c-7b7a7113cdb4 for instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 on n-h1-836830-13 Aug 29 15:41:07.529738 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1b7f9dc3-3f4e-4ba8-8a88-4a622954ddb8 req-d79c379c-6704-4b6e-aa66-23077dec7117 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037891 Aug 29 15:41:07.534490 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 494/1034] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:07.541230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:07.542214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:07.550397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.551675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.552465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.553503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:07.554439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:07.555668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:07.655601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.664336 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3119a9f9-7d52-4f3a-adf1-424cae7a4394 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1264 microversion: 2.1 time: 0.127987 Aug 29 15:41:07.665121 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 495/1035] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1264 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:07.749746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:07.762315 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e610a166-4401-43e6-9f6b-9b9f93b395aa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.336378 Aug 29 15:41:07.766831 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 541/1036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:07 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:08.135832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1892396080", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": "none"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:08.143764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.144380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.163096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.164786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.165452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.167615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.169168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.171161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.235691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:08.236350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:08.236997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:08.237562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:08.238196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:08.248552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.249372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.250047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.250986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.251699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.252355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.275188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Getting quotas for project 93cffdb3292247c69d9f8b425453962a. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:08.281870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Getting quotas for user 00c0fdb3a3524a93b7728b495750b95e and project 93cffdb3292247c69d9f8b425453962a. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:08.297623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:08.300694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:08.375732 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-87a5139d-629d-4501-b9f4-0fe507430fed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.387814 Aug 29 15:41:08.384068 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 496/1037] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:41:08.391479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79ae1496-3a39-4b6d-bab7-040b14949936 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:08.397404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79ae1496-3a39-4b6d-bab7-040b14949936 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.501204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79ae1496-3a39-4b6d-bab7-040b14949936 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.510281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79ae1496-3a39-4b6d-bab7-040b14949936 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.518728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79ae1496-3a39-4b6d-bab7-040b14949936 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.527379 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79ae1496-3a39-4b6d-bab7-040b14949936 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "PUT /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1359 microversion: 2.75 time: 0.141942 Aug 29 15:41:08.528215 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 497/1038] 10.222.0.83 () {62 vars in 1297 bytes} [Mon Aug 29 15:41:08 2022] PUT /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:08.539396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.539396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 86e619ff-e04f-483a-bbb9-a229dc41fa28] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.545625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.546599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.547282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.549409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.550342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.551882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.570527 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] HTTP exception thrown: Instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 could not be found. Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Request method failure captured: Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 HTTP/1.1 Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2ckOO7M1_76pr8Aq10HcWW-y0UNc37yQKGQGYcHDDeEi1-A0MvDXdGj4cKKUUTP9qryLMniQZJ8UWW_M3OGfQJDnVZpUNYHvUyGNtji1Nj9CjOU1ZsQHzGsyTHmoXc2b8D0irk_8mqOBOqc9dJ0nTdGQ3V1asLMPkIdJVvlQjnIt8 Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 068087b8e3274eb98dabdb60c8db2368 Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:08.572886 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/068087b8e3274eb98dabdb60c8db2368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_068087b8e3274eb98dabdb60c8db2368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/068087b8e3274eb98dabdb60c8db2368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/068087b8e3274eb98dabdb60c8db2368"}]}] Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 068087b8e3274eb98dabdb60c8db2368 Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersAdminTestJSON-2104095353-project Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 67701a88fc354d4c9ae7d16f8ee1355b Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersAdminTestJSON-2104095353-project Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 could not be found. Aug 29 15:41:08.574291 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '86e619ff-e04f-483a-bbb9-a229dc41fa28'} Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 could not be found. Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:08.575053 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 could not be found. Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 could not be found. Aug 29 15:41:08.576318 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:08.580010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Returning 404 to user: Instance 86e619ff-e04f-483a-bbb9-a229dc41fa28 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:08.581134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc834eb5-b800-450f-a854-47f0cf718d87 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28" status: 404 len: 111 microversion: 2.1 time: 0.051991 Aug 29 15:41:08.586632 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 498/1039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/86e619ff-e04f-483a-bbb9-a229dc41fa28 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:08.594157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c88859c-c62b-42ff-849c-e4f626f0d866 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.595298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2c88859c-c62b-42ff-849c-e4f626f0d866 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.646785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.659577 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6f54cc3e-9fcf-465a-bd1d-b607fbfb1237 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.518820 Aug 29 15:41:08.660590 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 542/1040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:08.670574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.671468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.693715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.694480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.695492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.699868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.700639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.701307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.737132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2c88859c-c62b-42ff-849c-e4f626f0d866 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.746579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2c88859c-c62b-42ff-849c-e4f626f0d866 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.751847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2c88859c-c62b-42ff-849c-e4f626f0d866 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.761436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:08.763315 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2c88859c-c62b-42ff-849c-e4f626f0d866 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1359 microversion: 2.75 time: 0.175532 Aug 29 15:41:08.781845 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 499/1041] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:08.794236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.794975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.805372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.805955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.807221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.808008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.809048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.809903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.911976 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6af4d2fc-c128-4e5b-b66d-6449fa63f49f tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "DELETE /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 204 len: 0 microversion: 2.1 time: 0.247645 Aug 29 15:41:08.913749 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 543/1042] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:08 2022] DELETE /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:08.922752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.924366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.935906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.937228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.937839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.938991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.941121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.941791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.942505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:08.952158 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1d6d787-0c96-4ab2-8b75-8b4ee05744d6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1264 microversion: 2.1 time: 0.168209 Aug 29 15:41:08.969761 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 500/1043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:08.975871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:08.977136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:08.984396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.984980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.985779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:08.986947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:08.987886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:08.989772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.127708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.136500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b97906f4-d59f-4926-91a6-00c379381500 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1308 microversion: 2.1 time: 0.221406 Aug 29 15:41:09.137286 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 544/1044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:09.228718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.238248 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79789742-1a4d-46d0-9e33-1184c19c0a0c tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1470 microversion: 2.1 time: 0.266974 Aug 29 15:41:09.240931 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 501/1045] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:08 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:09.703350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:09.704926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:09.713714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.725147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.725867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.726624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.727121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.727556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.789643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:09.790261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:09.814670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.815100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.815557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.816283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:09.822369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:09.823138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:09.977268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.985657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.987181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:09.992970 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a85a8c7-d862-4060-962f-5fbee42bb25f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1363 microversion: 2.75 time: 0.207975 Aug 29 15:41:09.993541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 502/1046] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:09 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:41:10.003947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.004637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:10.010926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.011441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.011866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.012559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.013007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.013423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.030434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:10.039227 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-485098ac-31ad-4179-8136-15e33ec948f5 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.351949 Aug 29 15:41:10.039806 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 545/1047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:09 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:10.101379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:10.122453 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ecbb8bb4-cd4d-44a4-9bf4-82ba7d68584b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1270 microversion: 2.1 time: 0.127506 Aug 29 15:41:10.123503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 503/1048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:09 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:10.158946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.160209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:10.170229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.171515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.173208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.174515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.175422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.176280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.268215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.269341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:10.291894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=13,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:10.304901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.306482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.307724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.312752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.313573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.314204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.340484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:10.350800 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2cd6a3c7-d0d0-4c78-b69d-3460843e9321 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1488 microversion: 2.1 time: 0.196201 Aug 29 15:41:10.352138 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 546/1049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:10 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1488 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:10.374657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8532c70-7cdb-4efc-80fb-bcafeea08718 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:10.386088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8532c70-7cdb-4efc-80fb-bcafeea08718 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.386587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8532c70-7cdb-4efc-80fb-bcafeea08718 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.387089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8532c70-7cdb-4efc-80fb-bcafeea08718 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.516958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8532c70-7cdb-4efc-80fb-bcafeea08718 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Going to try to stop instance {{(pid=129133) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:41:10.589211 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8532c70-7cdb-4efc-80fb-bcafeea08718 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40/action" status: 202 len: 0 microversion: 2.1 time: 0.218819 Aug 29 15:41:10.593217 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 547/1050] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:10 2022] POST /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:41:10.600122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:10.601081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:10.607925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.608517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.609035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.609816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.610349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.610869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.769111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:10.785208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62759feb-8e0f-46ec-aa62-a1096ca27568 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1470 microversion: 2.1 time: 0.524725 Aug 29 15:41:10.788433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 504/1051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:10 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1470 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:10.943973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:10.951129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4f8ddd14-79e1-46fa-8356-023933e66010 req-90f28534-7dc3-42e9-a26f-aefbf7853033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71066bd-e884-43f0-a85f-071adfa5c80f", "name": "network-vif-plugged", "status": "completed", "tag": "7b0821e2-5394-406e-a429-1524721547a3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:10.954102 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc89b261-43ab-4914-acb6-d30cb5d59099 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.359558 Aug 29 15:41:10.956560 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 548/1052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:10 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:10.965335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4f8ddd14-79e1-46fa-8356-023933e66010 req-90f28534-7dc3-42e9-a26f-aefbf7853033 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:10.966087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4f8ddd14-79e1-46fa-8356-023933e66010 req-90f28534-7dc3-42e9-a26f-aefbf7853033 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:10.966746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4f8ddd14-79e1-46fa-8356-023933e66010 req-90f28534-7dc3-42e9-a26f-aefbf7853033 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:10.979126 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4f8ddd14-79e1-46fa-8356-023933e66010 req-90f28534-7dc3-42e9-a26f-aefbf7853033 service nova] Creating event network-vif-plugged:7b0821e2-5394-406e-a429-1524721547a3 for instance b71066bd-e884-43f0-a85f-071adfa5c80f on n-h2-836830-13 Aug 29 15:41:10.986845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4f8ddd14-79e1-46fa-8356-023933e66010 req-90f28534-7dc3-42e9-a26f-aefbf7853033 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039592 Aug 29 15:41:10.987753 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 505/1053] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:11.017800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.019215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.026813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.027676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.028312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.029379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.030036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.030939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.062371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.063324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.076592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.077101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.079587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.081458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.083829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.085052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.216370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.237978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.244041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.256442 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2586d199-262c-456a-9b8a-b0eba7349e2c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1411 microversion: 2.75 time: 0.242662 Aug 29 15:41:11.267398 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 549/1054] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1411 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:11.279467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.280090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.296928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.297521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.297852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.298556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.299007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.299460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.437114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.454831 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97f69b56-886c-4f5f-9a33-2d5e49770e0a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1270 microversion: 2.1 time: 0.191700 Aug 29 15:41:11.455464 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 550/1055] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1270 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:11.463726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f3f14226-fca4-4510-8642-8312680d4424 req-298a1679-1f35-4d32-905e-b93424a9fee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ecae4f-8a73-4f39-be3f-da87823b9d94", "name": "network-vif-deleted", "tag": "0e4dbec9-a639-455d-9630-3a4e82a180c1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:11.491101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3f14226-fca4-4510-8642-8312680d4424 req-298a1679-1f35-4d32-905e-b93424a9fee1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.491711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3f14226-fca4-4510-8642-8312680d4424 req-298a1679-1f35-4d32-905e-b93424a9fee1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.492401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3f14226-fca4-4510-8642-8312680d4424 req-298a1679-1f35-4d32-905e-b93424a9fee1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.494689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.506905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c7fbbb4d-5b32-4410-b221-558c6f415e24 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.449103 Aug 29 15:41:11.507595 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 506/1056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:11.522662 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f3f14226-fca4-4510-8642-8312680d4424 req-298a1679-1f35-4d32-905e-b93424a9fee1 service nova] Creating event network-vif-deleted:0e4dbec9-a639-455d-9630-3a4e82a180c1 for instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 on n-h1-836830-13 Aug 29 15:41:11.531157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f3f14226-fca4-4510-8642-8312680d4424 req-298a1679-1f35-4d32-905e-b93424a9fee1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074448 Aug 29 15:41:11.531998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 551/1057] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:11.806318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.806938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.813627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.814118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.814584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.815328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.815787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.816213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.853458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.853929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.854360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.854809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lazy-loading 'fault' on Instance uuid 79ecae4f-8a73-4f39-be3f-da87823b9d94 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:11.904805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:11.913005 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5044f14a-83f0-4df9-9f64-4b2b705a7ca0 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1304 microversion: 2.1 time: 0.110482 Aug 29 15:41:11.927342 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 507/1058] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:11.978381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:11.979284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:11.986157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.987006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.987904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:11.988833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:11.990049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:11.990695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.146433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.155425 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f349d446-2f71-43ae-8aad-d04cdc6032de tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.183151 Aug 29 15:41:12.155999 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 552/1059] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:11 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:12.287383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.288119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:12.295548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.296370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.297078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.297779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.298235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.298653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.414760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.433210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.436013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.450794 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-35c6af55-9992-4202-ac9a-706a236132b0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1417 microversion: 2.75 time: 0.165462 Aug 29 15:41:12.463100 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 508/1060] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1417 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:12.477932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.478751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:12.485601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.486332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.486938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.487825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.488425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.489712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.514116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:12.529521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.530130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:12.537022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.537721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.538336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.539211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.539809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.540413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.727152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.739596 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1678b6ba-6fc1-4abd-ba3d-944ff9e857be tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.264671 Aug 29 15:41:12.756264 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 553/1061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:12.761547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a0f5f625-e65e-4b5c-bee0-219e8cd0d93d req-735b5c90-e6cd-47f3-8127-a3bc0abd1076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4655c40-ac22-4aff-b255-ade7df5360e4", "tag": "637658fb-18e7-4845-b4a4-d6913e7b26a6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:12.783652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a0f5f625-e65e-4b5c-bee0-219e8cd0d93d req-735b5c90-e6cd-47f3-8127-a3bc0abd1076 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.785329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a0f5f625-e65e-4b5c-bee0-219e8cd0d93d req-735b5c90-e6cd-47f3-8127-a3bc0abd1076 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.786477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a0f5f625-e65e-4b5c-bee0-219e8cd0d93d req-735b5c90-e6cd-47f3-8127-a3bc0abd1076 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.789568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:12.798561 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-768714a8-5678-41f4-b2dd-bab1d1113259 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1322 microversion: 2.1 time: 0.272713 Aug 29 15:41:12.799610 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 509/1062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:12.805300 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a0f5f625-e65e-4b5c-bee0-219e8cd0d93d req-735b5c90-e6cd-47f3-8127-a3bc0abd1076 service nova] Creating event network-changed:637658fb-18e7-4845-b4a4-d6913e7b26a6 for instance b4655c40-ac22-4aff-b255-ade7df5360e4 on n-h2-836830-13 Aug 29 15:41:12.812239 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a0f5f625-e65e-4b5c-bee0-219e8cd0d93d req-735b5c90-e6cd-47f3-8127-a3bc0abd1076 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054413 Aug 29 15:41:12.814026 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 554/1063] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:12.936506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:12.937432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:12.944633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.945249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.946930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.948473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.949297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.950453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.961403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:12.993809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:12.994473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:12.995013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:12.995623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lazy-loading 'fault' on Instance uuid 79ecae4f-8a73-4f39-be3f-da87823b9d94 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:13.053398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67701a88fc354d4c9ae7d16f8ee1355b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '068087b8e3274eb98dabdb60c8db2368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.062160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08642611-b4f0-4eb2-b9ee-6363aedc7598 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 200 len: 1304 microversion: 2.1 time: 0.130171 Aug 29 15:41:13.062737 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 510/1064] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:12 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:13.178134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.179059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:13.185947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.186434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.187080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.188008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.188464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.188890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.355154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.363173 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-205a9022-cd30-4cc3-aed0-1a57a57c8dc7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.190181 Aug 29 15:41:13.364787 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 555/1065] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:13 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:13.479041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.479879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:13.486695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.487325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.487832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.488601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.489940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.490809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.649210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.658231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.659909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.687827 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-243ecc1a-5103-4ade-8454-c2554652b8a8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1417 microversion: 2.75 time: 0.210119 Aug 29 15:41:13.688977 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 511/1066] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:13 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1417 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:13.763761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.764483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:13.771985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.772771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.773282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.774082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.774785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.775594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.821719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:13.822506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:13.836574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.838022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.838837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.839976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:13.843052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:13.844312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:13.974465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:13.984290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-350644f8-6d06-4411-9e10-672976e92501 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.224435 Aug 29 15:41:13.984871 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 556/1067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:13 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:14.086773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:14.087668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] [instance: 79ecae4f-8a73-4f39-be3f-da87823b9d94] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:14.095082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.095849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.096387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.097140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.097898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.099283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.104210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=25,nova_cell0:UPDATE=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:14.120122 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] HTTP exception thrown: Instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 could not be found. Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Request method failure captured: Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 HTTP/1.1 Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2ckOO7M1_76pr8Aq10HcWW-y0UNc37yQKGQGYcHDDeEi1-A0MvDXdGj4cKKUUTP9qryLMniQZJ8UWW_M3OGfQJDnVZpUNYHvUyGNtji1Nj9CjOU1ZsQHzGsyTHmoXc2b8D0irk_8mqOBOqc9dJ0nTdGQ3V1asLMPkIdJVvlQjnIt8 Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 068087b8e3274eb98dabdb60c8db2368 Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:41:14.122136 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/068087b8e3274eb98dabdb60c8db2368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_068087b8e3274eb98dabdb60c8db2368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/068087b8e3274eb98dabdb60c8db2368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/068087b8e3274eb98dabdb60c8db2368"}]}] Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 068087b8e3274eb98dabdb60c8db2368 Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdminTestJSON-2104095353 Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdminTestJSON-2104095353-project Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 67701a88fc354d4c9ae7d16f8ee1355b Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdminTestJSON-2104095353-project Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 could not be found. Aug 29 15:41:14.123758 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '79ecae4f-8a73-4f39-be3f-da87823b9d94'} Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 could not be found. Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:14.124740 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 could not be found. Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 could not be found. Aug 29 15:41:14.126295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:14.129461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] Returning 404 to user: Instance 79ecae4f-8a73-4f39-be3f-da87823b9d94 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:14.131219 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0454b40-6045-4a6b-94b9-195663497043 tempest-ServersAdminTestJSON-2104095353 tempest-ServersAdminTestJSON-2104095353-project] 10.222.0.83 "GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94" status: 404 len: 111 microversion: 2.1 time: 0.050410 Aug 29 15:41:14.132498 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 557/1068] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:14 2022] GET /compute/v2.1/servers/79ecae4f-8a73-4f39-be3f-da87823b9d94 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:14.160169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:14.171010 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dc203a3d-5037-440d-8f19-ae72e1b61b07 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1472 microversion: 2.1 time: 0.354249 Aug 29 15:41:14.172470 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 512/1069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:13 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:14.196444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:14.196994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:14.209654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.210253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.211160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.212157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.213073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.213762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.240290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lazy-loading 'flavor' on Instance uuid b71066bd-e884-43f0-a85f-071adfa5c80f {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:14.353046 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc96e745-0699-4eaf-b1f8-6ff98d507197 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f/action" status: 202 len: 0 microversion: 2.1 time: 0.141682 Aug 29 15:41:14.353822 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 558/1070] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:14 2022] POST /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:14.362113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:14.363085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:14.379162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.380552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.381574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.382486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.383158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.383753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.392792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:14.393788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:14.417288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.418939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.422153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.426247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.429215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.429924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.690431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:14.698988 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37c44e3f-171d-494b-bffd-4fd325152294 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.315717 Aug 29 15:41:14.699656 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 559/1071] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:14 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:14.717699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:14.718447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:14.726760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.727675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.728254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.729191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.729769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.730473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.818464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:14.830603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:14.832225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:14.839355 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6117d45c-9c64-4a42-aa1d-7f5b4c5b3523 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1438 microversion: 2.75 time: 0.125942 Aug 29 15:41:14.839966 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 560/1072] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:14 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:41:14.869743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:14.872624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:14.879169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.880138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.880960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.881929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:14.882546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:14.883151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:14.994751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:14.995378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:14.995905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:14.996549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:14.996991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:15.073694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.077242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:UPDATE=11,nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:15.081774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.082269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.082963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.083883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.084502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.085114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.135657 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-160cbf96-fa1c-4613-b76a-f2d1d72c5012 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1633 microversion: 2.1 time: 0.777249 Aug 29 15:41:15.138368 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 513/1073] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:14 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1633 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:15.147362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:15.149872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.164931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.170000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.170710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.173173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.173886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.174548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.251672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.264703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.266178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.273618 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a620e23-5437-4c81-ac16-ea5cd195c0bb tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "POST /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0/action" status: 202 len: 1495 microversion: 2.75 time: 0.408657 Aug 29 15:41:15.287471 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 561/1074] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:41:14 2022] POST /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0/action => generated 1495 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:41:15.322063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:15.322926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.341814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.342582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.343347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.344217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.344873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.345440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.453775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.463680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.466027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.474274 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-14bfec49-ad7b-4c5c-a0fd-ffa672436aae tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.166288 Aug 29 15:41:15.476173 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 562/1075] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:15 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:15.720646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:15.721668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:15.729019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.729773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.730384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.731133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:15.731597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:15.732028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:15.863237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.872019 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-445c0546-41a9-4b91-a118-8a2e0b448661 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.732447 Aug 29 15:41:15.886287 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 514/1076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:15 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:15.986011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:15.995317 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a35b549-29de-4ed0-b29b-89374d3e3171 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.278446 Aug 29 15:41:15.996410 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 563/1077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:15 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:16.158008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:16.158806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:16.166453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.166906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.167380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.168148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.168614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.169044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.343621 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29525da6-840b-4684-bed0-b187d3d586ca tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1633 microversion: 2.1 time: 0.189653 Aug 29 15:41:16.356449 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 515/1078] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:16 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1633 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:16.502254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:16.502854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:16.509722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.512597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.513071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.513779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.515287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.516348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.618112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:16.626463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:16.628188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:16.635265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-adccf246-0bbd-4da5-a7a4-65a6a932b32f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.136810 Aug 29 15:41:16.636550 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 564/1079] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:16 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:16.900401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:16.903150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:16.913342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.915824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.916649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:16.917950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:16.919300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:16.920958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.016597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:17.017468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.030757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.034282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.035169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.038464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.039167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.039599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.123718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.133025 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aafa0d19-e729-472e-bf12-ab334063cc9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.241543 Aug 29 15:41:17.133820 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 516/1080] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:16 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:17.350444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.371357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:17.372472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.392220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b39c314c-46ba-41ad-a3b9-47f2141eed87 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.379244 Aug 29 15:41:17.394487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.394637 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 565/1081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:17 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:17.399622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.400145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.400893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.403465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.403914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.664606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:17.665973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:17.677047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.678035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.680373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.683460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:17.684590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:17.685255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:17.809516 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39e9da3a-0847-45ca-b194-a037d92ac277 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1633 microversion: 2.1 time: 0.446235 Aug 29 15:41:17.810018 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 517/1082] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:17 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1633 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:17.842129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.859624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.861298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:17.868929 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-00e13f1c-df99-4ce0-88cb-9647d31cf801 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.211079 Aug 29 15:41:17.870042 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 566/1083] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:17 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:18.154357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:18.155507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:18.165458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.165959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.166577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.167494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.168117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.168877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.266009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:18.415400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:18.416208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:18.426361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.426634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:18.428742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.429383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.436840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.437503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.438115 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd8b7807-9bd1-46c8-b7df-2d859b5dd8d8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.288057 Aug 29 15:41:18.438258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.445547 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 518/1084] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:18 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:18.473172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:18.773604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:18.791557 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f89706c-d066-4fd9-9982-92f596f45c09 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.380314 Aug 29 15:41:18.805391 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 567/1085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:18 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:18.834430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:18.835978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:18.842745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=30 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:18.844628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.845341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.845956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.846854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.848203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.848644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.900788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:18.901427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:18.918819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.919350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.919793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:18.926154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:18.930517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:18.931565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.040034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:19.059622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:19.072880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:19.096874 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5804b24d-9f29-48bd-ae29-d63786ee1d50 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.201751 Aug 29 15:41:19.099789 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 568/1086] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:18 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:19.274396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36629594-8449-4730-8ae5-30d756442f72 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1616 microversion: 2.1 time: 0.444515 Aug 29 15:41:19.276724 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 519/1087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:18 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1616 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:19.297409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:19.298140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:19.310900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.313987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.314855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.317685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.319587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.320930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.431281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] HTTP exception thrown: Cannot 'migrate' instance b71066bd-e884-43f0-a85f-071adfa5c80f while it is in vm_state suspended Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Request method failure captured: Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f/action HTTP/1.1 Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 15 Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3vyG48bZEz0y3aVs4cWiGm8pCllzfcnKDxRL6APl0up6jwzJgw9BrX8hshxPePpcLNa_WWZO7ObhKa4aUKaYv8bkVfppp5GnN5KPegoAwxxPF_CIr16us-XItlxX_IcG4_GK8V06TlVBryfwZfFd0mpQAYKb6fVtBnOtZhcpaj5uM Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:41:19.433389 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b85774c4058e41039e37bf970208d1df", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b85774c4058e41039e37bf970208d1df"}]}] Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: b707e515afc149219025d224fe1df8e0 Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: {"migrate": {}} Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:41:19.434895 n-d-836830-13 devstack@n-api.service[129133]: exception: Cannot 'migrate' instance b71066bd-e884-43f0-a85f-071adfa5c80f while it is in vm_state suspended Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b71066bd-e884-43f0-a85f-071adfa5c80f', 'body': {'migrate': {}}} Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b71066bd-e884-43f0-a85f-071adfa5c80f in vm_state suspended. Cannot resize while the instance is in this state. Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.435928 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b71066bd-e884-43f0-a85f-071adfa5c80f while it is in vm_state suspended Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.437514 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.439218 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:19.439218 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:19.439218 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b71066bd-e884-43f0-a85f-071adfa5c80f while it is in vm_state suspended Aug 29 15:41:19.439218 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.440591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Returning 409 to user: Cannot 'migrate' instance b71066bd-e884-43f0-a85f-071adfa5c80f while it is in vm_state suspended {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:19.441681 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-16425ea0-5ab8-4c52-beb0-29154c904e42 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f/action" status: 409 len: 148 microversion: 2.1 time: 0.149691 Aug 29 15:41:19.442801 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 569/1088] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:19 2022] POST /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f/action => generated 148 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:19.457869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-308ababd-e00e-4953-b84b-4c9119520e20 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-308ababd-e00e-4953-b84b-4c9119520e20 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Request method failure captured: Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708/action HTTP/1.1 Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 39 Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3vyG48bZEz0y3aVs4cWiGm8pCllzfcnKDxRL6APl0up6jwzJgw9BrX8hshxPePpcLNa_WWZO7ObhKa4aUKaYv8bkVfppp5GnN5KPegoAwxxPF_CIr16us-XItlxX_IcG4_GK8V06TlVBryfwZfFd0mpQAYKb6fVtBnOtZhcpaj5uM Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:41:19.462420 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b85774c4058e41039e37bf970208d1df", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b85774c4058e41039e37bf970208d1df"}]}] Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: b707e515afc149219025d224fe1df8e0 Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: {"os-resetState": {"state": "invalid"}} Aug 29 15:41:19.464305 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd305b112-5285-4873-85ce-040157c62708', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.465159 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:19.466626 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 29 15:41:19.467967 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.468744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-308ababd-e00e-4953-b84b-4c9119520e20 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:19.471619 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-308ababd-e00e-4953-b84b-4c9119520e20 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708/action" status: 400 len: 144 microversion: 2.1 time: 0.017588 Aug 29 15:41:19.472685 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 570/1089] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:19 2022] POST /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:41:19.478030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.479194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:19.487330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.488033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.488787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.490239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.491163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.491754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.621537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b45208f7-0752-46ef-be3c-b234864d4955 tempest-FloatingIPDetailsNegativeTestJSON-1396753783 tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project] Calling method '.version_select at 0x7f32ee7c7820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.677143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:19.685731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-b45208f7-0752-46ef-be3c-b234864d4955 tempest-FloatingIPDetailsNegativeTestJSON-1396753783 tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e2e203b3-229b-410c-8bcf-4cd478efc5b6 could not be found", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:41:19.686961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-203d6e50-9f8e-46b7-93fb-6a78fee0996c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.212353 Aug 29 15:41:19.688280 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 571/1090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:19 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:19.688458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b45208f7-0752-46ef-be3c-b234864d4955 tempest-FloatingIPDetailsNegativeTestJSON-1396753783 tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project] HTTP exception thrown: Floating IP not found for ID e2e203b3-229b-410c-8bcf-4cd478efc5b6 Aug 29 15:41:19.695697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63479813-0650-4fe7-b97e-b7fd5fc51b2d tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63479813-0650-4fe7-b97e-b7fd5fc51b2d tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Request method failure captured: Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708/action HTTP/1.1 Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 31 Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3vyG48bZEz0y3aVs4cWiGm8pCllzfcnKDxRL6APl0up6jwzJgw9BrX8hshxPePpcLNa_WWZO7ObhKa4aUKaYv8bkVfppp5GnN5KPegoAwxxPF_CIr16us-XItlxX_IcG4_GK8V06TlVBryfwZfFd0mpQAYKb6fVtBnOtZhcpaj5uM Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:41:19.699891 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b85774c4058e41039e37bf970208d1df", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b85774c4058e41039e37bf970208d1df"}]}] Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: b707e515afc149219025d224fe1df8e0 Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: {"os-resetState": {"state": 1}} Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:41:19.701287 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd305b112-5285-4873-85ce-040157c62708', 'body': {'os-resetState': {'state': 1}}} Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 1 Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:19.702065 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 29 15:41:19.703409 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b45208f7-0752-46ef-be3c-b234864d4955 tempest-FloatingIPDetailsNegativeTestJSON-1396753783 tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project] Request method failure captured: Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-floating-ips/e2e203b3-229b-410c-8bcf-4cd478efc5b6 HTTP/1.1 Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN4f41bWgPa3SNpYI4EcySwkdnSQC-CtP8MiVdy4VmGuRckc1f3y9bQB94KcYmrUkdDYIDDSaKpruP878OfWNBQ948r9WnaEP6smVLfBGAtT7X-l9c3qWTJhZHd2_eUktb4thJufHMIuHfEW9r2V3xJ3ZTtHLrFR_ePrV3qROVZMVOk Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: f9db9f6ebf0b495a8bb1f85dc8fad7be Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1396753783 Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:19.707731 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f9db9f6ebf0b495a8bb1f85dc8fad7be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f9db9f6ebf0b495a8bb1f85dc8fad7be", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f9db9f6ebf0b495a8bb1f85dc8fad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f9db9f6ebf0b495a8bb1f85dc8fad7be"}]}] Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1396753783 Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: f9db9f6ebf0b495a8bb1f85dc8fad7be Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1396753783 Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 65a196bbedec4627be79cc71193843d8 Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: exception: Floating IP not found for ID e2e203b3-229b-410c-8bcf-4cd478efc5b6 Aug 29 15:41:19.709507 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e2e203b3-229b-410c-8bcf-4cd478efc5b6'} Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:19.710694 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e2e203b3-229b-410c-8bcf-4cd478efc5b6 could not be found Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-502ec1fa-65e4-4a63-b660-91148a19b63d'] Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e2e203b3-229b-410c-8bcf-4cd478efc5b6. Aug 29 15:41:19.718089 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e2e203b3-229b-410c-8bcf-4cd478efc5b6 Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.721113 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:19.725433 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:19.725433 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e2e203b3-229b-410c-8bcf-4cd478efc5b6 Aug 29 15:41:19.725433 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.725433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b45208f7-0752-46ef-be3c-b234864d4955 tempest-FloatingIPDetailsNegativeTestJSON-1396753783 tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project] Returning 404 to user: Floating IP not found for ID e2e203b3-229b-410c-8bcf-4cd478efc5b6 {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:19.725433 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b45208f7-0752-46ef-be3c-b234864d4955 tempest-FloatingIPDetailsNegativeTestJSON-1396753783 tempest-FloatingIPDetailsNegativeTestJSON-1396753783-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips/e2e203b3-229b-410c-8bcf-4cd478efc5b6" status: 404 len: 111 microversion: 2.1 time: 0.311611 Aug 29 15:41:19.725433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 520/1091] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:19 2022] GET /compute/v2.1/os-floating-ips/e2e203b3-229b-410c-8bcf-4cd478efc5b6 => generated 111 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:19.726272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63479813-0650-4fe7-b97e-b7fd5fc51b2d tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:19.726272 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-63479813-0650-4fe7-b97e-b7fd5fc51b2d tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708/action" status: 400 len: 120 microversion: 2.1 time: 0.021833 Aug 29 15:41:19.726272 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 572/1092] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:19 2022] POST /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708/action => generated 120 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:19.727962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7917e19e-c276-41a9-a9cd-c40ce33be822 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:19.733610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7917e19e-c276-41a9-a9cd-c40ce33be822 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Failed to fetch instance by id 999 {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:41:19.733610 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-7917e19e-c276-41a9-a9cd-c40ce33be822 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7917e19e-c276-41a9-a9cd-c40ce33be822 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Request method failure captured: Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 37 Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN3vyG48bZEz0y3aVs4cWiGm8pCllzfcnKDxRL6APl0up6jwzJgw9BrX8hshxPePpcLNa_WWZO7ObhKa4aUKaYv8bkVfppp5GnN5KPegoAwxxPF_CIr16us-XItlxX_IcG4_GK8V06TlVBryfwZfFd0mpQAYKb6fVtBnOtZhcpaj5uM Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:41:19.736286 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b85774c4058e41039e37bf970208d1df", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b85774c4058e41039e37bf970208d1df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b85774c4058e41039e37bf970208d1df"}]}] Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b85774c4058e41039e37bf970208d1df Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1316321010 Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: b707e515afc149219025d224fe1df8e0 Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1316321010-project-admin Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: {"os-resetState": {"state": "error"}} Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:41:19.737564 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 999 could not be found. Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:19.738348 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7917e19e-c276-41a9-a9cd-c40ce33be822 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:19.742432 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7917e19e-c276-41a9-a9cd-c40ce33be822 tempest-ServersAdminNegativeTestJSON-1316321010 tempest-ServersAdminNegativeTestJSON-1316321010-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.015058 Aug 29 15:41:19.744630 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 521/1093] 10.222.0.83 () {60 vars in 1179 bytes} [Mon Aug 29 15:41:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:19.750778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.753062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:19.763541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.765041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.765730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.766635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.767309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.767762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.804910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:19.818401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.819015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:19.834877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.836913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.838382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.841359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.841853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.842285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.912086 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d02a6da-ae59-4f12-9364-48e0abde9c7e tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 204 len: 0 microversion: 2.1 time: 0.164012 Aug 29 15:41:19.912737 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 573/1094] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:19 2022] DELETE /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:19.924721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:19.925604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:19.932487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.933004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.933435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:19.934247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:19.934639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:19.935100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.182179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.193549 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bfa2db38-cd2f-44f4-9016-e5e3f245484c tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1469 microversion: 2.1 time: 0.274552 Aug 29 15:41:20.194894 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 574/1095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:19 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:20.211746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:20.212367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:20.218741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.219294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.219710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.220417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.220875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.221296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.344762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.360339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.361835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.374437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.374667 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f22c0fa-288d-4a13-b5cb-42ab592110e3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.178047 Aug 29 15:41:20.375092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 575/1096] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:20 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:20.386707 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ae45af3-b4e3-4df7-9f95-b656ebb1ca9b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.574049 Aug 29 15:41:20.387327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 522/1097] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:19 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:20.710929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:20.711582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:20.718106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.718606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.719071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.719765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:20.720475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:20.721114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:20.903571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:20.918704 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-310c6f0f-bb4c-4246-b9ac-206ec07d0d62 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.206958 Aug 29 15:41:20.919605 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 576/1098] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:20 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:21.215655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:21.216861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:21.228368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.228874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.229315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.230033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.230494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.230922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.410043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:21.414183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:21.431418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.431912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.435054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.439965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.440482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.440921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.538419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:21.549126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:21.553528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:21.561287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2fb4a7da-af67-46aa-8622-175a42bb74a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.163088 Aug 29 15:41:21.561920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 577/1099] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:21 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:21.580379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:21.581184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:21.588050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.588530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.588956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.591874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.592763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.592763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.739580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:21.765251 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71cb1e15-6c29-4949-96e3-03eeab6828e2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1469 microversion: 2.1 time: 0.553325 Aug 29 15:41:21.765863 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 523/1100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:21 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1469 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:21.834652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:21.846457 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53389d88-8539-4d18-b874-e8c66b64b2cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.283153 Aug 29 15:41:21.847866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 578/1101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:21 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:21.915567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-dffefb97-aa9a-42c5-b99a-fb70ff52d986 req-a6c06a34-9cd0-4330-8408-f80b130b1bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4655c40-ac22-4aff-b255-ade7df5360e4", "name": "network-vif-plugged", "status": "completed", "tag": "637658fb-18e7-4845-b4a4-d6913e7b26a6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:21.941145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:21.944029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:21.950078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dffefb97-aa9a-42c5-b99a-fb70ff52d986 req-a6c06a34-9cd0-4330-8408-f80b130b1bbd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.950487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.950619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dffefb97-aa9a-42c5-b99a-fb70ff52d986 req-a6c06a34-9cd0-4330-8408-f80b130b1bbd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.950985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dffefb97-aa9a-42c5-b99a-fb70ff52d986 req-a6c06a34-9cd0-4330-8408-f80b130b1bbd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.951136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.951592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.952353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:21.952877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:21.953363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:21.983310 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-dffefb97-aa9a-42c5-b99a-fb70ff52d986 req-a6c06a34-9cd0-4330-8408-f80b130b1bbd service nova] Creating event network-vif-plugged:637658fb-18e7-4845-b4a4-d6913e7b26a6 for instance b4655c40-ac22-4aff-b255-ade7df5360e4 on n-h2-836830-13 Aug 29 15:41:22.001839 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-dffefb97-aa9a-42c5-b99a-fb70ff52d986 req-a6c06a34-9cd0-4330-8408-f80b130b1bbd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094858 Aug 29 15:41:22.002996 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 524/1102] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:22.131730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:22.140906 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0c1617a0-1bd5-40d9-8693-258a93b0df0c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.204174 Aug 29 15:41:22.141484 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 579/1103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:21 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:22.588383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:22.589092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:22.607679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.608390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.608989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.609882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.610499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.611107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.783801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:22.793911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:22.798093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:22.808724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.810451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.811219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.812214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.812895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.813540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.828131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:22.829982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:22.839331 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce3b65fe-b7f5-41b8-a11f-a94b2e4840a7 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.256210 Aug 29 15:41:22.851911 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 525/1104] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:22 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:22.871692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:22.872396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:22.894376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.894868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.895362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:22.896195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:22.896653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:22.897078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.102624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:23.112445 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-325e48ab-d6d5-403b-994c-208692aaf37d tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1469 microversion: 2.1 time: 0.327147 Aug 29 15:41:23.118673 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 580/1105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:22 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:23.162822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:23.163807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:23.177471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.178276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.178911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.179851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.181308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.182279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.289610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:23.297878 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21077c67-2314-40b7-a64e-bed9afb454cb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.431494 Aug 29 15:41:23.328937 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 526/1106] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:22 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:23.516775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:23.536174 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-21f9e3d2-82c9-4596-9f3b-77fa57d6862b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.378028 Aug 29 15:41:23.536799 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 581/1107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:23 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:23.866728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:23.867570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:23.876920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.877880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.878554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:23.880491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:23.881325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:23.881970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.010866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1b8a576f-f6c6-48ad-b584-f248cd202c25 req-885687c5-eafb-484a-b9c2-25159fcbd461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71066bd-e884-43f0-a85f-071adfa5c80f", "name": "network-vif-deleted", "tag": "7b0821e2-5394-406e-a429-1524721547a3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:24.013130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:24.027454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:24.031073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:24.034390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1b8a576f-f6c6-48ad-b584-f248cd202c25 req-885687c5-eafb-484a-b9c2-25159fcbd461 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.034879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1b8a576f-f6c6-48ad-b584-f248cd202c25 req-885687c5-eafb-484a-b9c2-25159fcbd461 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.035337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1b8a576f-f6c6-48ad-b584-f248cd202c25 req-885687c5-eafb-484a-b9c2-25159fcbd461 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.045834 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-63160217-d8b8-4fdb-8069-2be0c5745484 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.184978 Aug 29 15:41:24.049711 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 527/1108] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:23 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:24.067312 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1b8a576f-f6c6-48ad-b584-f248cd202c25 req-885687c5-eafb-484a-b9c2-25159fcbd461 service nova] Creating event network-vif-deleted:7b0821e2-5394-406e-a429-1524721547a3 for instance b71066bd-e884-43f0-a85f-071adfa5c80f on n-h2-836830-13 Aug 29 15:41:24.075421 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1b8a576f-f6c6-48ad-b584-f248cd202c25 req-885687c5-eafb-484a-b9c2-25159fcbd461 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068404 Aug 29 15:41:24.080613 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 582/1109] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:24.140539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.141160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.163986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.164465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.164900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.165615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.167960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.169387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.325243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.329724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.339143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.339648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.340077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.340790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.341242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.341670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.376254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:24.393993 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe4ede2c-f0a7-4a0e-adc5-498b9d7a8eca tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1427 microversion: 2.1 time: 0.256961 Aug 29 15:41:24.394643 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 528/1110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1427 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:24.557478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:24.558355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:24.566337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.579185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.579628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.580367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:24.580813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:24.582283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:24.596568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:24.975712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:24.986816 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-176c8d29-70dd-4046-a82d-497b674903db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1312 microversion: 2.1 time: 0.433103 Aug 29 15:41:24.991719 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 529/1111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:25.079123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.080295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:25.087297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.087995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.088629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.089533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.090302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.090923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.160707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.168894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-db802382-4dd0-4079-a05c-99b8b62dc0c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.850258 Aug 29 15:41:25.189422 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 583/1112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:24 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:25.220412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.232041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.234199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.278100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-27d233a3-dcc7-465c-ad88-2c8bbe24faf4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.201201 Aug 29 15:41:25.284134 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 530/1113] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:25 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:25.419587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:25.420269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:25.441023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.441526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.444994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.446019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.446858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.447671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.524404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:25.524921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:25.525580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:25.526045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lazy-loading 'fault' on Instance uuid b71066bd-e884-43f0-a85f-071adfa5c80f {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:25.625196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:25.638738 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a67c84f-b880-4bda-ab70-37bad0ab2c34 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 200 len: 1312 microversion: 2.1 time: 0.223828 Aug 29 15:41:25.639709 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 584/1114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:25 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:26.017351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.018505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.033107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.033617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.034062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.047759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.048602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.050121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.208842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.209763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.220656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.222707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.230342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.231407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.232101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.233506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.238531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:26.360297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.390394 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a1be484-10b9-463b-9a30-0469d1af47db tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1461 microversion: 2.1 time: 0.383733 Aug 29 15:41:26.408567 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 531/1115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1461 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:26.463552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.475755 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f9dcf41c-f4a1-4eb8-8f90-dda27fe9318b tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.277214 Aug 29 15:41:26.479330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 585/1116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:26.491984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:26.498240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.513342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.521317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.522194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.523189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.523975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.524399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.654667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f783d4e-fc11-4eee-b0ca-4997c77f0fe4 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Action: 'create', calling method: .version_select at 0x7f32ee8df9d0>, body: {"pool": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:26.737544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.756954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.761865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:26.785839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-55115307-abcd-4751-8c77-2807926920b6 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.305121 Aug 29 15:41:26.786436 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 586/1117] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:26 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:26.791456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:26.793659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:26.810500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.810989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.811446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:26.812139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:26.812585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:26.813002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.017758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:27.032516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Old instance type m1.heat2, new instance type m1.heat {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:41:27.062968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:27.063600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:27.064080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:27.064493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:27.064908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:27.308961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a957150f-0012-43c7-a0b5-21056094aebf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4/action" status: 202 len: 0 microversion: 2.1 time: 0.520839 Aug 29 15:41:27.310669 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 587/1118] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:26 2022] POST /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:27.337604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.347206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: b71066bd-e884-43f0-a85f-071adfa5c80f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.357501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.358244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.358843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.359725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.360330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.360932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.382270 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] HTTP exception thrown: Instance b71066bd-e884-43f0-a85f-071adfa5c80f could not be found. Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Request method failure captured: Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f HTTP/1.1 Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN3t3IMnLEFHvQ8uvSksk_PyxfMeh-UlCGcTErivGzffUMqyf8N77Imd3ZAncRyb-i9vOm4zRR6YajX15-bflhavZPj6noGC42ovezQwF-efaxC4SFz_kKnTYwqdA-fU4jvLayIOQ2ifru43650jS334Why72xMS4mjPa5RYxpZVvEE Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 936fa60fa7e24fd9b9014521544670dc Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1118586876 Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:41:27.384904 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/936fa60fa7e24fd9b9014521544670dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_936fa60fa7e24fd9b9014521544670dc", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/936fa60fa7e24fd9b9014521544670dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/936fa60fa7e24fd9b9014521544670dc"}]}] Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1118586876 Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 936fa60fa7e24fd9b9014521544670dc Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1118586876 Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdminNegativeTestJSON-1118586876-project Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: cd46d7afd06f41c2a09132a349aa3fd4 Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1118586876-project Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b71066bd-e884-43f0-a85f-071adfa5c80f could not be found. Aug 29 15:41:27.386277 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b71066bd-e884-43f0-a85f-071adfa5c80f'} Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71066bd-e884-43f0-a85f-071adfa5c80f could not be found. Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:27.387001 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71066bd-e884-43f0-a85f-071adfa5c80f could not be found. Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71066bd-e884-43f0-a85f-071adfa5c80f could not be found. Aug 29 15:41:27.388502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:27.391280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Returning 404 to user: Instance b71066bd-e884-43f0-a85f-071adfa5c80f could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:27.392536 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e9463704-3b67-491f-aae3-b7f7a009e6a7 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f" status: 404 len: 111 microversion: 2.1 time: 0.080291 Aug 29 15:41:27.399617 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 588/1119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:27 2022] GET /compute/v2.1/servers/b71066bd-e884-43f0-a85f-071adfa5c80f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:27.405945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.406788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.415748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.416492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.417147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.418060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.418811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.419553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.712149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:27.723840 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5280c66c-f0d0-4545-9ca0-8aea4b42f779 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1470 microversion: 2.1 time: 0.322332 Aug 29 15:41:27.724693 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 589/1120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:27 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1470 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:27.742068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.742935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.750340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.751332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.751944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.753028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.753668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.754509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.789413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:41:27.921768 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a6781ac-cac2-402f-bdef-f3e237d9cfb2 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 204 len: 0 microversion: 2.1 time: 0.195706 Aug 29 15:41:27.927269 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 590/1121] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:27 2022] DELETE /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:27.932950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:27.933827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:27.940984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.941457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.941696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:27.943061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:27.943841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:27.944274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.287255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.297074 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6eaf787-0213-45e6-a507-3b0ba085d386 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.368259 Aug 29 15:41:28.298314 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 591/1122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:27 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:28.318125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.318967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:28.325773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.326379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.326882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.327873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.328551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.329210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.414346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.423776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.427878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.435281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4c4c0bd-1b46-418a-b717-150265a975ed tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.122877 Aug 29 15:41:28.437254 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 592/1123] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:28.444910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.450182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:28.465072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.465574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.470316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.471318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.471817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.472256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.771876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:28.779994 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1ac83d6-3e22-442f-9ec5-41eaaa634c7b tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1478 microversion: 2.1 time: 0.341634 Aug 29 15:41:28.781455 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 593/1124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1478 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:28.786906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:28.788093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:28.798408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.799210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.800747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:28.802693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:28.803440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:28.804283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.009598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.029850 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76c7ab70-731e-4f9a-9b52-1f537c88d093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1470 microversion: 2.1 time: 0.247013 Aug 29 15:41:29.031157 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 594/1125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:28 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:29.182892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f783d4e-fc11-4eee-b0ca-4997c77f0fe4 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.766972 Aug 29 15:41:29.183534 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 532/1126] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:41:26 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:29.206755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a7f9588-1617-448f-8b4c-5db73a900c46 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Calling method '.version_select at 0x7f32eec3ac10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.323118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.323671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:29.331216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.331706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.335007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.336120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.336893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.337519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.473740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a7f9588-1617-448f-8b4c-5db73a900c46 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips/80d881e7-30b0-4c55-89a5-4eeae9a1edff" status: 200 len: 140 microversion: 2.1 time: 0.281109 Aug 29 15:41:29.483384 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 595/1127] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/os-floating-ips/80d881e7-30b0-4c55-89a5-4eeae9a1edff => generated 140 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:29.491374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.494301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:29.498542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:29.506094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.506584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.507284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.508241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.508893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.510388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.612468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.620543 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-800cc705-a8cb-4a76-abf7-11c5fb5e1bfa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.303288 Aug 29 15:41:29.623576 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 533/1128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:29.628717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1f8918d-a06f-4b4b-9b57-563ac2aad75d tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Calling method '.version_select at 0x7f32ee7f6430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.637720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.654480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.656265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:29.663633 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f9ae9742-debb-46d9-b706-67552039496c tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.179030 Aug 29 15:41:29.664451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 596/1129] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:29.669382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-304a44a6-a5e3-40a3-86ad-092dcdd104de tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32ee62cdc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.720647 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-304a44a6-a5e3-40a3-86ad-092dcdd104de tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79" status: 200 len: 637 microversion: 2.1 time: 0.054812 Aug 29 15:41:29.723102 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 597/1130] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79 => generated 637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:29.741856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0de03d80-25d8-4ce2-9c9b-d2523d475a7b tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update_all', calling method: .version_select at 0x7f32ee70ff70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:29.812232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0de03d80-25d8-4ce2-9c9b-d2523d475a7b tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:29.821220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0de03d80-25d8-4ce2-9c9b-d2523d475a7b tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:29.855293 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1f8918d-a06f-4b4b-9b57-563ac2aad75d tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.230211 Aug 29 15:41:29.855944 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 534/1131] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:29.860733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:29.861817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:29.870042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.870897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.871611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:29.872603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:29.873409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:29.873899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.028955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:30.037759 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3801e516-9c0d-42ea-b25e-8bb1ae9f93ac tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1478 microversion: 2.1 time: 0.180549 Aug 29 15:41:30.038337 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 535/1132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:29 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1478 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:30.042762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1cdec97-f37e-4750-aac5-df22ceb58a42 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Calling method '.version_select at 0x7f32ee672820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:30.164470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0de03d80-25d8-4ce2-9c9b-d2523d475a7b tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 61 microversion: 2.1 time: 0.428138 Aug 29 15:41:30.165063 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 598/1133] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:29 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 61 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:30.170262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:30.172158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:30.189728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.190617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.191091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.191791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.193586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.202357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.361498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:30.369968 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e9e9c31e-9aaa-4a70-b8f9-48224d4530aa tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1470 microversion: 2.1 time: 0.203702 Aug 29 15:41:30.370612 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 599/1134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:30 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:30.383007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37829ca2-cac4-4a1b-9dca-915804a2a970 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32eee18af0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:30.762054 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37829ca2-cac4-4a1b-9dca-915804a2a970 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "DELETE /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.390351 Aug 29 15:41:30.762806 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 600/1135] 10.222.0.83 () {58 vars in 1296 bytes} [Mon Aug 29 15:41:30 2022] DELETE /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata/os_version => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:30.772821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:30.773826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:30.785894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.788072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.788522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:30.789303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:30.790453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:30.790902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.183261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:31.205428 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-855b341c-23bc-4cd6-a83a-8820b42cc3b7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.437809 Aug 29 15:41:31.219053 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 601/1136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:30 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:31.229982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.230772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:31.237384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.238055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.239265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.241887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.242734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.246155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.329309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1cdec97-f37e-4750-aac5-df22ceb58a42 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/80d881e7-30b0-4c55-89a5-4eeae9a1edff" status: 202 len: 0 microversion: 2.1 time: 1.289475 Aug 29 15:41:31.329719 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 536/1137] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:30 2022] DELETE /compute/v2.1/os-floating-ips/80d881e7-30b0-4c55-89a5-4eeae9a1edff => generated 0 bytes in 1291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:31.334481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99421967-3988-4790-82dd-f11e783926c9 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32ee855b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.416494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:31.425032 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99421967-3988-4790-82dd-f11e783926c9 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 37 microversion: 2.1 time: 0.093829 Aug 29 15:41:31.426708 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 537/1138] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 37 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:31.432707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:31.434391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:31.439752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.441034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:31.449825 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92d5977a-e84f-4225-b790-d3bb20a93231 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.236400 Aug 29 15:41:31.450915 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 602/1139] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:31.455857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f35799d3-bc50-4d75-9ef7-e1b5b4b81611 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Action: 'create', calling method: .version_select at 0x7f32ee5e5430>, body: {"pool": null} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:31.456608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.457303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.458803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.459799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.460475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.461091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.561542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd46d7afd06f41c2a09132a349aa3fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936fa60fa7e24fd9b9014521544670dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:31.592037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5690eb4-4c35-4abb-a0d0-9a0c4bb0d1ba tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 200 len: 1436 microversion: 2.1 time: 0.162430 Aug 29 15:41:31.597167 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 538/1140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 1436 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:31.607353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:31.622854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:31.641083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.642904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.645940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.649817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:31.650339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:31.650940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:31.858023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:31.868805 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-41e76b61-8931-4b2e-b7f4-9d873a77b89c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1470 microversion: 2.1 time: 0.269078 Aug 29 15:41:31.869393 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 539/1141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:31 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1470 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:31.888865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-03c289a9-c218-4d8d-83d0-d2e2121248d6 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update_all', calling method: .version_select at 0x7f32ee765430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:31.958384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-03c289a9-c218-4d8d-83d0-d2e2121248d6 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:31.964694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-03c289a9-c218-4d8d-83d0-d2e2121248d6 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:32.293271 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-03c289a9-c218-4d8d-83d0-d2e2121248d6 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 61 microversion: 2.1 time: 0.413104 Aug 29 15:41:32.293875 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 540/1142] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:31 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 61 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:32.308208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ccdf44ff-5069-4fdf-92d1-8783a832e899 req-3a3f7347-e12d-465c-b1be-9d639823d246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d305b112-5285-4873-85ce-040157c62708", "name": "network-vif-deleted", "tag": "7d83dfb5-6b01-4fe3-ab0a-d7a7fa09ed52"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:32.319615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ccdf44ff-5069-4fdf-92d1-8783a832e899 req-3a3f7347-e12d-465c-b1be-9d639823d246 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.320097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ccdf44ff-5069-4fdf-92d1-8783a832e899 req-3a3f7347-e12d-465c-b1be-9d639823d246 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.320524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ccdf44ff-5069-4fdf-92d1-8783a832e899 req-3a3f7347-e12d-465c-b1be-9d639823d246 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.331953 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ccdf44ff-5069-4fdf-92d1-8783a832e899 req-3a3f7347-e12d-465c-b1be-9d639823d246 service nova] Creating event network-vif-deleted:7d83dfb5-6b01-4fe3-ab0a-d7a7fa09ed52 for instance d305b112-5285-4873-85ce-040157c62708 on n-h2-836830-13 Aug 29 15:41:32.337330 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ccdf44ff-5069-4fdf-92d1-8783a832e899 req-3a3f7347-e12d-465c-b1be-9d639823d246 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041954 Aug 29 15:41:32.338151 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 541/1143] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:32.343435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.344133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:32.353348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.353866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.354305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.355001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.355648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.356253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.511359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.525527 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0f8cf48-f8d2-42ec-bee8-c6f668bad65d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.186037 Aug 29 15:41:32.535457 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 542/1144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:32.541865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.542490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:32.551006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.551448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.551940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.552690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.553150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.553599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.748908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:32.771361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f69cbeb1-3c02-4ed0-a21b-9ccc616075a0 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 2346 microversion: 2.25 time: 0.233488 Aug 29 15:41:32.783455 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 543/1145] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 2346 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:32.795524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3f8800e-1136-4c40-a784-542c5fae69de tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32ee691820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.856492 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3f8800e-1136-4c40-a784-542c5fae69de tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.070531 Aug 29 15:41:32.857389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 544/1146] 10.222.0.83 () {58 vars in 1290 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata/os_distro => generated 33 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:32.865681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.866669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:32.880707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.881570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.882329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.883298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.883992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.884928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.964130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.972524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.974710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:32.980191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3deb9c52-c10e-4505-bf4b-147790e46d1b tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.121564 Aug 29 15:41:32.981127 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 545/1147] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:32.986584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:32.987316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] [instance: d305b112-5285-4873-85ce-040157c62708] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:32.994495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.995898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.996430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:32.997223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:32.997745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:32.998232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.013901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] HTTP exception thrown: Instance d305b112-5285-4873-85ce-040157c62708 could not be found. Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Request method failure captured: Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 HTTP/1.1 Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN3t3IMnLEFHvQ8uvSksk_PyxfMeh-UlCGcTErivGzffUMqyf8N77Imd3ZAncRyb-i9vOm4zRR6YajX15-bflhavZPj6noGC42ovezQwF-efaxC4SFz_kKnTYwqdA-fU4jvLayIOQ2ifru43650jS334Why72xMS4mjPa5RYxpZVvEE Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 936fa60fa7e24fd9b9014521544670dc Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1118586876 Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:33.015809 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/936fa60fa7e24fd9b9014521544670dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_936fa60fa7e24fd9b9014521544670dc", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/936fa60fa7e24fd9b9014521544670dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/936fa60fa7e24fd9b9014521544670dc"}]}] Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1118586876 Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 936fa60fa7e24fd9b9014521544670dc Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1118586876 Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersAdminNegativeTestJSON-1118586876-project Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: cd46d7afd06f41c2a09132a349aa3fd4 Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1118586876-project Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d305b112-5285-4873-85ce-040157c62708 could not be found. Aug 29 15:41:33.017311 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd305b112-5285-4873-85ce-040157c62708'} Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d305b112-5285-4873-85ce-040157c62708 could not be found. Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:33.018056 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d305b112-5285-4873-85ce-040157c62708 could not be found. Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d305b112-5285-4873-85ce-040157c62708 could not be found. Aug 29 15:41:33.019576 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:33.021270 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f35799d3-bc50-4d75-9ef7-e1b5b4b81611 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.564409 Aug 29 15:41:33.021270 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 603/1148] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:41:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:33.023165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] Returning 404 to user: Instance d305b112-5285-4873-85ce-040157c62708 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:33.024218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee4a3352-a210-415d-9e42-8db196b260d6 tempest-ServersAdminNegativeTestJSON-1118586876 tempest-ServersAdminNegativeTestJSON-1118586876-project] 10.222.0.83 "GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708" status: 404 len: 111 microversion: 2.1 time: 0.041965 Aug 29 15:41:33.025280 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 546/1149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:32 2022] GET /compute/v2.1/servers/d305b112-5285-4873-85ce-040157c62708 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:33.025613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.030460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3fc08ecf-8edf-4e47-854a-ccaf79e7b5fe tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update_all', calling method: .version_select at 0x7f32ee79ae50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:33.030593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.031012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.031489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.032247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.032722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.033376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.065581 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9bccf836-65ea-4ef4-9cbc-cd6a222767dc tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.045242 Aug 29 15:41:33.066461 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 604/1150] 10.222.0.83 () {60 vars in 1217 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:41:33.077795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.078691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:33.089959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.090652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.091362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.092276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.093096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.093675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.095292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3fc08ecf-8edf-4e47-854a-ccaf79e7b5fe tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:33.101779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:33.102466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3fc08ecf-8edf-4e47-854a-ccaf79e7b5fe tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:33.117284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:33.322053 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3fc08ecf-8edf-4e47-854a-ccaf79e7b5fe tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 61 microversion: 2.1 time: 0.295145 Aug 29 15:41:33.322980 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 547/1151] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:33 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 61 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:33.328100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e954c687-f305-4409-8439-3fc220c38425 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Calling method '.version_select at 0x7f32ee691940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.381023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:33.390331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d1ac4666-efda-4505-9ad6-7daf7d46fb15 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.322415 Aug 29 15:41:33.392154 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 605/1152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:33.398613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49a880fd-abb0-4732-b706-6f0fe9a559e3 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32ee6ace50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.468703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49a880fd-abb0-4732-b706-6f0fe9a559e3 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 61 microversion: 2.1 time: 0.075151 Aug 29 15:41:33.469844 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 606/1153] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 61 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:33.488988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-105b761f-24d3-4aa7-988b-ddc60dbb55e8 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update_all', calling method: .version_select at 0x7f32ee5e50d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:33.600268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-105b761f-24d3-4aa7-988b-ddc60dbb55e8 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:33.608290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-105b761f-24d3-4aa7-988b-ddc60dbb55e8 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:33.875062 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-105b761f-24d3-4aa7-988b-ddc60dbb55e8 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 61 microversion: 2.1 time: 0.398418 Aug 29 15:41:33.876105 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 607/1154] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:33 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 61 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:33.882069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:33.882696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:33.897600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.898350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.898875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:33.899682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:33.900142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:33.900574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.085043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.095298 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78fe1862-5e8f-4e09-978a-64f0ea5bf43c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.217770 Aug 29 15:41:34.096045 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 608/1155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:33 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:34.104475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54d1a1e7-9cbe-495b-a2ea-e12c3ea1c165 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update_all', calling method: .version_select at 0x7f32ee5dbd30>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:34.164517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-54d1a1e7-9cbe-495b-a2ea-e12c3ea1c165 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:34.171085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-54d1a1e7-9cbe-495b-a2ea-e12c3ea1c165 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:34.584252 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54d1a1e7-9cbe-495b-a2ea-e12c3ea1c165 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 64 microversion: 2.1 time: 0.486964 Aug 29 15:41:34.585010 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 609/1156] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:34 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 64 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:34.590299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:34.591967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:34.600749 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e954c687-f305-4409-8439-3fc220c38425 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec" status: 202 len: 0 microversion: 2.1 time: 1.276452 Aug 29 15:41:34.601794 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 548/1157] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:33 2022] DELETE /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec => generated 0 bytes in 1278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:34.604465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.605243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.605843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.606473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:34.606750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.607172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:34.607300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.607674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.618552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.619081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.619598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.620456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.621026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.621457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.695953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.714622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.716397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.723694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4367bba-711d-47f5-9336-fcdee24739b4 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.136808 Aug 29 15:41:34.739401 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 610/1158] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:34 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:34.739401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cd12b22-97ef-4c1d-a2c4-9cf806e49575"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:34.739833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:34.752215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.752819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.753337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.754132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:34.754751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:34.755428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:34.824720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:34.834497 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0194656d-9f98-4130-ba1f-91b56b71bd52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.231789 Aug 29 15:41:34.836407 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 549/1159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:34 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:34.847487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de3eb8cd-d5f7-4771-a3fd-e80185eaf75d tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32ee780d30>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:34.914510 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de3eb8cd-d5f7-4771-a3fd-e80185eaf75d tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 64 microversion: 2.1 time: 0.075229 Aug 29 15:41:34.915101 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 550/1160] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:34 2022] GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 64 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:34.924927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39dfb495-1c9e-4757-a22c-edc215fdfd87 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Calling method '.version_select at 0x7f32ee79a1f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:34.977804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-39dfb495-1c9e-4757-a22c-edc215fdfd87 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e5af87db-9ec3-496f-a944-7781651f7fec could not be found", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:41:34.978550 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-39dfb495-1c9e-4757-a22c-edc215fdfd87 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] HTTP exception thrown: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39dfb495-1c9e-4757-a22c-edc215fdfd87 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Request method failure captured: Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec HTTP/1.1 Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN4mpLdUARDQDc7O3CO33jaP8PPx5-rqUKPG_VfDpKJ1vaAL1GdQvEgYqbbLsQgHS9AyKsFAhEu0hcR49IAvfN0oDCECZRAopM1jmeYsenVd0x2KLrC5zgHi-R_7TJjEFlX90jR9SLLncgDdrMTi6QzkvQYZKMaz2nwEBUy6IvWmypI Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: f6f4058c4a9b420dbdbe5658e3885ea0 Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FloatingIPsTestJSON-2100263565 Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:34.980468 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f6f4058c4a9b420dbdbe5658e3885ea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f6f4058c4a9b420dbdbe5658e3885ea0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f6f4058c4a9b420dbdbe5658e3885ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f6f4058c4a9b420dbdbe5658e3885ea0"}]}] Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FloatingIPsTestJSON-2100263565 Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: f6f4058c4a9b420dbdbe5658e3885ea0 Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2100263565 Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FloatingIPsTestJSON-2100263565-project Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 99687f484fd745c68f95d11c7e8fd976 Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FloatingIPsTestJSON-2100263565-project Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: exception: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e5af87db-9ec3-496f-a944-7781651f7fec'} Aug 29 15:41:34.981955 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:41:34.982945 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e5af87db-9ec3-496f-a944-7781651f7fec could not be found Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3434bce1-18c3-4796-b751-0f605eb4b583'] Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec. Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:34.984399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:34.985740 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:34.987245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:34.987245 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:34.987245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39dfb495-1c9e-4757-a22c-edc215fdfd87 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Returning 404 to user: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:34.987245 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39dfb495-1c9e-4757-a22c-edc215fdfd87 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec" status: 404 len: 111 microversion: 2.1 time: 0.064476 Aug 29 15:41:34.987245 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 551/1161] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:34 2022] GET /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:34.988340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fdb10381-1929-4706-96e6-544d1af4ba5d tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update_all', calling method: .version_select at 0x7f32ee747820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:35.047538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fdb10381-1929-4706-96e6-544d1af4ba5d tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:35.053090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fdb10381-1929-4706-96e6-544d1af4ba5d tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:35.201583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7fdc32a-50ca-4cba-ae85-efeb6c535d29 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "POST /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468695 Aug 29 15:41:35.208746 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 611/1162] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:41:34 2022] POST /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments => generated 194 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:35.217483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24b9c11a-04ca-4533-b52b-d2145ff3bea0", "device": "/dev/xvdb"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:35.223738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:35.238130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.238977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.240323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.241388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.241888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.242400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.409302 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fdb10381-1929-4706-96e6-544d1af4ba5d tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 61 microversion: 2.1 time: 0.425144 Aug 29 15:41:35.409953 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 552/1163] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:34 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 61 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:35.416707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcddf559-4222-445c-82b9-21d650caf194 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Calling method '.version_select at 0x7f32ee6911f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.463646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-bcddf559-4222-445c-82b9-21d650caf194 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e5af87db-9ec3-496f-a944-7781651f7fec could not be found", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:41:35.464370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-bcddf559-4222-445c-82b9-21d650caf194 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] HTTP exception thrown: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcddf559-4222-445c-82b9-21d650caf194 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Request method failure captured: Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec HTTP/1.1 Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN4mpLdUARDQDc7O3CO33jaP8PPx5-rqUKPG_VfDpKJ1vaAL1GdQvEgYqbbLsQgHS9AyKsFAhEu0hcR49IAvfN0oDCECZRAopM1jmeYsenVd0x2KLrC5zgHi-R_7TJjEFlX90jR9SLLncgDdrMTi6QzkvQYZKMaz2nwEBUy6IvWmypI Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: f6f4058c4a9b420dbdbe5658e3885ea0 Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FloatingIPsTestJSON-2100263565 Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:35.466451 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f6f4058c4a9b420dbdbe5658e3885ea0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f6f4058c4a9b420dbdbe5658e3885ea0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f6f4058c4a9b420dbdbe5658e3885ea0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f6f4058c4a9b420dbdbe5658e3885ea0"}]}] Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FloatingIPsTestJSON-2100263565 Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: f6f4058c4a9b420dbdbe5658e3885ea0 Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2100263565 Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FloatingIPsTestJSON-2100263565-project Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 99687f484fd745c68f95d11c7e8fd976 Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FloatingIPsTestJSON-2100263565-project Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: exception: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e5af87db-9ec3-496f-a944-7781651f7fec'} Aug 29 15:41:35.467754 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:41:35.468554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e5af87db-9ec3-496f-a944-7781651f7fec could not be found Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c302e3e7-fc74-4691-935f-1688dfa8b793'] Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec. Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:35.469766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:35.470904 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:35.472256 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec Aug 29 15:41:35.472256 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:35.474149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcddf559-4222-445c-82b9-21d650caf194 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] Returning 404 to user: Floating IP not found for ID e5af87db-9ec3-496f-a944-7781651f7fec {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:35.475628 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcddf559-4222-445c-82b9-21d650caf194 tempest-FloatingIPsTestJSON-2100263565 tempest-FloatingIPsTestJSON-2100263565-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec" status: 404 len: 111 microversion: 2.1 time: 0.064192 Aug 29 15:41:35.476855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 553/1164] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:41:35 2022] DELETE /compute/v2.1/os-floating-ips/e5af87db-9ec3-496f-a944-7781651f7fec => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:41:35.482974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.484125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:35.491737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.492422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.493038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.493889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.494662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.495299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.583309 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f85985e0-8cbd-4127-be43-d2233f5c923f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "POST /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.371431 Aug 29 15:41:35.584012 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 612/1165] 10.222.0.83 () {62 vars in 1364 bytes} [Mon Aug 29 15:41:35 2022] POST /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:41:35.595010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7e2cf61-35ae-4c0a-9161-b0bbe30f3540 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update', calling method: .version_select at 0x7f32ee50d670>, body: {"meta": {"os_version": "alt"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:35.681669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c7e2cf61-35ae-4c0a-9161-b0bbe30f3540 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:35.697510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.708544 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-516ba127-3412-4747-9b63-8df63ddb1527 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.228818 Aug 29 15:41:35.708952 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 554/1166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:35.713981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c7e2cf61-35ae-4c0a-9161-b0bbe30f3540 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:35.750886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.751529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:35.760170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.760966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.761425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.762126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.762588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.763032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.892315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.902255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.903950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:35.909414 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b6c1298c-4a80-4955-8b55-362526b7cb64 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.163255 Aug 29 15:41:35.909786 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 555/1167] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:35.927140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:35.927773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:35.937571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.937571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.937571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:35.937571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:35.943124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:35.943945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.164770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7e2cf61-35ae-4c0a-9161-b0bbe30f3540 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.573976 Aug 29 15:41:36.165367 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 613/1168] 10.222.0.83 () {60 vars in 1313 bytes} [Mon Aug 29 15:41:35 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata/os_version => generated 31 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:36.174923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e25660fc-b3a6-4d03-9df9-1ae8037e310b tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32ee51d4c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.205239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:36.221013 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b137fee-caf1-4fbd-a925-de4e664c537e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.299526 Aug 29 15:41:36.224256 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 556/1169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:35 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:36.273730 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e25660fc-b3a6-4d03-9df9-1ae8037e310b tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 58 microversion: 2.1 time: 0.102275 Aug 29 15:41:36.276405 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 614/1170] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 58 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:36.288474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69f72d1a-ffcc-44e6-ae77-f0b2d1e91927 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'update_all', calling method: .version_select at 0x7f32ee75c3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:36.358353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-69f72d1a-ffcc-44e6-ae77-f0b2d1e91927 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:36.368358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-69f72d1a-ffcc-44e6-ae77-f0b2d1e91927 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:36.735695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:36.736725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:36.767831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.768634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.772185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.774859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:36.777438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:36.778371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:36.814007 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69f72d1a-ffcc-44e6-ae77-f0b2d1e91927 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 61 microversion: 2.1 time: 0.529816 Aug 29 15:41:36.815910 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 557/1171] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:41:36 2022] PUT /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 61 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:36.827382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d7b6811-8ead-4100-859e-549c812a6965 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Action: 'create', calling method: .version_select at 0x7f32ee691af0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:36.921123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-6d7b6811-8ead-4100-859e-549c812a6965 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:36.939909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-6d7b6811-8ead-4100-859e-549c812a6965 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Getting quotas for user cb47ac0e7edc41a59246fad43a1b5be1 and project 96637b9e55854348add20636d3d92a85. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:37.259409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.274388 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75d35ef9-38ad-486d-9529-55961461aa1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.547211 Aug 29 15:41:37.276129 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 615/1172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:36 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:37.289623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:37.290587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:37.299635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.300550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.301280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.303295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.304428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.306150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.310424 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d7b6811-8ead-4100-859e-549c812a6965 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "POST /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 85 microversion: 2.1 time: 0.487824 Aug 29 15:41:37.311387 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 558/1173] 10.222.0.83 () {60 vars in 1281 bytes} [Mon Aug 29 15:41:36 2022] POST /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 85 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 15:41:37.486325 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-603bdca2-a7ff-498d-82a8-c3e0bea672b5 tempest-TenantUsagesNegativeTestJSON-1630699092 tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin] 10.222.0.83 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T15%3A41%3A37.163787&end=2022-08-30T15%3A41%3A37.163787" status: 404 len: 112 microversion: - time: 0.167564 Aug 29 15:41:37.487075 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 559/1174] 10.222.0.83 () {58 vars in 1316 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-28T15%3A41%3A37.163787&end=2022-08-30T15%3A41%3A37.163787 => generated 112 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:41:37.510029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:37.511266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:37.519260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.519862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.520869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.524127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:37.524650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:37.525090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:37.670502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.680912 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0398a7ca-e889-4225-a0ea-e60e9a7dac43 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.192651 Aug 29 15:41:37.681762 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 560/1175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:37.694655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b67abfd-36cd-4077-8aea-839964c7c1d1 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] Calling method '.version_select at 0x7f32ee765040>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:37.713539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.723780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.725699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.736858 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-faa1db33-340c-46c9-b1e2-ebba8259a8a2 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.459350 Aug 29 15:41:37.737665 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 616/1176] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:37.744470 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b67abfd-36cd-4077-8aea-839964c7c1d1 tempest-ImagesMetadataTestJSON-227508914 tempest-ImagesMetadataTestJSON-227508914-project] 10.222.0.83 "GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata" status: 200 len: 85 microversion: 2.1 time: 0.056174 Aug 29 15:41:37.744862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2255e5e-af16-4016-ba58-de92a9686db3 tempest-TenantUsagesNegativeTestJSON-1630699092 tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin] Calling method '.version_select at 0x7f32ee50d790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:37.745818 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 561/1177] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/images/3548423e-5d41-4ea5-b09d-49892d68dd79/metadata => generated 85 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:41:37.755386 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e2255e5e-af16-4016-ba58-de92a9686db3 tempest-TenantUsagesNegativeTestJSON-1630699092 tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2255e5e-af16-4016-ba58-de92a9686db3 tempest-TenantUsagesNegativeTestJSON-1630699092 tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin] Request method failure captured: Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-simple-tenant-usage/84a0d6189dd04531b9124e4e7d8eb2c6?start=2022-08-30T15%3A41%3A37.163787&end=2022-08-28T15%3A41%3A37.163787 HTTP/1.1 Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN4xsD-SdqffawOA9rIdktOc-Cq30ZOqPfJZMTqtU8iP3Uh55jpshSXQ-NacNs_zR2ugxYQLRdfrWB4miQeaLOOESXEEo93Gr77eDzcXr1p1w3UU5z9kbnn0D0-pP9FEQl3vtAKev5DEZvovf1xH4xhUyt1IQxiVTW_MoYSgU-e2mN8 Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d0ac8a1324c848a19548e9f85a9409de Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1630699092 Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:41:37.757407 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d0ac8a1324c848a19548e9f85a9409de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d0ac8a1324c848a19548e9f85a9409de", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d0ac8a1324c848a19548e9f85a9409de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d0ac8a1324c848a19548e9f85a9409de"}]}] Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1630699092 Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d0ac8a1324c848a19548e9f85a9409de Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1630699092 Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8d7add98a1d34a41a0d3018f2ed80ff9 Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid start time. The start time cannot occur after the end time. Aug 29 15:41:37.758995 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '84a0d6189dd04531b9124e4e7d8eb2c6'} Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:41:37.759957 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2255e5e-af16-4016-ba58-de92a9686db3 tempest-TenantUsagesNegativeTestJSON-1630699092 tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:37.761464 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2255e5e-af16-4016-ba58-de92a9686db3 tempest-TenantUsagesNegativeTestJSON-1630699092 tempest-TenantUsagesNegativeTestJSON-1630699092-project-admin] 10.222.0.83 "GET /compute/v2.1/os-simple-tenant-usage/84a0d6189dd04531b9124e4e7d8eb2c6?start=2022-08-30T15%3A41%3A37.163787&end=2022-08-28T15%3A41%3A37.163787" status: 400 len: 111 microversion: 2.1 time: 0.020064 Aug 29 15:41:37.765137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 617/1178] 10.222.0.83 () {58 vars in 1412 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/os-simple-tenant-usage/84a0d6189dd04531b9124e4e7d8eb2c6?start=2022-08-30T15%3A41%3A37.163787&end=2022-08-28T15%3A41%3A37.163787 => generated 111 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:37.917938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c55814f-fe60-44bc-af41-41d8dfabac15 tempest-TenantUsagesNegativeTestJSON-1627924646 tempest-TenantUsagesNegativeTestJSON-1627924646-project] Calling method '.version_select at 0x7f32ee6913a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:37.921430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c55814f-fe60-44bc-af41-41d8dfabac15 tempest-TenantUsagesNegativeTestJSON-1627924646 tempest-TenantUsagesNegativeTestJSON-1627924646-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '60f6fe3ed2af4f6a944b314b2e0bc21b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a0d6189dd04531b9124e4e7d8eb2c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c55814f-fe60-44bc-af41-41d8dfabac15 tempest-TenantUsagesNegativeTestJSON-1627924646 tempest-TenantUsagesNegativeTestJSON-1627924646-project] Request method failure captured: Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A41%3A37.163787&end=2022-08-30T15%3A41%3A37.163787&detailed=1 HTTP/1.1 Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN4w_G-u4rt60GmT57FbNAkcmpJwVSa78zmhN_ooGrim8lCGJJpf6jZrBcM5BLwhq0lCFyX23cpbnUDnHAhyQ0K6sk_LQN1TORx2iJkQ_Ssq7-eeLtKIz6Ewfiyrik__vWqk2kKmYc-M3u-BGrCAM7UA8eN0U5nlyRC0nZ0xUuCDFA4 Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 84a0d6189dd04531b9124e4e7d8eb2c6 Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1627924646 Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:37.923381 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/84a0d6189dd04531b9124e4e7d8eb2c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_84a0d6189dd04531b9124e4e7d8eb2c6", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/84a0d6189dd04531b9124e4e7d8eb2c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/84a0d6189dd04531b9124e4e7d8eb2c6"}]}] Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1627924646 Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 84a0d6189dd04531b9124e4e7d8eb2c6 Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1627924646 Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TenantUsagesNegativeTestJSON-1627924646-project Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 60f6fe3ed2af4f6a944b314b2e0bc21b Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1627924646-project Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: action_args: {} Aug 29 15:41:37.924986 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 29 15:41:37.925863 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 29 15:41:37.927650 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 29 15:41:37.929399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 29 15:41:37.929399 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:37.929399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c55814f-fe60-44bc-af41-41d8dfabac15 tempest-TenantUsagesNegativeTestJSON-1627924646 tempest-TenantUsagesNegativeTestJSON-1627924646-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:37.929399 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c55814f-fe60-44bc-af41-41d8dfabac15 tempest-TenantUsagesNegativeTestJSON-1627924646 tempest-TenantUsagesNegativeTestJSON-1627924646-project] 10.222.0.83 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A41%3A37.163787&end=2022-08-30T15%3A41%3A37.163787&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.159317 Aug 29 15:41:37.929399 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 562/1179] 10.222.0.83 () {58 vars in 1335 bytes} [Mon Aug 29 15:41:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-28T15%3A41%3A37.163787&end=2022-08-30T15%3A41%3A37.163787&detailed=1 => generated 123 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:41:38.298067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.299892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.311442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.319810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.321343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.322893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.330957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.331799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.691125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:38.705514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.706205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.714927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-910a2a7f-febb-4395-8e42-ba7700b3865c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.421165 Aug 29 15:41:38.716614 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 618/1180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:38.722917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.725018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.725503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.726243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.728897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.729511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.764386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:38.765018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:38.774707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.775243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.775677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.776792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:38.777594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:38.778625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:38.899593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:38.913168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:38.915475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:38.921951 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f78f8811-7af3-4128-aadf-1bb090e9aed1 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.161539 Aug 29 15:41:38.923915 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 619/1181] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:41:39.097047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:39.103279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:39.108977 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc5d4f4c-3cdd-445a-b9ec-54f8d876df09 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.409194 Aug 29 15:41:39.109814 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 563/1182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:38 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:39.737703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:39.738469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:39.755332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.756137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.756672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:39.757467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.758017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.758660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:39.948416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:39.949132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:39.966952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.967482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.967914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:39.968612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:39.969064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:39.969477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:40.137107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:40.168721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:40.180143 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54f4706d-1769-4adf-a07d-88d2be89633f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.446410 Aug 29 15:41:40.194886 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 620/1183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:39 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:40.198515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:40.200083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:40.200782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:40.201442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:40.212209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-03a7da1c-f99a-4c4b-9dff-ca1ac34b6637 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.267665 Aug 29 15:41:40.214939 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 564/1184] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:39 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:40.222350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:40.222839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:40.224288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:40.226426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:40.235800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:40.236129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:40.482920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:40.498902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e3c12e1-8ecf-4969-a96b-422ea672b984 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.302799 Aug 29 15:41:40.500809 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 621/1185] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:40 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:41.205304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:41.206033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:41.221652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.222245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.226627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.227624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.228111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.229137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.240721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:41.243001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:41.254134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.263942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.264661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.265562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.266344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.266956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.396849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.420459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.424466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.436108 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5546269-5741-49f9-b716-c330e55434a5 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1447 microversion: 2.75 time: 0.199618 Aug 29 15:41:41.447317 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 622/1186] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:41 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1447 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:41.495308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.503399 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-834a5ff6-ec55-4d30-b2f1-c6d128132d2a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.303297 Aug 29 15:41:41.507915 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 565/1187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:41 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:41.531180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:41.531943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:41.542068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.543889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.544526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.546260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:41.547080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:41.547680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:41.758200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:41.773653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b041568-67bb-4164-8055-94adfa24c7de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.250334 Aug 29 15:41:41.774242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 623/1188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:41 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.198150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1b34ec52-c921-41fc-80ca-23f883e19f45 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.210911 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1b34ec52-c921-41fc-80ca-23f883e19f45 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.178804 Aug 29 15:41:42.211536 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 566/1189] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.226907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e22b49e-b92c-4ff4-b7c0-c66bf0108b56 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.249473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e22b49e-b92c-4ff4-b7c0-c66bf0108b56 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.027042 Aug 29 15:41:42.250381 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 624/1190] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.265213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04e0a749-46f3-4498-9d56-aaf439b9f871 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.280900 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04e0a749-46f3-4498-9d56-aaf439b9f871 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017720 Aug 29 15:41:42.282548 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 567/1191] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.298475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7dac385b-b04b-417a-9ec4-c4981faa135f tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.308053 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7dac385b-b04b-417a-9ec4-c4981faa135f tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013426 Aug 29 15:41:42.308951 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 625/1192] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.320323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7cb72a6-ccb7-4bcd-b405-16f343e33d60 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.353064 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7cb72a6-ccb7-4bcd-b405-16f343e33d60 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.036431 Aug 29 15:41:42.353722 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 568/1193] 10.222.0.83 () {58 vars in 1165 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.372768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5fc5d714-fdb2-4c6c-ad75-cd21a81fa7eb tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.384278 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5fc5d714-fdb2-4c6c-ad75-cd21a81fa7eb tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015441 Aug 29 15:41:42.385120 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 626/1194] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.398457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d8065f0-8f52-4053-af27-e594441028ec tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.429125 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d8065f0-8f52-4053-af27-e594441028ec tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.035875 Aug 29 15:41:42.429810 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 569/1195] 10.222.0.83 () {58 vars in 1169 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.452154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2008e8a-1773-4052-880b-bcd113b0ce31 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.467343 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2008e8a-1773-4052-880b-bcd113b0ce31 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.019230 Aug 29 15:41:42.467926 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 627/1196] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.474590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.475811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:42.486558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.487425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.487981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7c0dc47-98f6-4d99-9c59-255c004f0073 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.488164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.489632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.490436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.491692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.508690 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7c0dc47-98f6-4d99-9c59-255c004f0073 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029722 Aug 29 15:41:42.510037 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 628/1197] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.522533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dea13043-a869-4c5e-847e-223f84b599f6 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.563220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dea13043-a869-4c5e-847e-223f84b599f6 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.045817 Aug 29 15:41:42.575516 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 629/1198] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:42.578519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.583200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:42.590775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.591613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.592200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.593285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.593921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.594534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.622884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:42.632752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:42.635554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:42.646179 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-60e21582-791e-4591-b6a7-5acb954abb4f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1453 microversion: 2.75 time: 0.186622 Aug 29 15:41:42.646494 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 570/1199] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:42.670291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1488fd8a-8c6d-4e81-b760-f4abedab6ec7 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.680492 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1488fd8a-8c6d-4e81-b760-f4abedab6ec7 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020101 Aug 29 15:41:42.687740 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 571/1200] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.696025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75642779-ad9a-422b-b602-22d02d7284e4 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.719718 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75642779-ad9a-422b-b602-22d02d7284e4 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.030125 Aug 29 15:41:42.730179 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 572/1201] 10.222.0.83 () {58 vars in 1144 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:42.735449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a79c6e0-bda9-42db-b7ac-60d1f87b2130 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.744295 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a79c6e0-bda9-42db-b7ac-60d1f87b2130 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012610 Aug 29 15:41:42.759603 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 573/1202] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:42.766594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-67087ac9-ede5-4c9d-8d17-ca2ea868378e tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.784330 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-67087ac9-ede5-4c9d-8d17-ca2ea868378e tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.023378 Aug 29 15:41:42.794378 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 574/1203] 10.222.0.83 () {58 vars in 1148 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.799645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:42.800594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:42.808690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.809259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.809769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.810999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:42.811796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:42.812483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:42.954333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:42.969476 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31447722-8b50-44e2-9346-885015929322 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.399898 Aug 29 15:41:42.971389 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 630/1204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:42.992870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05e77d31-e44d-4398-ba20-932a363c054d tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.020747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05e77d31-e44d-4398-ba20-932a363c054d tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.042543 Aug 29 15:41:43.023459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 631/1205] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:43.039729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea62efe1-c1aa-4164-ba43-bee3b819d069 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.053198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:43.059104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.064065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.065748 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cb27d91-8f49-4d38-9a36-7e3e0bc98c4f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.269791 Aug 29 15:41:43.066338 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 575/1206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:42 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:43.089786 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea62efe1-c1aa-4164-ba43-bee3b819d069 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.058086 Aug 29 15:41:43.091737 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 632/1207] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:41:43.110917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f631b938-3aa9-40b1-856e-28125d7cfebd tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.182238 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f631b938-3aa9-40b1-856e-28125d7cfebd tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.079361 Aug 29 15:41:43.183293 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 576/1208] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:43.197795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c12c2138-2741-49b8-bfd2-60efcbe6026e tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.247663 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c12c2138-2741-49b8-bfd2-60efcbe6026e tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053884 Aug 29 15:41:43.248756 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 633/1209] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:43.272093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fdd0d49c-9973-4ef3-87c6-912247b90176 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.283177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fdd0d49c-9973-4ef3-87c6-912247b90176 tempest-FlavorsV2TestJSON-1135259467 tempest-FlavorsV2TestJSON-1135259467-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017200 Aug 29 15:41:43.283759 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 577/1210] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:43.374230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c000178e-0957-4a3b-8649-6ff4c6be9dc4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee50de50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.424464 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c000178e-0957-4a3b-8649-6ff4c6be9dc4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/89f296a5-7780-4b36-9d52-318fb9b5f21e" status: 200 len: 662 microversion: 2.1 time: 0.054777 Aug 29 15:41:43.425568 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 634/1211] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/images/89f296a5-7780-4b36-9d52-318fb9b5f21e => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:43.438983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a610206c-c5cf-4054-80ba-e8fb7357e9cf tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee4eedc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.503918 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a610206c-c5cf-4054-80ba-e8fb7357e9cf tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/89f296a5-7780-4b36-9d52-318fb9b5f21e" status: 200 len: 662 microversion: 2.1 time: 0.068744 Aug 29 15:41:43.504947 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 635/1212] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/images/89f296a5-7780-4b36-9d52-318fb9b5f21e => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:43.553356 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ebd17730-d7dd-4694-a253-e0a89f216f7d tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] 10.222.0.83 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.158185 Aug 29 15:41:43.563179 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 578/1213] 10.222.0.83 () {58 vars in 1128 bytes} [Mon Aug 29 15:41:43 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 29 15:41:43.564961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb2c6617-503e-4524-a972-6c2572de469c tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Calling method '.version_select at 0x7f32ee55be50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.628753 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-bb2c6617-503e-4524-a972-6c2572de469c tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] HTTP exception thrown: Image not found. Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb2c6617-503e-4524-a972-6c2572de469c tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Request method failure captured: Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN43rC88i34BDYEVgPDcI5zGwUOmfIQA8xRJuPIQgCJVoDNHJK0ljhmlangHtxCk5WHcSOzbjqI6BlrEkNrap8ll2Kf3XLTADrLsoKRNalzvI0Rw6l2SiEui612k2N7oDm9dPT8VN-Uf7BeVAfqys2yKw2n29BscHc6ZR9JWE1wAVd8 Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:41:43.650886 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8e7797583f743d49c21ee5e00523607", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8e7797583f743d49c21ee5e00523607"}]}] Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 30f67d5baa4f4242b9a4d06603cdcad3 Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: exception: Image not found. Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '-1'} Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:43.652467 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.653410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:43.654643 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb2c6617-503e-4524-a972-6c2572de469c tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Returning 404 to user: Image not found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bb2c6617-503e-4524-a972-6c2572de469c tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] 10.222.0.83 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.091340 Aug 29 15:41:43.655943 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 636/1214] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 15:41:43 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:41:43.664267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-826d2c3f-fb80-40af-9413-ccaeedfad48a tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Calling method '.version_select at 0x7f32ee780dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.677606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.678357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:43.687258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:43.687956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:43.688535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:43.689469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:43.690489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:43.691269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:43.694726 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-826d2c3f-fb80-40af-9413-ccaeedfad48a tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] HTTP exception thrown: Image not found. Aug 29 15:41:43.697538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-826d2c3f-fb80-40af-9413-ccaeedfad48a tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Request method failure captured: Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/47c95c4b-6707-4a9f-ac19-254266037aej HTTP/1.1 Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN43rC88i34BDYEVgPDcI5zGwUOmfIQA8xRJuPIQgCJVoDNHJK0ljhmlangHtxCk5WHcSOzbjqI6BlrEkNrap8ll2Kf3XLTADrLsoKRNalzvI0Rw6l2SiEui612k2N7oDm9dPT8VN-Uf7BeVAfqys2yKw2n29BscHc6ZR9JWE1wAVd8 Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:43.702653 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8e7797583f743d49c21ee5e00523607", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8e7797583f743d49c21ee5e00523607"}]}] Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 30f67d5baa4f4242b9a4d06603cdcad3 Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '47c95c4b-6707-4a9f-ac19-254266037aej'} Aug 29 15:41:43.704300 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 47c95c4b-6707-4a9f-ac19-254266037aej to delete Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.705289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 47c95c4b-6707-4a9f-ac19-254266037aej could not be found. Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:43.706626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-826d2c3f-fb80-40af-9413-ccaeedfad48a tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:43.711840 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-826d2c3f-fb80-40af-9413-ccaeedfad48a tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] 10.222.0.83 "DELETE /compute/v2.1/images/47c95c4b-6707-4a9f-ac19-254266037aej" status: 404 len: 62 microversion: 2.1 time: 0.046823 Aug 29 15:41:43.712991 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 579/1215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:43 2022] DELETE /compute/v2.1/images/47c95c4b-6707-4a9f-ac19-254266037aej => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:43.720928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-00a8a986-06af-42d5-a102-0c796b503a62 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Calling method '.version_select at 0x7f32ee63f9d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.748038 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-00a8a986-06af-42d5-a102-0c796b503a62 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] HTTP exception thrown: Image not found. Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-00a8a986-06af-42d5-a102-0c796b503a62 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Request method failure captured: Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/e8cf0524-748a-413b-8d4e-f4a3565383fd1 HTTP/1.1 Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN43rC88i34BDYEVgPDcI5zGwUOmfIQA8xRJuPIQgCJVoDNHJK0ljhmlangHtxCk5WHcSOzbjqI6BlrEkNrap8ll2Kf3XLTADrLsoKRNalzvI0Rw6l2SiEui612k2N7oDm9dPT8VN-Uf7BeVAfqys2yKw2n29BscHc6ZR9JWE1wAVd8 Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:43.749810 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8e7797583f743d49c21ee5e00523607", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8e7797583f743d49c21ee5e00523607"}]}] Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 30f67d5baa4f4242b9a4d06603cdcad3 Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e8cf0524-748a-413b-8d4e-f4a3565383fd1'} Aug 29 15:41:43.751115 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8cf0524-748a-413b-8d4e-f4a3565383fd1 to delete Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.751921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8cf0524-748a-413b-8d4e-f4a3565383fd1 could not be found. Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:43.753024 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-00a8a986-06af-42d5-a102-0c796b503a62 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:43.755402 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-00a8a986-06af-42d5-a102-0c796b503a62 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] 10.222.0.83 "DELETE /compute/v2.1/images/e8cf0524-748a-413b-8d4e-f4a3565383fd1" status: 404 len: 62 microversion: 2.1 time: 0.038020 Aug 29 15:41:43.756298 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 580/1216] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:41:43 2022] DELETE /compute/v2.1/images/e8cf0524-748a-413b-8d4e-f4a3565383fd1 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:41:43.765742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed9c4073-58a4-423a-b144-fcee94d84417 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Calling method '.version_select at 0x7f32ee855940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.790449 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ed9c4073-58a4-423a-b144-fcee94d84417 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] HTTP exception thrown: Image not found. Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed9c4073-58a4-423a-b144-fcee94d84417 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Request method failure captured: Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/tempest-invalid-867004774 HTTP/1.1 Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN43rC88i34BDYEVgPDcI5zGwUOmfIQA8xRJuPIQgCJVoDNHJK0ljhmlangHtxCk5WHcSOzbjqI6BlrEkNrap8ll2Kf3XLTADrLsoKRNalzvI0Rw6l2SiEui612k2N7oDm9dPT8VN-Uf7BeVAfqys2yKw2n29BscHc6ZR9JWE1wAVd8 Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:43.792216 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8e7797583f743d49c21ee5e00523607", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8e7797583f743d49c21ee5e00523607"}]}] Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 30f67d5baa4f4242b9a4d06603cdcad3 Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'tempest-invalid-867004774'} Aug 29 15:41:43.793527 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-867004774 to delete Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.794302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-867004774 could not be found. Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:43.796444 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed9c4073-58a4-423a-b144-fcee94d84417 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:43.798930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed9c4073-58a4-423a-b144-fcee94d84417 tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] 10.222.0.83 "DELETE /compute/v2.1/images/tempest-invalid-867004774" status: 404 len: 62 microversion: 2.1 time: 0.033928 Aug 29 15:41:43.800062 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 581/1217] 10.222.0.83 () {58 vars in 1203 bytes} [Mon Aug 29 15:41:43 2022] DELETE /compute/v2.1/images/tempest-invalid-867004774 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:41:43.804942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f44a3bb5-1c1d-4ca5-8236-c3da23dcf5ec tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Calling method '.version_select at 0x7f32ee63f310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.807694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:43.818318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:43.820088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:43.825824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1a1736c7-883d-4c9e-8c51-8431d45c16c8 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1453 microversion: 2.75 time: 0.154415 Aug 29 15:41:43.826392 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 637/1218] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:41:43.846269 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f44a3bb5-1c1d-4ca5-8236-c3da23dcf5ec tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] HTTP exception thrown: Image not found. Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f44a3bb5-1c1d-4ca5-8236-c3da23dcf5ec tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Request method failure captured: Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/152a1356-d830-4ce8-ba0e-f3c8ff4f9f65 HTTP/1.1 Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN43rC88i34BDYEVgPDcI5zGwUOmfIQA8xRJuPIQgCJVoDNHJK0ljhmlangHtxCk5WHcSOzbjqI6BlrEkNrap8ll2Kf3XLTADrLsoKRNalzvI0Rw6l2SiEui612k2N7oDm9dPT8VN-Uf7BeVAfqys2yKw2n29BscHc6ZR9JWE1wAVd8 Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:41:43.848746 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8e7797583f743d49c21ee5e00523607", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8e7797583f743d49c21ee5e00523607"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8e7797583f743d49c21ee5e00523607"}]}] Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d8e7797583f743d49c21ee5e00523607 Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-56405891 Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 30f67d5baa4f4242b9a4d06603cdcad3 Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-56405891-project Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '152a1356-d830-4ce8-ba0e-f3c8ff4f9f65'} Aug 29 15:41:43.850325 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 152a1356-d830-4ce8-ba0e-f3c8ff4f9f65 to delete Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.851381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 152a1356-d830-4ce8-ba0e-f3c8ff4f9f65 could not be found. Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:43.852719 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f44a3bb5-1c1d-4ca5-8236-c3da23dcf5ec tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:43.853966 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f44a3bb5-1c1d-4ca5-8236-c3da23dcf5ec tempest-ImagesDeleteNegativeTestJSON-56405891 tempest-ImagesDeleteNegativeTestJSON-56405891-project] 10.222.0.83 "DELETE /compute/v2.1/images/152a1356-d830-4ce8-ba0e-f3c8ff4f9f65" status: 404 len: 62 microversion: 2.1 time: 0.050078 Aug 29 15:41:43.855657 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 582/1219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:43 2022] DELETE /compute/v2.1/images/152a1356-d830-4ce8-ba0e-f3c8ff4f9f65 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:41:43.993387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:43.994073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:44.000360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.000847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.001805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.002218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.002679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.003125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.091648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:44.092270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:44.106798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.107527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.107977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.111746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.116948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.117450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.203292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:44.213890 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b51baff-e831-4a09-b67b-90cc8185b7a5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.224409 Aug 29 15:41:44.214462 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 638/1220] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:43 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:44.429994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:44.451161 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78ba37df-cde0-438f-933f-9b2e92ea3be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.365150 Aug 29 15:41:44.451738 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 583/1221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:44 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:44.870837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:44.872829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:44.881021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.881387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.881936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.882694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:44.883399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:44.883959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:44.970373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:44.980421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:44.981387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:44.987174 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-86fbae2e-e04c-4dc2-b932-45ff919a99d3 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1438 microversion: 2.75 time: 0.139101 Aug 29 15:41:44.987763 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 639/1222] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:44 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1438 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:45.235646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.236610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:45.244115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.244894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.245643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.247387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.248149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.248904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.499593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:45.502968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:45.521423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.522114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.523548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.524284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.526525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.527154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.528621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:45.537147 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7370bbfc-89fc-4ec4-abf5-05c6c1753d63 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.305658 Aug 29 15:41:45.537665 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 640/1223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:45 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:45.554577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d8c65e6-1dce-415e-b046-9134b1094e7d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee51d430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.637321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:45.638079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:45.638969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:45.639653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:45.640543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:45.645408 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d8c65e6-1dce-415e-b046-9134b1094e7d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/3ccb43ed-5792-4868-9a94-ff01650c134c" status: 200 len: 662 microversion: 2.1 time: 0.101499 Aug 29 15:41:45.646168 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 641/1224] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:45 2022] GET /compute/v2.1/images/3ccb43ed-5792-4868-9a94-ff01650c134c => generated 662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:45.660306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.662437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:45.670338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.670828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.671380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.672075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.672522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.672939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.721997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=16 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:45.750142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:45.759459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.760060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.760822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.761617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:45.762614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:45.763181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:45.945991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:45.956788 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bf573e0b-d400-4dc7-bf90-49bc7add11d0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.300594 Aug 29 15:41:45.958651 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 642/1225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:45 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:45.965211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-708576b5-fd48-49c9-99d1-066c5c6dca4d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee468d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:45.975509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:46.004210 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39fd585d-f39a-4f82-ad45-d96587efcbc0 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0/action" status: 202 len: 1944 microversion: 2.75 time: 0.995551 Aug 29 15:41:46.005571 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 584/1226] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:41:45 2022] POST /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0/action => generated 1944 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:41:46.032309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:46.032919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:46.039678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.040180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.040619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.041389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.041753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.042175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.056878 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-708576b5-fd48-49c9-99d1-066c5c6dca4d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/3ccb43ed-5792-4868-9a94-ff01650c134c" status: 200 len: 662 microversion: 2.1 time: 0.096274 Aug 29 15:41:46.057491 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 643/1227] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:45 2022] GET /compute/v2.1/images/3ccb43ed-5792-4868-9a94-ff01650c134c => generated 662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:46.507614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:46.546226 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca59afb8-6576-487d-a95d-f90b0bd55383 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.517921 Aug 29 15:41:46.546743 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 585/1228] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:46 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:41:46.563554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:46.563554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:46.572012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.572707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.573550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.577263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:46.577934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:46.578631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:46.965195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:46.975387 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f7e8ce9-84e7-4c1a-9956-359c2554cdbf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.420893 Aug 29 15:41:46.979995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:46.981231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:46.991566 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 644/1229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:46 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:46.996229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=20 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:46.999171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.001745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.007854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.008546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.009018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.009687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.392111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:47.401334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd41698c-787c-4956-b22c-b17638930249 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.426454 Aug 29 15:41:47.402212 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 586/1230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:46 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:47.571873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:47.572645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:47.586292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.588718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.591487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.592557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:47.596319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:47.598063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:47.800591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:47.842879 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed81d39b-e6d2-48b1-84ca-198d8fb46d92 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.274199 Aug 29 15:41:47.855208 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 645/1231] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:47 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:47.866489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8fe9c2cd-5ac6-474e-b09b-8d511fed9840 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee79a670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:47.935610 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8fe9c2cd-5ac6-474e-b09b-8d511fed9840 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/d757a595-9cdc-4776-a74a-8698b73bb77b" status: 200 len: 661 microversion: 2.1 time: 0.073917 Aug 29 15:41:47.937828 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 587/1232] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:47 2022] GET /compute/v2.1/images/d757a595-9cdc-4776-a74a-8698b73bb77b => generated 661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:47.949844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f752c75-2963-485d-a58a-2f3d0d09aa3a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee4ee0d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:47.999368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:48.000199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:48.013110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.013611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.014048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.014754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.017287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f752c75-2963-485d-a58a-2f3d0d09aa3a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/d757a595-9cdc-4776-a74a-8698b73bb77b" status: 200 len: 661 microversion: 2.1 time: 0.071205 Aug 29 15:41:48.019048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 646/1233] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:47 2022] GET /compute/v2.1/images/d757a595-9cdc-4776-a74a-8698b73bb77b => generated 661 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:48.024700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.029097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.159302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1553870942", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:48.231668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:48.523461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:48.530543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:48.531000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:48.531654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:48.532284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:48.532857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:48.533605 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f22054d8-04d5-49ef-aac9-9c77b2ce85ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.540002 Aug 29 15:41:48.534354 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 588/1234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:47 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:48.539616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:48.542218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:48.548930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.549434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.549711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.549874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.550204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.550633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.552269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.553080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.553800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.556236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:48.556892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:48.561544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:48.594033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Getting quotas for project d41e3c60ee6c4e41bb046e0e585ae41d. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:48.601337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Getting quotas for user 29fa4fbf7bb34c13952163feeaafe738 and project d41e3c60ee6c4e41bb046e0e585ae41d. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:48.617032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:48.619880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:48.707281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d78e03fe-298f-449c-beb3-d4451af00d2b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552769 Aug 29 15:41:48.708513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 647/1235] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:41:48.799639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-956237506", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:48.875997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:41:49.350956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:41:49.351671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:41:49.352222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:41:49.352921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:41:49.353617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:41:49.373555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.381691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.384033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.385422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.386169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.386850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.390064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:49.405091 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6501f7fe-05a3-482e-a0a8-e78b15ec5da6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.864820 Aug 29 15:41:49.406905 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 589/1236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:48 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:49.424105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:49.424626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:49.432112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Getting quotas for project d41e3c60ee6c4e41bb046e0e585ae41d. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:41:49.436045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.436558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.438332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.440208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Getting quotas for user 29fa4fbf7bb34c13952163feeaafe738 and project d41e3c60ee6c4e41bb046e0e585ae41d. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:41:49.453819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.454404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.454889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.457413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:41:49.459799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:41:49.528650 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a869644-4bb7-40c1-b95b-486ae95e5232 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737553 Aug 29 15:41:49.529477 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 648/1237] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:41:49.541333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-059bd35d-4c03-4e2b-bfae-18dfe5aa1b9a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:49.543583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-059bd35d-4c03-4e2b-bfae-18dfe5aa1b9a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:49.612322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:49.667782 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8056e8a-1595-4b16-9bc9-2bf46d4dbd81 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.259711 Aug 29 15:41:49.670188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 590/1238] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:49 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:49.675919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-059bd35d-4c03-4e2b-bfae-18dfe5aa1b9a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:49.682668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:49.685610 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-059bd35d-4c03-4e2b-bfae-18dfe5aa1b9a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1217 microversion: 2.1 time: 0.148780 Aug 29 15:41:49.686013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:49.689884 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 649/1239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:49 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:49.714381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.716230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.717600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:49.718483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:49.721298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:49.721925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.108677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:50.120862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5cf0937-fb01-4560-ae5b-c9a50ef0a9f1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.448357 Aug 29 15:41:50.121492 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 591/1240] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:49 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:50.426999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:50.427910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:50.441591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.443473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.444219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.445265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.445965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.446684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.689657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:50.699635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:50.700977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:50.707883 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b12b543-1352-4859-956a-1c17c1d8c093 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.283692 Aug 29 15:41:50.709207 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 650/1241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:50 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:50.714642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:50.715448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:50.717628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:50.720584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.721092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.721597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.722326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.722685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.722824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.723238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.723691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.724291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.725139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:50.725762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:50.726335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:50.853804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:50.865851 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-996df2f8-53b4-41ae-8f78-1f0eab28853a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1213 microversion: 2.1 time: 0.155388 Aug 29 15:41:50.867676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 651/1242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:50 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:50.889858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:50.900015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:50.945246 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e38121f-bcc3-4c85-8dd4-0f6a54fd92c5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.249401 Aug 29 15:41:50.960667 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 592/1243] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:50 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:51.151132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:51.152017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:51.161484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.162434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.163079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.164013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.164791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.165375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.736907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:51.738230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:51.747105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.748036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.749634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.750564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.751328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.751964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.869252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:51.877336 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a34a232-1977-48cc-aa24-eed6bc70d24a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1498 microversion: 2.1 time: 0.738449 Aug 29 15:41:51.881115 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 652/1244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:51 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1498 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:51.897460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:51.898084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:51.909944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.911397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.913770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:51.914623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:51.915684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:51.916768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.099745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:52.123059 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38efe895-df29-418d-baa9-0c6914ff3e81 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.390021 Aug 29 15:41:52.137477 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 593/1245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:51 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:52.145890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:52.147964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:52.148407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:52.157839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-404098ef-14bc-4e4d-a2bf-1ad8f198cf9f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1269 microversion: 2.1 time: 0.267740 Aug 29 15:41:52.158059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.158877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.159066 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 653/1246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:51 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1269 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:52.159978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.162026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.163522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.164180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.320280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:52.369037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d40e1342-af05-42f5-9d0b-debbe7b06942 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.229209 Aug 29 15:41:52.370154 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 594/1247] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:52 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:52.929697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:52.943084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:52.958183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.962963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.966776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:52.967781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:52.970590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:52.971228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.145867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:53.147373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:53.166043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.167266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.168496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.172005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.172766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.174192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.608922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:53.623158 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a12fc99-b0c6-47f3-ad23-dcd1e82d39ce tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 200 len: 1475 microversion: 2.1 time: 0.718002 Aug 29 15:41:53.625366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 654/1248] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:52 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 1475 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:53.637499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:53.638328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:53.648884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.649659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.650359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.651260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.651862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.652429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.755230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:53.771212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3977b22-140d-4495-a0bb-8295a004859c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.628544 Aug 29 15:41:53.773389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 595/1249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:53.785256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:53.786980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:53.800977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.802007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.802454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.803201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.803657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.804080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.854280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:53.867336 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09a74f35-803f-406a-8df7-7f4fc83f6438 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1275 microversion: 2.1 time: 0.240679 Aug 29 15:41:53.867919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 655/1250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:53.874673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-366658446"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:53.887550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:53.898442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.899367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.903451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.904403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:53.905071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:53.907765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:53.952091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:53.993372 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dcb34a49-fcba-4985-b807-aa7419eb8469 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.216811 Aug 29 15:41:54.003056 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 596/1251] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:54.011808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.014493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:54.044879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.045737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.046372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.047308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.048812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.050485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.438625 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7fad0458-f735-42fb-bd7f-f7826176e57d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40/action" status: 202 len: 0 microversion: 2.1 time: 0.567228 Aug 29 15:41:54.453062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 656/1252] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:41:53 2022] POST /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:41:54.460985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe558237-d62e-4911-bcc6-efb390db4436 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee4f8280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.523237 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe558237-d62e-4911-bcc6-efb390db4436 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.068407 Aug 29 15:41:54.523831 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 657/1253] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:54 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:54.674624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:54.713059 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d2bde80-4289-46aa-9fcd-e1ec36ba0faa tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 2424 microversion: 2.25 time: 0.713691 Aug 29 15:41:54.713668 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 597/1254] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:53 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 2424 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:54.736280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-13", "block_migration": "auto"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:54.739790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:54.766566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.767373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.768580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.773044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.774671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.776429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.798024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:54.798865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:54.809319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.813304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.814059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.815079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:54.815758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:54.819284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:54.833546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:54.872717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'flavor' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:54.908440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Going to try to live migrate instance to n-h2-836830-13 {{(pid=129133) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:41:55.249677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:55.259959 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d12829c-66c8-406c-bb10-2fdf4dee7438 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.465885 Aug 29 15:41:55.265789 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 598/1255] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:54 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:41:55.281920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:55.282824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:55.291994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.292726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.293403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:55.294439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.295148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.295868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:55.461056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:55.481066 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08945a97-6c15-4e96-a4b3-8910a9952e71 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1275 microversion: 2.1 time: 0.203593 Aug 29 15:41:55.496658 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 599/1256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:55 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:55.508529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:55.510278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:55.524517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.526421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.528310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:55.529297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:55.530883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:55.531593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:55.701664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:55.764561 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-058cb415-1b0f-4625-b12e-964ffe88f832 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.261888 Aug 29 15:41:55.765560 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 600/1257] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:55 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:55.967633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e938942e-a387-46e8-b75f-12b610484737 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee4fe940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1153367144", "description": "tempest-description-48052908"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:56.676714 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e938942e-a387-46e8-b75f-12b610484737 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.909831 Aug 29 15:41:56.685705 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 601/1258] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:41:55 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:56.692459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-64501aea-32d2-4400-8f93-b68d6289f1f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee5540d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:56.805733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-64501aea-32d2-4400-8f93-b68d6289f1f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.118395 Aug 29 15:41:56.806430 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 602/1259] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:56 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:56.816456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2b93dc67-31c1-46d4-80b6-de3266444888 req-d27ccd50-4470-490a-a611-c6781c2cb74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c1c64a-0520-432c-8c72-608633f27d35", "tag": "38a41bff-78ab-411e-8d27-7a0d76ee3a93"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:56.842328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2b93dc67-31c1-46d4-80b6-de3266444888 req-d27ccd50-4470-490a-a611-c6781c2cb74b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.842807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2b93dc67-31c1-46d4-80b6-de3266444888 req-d27ccd50-4470-490a-a611-c6781c2cb74b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.845454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2b93dc67-31c1-46d4-80b6-de3266444888 req-d27ccd50-4470-490a-a611-c6781c2cb74b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.891003 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2b93dc67-31c1-46d4-80b6-de3266444888 req-d27ccd50-4470-490a-a611-c6781c2cb74b service nova] Creating event network-changed:38a41bff-78ab-411e-8d27-7a0d76ee3a93 for instance 55c1c64a-0520-432c-8c72-608633f27d35 on n-h1-836830-13 Aug 29 15:41:56.905073 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2b93dc67-31c1-46d4-80b6-de3266444888 req-d27ccd50-4470-490a-a611-c6781c2cb74b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095638 Aug 29 15:41:56.906014 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 603/1260] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:56.914251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:56.915194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:56.925016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.926056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.927426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:56.929138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:56.932329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:56.933032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:57.373089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:57.387248 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2425bab5-cbab-473b-8a06-0f0c0a5ca29a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.475672 Aug 29 15:41:57.388485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 604/1261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:56 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:57.394771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:57.395888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:57.404001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:57.405294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:57.406322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:57.407553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:57.408715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:57.409550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:57.685422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:57.699343 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-295f7872-8557-4c76-be63-f4fe1df3d36c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.308451 Aug 29 15:41:57.705573 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 605/1262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:57 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:57.710112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c29382a-3806-4a91-b4e8-b1c2963c854d tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee4feee0>, body: {"security_group_rule": {"parent_group_id": "ab9b1435-733c-428d-ab43-d62a35cf7c2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:58.031238 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c29382a-3806-4a91-b4e8-b1c2963c854d tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.329173 Aug 29 15:41:58.031896 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 606/1263] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:41:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:58.043932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.044812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:58.050794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.051899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.052331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.053219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.053612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.054032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.152742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:58.171916 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-976d9b2c-38b8-47bf-99bb-19a978041ddd tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.131802 Aug 29 15:41:58.173528 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 607/1264] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:58.299303 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c84e3957-9afe-4e7e-96cc-031091ebdd33 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/action" status: 202 len: 0 microversion: 2.25 time: 3.566580 Aug 29 15:41:58.304596 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 658/1265] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:41:54 2022] POST /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/action => generated 0 bytes in 3573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:41:58.309679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca66ed2f-a5e9-4ce9-81b3-ab0c75751267 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee4ee3a0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.326493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "68afa39e-cb1f-4599-89b3-b42f61e0b223"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:58.333460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:58.340804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.341740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.342387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.343662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.344474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.345222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.363265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca66ed2f-a5e9-4ce9-81b3-ab0c75751267 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.056860 Aug 29 15:41:58.365445 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 659/1266] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:58.370532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d0225bba-180f-452c-a803-68b27f6b24a1 req-5add730e-46d0-4e4d-80a9-4a5b3f38f559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb580cd6-da8c-430a-8c23-39f4a6c236b4", "tag": "1495779a-a585-4e87-b55b-b1050fd3f0b5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:58.390916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d0225bba-180f-452c-a803-68b27f6b24a1 req-5add730e-46d0-4e4d-80a9-4a5b3f38f559 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.391958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d0225bba-180f-452c-a803-68b27f6b24a1 req-5add730e-46d0-4e4d-80a9-4a5b3f38f559 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.392778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d0225bba-180f-452c-a803-68b27f6b24a1 req-5add730e-46d0-4e4d-80a9-4a5b3f38f559 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.408610 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d0225bba-180f-452c-a803-68b27f6b24a1 req-5add730e-46d0-4e4d-80a9-4a5b3f38f559 service nova] Creating event network-changed:1495779a-a585-4e87-b55b-b1050fd3f0b5 for instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 on n-h1-836830-13 Aug 29 15:41:58.421118 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d0225bba-180f-452c-a803-68b27f6b24a1 req-5add730e-46d0-4e4d-80a9-4a5b3f38f559 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054363 Aug 29 15:41:58.422140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 660/1267] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:58.430500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5c893fa-2510-43ad-b6e8-2a3250cb64ca tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee4ee8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1447590280", "description": "tempest-description-1139244443"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:58.671426 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] HTTP exception thrown: Volume 68afa39e-cb1f-4599-89b3-b42f61e0b223 could not be found. Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Request method failure captured: Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments/7cd12b22-97ef-4c1d-a2c4-9cf806e49575 HTTP/1.1 Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 74 Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2rHwvuMrspBtxc-KTvMIwlUJAUSKJfMXly-IRulEdLrkBv7eY9L4mxcjp8RKfTpt1wLAP8Ob6g-SZrjxg2Z7rQqs6HE6MMM1CaR8ZSdJZm6zo_GjIBv5-PjcIii-FIY-pBJFC52DsCIYFvL4Ii3FXHxUM6hrlLZcL150PlR4Otdc0 Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a622fa01676b457e8bc242b060df727a Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesAdminNegativeTest-1982012281 Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 15:41:58.675756 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a622fa01676b457e8bc242b060df727a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a622fa01676b457e8bc242b060df727a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a622fa01676b457e8bc242b060df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a622fa01676b457e8bc242b060df727a"}]}] Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesAdminNegativeTest-1982012281 Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a622fa01676b457e8bc242b060df727a Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1982012281 Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesAdminNegativeTest-1982012281-project-admin Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: d6b7cd8a80a14209a18d66171186acaf Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesAdminNegativeTest-1982012281-project-admin Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: {"volumeAttachment": {"volumeId": "68afa39e-cb1f-4599-89b3-b42f61e0b223"}} Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:41:58.677905 n-d-836830-13 devstack@n-api.service[129132]: exception: Volume 68afa39e-cb1f-4599-89b3-b42f61e0b223 could not be found. Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': 'f2f4e3dc-31bd-4a4c-9227-6f82b15689dd', 'id': '7cd12b22-97ef-4c1d-a2c4-9cf806e49575', 'body': {'volumeAttachment': {'volumeId': '68afa39e-cb1f-4599-89b3-b42f61e0b223'}}} Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:41:58.679710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68afa39e-cb1f-4599-89b3-b42f61e0b223 could not be found. (HTTP 404) (Request-ID: req-b2a137a8-b8e1-4e90-a996-d3bcba951ba6) Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:41:58.682397 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68afa39e-cb1f-4599-89b3-b42f61e0b223 could not be found. Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:41:58.685613 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 68afa39e-cb1f-4599-89b3-b42f61e0b223 could not be found. Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68afa39e-cb1f-4599-89b3-b42f61e0b223 could not be found. Aug 29 15:41:58.689031 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:41:58.691532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Returning 400 to user: Volume 68afa39e-cb1f-4599-89b3-b42f61e0b223 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:41:58.691532 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d751af6f-baf5-47cd-b239-fc600b394071 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] 10.222.0.83 "PUT /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments/7cd12b22-97ef-4c1d-a2c4-9cf806e49575" status: 400 len: 107 microversion: 2.1 time: 0.509516 Aug 29 15:41:58.691532 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 608/1268] 10.222.0.83 () {60 vars in 1433 bytes} [Mon Aug 29 15:41:58 2022] PUT /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments/7cd12b22-97ef-4c1d-a2c4-9cf806e49575 => generated 107 bytes in 513 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:41:58.702265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.703988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:58.727158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.727777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.731830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.733130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.733739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.734285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.818455 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5c893fa-2510-43ad-b6e8-2a3250cb64ca tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.394578 Aug 29 15:41:58.819733 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 661/1269] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:41:58 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:41:58.824869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:58.825604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:58.834702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.835677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.836325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:58.837340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:58.841054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:58.841784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.150857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:59.172328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:59.177968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:59.181592 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84ff024a-3766-4285-892f-4c99c8d3c5d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.492260 Aug 29 15:41:59.183377 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 609/1270] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:41:59.203158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:59.203989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:59.215525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.216021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.216751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.217941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.218596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.219286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.312201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:59.322311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c529131-88fa-43ae-af43-efa06a6c2bc3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.501838 Aug 29 15:41:59.332526 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 662/1271] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:58 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:59.347323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:41:59.347830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:41:59.354155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.354649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.358318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.359276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:41:59.362258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:41:59.362811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:41:59.461921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:59.596926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lazy-loading 'services' on Instance uuid f2f4e3dc-31bd-4a4c-9227-6f82b15689dd {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:41:59.686368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=14 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:41:59.686607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:41:59.696815 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee9d5b62-79d8-411a-a1f4-b892de1cb589 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.506777 Aug 29 15:41:59.711480 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 610/1272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:41:59 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:41:59.777464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-257099215", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9bbf042d-13bc-4426-83e8-c7e73123f015"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:59.836485 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b54fbf4-f7fc-4c9c-ae40-916565101e83 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments/7cd12b22-97ef-4c1d-a2c4-9cf806e49575" status: 202 len: 0 microversion: 2.1 time: 0.501848 Aug 29 15:41:59.838001 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 663/1273] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 15:41:59 2022] DELETE /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments/7cd12b22-97ef-4c1d-a2c4-9cf806e49575 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:41:59.856618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b66d91e5-5344-4940-a37a-3788906df3e2 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee37a700>, body: {"security_group_rule": {"parent_group_id": "3ad05757-4df4-47ff-83c3-632dcd8a9472", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:41:59.875431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] validate_networks() for [('9bbf042d-13bc-4426-83e8-c7e73123f015', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:00.218256 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b66d91e5-5344-4940-a37a-3788906df3e2 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.378410 Aug 29 15:42:00.219049 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 664/1274] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:41:59 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:00.225601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.226858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:00.236621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.237372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.237855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.238821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.239300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.239813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.346645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:00.385337 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5ccb2fd-4d5d-4d3f-9afe-a19d8159afb7 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.165043 Aug 29 15:42:00.386258 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 665/1275] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:00.392504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60bab891-1bf2-4ac1-8bde-0fcf24346787 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee37ab80>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.467783 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60bab891-1bf2-4ac1-8bde-0fcf24346787 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.080184 Aug 29 15:42:00.468518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 666/1276] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:00.474921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.478007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:00.488494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.491116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.491869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.492845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.493632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.494290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.535549 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f4a7c66-d176-4287-8ab2-a7762341dd86 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065654 Aug 29 15:42:00.537547 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 667/1277] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:00.543105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:00.544012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:00.555608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.556113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.556553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.557541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.560605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.566257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.791929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:00.836915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:00.840904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:00.847242 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4bfbf019-4439-4cdd-ad52-24af83e67289 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.305097 Aug 29 15:42:00.850795 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 668/1278] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:00 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:00.859848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23cc3250-a515-48f6-989c-8390616deb58 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee3cd550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1664683327", "description": "tempest-description-1108201656"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:00.893440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:00.894033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:00.894318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:00.895864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:00.896406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:00.917443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.917929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.918365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.919121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:00.919589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:00.920014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:00.961594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:00.970927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for user 853f8300f9bb403b9cea4834c5a1edcb and project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:01.010711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:01.013394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:01.106413 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e461423-bbff-473c-adff-1b146e735706 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393662 Aug 29 15:42:01.107667 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 611/1279] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:01.116624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.124131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:01.146587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.148493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.149276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.151937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.152629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.153861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.218826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:01.523207 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23cc3250-a515-48f6-989c-8390616deb58 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.671382 Aug 29 15:42:01.524413 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 669/1280] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:42:00 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:01.530619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.531429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:01.554470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.555346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.555967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.559219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.559846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.560429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.681374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:01.694568 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ae7293d-c5d1-4fee-b3ce-86dcf03a29f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.585569 Aug 29 15:42:01.705597 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 612/1281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:01.713145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25a1c647-3a68-425c-a7ee-0ed0a9916552 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.714130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25a1c647-3a68-425c-a7ee-0ed0a9916552 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:01.846453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25a1c647-3a68-425c-a7ee-0ed0a9916552 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:01.861732 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25a1c647-3a68-425c-a7ee-0ed0a9916552 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1214 microversion: 2.1 time: 0.147750 Aug 29 15:42:01.871198 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 613/1282] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:01.882420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:01.886705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:01.900659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.902454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.904089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:01.905170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:01.906161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:01.908378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.084721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:02.087835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.113297 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d11a4d88-9091-4791-8b2d-18af3c214fa7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.582678 Aug 29 15:42:02.132890 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 670/1283] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:02.144555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a69cd38f-8758-47c8-a644-0a4e0334671d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee3cda60>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.173473 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80a795be-bea1-49aa-81ac-c655f62d907d tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.297951 Aug 29 15:42:02.175649 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 614/1284] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:01 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:02.183934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fdb5fab0-4c56-43dd-95d7-772faf9edfa3 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee47d3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1136438640", "description": "tempest-description-1244436831"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:02.237369 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a69cd38f-8758-47c8-a644-0a4e0334671d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.103228 Aug 29 15:42:02.239593 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 671/1285] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:02.252486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.256861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.276724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.278738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.281037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.282040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.283273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.286064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.362545 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b4a86ca-5203-4c1a-b495-739f804b7954 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119221 Aug 29 15:42:02.365512 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 672/1286] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:02.372436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.374966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.394424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.395783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.397893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.401469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.402330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.403378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.517969 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fdb5fab0-4c56-43dd-95d7-772faf9edfa3 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.338606 Aug 29 15:42:02.519142 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 615/1287] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:42:02 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:02.531797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7eae890-f833-4c70-a7a1-4f6bb27e58b9 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee3f8700>, body: {"security_group_rule": {"parent_group_id": "8ef22594-055a-49ec-8e1b-71474d1cf960", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "1db72a81-2b3f-4d95-82aa-d6784e328850"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:02.767120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.784527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.790420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:02.791861 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f792605-a744-4c3b-9708-561c050b3f9c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.424441 Aug 29 15:42:02.792538 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 673/1288] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:02.819144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:02.819960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:02.832054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.833270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.836218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:02.837085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:02.837654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:02.838140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.003894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7eae890-f833-4c70-a7a1-4f6bb27e58b9 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.475850 Aug 29 15:42:03.014831 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 616/1289] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:42:02 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:03.020639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.024432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.043795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.044626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.046005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.048277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.048958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.050025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.078081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:03.088824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-159a45b7-1600-4fa6-bf0c-3c5e5210d3f0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.284384 Aug 29 15:42:03.089977 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 674/1290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:02 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.108807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c3bf2196-9f68-4640-9ec4-966a9f008c7f tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee2acca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1633338403", "description": "tempest-description-85952360"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:03.234798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:03.294172 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6542d0d3-4e14-4c66-a975-138777f4e5bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1266 microversion: 2.1 time: 0.277987 Aug 29 15:42:03.294803 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 617/1291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.307576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.308200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.344779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.345613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.346522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.347399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.348469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.351706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.408031 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c3bf2196-9f68-4640-9ec4-966a9f008c7f tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.302979 Aug 29 15:42:03.409172 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 675/1292] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:42:03 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:03.416774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.417802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.422844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:03.429692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.432474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.432946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.433689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.434148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.434574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.540755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:03.561375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:03.563252 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09e70a54-bfdb-4ceb-b4b1-8cc9609153d8 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.152307 Aug 29 15:42:03.568087 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 676/1293] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:03.573802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a00bf8a0-009e-40b8-ad20-8c406bcd2931 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee2ac160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.580611 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-974ec79b-eae2-4d55-a181-376e554c699b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.273235 Aug 29 15:42:03.581348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 618/1294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.589196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.597528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.605139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.605652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.606080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.606987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.607662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.608093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.644299 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a00bf8a0-009e-40b8-ad20-8c406bcd2931 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.074735 Aug 29 15:42:03.646135 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 677/1295] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:03.651176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0310ecdc-a191-4e4a-b4ab-a2aea742188a tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee3cda60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2006369213", "description": "tempest-description-1807039123"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:03.651912 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-954c160a-577d-47f4-9f9a-972e5c56a13c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069153 Aug 29 15:42:03.652491 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 619/1296] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:03.819042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:03.820838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:03.836825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.839098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.840812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.843136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:03.843896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:03.845743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:03.857122 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0310ecdc-a191-4e4a-b4ab-a2aea742188a tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.209554 Aug 29 15:42:03.858341 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 678/1297] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:42:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:03.871534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4474a674-8fb8-4a07-a5f8-bab1613eed1c tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee4680d0>, body: {"security_group_rule": {"parent_group_id": "54442aa1-9b79-4076-9b3e-44957535a40f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c383b5f9-2674-4161-a9b1-0014cbe8645b"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:04.044140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.055597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.058289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.059869 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2a4ae108-ecc5-4dbd-b55e-8f19c0994ce6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.246747 Aug 29 15:42:04.061320 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 620/1298] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:03 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:04.066360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d00c5910-1c61-467f-a14c-0a710f6c19d4 req-85fb3491-8c70-4931-ae07-276388712833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a5660c-ddba-4fd7-a7e8-a87e38ea1f40", "name": "network-vif-plugged", "status": "completed", "tag": "08dab329-5c8b-412e-87cf-d371e5f22396"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:04.078473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d00c5910-1c61-467f-a14c-0a710f6c19d4 req-85fb3491-8c70-4931-ae07-276388712833 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.079310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d00c5910-1c61-467f-a14c-0a710f6c19d4 req-85fb3491-8c70-4931-ae07-276388712833 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.079954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d00c5910-1c61-467f-a14c-0a710f6c19d4 req-85fb3491-8c70-4931-ae07-276388712833 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.093309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d00c5910-1c61-467f-a14c-0a710f6c19d4 req-85fb3491-8c70-4931-ae07-276388712833 service nova] Creating event network-vif-plugged:08dab329-5c8b-412e-87cf-d371e5f22396 for instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 on n-h2-836830-13 Aug 29 15:42:04.100961 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d00c5910-1c61-467f-a14c-0a710f6c19d4 req-85fb3491-8c70-4931-ae07-276388712833 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038031 Aug 29 15:42:04.101664 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 621/1299] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:04.111430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.112292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.120003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.120629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.121170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.122003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.122565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.123262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.242389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4474a674-8fb8-4a07-a5f8-bab1613eed1c tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.375749 Aug 29 15:42:04.243048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 679/1300] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:42:03 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:04.259437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-93969a28-9a41-45fe-91aa-be24cff8c961 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee37a670>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.348804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.361800 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-add7e9e5-4099-4761-8c0d-2fb340734ba5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1475 microversion: 2.1 time: 0.255234 Aug 29 15:42:04.376233 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 622/1301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1475 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:04.382062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.383182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.389603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.390310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.390906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.391822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.392440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.393114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.476807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:04.486157 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5c4f5b59-5402-4d74-8432-9d47b48e863c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1266 microversion: 2.1 time: 0.108466 Aug 29 15:42:04.486741 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 623/1302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:04.539900 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-93969a28-9a41-45fe-91aa-be24cff8c961 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/c383b5f9-2674-4161-a9b1-0014cbe8645b" status: 202 len: 0 microversion: 2.1 time: 0.287754 Aug 29 15:42:04.540732 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 680/1303] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:04 2022] DELETE /compute/v2.1/os-security-groups/c383b5f9-2674-4161-a9b1-0014cbe8645b => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:04.552438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f2a08aa-8b64-4f98-9546-723682ede22d tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee3e9940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.593407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.594077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.608809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.609299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.609725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.610427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.610871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.611331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.654328 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f2a08aa-8b64-4f98-9546-723682ede22d tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/54442aa1-9b79-4076-9b3e-44957535a40f" status: 200 len: 246 microversion: 2.1 time: 0.108884 Aug 29 15:42:04.655443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 624/1304] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/os-security-groups/54442aa1-9b79-4076-9b3e-44957535a40f => generated 246 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:04.659990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.660811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.670935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.671703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.672145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.672859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.673419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.673849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.754022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:04.796637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8731c9f4-14de-46b3-8aa5-374971a183a3 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.206108 Aug 29 15:42:04.797350 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 681/1305] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:04.803589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-597caf47-ba38-4364-92ef-6a7e9c4200f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee3cd310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.860590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-597caf47-ba38-4364-92ef-6a7e9c4200f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.061759 Aug 29 15:42:04.869448 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 682/1306] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:04.875265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:04.877444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:04.885385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.886360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.886978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.888036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:04.888630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:04.889075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:04.927651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe530211-9362-4f87-a11f-f0a2b84e8273 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063599 Aug 29 15:42:04.928563 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 683/1307] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:04.933243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc4f512b-8bc9-475a-918a-ab013d5e8ddf tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee332430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1420521189", "description": "tempest-description-513312565"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:04.988191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:05.002807 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc255005-8d77-4af2-b6ce-366cb4d7c41b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.346221 Aug 29 15:42:05.003579 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 625/1308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:04 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:05.083838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.085265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:05.117587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.118633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.119552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.120395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.121056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.121694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.229976 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc4f512b-8bc9-475a-918a-ab013d5e8ddf tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.300190 Aug 29 15:42:05.231292 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 684/1309] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:42:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:05.249572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-940d55ae-110b-4d74-ba0c-4b31a02ae9e3 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee3cda60>, body: {"security_group_rule": {"parent_group_id": "914eaaf1-a885-497d-86ec-464701befce7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:05.609309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:05.631786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:05.636809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:05.639912 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77de6caf-65d7-4365-b339-d196681400b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.559580 Aug 29 15:42:05.656843 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 626/1310] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:05 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:05.658922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:05.662391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:05.689125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.689776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.693900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:05.696015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:05.697754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:05.705636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.034645 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-940d55ae-110b-4d74-ba0c-4b31a02ae9e3 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.792553 Aug 29 15:42:06.037959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 685/1311] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:42:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:06.052526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.053851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.075944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.080164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.080632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.081392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.086454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.088133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.106164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:06.260515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.272729 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e51f44c8-ebd9-4d39-b521-c814ac35ef48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1272 microversion: 2.1 time: 0.233364 Aug 29 15:42:06.273540 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 686/1312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.302130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.305320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.320486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.322254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.328745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.330147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.330774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.331377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.439282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:06.448918 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-63ab6118-23d8-414b-9a70-ad8a29cfbe61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1474 microversion: 2.1 time: 0.805206 Aug 29 15:42:06.455180 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 627/1313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:05 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1474 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.466266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-435d9ac8-e152-495d-90e9-e0ad54848ebf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee404940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.499409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:06.539261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-435d9ac8-e152-495d-90e9-e0ad54848ebf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.083000 Aug 29 15:42:06.546539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 628/1314] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:06.548194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.556548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.572438 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7be47e37-99d9-475d-a1f4-0d67394d5f68 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.279794 Aug 29 15:42:06.573051 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 687/1315] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:06.585306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:06.589657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:06.596182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.596696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.597152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.597852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.601475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.602106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.607964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.608468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.608911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.610239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:06.610870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:06.611493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:06.649447 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa2d2f85-77db-427e-ba55-e029d330c100 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108207 Aug 29 15:42:06.654662 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 629/1316] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:06.666877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a734e449-ec23-41c5-bf7a-69ffc88aa0aa tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Action: 'create', calling method: .version_select at 0x7f32ee446ee0>, body: {"security_group_rule": {"parent_group_id": "914eaaf1-a885-497d-86ec-464701befce7", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:07.549028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:07.560819 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a75820e9-dda3-4ce9-b6d2-068a614492fd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.985957 Aug 29 15:42:07.562518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 688/1317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:06 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:07.572267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-78a3b50a-eec0-4d20-966e-64ece31c2f95 req-e57f58ff-d89a-48f5-80a5-fbfea50aff26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb580cd6-da8c-430a-8c23-39f4a6c236b4", "name": "network-vif-plugged", "status": "completed", "tag": "1495779a-a585-4e87-b55b-b1050fd3f0b5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:07.602222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78a3b50a-eec0-4d20-966e-64ece31c2f95 req-e57f58ff-d89a-48f5-80a5-fbfea50aff26 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.605059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78a3b50a-eec0-4d20-966e-64ece31c2f95 req-e57f58ff-d89a-48f5-80a5-fbfea50aff26 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.606436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78a3b50a-eec0-4d20-966e-64ece31c2f95 req-e57f58ff-d89a-48f5-80a5-fbfea50aff26 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.636346 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a734e449-ec23-41c5-bf7a-69ffc88aa0aa tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.973798 Aug 29 15:42:07.636936 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 630/1318] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:42:06 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:07.640460 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-78a3b50a-eec0-4d20-966e-64ece31c2f95 req-e57f58ff-d89a-48f5-80a5-fbfea50aff26 service nova] Creating event network-vif-plugged:1495779a-a585-4e87-b55b-b1050fd3f0b5 for instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 on n-h1-836830-13 Aug 29 15:42:07.641617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:07.642225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:07.659277 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-78a3b50a-eec0-4d20-966e-64ece31c2f95 req-e57f58ff-d89a-48f5-80a5-fbfea50aff26 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092273 Aug 29 15:42:07.662073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 689/1319] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:07.664727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.667536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.669750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.672396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d85c6b27-36c3-4935-910d-8be4870cada8 req-2064eeb1-8c6e-4bbc-95ef-ba34e2ef3e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4655c40-ac22-4aff-b255-ade7df5360e4", "name": "network-vif-unplugged", "status": "completed", "tag": "637658fb-18e7-4845-b4a4-d6913e7b26a6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:07.674016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.674682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.678395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.688974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d85c6b27-36c3-4935-910d-8be4870cada8 req-2064eeb1-8c6e-4bbc-95ef-ba34e2ef3e65 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.689629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d85c6b27-36c3-4935-910d-8be4870cada8 req-2064eeb1-8c6e-4bbc-95ef-ba34e2ef3e65 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.690371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d85c6b27-36c3-4935-910d-8be4870cada8 req-2064eeb1-8c6e-4bbc-95ef-ba34e2ef3e65 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.717515 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d85c6b27-36c3-4935-910d-8be4870cada8 req-2064eeb1-8c6e-4bbc-95ef-ba34e2ef3e65 service nova] Creating event network-vif-unplugged:637658fb-18e7-4845-b4a4-d6913e7b26a6 for instance b4655c40-ac22-4aff-b255-ade7df5360e4 on n-h1-836830-13 Aug 29 15:42:07.726100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-d85c6b27-36c3-4935-910d-8be4870cada8 req-2064eeb1-8c6e-4bbc-95ef-ba34e2ef3e65 service nova] Instance b4655c40-ac22-4aff-b255-ade7df5360e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:42:07.744316 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d85c6b27-36c3-4935-910d-8be4870cada8 req-2064eeb1-8c6e-4bbc-95ef-ba34e2ef3e65 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078228 Aug 29 15:42:07.745981 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 690/1320] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:07.752523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:07.753247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:07.760669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.761256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.762065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:07.762843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:07.763617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:07.764892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.056689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.068912 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-165458c0-bf1d-47e0-ae19-e3895ec2785e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.319867 Aug 29 15:42:08.083063 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 691/1321] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:07 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.083063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.083063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.103256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.104464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.105518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.106825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.109744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.114792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.481053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.503294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.505934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.507186 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f6b5536-f47d-4a73-a3e2-314901f3a00c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.869296 Aug 29 15:42:08.518689 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 631/1322] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:07 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:08.530926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2495c1b4-d1f7-4682-9e03-ae4be514d7ad tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee3e9940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.625719 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2495c1b4-d1f7-4682-9e03-ae4be514d7ad tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.099837 Aug 29 15:42:08.627350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 632/1323] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.632965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.648077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.667760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.668533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.669123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.669985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.670591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.673622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.715331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:08.727273 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c6d8f84-bda4-498e-9f5d-0d0bd7733ad2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1474 microversion: 2.1 time: 0.654781 Aug 29 15:42:08.744176 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 692/1324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1474 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:08.749485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aafe2568-b0a1-4e80-a4f9-286eb0d50cdb tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee55b940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.834177 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aafe2568-b0a1-4e80-a4f9-286eb0d50cdb tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/914eaaf1-a885-497d-86ec-464701befce7" status: 200 len: 664 microversion: 2.1 time: 0.088500 Aug 29 15:42:08.835354 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 693/1325] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/os-security-groups/914eaaf1-a885-497d-86ec-464701befce7 => generated 664 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:08.840578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.845140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.853460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.854214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.854860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.856036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.856693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.857311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.899053 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0b73fde-f191-46dd-96f7-8278fc544962 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062148 Aug 29 15:42:08.900081 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 694/1326] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:08.905006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:08.905670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:08.913158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.913790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.914341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.915187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:08.915754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:08.916326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:08.919346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:08.943785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a662db13-f8d7-4436-9db5-7fbe4f8cdaa4 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.315271 Aug 29 15:42:08.959199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 633/1327] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:08.966631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-96f73db6-9c95-4697-a0a8-bfb7ca5e4771 req-1ad36507-964a-4c36-b7d5-4322188936a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8812e03-0998-482f-9c15-31e6bc87c95d", "tag": "d604872a-ee68-4a4b-a75b-c588a57d0efb"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:09.023734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96f73db6-9c95-4697-a0a8-bfb7ca5e4771 req-1ad36507-964a-4c36-b7d5-4322188936a7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.024474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96f73db6-9c95-4697-a0a8-bfb7ca5e4771 req-1ad36507-964a-4c36-b7d5-4322188936a7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.025081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96f73db6-9c95-4697-a0a8-bfb7ca5e4771 req-1ad36507-964a-4c36-b7d5-4322188936a7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.055044 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-96f73db6-9c95-4697-a0a8-bfb7ca5e4771 req-1ad36507-964a-4c36-b7d5-4322188936a7 service nova] Creating event network-changed:d604872a-ee68-4a4b-a75b-c588a57d0efb for instance b8812e03-0998-482f-9c15-31e6bc87c95d on n-h2-836830-13 Aug 29 15:42:09.069133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-96f73db6-9c95-4697-a0a8-bfb7ca5e4771 req-1ad36507-964a-4c36-b7d5-4322188936a7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108580 Aug 29 15:42:09.074505 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 634/1328] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:09.086814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1b830c54-b5eb-442a-9fbe-6545c7b53d4f tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee3f8a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.163599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:09.172712 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33eab930-2c96-43a0-b02c-6b7179ef9186 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.271469 Aug 29 15:42:09.186304 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 695/1329] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:08 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:09.191485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.192877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:09.210025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.210949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.211729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.212580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.213268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.213952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.455458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:09.476611 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c393481-4af6-49c9-8b4f-74e3cd0e5927 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.288796 Aug 29 15:42:09.485566 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 696/1330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:09 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:09.506048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1814749104", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "21199f17-4c6d-400b-9a1f-170228f2818d"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:09.513309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1b830c54-b5eb-442a-9fbe-6545c7b53d4f tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-group-rules/89881ce7-6042-4236-bbfb-53ea0b637225" status: 202 len: 0 microversion: 2.1 time: 0.434458 Aug 29 15:42:09.513911 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 635/1331] 10.222.0.83 () {58 vars in 1287 bytes} [Mon Aug 29 15:42:09 2022] DELETE /compute/v2.1/os-security-group-rules/89881ce7-6042-4236-bbfb-53ea0b637225 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:09.528453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40ccdbfe-9fd0-4528-bae1-cf863e85b916 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee462670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.603423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] validate_networks() for [('21199f17-4c6d-400b-9a1f-170228f2818d', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:09.867562 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40ccdbfe-9fd0-4528-bae1-cf863e85b916 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/914eaaf1-a885-497d-86ec-464701befce7" status: 202 len: 0 microversion: 2.1 time: 0.343013 Aug 29 15:42:09.868545 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 636/1332] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:09 2022] DELETE /compute/v2.1/os-security-groups/914eaaf1-a885-497d-86ec-464701befce7 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:42:09.873912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:09.874681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:09.893336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.893904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.894345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:09.897220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:09.897920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:09.898360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.138679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.153314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.156036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.157495 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6343d28e-647b-4213-9b72-26b19d36b679 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.287949 Aug 29 15:42:10.158313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 637/1333] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:09 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:10.163712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd57ef2c-040e-422e-afdb-3edd8e0836dc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee3f80d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.204439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:10.206693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:10.208791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:10.209523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:10.210176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:10.223551 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd57ef2c-040e-422e-afdb-3edd8e0836dc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.063192 Aug 29 15:42:10.224377 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 638/1334] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.230615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b2903a47-1d90-41dc-b00e-a715cef8e7e5 req-12582d27-6382-4d5c-9a5a-67b8e6feb1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c1c64a-0520-432c-8c72-608633f27d35", "name": "network-vif-plugged", "status": "completed", "tag": "38a41bff-78ab-411e-8d27-7a0d76ee3a93"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:10.232733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.233351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.233900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.235989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.237508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:10.238102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.239068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.245590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b2903a47-1d90-41dc-b00e-a715cef8e7e5 req-12582d27-6382-4d5c-9a5a-67b8e6feb1dd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.246090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b2903a47-1d90-41dc-b00e-a715cef8e7e5 req-12582d27-6382-4d5c-9a5a-67b8e6feb1dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.246553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b2903a47-1d90-41dc-b00e-a715cef8e7e5 req-12582d27-6382-4d5c-9a5a-67b8e6feb1dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.259393 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b2903a47-1d90-41dc-b00e-a715cef8e7e5 req-12582d27-6382-4d5c-9a5a-67b8e6feb1dd service nova] Creating event network-vif-plugged:38a41bff-78ab-411e-8d27-7a0d76ee3a93 for instance 55c1c64a-0520-432c-8c72-608633f27d35 on n-h1-836830-13 Aug 29 15:42:10.267070 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b2903a47-1d90-41dc-b00e-a715cef8e7e5 req-12582d27-6382-4d5c-9a5a-67b8e6feb1dd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041289 Aug 29 15:42:10.267942 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 639/1335] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:10.274915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.275798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.276992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Getting quotas for project b14d17b6ccdc4d4d874ff1e303d3eb6c. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:10.282408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.283128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.283734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.284220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Getting quotas for user 53387bcdf14248b9bdf716e782b786d7 and project b14d17b6ccdc4d4d874ff1e303d3eb6c. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:10.284774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.285375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.286288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.302809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:10.307492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:10.311074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:10.388460 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a60e463-1076-48c7-ae18-7335b49cd4b0 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899683 Aug 29 15:42:10.389439 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 697/1336] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:10.399551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8bbd4ce3-d8ef-4c67-a716-9c64861f781b req-18689bcc-b09c-4a28-b834-5a37a923ebe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4655c40-ac22-4aff-b255-ade7df5360e4", "tag": "637658fb-18e7-4845-b4a4-d6913e7b26a6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:10.414510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8bbd4ce3-d8ef-4c67-a716-9c64861f781b req-18689bcc-b09c-4a28-b834-5a37a923ebe4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.415167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8bbd4ce3-d8ef-4c67-a716-9c64861f781b req-18689bcc-b09c-4a28-b834-5a37a923ebe4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.415879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8bbd4ce3-d8ef-4c67-a716-9c64861f781b req-18689bcc-b09c-4a28-b834-5a37a923ebe4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.430899 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8bbd4ce3-d8ef-4c67-a716-9c64861f781b req-18689bcc-b09c-4a28-b834-5a37a923ebe4 service nova] Creating event network-changed:637658fb-18e7-4845-b4a4-d6913e7b26a6 for instance b4655c40-ac22-4aff-b255-ade7df5360e4 on n-h1-836830-13 Aug 29 15:42:10.464005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-8bbd4ce3-d8ef-4c67-a716-9c64861f781b req-18689bcc-b09c-4a28-b834-5a37a923ebe4 service nova] Instance b4655c40-ac22-4aff-b255-ade7df5360e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:42:10.485290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8bbd4ce3-d8ef-4c67-a716-9c64861f781b req-18689bcc-b09c-4a28-b834-5a37a923ebe4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092992 Aug 29 15:42:10.493146 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 698/1337] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:10.507056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4e1ff94-eecc-42b5-8049-586d803f4fea tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee3ad430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.511424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.540321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c6967e2a-b788-46b1-bfd3-b657d3e3243a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1472 microversion: 2.1 time: 0.269914 Aug 29 15:42:10.543486 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 640/1338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.551882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.552911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.562490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-a4e1ff94-eecc-42b5-8049-586d803f4fea tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:42:10.562732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.563467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.563593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-a4e1ff94-eecc-42b5-8049-586d803f4fea tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Neutron security group c383b5f9-2674-4161-a9b1-0014cbe8645b not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:42:10.564178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.564323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a4e1ff94-eecc-42b5-8049-586d803f4fea tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] HTTP exception thrown: Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist Aug 29 15:42:10.564323 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-0bb68391-1bef-4f80-bb5f-92ab5a9189a8'] Aug 29 15:42:10.565851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.566669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.567964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4e1ff94-eecc-42b5-8049-586d803f4fea tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Request method failure captured: Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-security-groups/c383b5f9-2674-4161-a9b1-0014cbe8645b HTTP/1.1 Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5D_cQ7hbLVa4kx1e8R5L9zWCQRJV72RRUgi7h-Mq-Sl8j5Yse6CDFVu5UWEQJYFTuUBPwx5i1xKGLzfzfWBxEZ0UI8QauaUi14TlpPhRHtEQF30OQyK9wt5nTpU8fS7zhJRVpYuFVvJfcNvTo3ucji0URCR4dgCb2JOyWOeKpceTg Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b3a51af1d22640a7947141027832b034 Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2106133204 Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:42:10.572711 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b3a51af1d22640a7947141027832b034"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b3a51af1d22640a7947141027832b034", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b3a51af1d22640a7947141027832b034"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b3a51af1d22640a7947141027832b034"}]}] Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2106133204 Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b3a51af1d22640a7947141027832b034 Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2106133204 Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesTestJSON-2106133204-project Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ae91e75e4db544cda09ae9cbb5318b54 Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2106133204-project Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-0bb68391-1bef-4f80-bb5f-92ab5a9189a8'] Aug 29 15:42:10.576038 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'c383b5f9-2674-4161-a9b1-0014cbe8645b'} Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:42:10.577069 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bb68391-1bef-4f80-bb5f-92ab5a9189a8'] Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:42:10.578548 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bb68391-1bef-4f80-bb5f-92ab5a9189a8'] Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bb68391-1bef-4f80-bb5f-92ab5a9189a8'] Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:10.579949 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0bb68391-1bef-4f80-bb5f-92ab5a9189a8'] Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4e1ff94-eecc-42b5-8049-586d803f4fea tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Returning 404 to user: Security group c383b5f9-2674-4161-a9b1-0014cbe8645b does not exist Aug 29 15:42:10.584531 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-0bb68391-1bef-4f80-bb5f-92ab5a9189a8'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:10.585837 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4e1ff94-eecc-42b5-8049-586d803f4fea tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/c383b5f9-2674-4161-a9b1-0014cbe8645b" status: 404 len: 194 microversion: 2.1 time: 0.088186 Aug 29 15:42:10.592477 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 699/1339] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:10 2022] DELETE /compute/v2.1/os-security-groups/c383b5f9-2674-4161-a9b1-0014cbe8645b => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:10.602560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.607286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.618374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.621699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.622153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.627458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.627931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.628356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.710175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:10.733709 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13a87d7b-8052-4ce8-bf97-cdd49839c0d5 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.188833 Aug 29 15:42:10.773439 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 641/1340] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:10.783443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1aff34b5-0eea-47b7-b1d8-f63a59070af4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.787648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1aff34b5-0eea-47b7-b1d8-f63a59070af4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.861193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1aff34b5-0eea-47b7-b1d8-f63a59070af4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.876376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1aff34b5-0eea-47b7-b1d8-f63a59070af4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1218 microversion: 2.1 time: 0.101304 Aug 29 15:42:10.889666 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 642/1341] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.889666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.889666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:10.892617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.893163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.893636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.894363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:10.895152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:10.895549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:10.907805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:10.917403 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff96c1b5-3357-4bde-ac48-9e9ab9c7e892 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1317 microversion: 2.1 time: 0.323664 Aug 29 15:42:10.918375 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 700/1342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:10.923154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-172b6670-48a1-4c07-82ed-b317d0056071 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee55bd30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:10.929150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:11.099861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.114817 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1b2ff46-78f7-4785-8df9-ef278bb0a18d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.233689 Aug 29 15:42:11.117748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 643/1343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:10 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:11.184646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.185761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.199787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.200305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.200756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.203249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.204878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.205337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.391843 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-172b6670-48a1-4c07-82ed-b317d0056071 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/54442aa1-9b79-4076-9b3e-44957535a40f" status: 202 len: 0 microversion: 2.1 time: 0.472338 Aug 29 15:42:11.393603 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 701/1344] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:10 2022] DELETE /compute/v2.1/os-security-groups/54442aa1-9b79-4076-9b3e-44957535a40f => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:11.399806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce2568ee-2099-40a1-a410-bff39e320a5a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee7f2dc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.511749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce2568ee-2099-40a1-a410-bff39e320a5a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.116538 Aug 29 15:42:11.513062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 702/1345] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:11.525646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0676c072-c8bd-4968-893c-293e4fa067a7 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee4eeaf0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.541211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.582787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.592326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.596810 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbf80bae-ef7e-49cf-bdc2-9858b9511fbc tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.416515 Aug 29 15:42:11.607979 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 644/1346] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:11.630337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.631384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.638668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.639929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.640758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.641673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.642375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.642964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.829316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:11.833393 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0676c072-c8bd-4968-893c-293e4fa067a7 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/1db72a81-2b3f-4d95-82aa-d6784e328850" status: 202 len: 0 microversion: 2.1 time: 0.317192 Aug 29 15:42:11.833984 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 703/1347] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:11 2022] DELETE /compute/v2.1/os-security-groups/1db72a81-2b3f-4d95-82aa-d6784e328850 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:11.839920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.840730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:11.851000 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-623d94fd-93a5-4f90-8180-09a306bcf7ac tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1469 microversion: 2.1 time: 0.238226 Aug 29 15:42:11.863165 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 645/1348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:11.863380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.863380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.863380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.863380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:11.864341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:11.864341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:11.864565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4dd396c4-db9d-47cf-98c7-159193e30a6f tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee5de310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:11.971176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:12.016868 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ffad036-06bd-4e6e-996d-ce150814eead tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1931 microversion: 2.75 time: 0.181386 Aug 29 15:42:12.017467 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 704/1349] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:11 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1931 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:12.030108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:12.030604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.041317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.041867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.046619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.048148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.048639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.049089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.237304 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0733e62-785e-4191-8603-28c9f23ab31d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4/action" status: 204 len: 0 microversion: 2.1 time: 0.218436 Aug 29 15:42:12.238260 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 705/1350] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:12 2022] POST /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4/action => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:12.252489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.255148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.272635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.277555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.278464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.279545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.281085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.281875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.397666 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4dd396c4-db9d-47cf-98c7-159193e30a6f tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/8ef22594-055a-49ec-8e1b-71474d1cf960" status: 202 len: 0 microversion: 2.1 time: 0.544205 Aug 29 15:42:12.398958 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 646/1351] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:11 2022] DELETE /compute/v2.1/os-security-groups/8ef22594-055a-49ec-8e1b-71474d1cf960 => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:12.404322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.405156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.422293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.422992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.427979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.429010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.432772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.433671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.453046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:12.465964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-de6f52b3-ca6a-41a3-8072-74aa41ece4fd tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1222 microversion: 2.1 time: 0.223500 Aug 29 15:42:12.471330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 706/1352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:12.476638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:12.486677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:12.522536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.525467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.526157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:12.527126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:12.530269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:12.531066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.112432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:13.127451 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f6f5ef62-147e-41f7-a5ce-abe25ba994f9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1467 microversion: 2.1 time: 0.725290 Aug 29 15:42:13.134430 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 647/1353] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1467 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:13.142073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.147035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:13.160069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.164758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.165548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.167140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.167140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.170340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.234617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:13.245151 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9cb8ad15-8201-48c4-b053-c3678607cfc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.772524 Aug 29 15:42:13.276990 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 707/1354] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:12 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:13.305247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7cbf0e7-1e4e-432d-abd9-8ee1c3f9d9e0 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee55bee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.591715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:13.605611 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71edaae5-5c34-4fd6-a648-55468577801c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1469 microversion: 2.1 time: 0.467474 Aug 29 15:42:13.606224 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 648/1355] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:13 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1469 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:13.636484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-333e5a2d-097d-4330-a7e3-7b3aa43a22da tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee3e93a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.721358 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-333e5a2d-097d-4330-a7e3-7b3aa43a22da tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.094558 Aug 29 15:42:13.721944 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 649/1356] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:13 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:13.761398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.762021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:13.781637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.787198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.788057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.792786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.795574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.796340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.923876 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7cbf0e7-1e4e-432d-abd9-8ee1c3f9d9e0 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/3ad05757-4df4-47ff-83c3-632dcd8a9472" status: 202 len: 0 microversion: 2.1 time: 0.645027 Aug 29 15:42:13.925563 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 708/1357] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:13 2022] DELETE /compute/v2.1/os-security-groups/3ad05757-4df4-47ff-83c3-632dcd8a9472 => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:13.934423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:13.935860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:13.960117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.960748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.961320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.962145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:13.962708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:13.965717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:13.996205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:14.063827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:14.111834 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71ab69a7-2a88-45fc-8edf-d3e96f5d4cbe tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1937 microversion: 2.75 time: 0.184243 Aug 29 15:42:14.131048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 709/1358] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:13 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1937 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:14.131048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:14.131048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:14.148321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.150809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.154456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.154456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.154456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.157382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.729866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:14.741440 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7af21099-39b0-4817-9178-6164d980e15b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1318 microversion: 2.1 time: 0.627785 Aug 29 15:42:14.745563 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 710/1359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:14 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:14.755916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:14.758877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:14.776316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.780134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.781259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:14.783061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:14.787858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:14.788666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.130253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.152087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.154280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.155941 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2ec119d6-7eef-4554-a1ca-615e82296877 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 1.428884 Aug 29 15:42:15.159984 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 650/1360] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:13 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:15.175002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02443b59-4a55-4662-9b07-a7bfb0e0c440 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] Calling method '.version_select at 0x7f32ee4469d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.196077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.205566 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c17e0dbd-0adb-4d7b-ac1e-cd8d2368138e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1276 microversion: 2.1 time: 0.458721 Aug 29 15:42:15.211198 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 711/1361] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:14 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1276 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:15.222726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.223691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:15.243941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.244444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.245098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.245852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.246404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.247054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.514624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.529690 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19ee3c0b-9de7-4a49-a25e-2ec7662193dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.316972 Aug 29 15:42:15.547282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 712/1362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:15.556104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.557098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:15.564124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.565095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.566896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.568597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.569860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.570739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.804987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:15.817566 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3195ff8e-21e8-43aa-95a2-d641c0d3b979 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1469 microversion: 2.1 time: 0.268884 Aug 29 15:42:15.818278 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 713/1363] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:15.824703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bded9884-2a8e-48c4-b02c-fe6d34116f8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee62c430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.926453 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bded9884-2a8e-48c4-b02c-fe6d34116f8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.106880 Aug 29 15:42:15.934345 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 714/1364] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:15.943289 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02443b59-4a55-4662-9b07-a7bfb0e0c440 tempest-SecurityGroupRulesTestJSON-2106133204 tempest-SecurityGroupRulesTestJSON-2106133204-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/ab9b1435-733c-428d-ab43-d62a35cf7c2c" status: 202 len: 0 microversion: 2.1 time: 0.781193 Aug 29 15:42:15.944150 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 651/1365] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:42:15 2022] DELETE /compute/v2.1/os-security-groups/ab9b1435-733c-428d-ab43-d62a35cf7c2c => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:42:15.956323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.956594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:15.959068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:15.960533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:15.970752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.971647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.972268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.974356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.975196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.975811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.984361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.984863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.985310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:15.986588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:15.987316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:15.987765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.161024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:16.225226 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef5a3318-f6b2-4314-b38d-6365ff615446 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1937 microversion: 2.75 time: 0.289299 Aug 29 15:42:16.239281 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 715/1366] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1937 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:16.239281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-db4bf757-c038-40b5-89d1-94d172554934 req-e3cb1662-f70e-4874-bb2b-76a2364db2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4655c40-ac22-4aff-b255-ade7df5360e4", "name": "network-vif-plugged", "status": "completed", "tag": "637658fb-18e7-4845-b4a4-d6913e7b26a6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:16.251990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-db4bf757-c038-40b5-89d1-94d172554934 req-e3cb1662-f70e-4874-bb2b-76a2364db2e6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.253239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-db4bf757-c038-40b5-89d1-94d172554934 req-e3cb1662-f70e-4874-bb2b-76a2364db2e6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.257879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-db4bf757-c038-40b5-89d1-94d172554934 req-e3cb1662-f70e-4874-bb2b-76a2364db2e6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.289712 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-db4bf757-c038-40b5-89d1-94d172554934 req-e3cb1662-f70e-4874-bb2b-76a2364db2e6 service nova] Creating event network-vif-plugged:637658fb-18e7-4845-b4a4-d6913e7b26a6 for instance b4655c40-ac22-4aff-b255-ade7df5360e4 on n-h1-836830-13 Aug 29 15:42:16.305843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-db4bf757-c038-40b5-89d1-94d172554934 req-e3cb1662-f70e-4874-bb2b-76a2364db2e6 service nova] Instance b4655c40-ac22-4aff-b255-ade7df5360e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:42:16.334999 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-db4bf757-c038-40b5-89d1-94d172554934 req-e3cb1662-f70e-4874-bb2b-76a2364db2e6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104842 Aug 29 15:42:16.340808 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 716/1367] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:16.354519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:16.355420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.367274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.373847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.375622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.376336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.378725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.380992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.381651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.385461 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e154b83d-1a02-482c-9a61-bebec1a49377 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1468 microversion: 2.1 time: 0.431168 Aug 29 15:42:16.406417 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 652/1368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:15 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:16.412627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:16.413533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.420754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.421490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.422364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.423402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.424047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.424635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.754611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.761787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.770739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.772569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:16.774583 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1bb62334-c019-4699-8730-109eb666644d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.366444 Aug 29 15:42:16.778565 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-85578ca7-a7e8-49e5-8347-4f59be701d82 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.430136 Aug 29 15:42:16.779520 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 717/1369] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:16 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:16.787568 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 653/1370] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:16 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:16.793707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:16.801399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-952269838"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:16.802729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.811381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:16.817176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.822476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.823223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.824059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.824584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.825094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.826629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.828218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:16.830644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.831160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:16.834025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:16.834554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.116607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:17.126147 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c7a6e548-e8b2-4a66-9e2c-a7a23ce5819f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.336321 Aug 29 15:42:17.130965 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 654/1371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:16 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:17.148312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.149199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.162990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.165104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.165675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.167087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.169208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.169762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.358045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45728618-fd5a-41bb-a61d-aa7d5fb1790e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "POST /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35/action" status: 202 len: 0 microversion: 2.1 time: 0.573832 Aug 29 15:42:17.359074 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 718/1372] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:16 2022] POST /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:42:17.370077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24fc8970-c71c-4256-a657-6afe367771ac tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee9849d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.498920 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24fc8970-c71c-4256-a657-6afe367771ac tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.136781 Aug 29 15:42:17.499731 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 719/1373] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:17.517804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.521259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.538079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:17.541930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.541930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.542249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.542798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.545248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.545248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.565782 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aff56aea-c16d-4aba-8e61-eb4e2722172a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1461 microversion: 2.1 time: 0.433497 Aug 29 15:42:17.567620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 655/1374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1461 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:17.577521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0a6ada8-9e79-4d3c-bbce-3d3c3aba8636 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3e9790>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.632101 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0a6ada8-9e79-4d3c-bbce-3d3c3aba8636 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.062945 Aug 29 15:42:17.633748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 656/1375] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:17.638384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.639230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.647091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.647867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.648447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.649298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.649890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.650463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.706762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] Lazy-loading 'services' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:17.751406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-376934e9-9a9d-4b00-b89e-20c84cb528b9 tempest-ServersAdmin275Test-88919618 tempest-ServersAdmin275Test-88919618-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1922 microversion: 2.75 time: 0.243804 Aug 29 15:42:17.752897 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 720/1376] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1922 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:17.798118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.798685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.819220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.819835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.822953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.823925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.827804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.829694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.901334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:17.934732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:17.953896 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7815ddc2-d246-48f9-9956-4588454eeda0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1461 microversion: 2.1 time: 0.317778 Aug 29 15:42:17.954900 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 657/1377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1461 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:17.971334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:17.972325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:17.991148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.992186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:17.994410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:17.995399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:17.996893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.001314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.086525 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8052b2b6-ddb2-4871-87b5-678a9bbac4a0 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 204 len: 0 microversion: 2.75 time: 0.293541 Aug 29 15:42:18.088078 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 721/1378] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:42:17 2022] DELETE /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:42:18.098018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:18.099337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:18.158153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.161116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.161870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.164003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.166127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.166821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.342837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.354421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.355894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.362846 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-59bd2899-9ed6-4c19-bee8-a49cef550eee tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.398632 Aug 29 15:42:18.364884 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 658/1379] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:17 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:18.379700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fbb8d408-b0b8-4349-b88b-ab0523a2c0e2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'create', calling method: .version_select at 0x7f32ee3c4430>, body: {"keypair": {"name": "tempest-keypair-436511461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDiaWoZvqbRYp5wGDhf/+Orwaaz2NHYDwMJ89J9F/tlb96rWjeTAUTSGDNwOLw/a8QLVu/+2D3S4TwQM9dTGR04RtrX3FTrRPYDryY3GSu4khW7YXFy25iBTLGo/80MJw=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:18.412947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fbb8d408-b0b8-4349-b88b-ab0523a2c0e2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:18.420245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fbb8d408-b0b8-4349-b88b-ab0523a2c0e2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for user cc90d88d1e574a94858bbe2523855caa and project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:18.460690 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fbb8d408-b0b8-4349-b88b-ab0523a2c0e2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090725 Aug 29 15:42:18.461994 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 659/1380] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:42:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:18.467432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:18.468877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:18.477219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.477831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.478925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.479781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.480475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.481022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.591799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.610966 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a58d3ecd-73d7-4150-a2df-cd9c973dee99 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.520493 Aug 29 15:42:18.612129 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 722/1381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:18 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:18.621426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.643285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.646097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e35262ce-1f2f-4493-ac2b-5fc003344d02 req-f73a1dfd-59f6-4fe5-8af6-eb11ca513364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0279f9d2-7281-49ed-909b-c7aefacba4dc", "tag": "5e744617-4cca-49fe-af24-450eb780b7b5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:18.649869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:18.668125 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0526bea3-cc4c-4f4b-b113-cdc0f374fc33 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1444 microversion: 2.75 time: 0.204294 Aug 29 15:42:18.670884 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 660/1382] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:18 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1444 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:18.675774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e35262ce-1f2f-4493-ac2b-5fc003344d02 req-f73a1dfd-59f6-4fe5-8af6-eb11ca513364 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.677090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e35262ce-1f2f-4493-ac2b-5fc003344d02 req-f73a1dfd-59f6-4fe5-8af6-eb11ca513364 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.680469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:18.680757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e35262ce-1f2f-4493-ac2b-5fc003344d02 req-f73a1dfd-59f6-4fe5-8af6-eb11ca513364 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.686027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:18.701792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.706126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.707619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.709264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.709989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.710501 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e35262ce-1f2f-4493-ac2b-5fc003344d02 req-f73a1dfd-59f6-4fe5-8af6-eb11ca513364 service nova] Creating event network-changed:5e744617-4cca-49fe-af24-450eb780b7b5 for instance 0279f9d2-7281-49ed-909b-c7aefacba4dc on n-h2-836830-13 Aug 29 15:42:18.712965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.727985 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e35262ce-1f2f-4493-ac2b-5fc003344d02 req-f73a1dfd-59f6-4fe5-8af6-eb11ca513364 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113528 Aug 29 15:42:18.735704 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 723/1383] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:18.742266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ea0afdfc-837b-45c0-bf26-0019efe45bf2 req-4c799c1c-bad5-4820-82cb-ac0f29c5b266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8812e03-0998-482f-9c15-31e6bc87c95d", "name": "network-vif-plugged", "status": "completed", "tag": "d604872a-ee68-4a4b-a75b-c588a57d0efb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:18.768239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:18.772684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ea0afdfc-837b-45c0-bf26-0019efe45bf2 req-4c799c1c-bad5-4820-82cb-ac0f29c5b266 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:18.775574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ea0afdfc-837b-45c0-bf26-0019efe45bf2 req-4c799c1c-bad5-4820-82cb-ac0f29c5b266 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:18.777582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ea0afdfc-837b-45c0-bf26-0019efe45bf2 req-4c799c1c-bad5-4820-82cb-ac0f29c5b266 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:18.814886 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ea0afdfc-837b-45c0-bf26-0019efe45bf2 req-4c799c1c-bad5-4820-82cb-ac0f29c5b266 service nova] Creating event network-vif-plugged:d604872a-ee68-4a4b-a75b-c588a57d0efb for instance b8812e03-0998-482f-9c15-31e6bc87c95d on n-h2-836830-13 Aug 29 15:42:18.823229 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ea0afdfc-837b-45c0-bf26-0019efe45bf2 req-4c799c1c-bad5-4820-82cb-ac0f29c5b266 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085360 Aug 29 15:42:18.824571 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 724/1384] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:18.839972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-97dd9f38-930d-45c0-bff7-0b8c417bffc8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee7f2ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:18.963571 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97dd9f38-930d-45c0-bff7-0b8c417bffc8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.137200 Aug 29 15:42:18.965005 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 725/1385] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:18 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:18.973062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a00035ff-e1c4-43e9-9c62-a6fefd5b8a1a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee73aee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.006834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.019793 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec8fa97a-e34a-4d7f-8873-1e5e969c9a04 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.347475 Aug 29 15:42:19.042229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 661/1386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:18 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:19.052297 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a00035ff-e1c4-43e9-9c62-a6fefd5b8a1a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.083184 Aug 29 15:42:19.053573 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 726/1387] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:18 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:19.395918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.396894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.409450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.411394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.413306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.414303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.415446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.416770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.633766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.634517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.644148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.646861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.647573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.648586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.649281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.650349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.683853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:19.700936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.705953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:19.713412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.715996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.717688 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5878953d-3c6b-4986-8657-ba950e71019b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.327604 Aug 29 15:42:19.719140 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 662/1388] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:19.725656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:19.726608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:19.746429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.747010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.747833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.748800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:19.749851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:19.750524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:19.908702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.922221 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-097d9f50-5308-4859-95c1-989ac2f3bedb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.293388 Aug 29 15:42:19.923487 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 727/1389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:19.942990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.958687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.960406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:19.970101 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f211f400-8f17-4d84-988a-c9d8bb01242f tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1444 microversion: 2.75 time: 0.249494 Aug 29 15:42:19.988311 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 663/1390] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1444 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:19.995391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fba25807-c4a0-4f63-bb6a-210fcfb78d41 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32eebd4550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.056746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.057717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.076548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.081006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.082567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.084080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.086623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.086623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.101511 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fba25807-c4a0-4f63-bb6a-210fcfb78d41 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.110038 Aug 29 15:42:20.102328 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 728/1391] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:19 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:20.111914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20a3c7e6-f915-4553-ae5f-3a914a96b12a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ef286c10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.201444 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20a3c7e6-f915-4553-ae5f-3a914a96b12a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.093726 Aug 29 15:42:20.214355 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 729/1392] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:20.447594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.458111 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-48741c0e-f7c9-4813-b022-0a26080174b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.412230 Aug 29 15:42:20.469260 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 664/1393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:20.746378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.747854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.750082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:20.751122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:20.776105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.777003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.777666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.778806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.779493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.780101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.947780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.948989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:20.961994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.965942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.966427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.967651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.968530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:20.969151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:20.969723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:20.972670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.975270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:20.976764 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-44d79a80-bebb-4eda-a6ea-d72c86c4c498 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.234778 Aug 29 15:42:20.977884 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 730/1394] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:20.997070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:20.997663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:21.005164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:21.006171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:21.006920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:21.007760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:21.008471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:21.009121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:21.076736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:21.077470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:21.078104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:21.078801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lazy-loading 'fault' on Instance uuid 7ce93038-9afb-45cc-b46a-e08625870bc0 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:21.193180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:21.215892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:21.218021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00c0fdb3a3524a93b7728b495750b95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cffdb3292247c69d9f8b425453962a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:21.225208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10c3b923-b4ee-4516-ad1d-b0b7141ca992 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 200 len: 1449 microversion: 2.75 time: 0.232875 Aug 29 15:42:21.250555 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 731/1395] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 1449 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:21.255856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-136509c8-497d-474f-b82c-066db7a7c2c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee37bdc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:21.349176 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-136509c8-497d-474f-b82c-066db7a7c2c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1413 microversion: 2.1 time: 0.097387 Aug 29 15:42:21.356284 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 732/1396] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:21 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:21.367971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0dbb7873-feef-48b8-96aa-ff4f4c5095d6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee2ac550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:21.423605 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0dbb7873-feef-48b8-96aa-ff4f4c5095d6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.072582 Aug 29 15:42:21.431940 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 733/1397] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:21 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:21.493803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:21.495417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:21.526264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:21.536262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:21.537607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:21.543830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:21.557134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:21.560832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a1082cba-3da9-466c-a511-4c8b15e7f431 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.616687 Aug 29 15:42:21.564166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:21.564708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:21.568662 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 665/1398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:20 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:22.002324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:22.002941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:22.032703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.036679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.037177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.047896 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f1dd2316-bbbb-42f3-8a85-b828b4e54797 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1314 microversion: 2.1 time: 0.562053 Aug 29 15:42:22.049544 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 734/1399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:21 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:22.050938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.056334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.056882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.057324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.259444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:22.260309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] [instance: 7ce93038-9afb-45cc-b46a-e08625870bc0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:22.274356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.275530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.278242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.279792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:22.285871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:22.288032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:22.317497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] HTTP exception thrown: Instance 7ce93038-9afb-45cc-b46a-e08625870bc0 could not be found. Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Request method failure captured: Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 HTTP/1.1 Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN4SuLkYyI61vWmQNHEJ_fGJygiwmDYZS6FwOSqgyY5Wcqzdl_BAVv4G3jxRcNsAHtOEiXz1uMKSQGw0VtbTmF3cp3mrFAIW3E1-fPJ0_S6tJ8u-97RWbiZilLZxC1gI-FcZOapEBFeiQx0IWhtHB4XMhcPCh6j96ir6g79dTmlHt-M Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.75 Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 93cffdb3292247c69d9f8b425453962a Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdmin275Test-1780994308 Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:42:22.320007 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/93cffdb3292247c69d9f8b425453962a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_93cffdb3292247c69d9f8b425453962a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/93cffdb3292247c69d9f8b425453962a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/93cffdb3292247c69d9f8b425453962a"}]}] Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdmin275Test-1780994308 Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 93cffdb3292247c69d9f8b425453962a Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdmin275Test-1780994308 Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdmin275Test-1780994308-project Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 00c0fdb3a3524a93b7728b495750b95e Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdmin275Test-1780994308-project Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 7ce93038-9afb-45cc-b46a-e08625870bc0 could not be found. Aug 29 15:42:22.321871 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '7ce93038-9afb-45cc-b46a-e08625870bc0'} Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce93038-9afb-45cc-b46a-e08625870bc0 could not be found. Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:22.322992 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce93038-9afb-45cc-b46a-e08625870bc0 could not be found. Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce93038-9afb-45cc-b46a-e08625870bc0 could not be found. Aug 29 15:42:22.324432 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:22.325676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] Returning 404 to user: Instance 7ce93038-9afb-45cc-b46a-e08625870bc0 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:22.325676 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0dafefc3-4a90-4da8-a972-4a86fc325513 tempest-ServersAdmin275Test-1780994308 tempest-ServersAdmin275Test-1780994308-project] 10.222.0.83 "GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0" status: 404 len: 111 microversion: 2.75 time: 0.068440 Aug 29 15:42:22.325676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 735/1400] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:22 2022] GET /compute/v2.1/servers/7ce93038-9afb-45cc-b46a-e08625870bc0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:42:22.367555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19799f3b-3369-4033-bfaa-897f5165d1c0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee4f8af0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:22.522261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.561089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.567599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:22.571199 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3323274-9795-4f9a-a0e6-c495624e70c2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.572656 Aug 29 15:42:22.584315 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 666/1401] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:21 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:22.595285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6732f9a8-eabc-47fd-b0a8-0bfdd1e3a3b3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee404d30>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:26.903773 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19799f3b-3369-4033-bfaa-897f5165d1c0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1422 microversion: 2.1 time: 4.543524 Aug 29 15:42:26.910345 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 736/1402] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:22 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1422 bytes in 4551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:26.921181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6732f9a8-eabc-47fd-b0a8-0bfdd1e3a3b3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 4.344849 Aug 29 15:42:26.930588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:26.931219 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 667/1403] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:22 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 4355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:26.941303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:26.943131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e4a2a550-55d6-43f1-8581-c741dfc4c867 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '.version_select at 0x7f32ee404280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:26.950164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4a2a550-55d6-43f1-8581-c741dfc4c867 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:26.955261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4a2a550-55d6-43f1-8581-c741dfc4c867 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:26.956030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4a2a550-55d6-43f1-8581-c741dfc4c867 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:26.964539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:26.965055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:26.965501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:26.966273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:26.966662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:26.986359 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e4a2a550-55d6-43f1-8581-c741dfc4c867 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 1974 microversion: 2.1 time: 0.048357 Aug 29 15:42:26.998685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:26.998907 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 668/1404] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:42:26 2022] GET /compute/v2.1/os-migrations => generated 1974 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:27.008259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:27.009924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:27.029379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.031661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.034664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.036592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.040315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.041041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.432106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:27.453788 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5054ed2-f4e5-4ca3-b30f-87a51d412efc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1502 microversion: 2.1 time: 0.463774 Aug 29 15:42:27.455457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:27.457266 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 669/1405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:26 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1502 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:27.464737 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-12f02a56-820f-4762-aec1-01a4f72b187d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.548582 Aug 29 15:42:27.465314 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 737/1406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:26 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:27.476557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:27.479495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:27.485097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9f23ae4d-f61b-4fd1-a582-2d734bd1806e req-ee92f8f0-9ecc-497c-ba3a-57153583affe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c1c64a-0520-432c-8c72-608633f27d35", "name": "network-vif-plugged", "status": "completed", "tag": "38a41bff-78ab-411e-8d27-7a0d76ee3a93"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:27.497614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.498252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.498545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.499805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.500277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.500706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.527967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9f23ae4d-f61b-4fd1-a582-2d734bd1806e req-ee92f8f0-9ecc-497c-ba3a-57153583affe service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.528456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9f23ae4d-f61b-4fd1-a582-2d734bd1806e req-ee92f8f0-9ecc-497c-ba3a-57153583affe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.528894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9f23ae4d-f61b-4fd1-a582-2d734bd1806e req-ee92f8f0-9ecc-497c-ba3a-57153583affe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.587071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9f23ae4d-f61b-4fd1-a582-2d734bd1806e req-ee92f8f0-9ecc-497c-ba3a-57153583affe service nova] Creating event network-vif-plugged:38a41bff-78ab-411e-8d27-7a0d76ee3a93 for instance 55c1c64a-0520-432c-8c72-608633f27d35 on n-h1-836830-13 Aug 29 15:42:27.616400 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9f23ae4d-f61b-4fd1-a582-2d734bd1806e req-ee92f8f0-9ecc-497c-ba3a-57153583affe service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145218 Aug 29 15:42:27.616935 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 738/1407] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:27.622010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3213e1db-5fa0-4c7e-bfd1-ce4a0f0d596c req-d01ca0e4-1788-4ccc-ba06-86d6868a687c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36742e72-c374-4c67-82eb-e6dd5a601e99", "name": "network-vif-unplugged", "status": "completed", "tag": "15a54a03-347a-46bd-bbe5-7a555d14444e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:27.673295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3213e1db-5fa0-4c7e-bfd1-ce4a0f0d596c req-d01ca0e4-1788-4ccc-ba06-86d6868a687c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.673789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3213e1db-5fa0-4c7e-bfd1-ce4a0f0d596c req-d01ca0e4-1788-4ccc-ba06-86d6868a687c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.674216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3213e1db-5fa0-4c7e-bfd1-ce4a0f0d596c req-d01ca0e4-1788-4ccc-ba06-86d6868a687c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.719049 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3213e1db-5fa0-4c7e-bfd1-ce4a0f0d596c req-d01ca0e4-1788-4ccc-ba06-86d6868a687c service nova] Creating event network-vif-unplugged:15a54a03-347a-46bd-bbe5-7a555d14444e for instance 36742e72-c374-4c67-82eb-e6dd5a601e99 on n-h1-836830-13 Aug 29 15:42:27.734185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3213e1db-5fa0-4c7e-bfd1-ce4a0f0d596c req-d01ca0e4-1788-4ccc-ba06-86d6868a687c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115821 Aug 29 15:42:27.744592 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 739/1408] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:27.763572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ce9b6aa-a10e-456e-819f-ea33d81631ac tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee7f2280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:27.883335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ce9b6aa-a10e-456e-819f-ea33d81631ac tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 200 len: 1422 microversion: 2.1 time: 0.137053 Aug 29 15:42:27.887355 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 740/1409] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:27 2022] GET /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 1422 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:27.896087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02f0f591-108c-42cb-9b7d-e468bd03311f tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:27.914258 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02f0f591-108c-42cb-9b7d-e468bd03311f tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025768 Aug 29 15:42:27.918340 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 741/1410] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:42:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:27.930389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:27.931962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:27.948674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.951859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.952782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.953771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:27.958223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:27.959051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:27.984555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:28.000654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:28.010456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:28.012814 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-188f8b25-b1fb-443a-9346-a78df636c4d8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.552735 Aug 29 15:42:28.016508 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 670/1411] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:27 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:28.023950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:28.029282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-277340ec-91cb-4a1e-8c0f-65f7fa9cd3b8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee3c4dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:28.185706 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf3ca28c-90bc-496f-819c-4ef44b4009bd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 204 len: 0 microversion: 2.1 time: 0.265121 Aug 29 15:42:28.186811 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 742/1412] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:27 2022] DELETE /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:28.194853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c889d2e-7954-4a00-a38e-31918f5bd571 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-383544663", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:28.227292 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c889d2e-7954-4a00-a38e-31918f5bd571 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.038232 Aug 29 15:42:28.229267 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 743/1413] 10.222.0.83 () {60 vars in 1146 bytes} [Mon Aug 29 15:42:28 2022] POST /compute/v2.1/flavors => generated 498 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:28.236384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05647e0f-6c73-4cb5-b23f-87a1a63ab075 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee9844c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:28.433722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=14 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:29.462062 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-277340ec-91cb-4a1e-8c0f-65f7fa9cd3b8 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 204 len: 0 microversion: 2.1 time: 1.443815 Aug 29 15:42:29.465872 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 671/1414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:28 2022] DELETE /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 0 bytes in 1445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:29.470731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:29.471673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:29.483951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.485288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.488625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:29.490902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.491675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.493394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:29.529977 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05647e0f-6c73-4cb5-b23f-87a1a63ab075 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 1.297723 Aug 29 15:42:29.538901 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 744/1415] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:28 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:29.544381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4563964a-a852-460b-a650-495ddf602927 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:29.562229 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4563964a-a852-460b-a650-495ddf602927 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021122 Aug 29 15:42:29.575501 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 745/1416] 10.222.0.83 () {58 vars in 1182 bytes} [Mon Aug 29 15:42:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:42:29.592834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:29.593601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:29.612722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.613738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.614529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:29.618080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.618581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.619062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:29.808192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:29.820898 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e9b0ea39-0c6b-47db-b3ec-717d5ad7eec0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1508 microversion: 2.1 time: 0.353858 Aug 29 15:42:29.823805 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 672/1417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:29 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1508 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:29.841171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:29.842643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:29.859970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.861818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.865852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:29.868843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:29.869944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:29.872394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:30.063948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:30.101462 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a179cd7-2f96-43c0-a724-1582b25940ee tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.515326 Aug 29 15:42:30.103151 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 746/1418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:29 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:30.123086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:30.135565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:30.147080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:30.150210 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33cf804b-e0a3-4f89-9b54-27d79be1e567 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.324668 Aug 29 15:42:30.157012 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 673/1419] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:29 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:30.185666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:30.188293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:30.198394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:30.201325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:30.203899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:30.205912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:30.208483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:30.210695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:30.262053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:30.387043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1311880221", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:30.434375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a908e347-daf8-4ee7-8f76-9f03f1fad691 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 204 len: 0 microversion: 2.1 time: 0.256144 Aug 29 15:42:30.441123 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 674/1420] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:30 2022] DELETE /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:30.458718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4c21d065-3391-4418-a273-5133ec566855 req-a5054640-0b8f-4b5d-9a0e-08af725c3d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0279f9d2-7281-49ed-909b-c7aefacba4dc", "name": "network-vif-plugged", "status": "completed", "tag": "5e744617-4cca-49fe-af24-450eb780b7b5"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:30.481170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:30.487245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4c21d065-3391-4418-a273-5133ec566855 req-a5054640-0b8f-4b5d-9a0e-08af725c3d3a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:30.488974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4c21d065-3391-4418-a273-5133ec566855 req-a5054640-0b8f-4b5d-9a0e-08af725c3d3a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:30.489649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4c21d065-3391-4418-a273-5133ec566855 req-a5054640-0b8f-4b5d-9a0e-08af725c3d3a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:30.507724 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4c21d065-3391-4418-a273-5133ec566855 req-a5054640-0b8f-4b5d-9a0e-08af725c3d3a service nova] Creating event network-vif-plugged:5e744617-4cca-49fe-af24-450eb780b7b5 for instance 0279f9d2-7281-49ed-909b-c7aefacba4dc on n-h2-836830-13 Aug 29 15:42:30.514781 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4c21d065-3391-4418-a273-5133ec566855 req-a5054640-0b8f-4b5d-9a0e-08af725c3d3a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073304 Aug 29 15:42:30.516325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 675/1421] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:30.525249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8f7026ac-16c6-48c3-90ef-1c3189ea89ba req-ad1f9833-8497-4121-8670-10268bc607f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36742e72-c374-4c67-82eb-e6dd5a601e99", "tag": "15a54a03-347a-46bd-bbe5-7a555d14444e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:30.540700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8f7026ac-16c6-48c3-90ef-1c3189ea89ba req-ad1f9833-8497-4121-8670-10268bc607f0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:30.541377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8f7026ac-16c6-48c3-90ef-1c3189ea89ba req-ad1f9833-8497-4121-8670-10268bc607f0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:30.541898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8f7026ac-16c6-48c3-90ef-1c3189ea89ba req-ad1f9833-8497-4121-8670-10268bc607f0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:30.558898 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8f7026ac-16c6-48c3-90ef-1c3189ea89ba req-ad1f9833-8497-4121-8670-10268bc607f0 service nova] Creating event network-changed:15a54a03-347a-46bd-bbe5-7a555d14444e for instance 36742e72-c374-4c67-82eb-e6dd5a601e99 on n-h1-836830-13 Aug 29 15:42:30.566498 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8f7026ac-16c6-48c3-90ef-1c3189ea89ba req-ad1f9833-8497-4121-8670-10268bc607f0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047954 Aug 29 15:42:30.568903 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 676/1422] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:30.577448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-5752287", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "b901882a-7ad5-4c57-b2d4-b994550de20b"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:30.648087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:31.140697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:31.141980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:31.141980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:31.141980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:31.142380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:31.163079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.163703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.169857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.170764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.171286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.171724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.225649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:31.240921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for user cc90d88d1e574a94858bbe2523855caa and project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:31.260758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:31.263365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:31.292176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:31.292676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:31.293372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:31.293782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:31.294194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:31.311717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.314442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.314879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.316535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.323551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.324508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.332457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:31.358613 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-926ef089-eca9-442c-a092-43c742260237 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788215 Aug 29 15:42:31.367203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 677/1423] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:31.374549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f0eaa6f-3002-4d69-b285-b016f3c7160b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3c4ca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:31.388580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:31.402432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:31.444048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:31.449814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:31.481060 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f0eaa6f-3002-4d69-b285-b016f3c7160b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.111519 Aug 29 15:42:31.483073 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 678/1424] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:31 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:31.498535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1635490051", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "10e124fc-0fc1-4d6c-9bea-015d572a2eb7"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:31.547848 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b33d7090-b661-4dbd-b8b8-7d83d22483d8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442739 Aug 29 15:42:31.550625 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 747/1425] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:31.561851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:31.562470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:31.579683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.580231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.580664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.581373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:31.581823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:31.582276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:31.621932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] validate_networks() for [('10e124fc-0fc1-4d6c-9bea-015d572a2eb7', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:32.601956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:32.602559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:32.604897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:32.605455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:32.607566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:32.643309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.645033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.649389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.653230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.656079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.657020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.733906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:32.746137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:32.752153 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-099798c4-df4c-4510-8c0b-4bc9ca3a45b8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1508 microversion: 2.1 time: 1.194118 Aug 29 15:42:32.761351 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 748/1426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:31 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1508 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:32.768888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for user 09663bec61af43278da1d69c37594558 and project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:32.774684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:32.787198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:32.800752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.801278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.817809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.827753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:32.832095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:32.833297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:32.836428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:32.844745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:33.008894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-296836fb-de55-484c-8d80-724454b844fd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.519049 Aug 29 15:42:33.010721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 679/1427] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:33.021661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.022288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.040236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.040988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.041650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.042888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.051869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.054254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.527582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:33.536887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:33.538339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:33.553470 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2d3a487d-f6f8-4b78-8c73-b58a8b7ec3a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.540240 Aug 29 15:42:33.554071 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 680/1428] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:33.568923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.574398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.575288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:33.587972 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f33afef4-e2ca-4eef-8c61-ba5dc67b7afb tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.823519 Aug 29 15:42:33.600941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.603809 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 749/1429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:32 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:33.606056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.606537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.611463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.612186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.614576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.616551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.620052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.633325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.635815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.637235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.643725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.644599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.646666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.741764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:33.752915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06eaa9d8-6d47-48e2-9bfe-f146baf77357 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1328 microversion: 2.1 time: 0.197549 Aug 29 15:42:33.755577 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 681/1430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:33.764883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4bec90d8-a10d-4dfa-bb2b-f9445414a960 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3c4700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.836058 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4bec90d8-a10d-4dfa-bb2b-f9445414a960 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.079327 Aug 29 15:42:33.836640 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 682/1431] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:33.859581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-344a6b94-a496-49c3-8b18-635a6af3a065 req-c8a4276b-f1ca-44cc-9352-e77811cc2d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a5660c-ddba-4fd7-a7e8-a87e38ea1f40", "name": "network-vif-unplugged", "status": "completed", "tag": "08dab329-5c8b-412e-87cf-d371e5f22396"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:33.882338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-344a6b94-a496-49c3-8b18-635a6af3a065 req-c8a4276b-f1ca-44cc-9352-e77811cc2d5c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.885858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-344a6b94-a496-49c3-8b18-635a6af3a065 req-c8a4276b-f1ca-44cc-9352-e77811cc2d5c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.886492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-344a6b94-a496-49c3-8b18-635a6af3a065 req-c8a4276b-f1ca-44cc-9352-e77811cc2d5c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.911902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-344a6b94-a496-49c3-8b18-635a6af3a065 req-c8a4276b-f1ca-44cc-9352-e77811cc2d5c service nova] Creating event network-vif-unplugged:08dab329-5c8b-412e-87cf-d371e5f22396 for instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 on n-h2-836830-13 Aug 29 15:42:33.925037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-344a6b94-a496-49c3-8b18-635a6af3a065 req-c8a4276b-f1ca-44cc-9352-e77811cc2d5c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068132 Aug 29 15:42:33.928212 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 683/1432] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:33.932969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:33.943382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f6acff4-8c41-4220-8be8-71e415ec8e86 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.944793 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-35c73ad8-1ca5-4d08-a191-002f128134af tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1269 microversion: 2.1 time: 0.336746 Aug 29 15:42:33.946237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f6acff4-8c41-4220-8be8-71e415ec8e86 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.946971 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 750/1433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1269 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:33.974198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:33.975197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:33.993757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.994583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.995259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:33.996157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:33.997185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:33.997812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.146887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f6acff4-8c41-4220-8be8-71e415ec8e86 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:34.159376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f6acff4-8c41-4220-8be8-71e415ec8e86 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1208 microversion: 2.1 time: 0.229462 Aug 29 15:42:34.161541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 684/1434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1208 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:34.226674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-466b0c52-163c-43ee-a1f5-5f6d406cfbf6 req-2b84bd8e-7467-47cb-93b9-ef829db0e162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8812e03-0998-482f-9c15-31e6bc87c95d", "name": "network-vif-deleted", "tag": "d604872a-ee68-4a4b-a75b-c588a57d0efb"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:34.237694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-466b0c52-163c-43ee-a1f5-5f6d406cfbf6 req-2b84bd8e-7467-47cb-93b9-ef829db0e162 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:34.238526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-466b0c52-163c-43ee-a1f5-5f6d406cfbf6 req-2b84bd8e-7467-47cb-93b9-ef829db0e162 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.239371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-466b0c52-163c-43ee-a1f5-5f6d406cfbf6 req-2b84bd8e-7467-47cb-93b9-ef829db0e162 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.250567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:34.254289 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-466b0c52-163c-43ee-a1f5-5f6d406cfbf6 req-2b84bd8e-7467-47cb-93b9-ef829db0e162 service nova] Creating event network-vif-deleted:d604872a-ee68-4a4b-a75b-c588a57d0efb for instance b8812e03-0998-482f-9c15-31e6bc87c95d on n-h2-836830-13 Aug 29 15:42:34.260418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-466b0c52-163c-43ee-a1f5-5f6d406cfbf6 req-2b84bd8e-7467-47cb-93b9-ef829db0e162 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038260 Aug 29 15:42:34.265734 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 685/1435] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:34.274794 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9bafa19-9160-4645-b766-c0ccaf412615 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1466 microversion: 2.1 time: 0.306555 Aug 29 15:42:34.275859 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 751/1436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:33 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1466 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:34.580368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:34.581469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:34.599659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:34.604876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.607092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.611683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:34.614961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.617167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:34.617339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.618698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:34.644350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:34.645857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.649132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:34.649132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:34.649132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:34.654981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.106001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.115313 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0556993b-f4c8-4e53-9777-40f51c9f2297 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1318 microversion: 2.1 time: 0.504640 Aug 29 15:42:35.115651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.131967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.135976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.138221 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1395dc90-f2f9-4421-9173-61d23addfb4d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.564066 Aug 29 15:42:35.138847 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 752/1437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:34 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1318 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:35.139447 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 686/1438] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:34 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:35.170647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.170969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fbb966bd-b40e-4537-ba56-75096d6fd073 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3e9ee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.174051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:35.188074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.188565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.188999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.189700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.190154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.190575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.276274 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fbb966bd-b40e-4537-ba56-75096d6fd073 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.135074 Aug 29 15:42:35.277068 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 687/1439] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:35.290094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.290713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:35.334017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.334443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.334916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.335642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.336131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.336563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.378275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:35.452775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.459250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2a0569db-71e3-4300-9865-f4fb9cb666f7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1275 microversion: 2.1 time: 0.181176 Aug 29 15:42:35.473832 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 688/1440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:35.473832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.473832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:35.487067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.487651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.488181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.489754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.490362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.490799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.589733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.607395 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b265cab-6bcf-4f86-8e44-28343f73cc62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1204 microversion: 2.1 time: 0.142823 Aug 29 15:42:35.608512 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 689/1441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1204 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:35.616330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:35.616962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:35.628684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.630822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.631906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.633093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.634735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.635428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.640184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.654736 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f9514b31-ea25-427b-adf0-6f5501aaaccc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1334 microversion: 2.1 time: 0.498088 Aug 29 15:42:35.656496 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 753/1442] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1334 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:35.762127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:35.762637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:35.764829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:35.766463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'fault' on Instance uuid b8812e03-0998-482f-9c15-31e6bc87c95d {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:35.827318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:35.841448 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf982b45-269e-43e6-8e19-7422085b817f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1304 microversion: 2.1 time: 0.231280 Aug 29 15:42:35.844277 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 690/1443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:35 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:36.137536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.138269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.161499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.162514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.165454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.166934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.167586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.168172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.169259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.170508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.206850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.207906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.208456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.209177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.210797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.211307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.631137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.642315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.652721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.654212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-877ec245-db57-419c-90e6-b213ab1e6ba7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.494647 Aug 29 15:42:36.662776 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 691/1444] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:36.667831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0954a149-63e3-43cb-85e0-fd85e866a8e9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee4048b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.766452 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0954a149-63e3-43cb-85e0-fd85e866a8e9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.098140 Aug 29 15:42:36.779265 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 692/1445] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:36.784536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.786113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.793475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.794214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.794805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.795700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.796311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.796917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.891962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:36.905960 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a415cc38-75c1-4e4b-bf70-8f4609047edf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1275 microversion: 2.1 time: 0.125208 Aug 29 15:42:36.915602 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 693/1446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1275 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:36.921143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:36.946850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:36.967140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.974021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.974695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:36.976975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:36.977744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:36.979512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.091746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:37.103166 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e12aaf60-e43b-488a-a0e9-4b689b04ab8d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1260 microversion: 2.1 time: 0.185876 Aug 29 15:42:37.124643 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 694/1447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:37.132845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:37.133380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:37.147592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.148418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.149019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.150056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.150644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.151376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.226428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:37.230561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:37.239716 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4593caf-7a06-4cf7-8585-030f3a41013b tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1509 microversion: 2.1 time: 1.105878 Aug 29 15:42:37.243603 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 754/1448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:36 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1509 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:37.259847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:37.262001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:37.277224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.278323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.279386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.281179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.281912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.282511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.341206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.343155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.343997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.346356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'fault' on Instance uuid b8812e03-0998-482f-9c15-31e6bc87c95d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:37.850754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:37.860482 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-196a5a27-4683-4dfb-aeda-1b18e49ab0a4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 200 len: 1304 microversion: 2.1 time: 0.615585 Aug 29 15:42:37.861140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 755/1449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:37 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 1304 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:37.873306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f653f3f6-6a09-4fbd-bdde-ed6aab00958d req-fee9904c-38ca-442c-964e-9238e2fe6521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a5660c-ddba-4fd7-a7e8-a87e38ea1f40", "name": "network-vif-deleted", "tag": "08dab329-5c8b-412e-87cf-d371e5f22396"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:37.909473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f653f3f6-6a09-4fbd-bdde-ed6aab00958d req-fee9904c-38ca-442c-964e-9238e2fe6521 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:37.910014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f653f3f6-6a09-4fbd-bdde-ed6aab00958d req-fee9904c-38ca-442c-964e-9238e2fe6521 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:37.910514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f653f3f6-6a09-4fbd-bdde-ed6aab00958d req-fee9904c-38ca-442c-964e-9238e2fe6521 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:37.958214 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f653f3f6-6a09-4fbd-bdde-ed6aab00958d req-fee9904c-38ca-442c-964e-9238e2fe6521 service nova] Creating event network-vif-deleted:08dab329-5c8b-412e-87cf-d371e5f22396 for instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 on n-h2-836830-13 Aug 29 15:42:37.981230 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f653f3f6-6a09-4fbd-bdde-ed6aab00958d req-fee9904c-38ca-442c-964e-9238e2fe6521 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110836 Aug 29 15:42:37.982802 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 756/1450] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:38.018588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:38.020137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:38.039254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.039790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.040262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.040958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.043477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.046242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.061900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.072017 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46883e01-80ec-47e2-a3d4-c5ecd5ed93c3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1376 microversion: 2.1 time: 0.943993 Aug 29 15:42:38.080782 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 695/1451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:37 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1376 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:38.100450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0bec1cfa-8ae0-4cf8-9d83-bf341613ee8a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee404550>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:38.222155 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0bec1cfa-8ae0-4cf8-9d83-bf341613ee8a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.126024 Aug 29 15:42:38.230533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 696/1452] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:38 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:38.237054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:38.237690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:38.255225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.255879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.256331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.257063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.257514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.257937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.379901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.398409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f61d008b-d0fb-4968-9d21-d644c7dc2f9f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1275 microversion: 2.1 time: 0.172987 Aug 29 15:42:38.407070 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 697/1453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:38 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:38.414348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:38.415287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:38.431819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.438274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.439658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.440696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.443563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.445012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.868588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.882296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.888820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:38.890995 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8ea8cf1-8a23-4450-8cc7-4e5a62c50ebf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.904531 Aug 29 15:42:38.892946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 757/1454] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:37 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:38.902352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1568cb88-dc02-42b9-a22c-e59d3264f813 req-f293c807-2e99-40e9-b20c-88bfcf74e459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:38.924030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1568cb88-dc02-42b9-a22c-e59d3264f813 req-f293c807-2e99-40e9-b20c-88bfcf74e459 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:38.927072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1568cb88-dc02-42b9-a22c-e59d3264f813 req-f293c807-2e99-40e9-b20c-88bfcf74e459 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:38.927737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1568cb88-dc02-42b9-a22c-e59d3264f813 req-f293c807-2e99-40e9-b20c-88bfcf74e459 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:38.958663 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1568cb88-dc02-42b9-a22c-e59d3264f813 req-f293c807-2e99-40e9-b20c-88bfcf74e459 service nova] Creating event network-changed:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h1-836830-13 Aug 29 15:42:38.969707 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1568cb88-dc02-42b9-a22c-e59d3264f813 req-f293c807-2e99-40e9-b20c-88bfcf74e459 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075203 Aug 29 15:42:38.974365 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 758/1455] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:38.988587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:38.990639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:39.011447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.012201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.013129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.014005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.014626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.015312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.062244 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d HTTP/1.1 Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:42:39.065807 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:42:39.067632 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b8812e03-0998-482f-9c15-31e6bc87c95d'} Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:39.068560 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:42:39.070073 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:39.073391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:39.074439 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5c33609-5f7e-4ee7-b581-04521f8dff4c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 404 len: 111 microversion: 2.1 time: 0.096168 Aug 29 15:42:39.075518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 759/1456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:38 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:39.104770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:39.105652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:39.117558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.122873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.123671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.124781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.126936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.127871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.428036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.444639 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d563f9cd-1339-451d-bcd3-70cecf59311f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1266 microversion: 2.1 time: 1.044090 Aug 29 15:42:39.454238 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 698/1457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:38 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1266 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:39.478019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-37e36277-fa4a-41b2-bf2b-8c26c5f3b425 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2a88280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:39.572511 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-37e36277-fa4a-41b2-bf2b-8c26c5f3b425 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.116912 Aug 29 15:42:39.573463 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 699/1458] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:39 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:39.583145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:39.588444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:39.615744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.617193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.619151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.621167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:39.624024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:39.626259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:39.875659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:39.888218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0639c0eb-1e3c-4a55-8909-4a16c585c3bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1275 microversion: 2.1 time: 0.313537 Aug 29 15:42:39.907411 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 700/1459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:39 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1275 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:39.914166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-190038638", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9bbf042d-13bc-4426-83e8-c7e73123f015"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:40.047553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] validate_networks() for [('9bbf042d-13bc-4426-83e8-c7e73123f015', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:42:40.187577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:40.203543 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90eebe5e-5055-4f66-8f8e-da91f78e9451 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1376 microversion: 2.1 time: 1.105243 Aug 29 15:42:40.204499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 760/1460] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:39 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1376 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:40.214468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:40.217798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:40.288194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.288882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.047s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.300326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:40.310749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:40.311950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:40.312946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.229554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.241611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.263903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:41.265784 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc107492-2a56-40b3-a4ca-b9be6665ce32 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 1.056463 Aug 29 15:42:41.266494 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 761/1461] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:40 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:41.279311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:41.279311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:41.308313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.308777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.309214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.309931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.310384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.310833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.343172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:41.436041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:41.766486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:41.769881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:41.772433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:41.773012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:41.773302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:41.792472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.793459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.794332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.795630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:41.796713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:41.797509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:41.830304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:42:41.844110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for user 853f8300f9bb403b9cea4834c5a1edcb and project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:42:41.868278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:42:41.872708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:42:41.967988 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c97cc2ae-8b9e-4ab9-9fa3-76593fc3ca8f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057878 Aug 29 15:42:41.969707 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 701/1462] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:42:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:42:41.977992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c25b04b0-a165-4134-be46-724033fda89e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3db4c0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:41.994359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.009940 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9713d186-63dd-4604-b0ea-d4a40a5b5ad2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1266 microversion: 2.1 time: 0.741913 Aug 29 15:42:42.012306 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 762/1463] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:41 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1266 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:42.018559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "025bf24f-ff9a-49be-bb25-751533929b5c"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:42.024325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:42.033605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.034252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.034803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.036301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.036909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.037642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.115742 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c25b04b0-a165-4134-be46-724033fda89e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.138407 Aug 29 15:42:42.117001 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 702/1464] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:41 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:42.122161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:42.123621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:42.138161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.139306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.140732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.141512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.142198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.142860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.169834 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] HTTP exception thrown: Volume 71ceb576-2e0e-46b1-82fd-01883ed7a2e9 could not be found. Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Request method failure captured: Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc/os-volume_attachments/71ceb576-2e0e-46b1-82fd-01883ed7a2e9 HTTP/1.1 Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 74 Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2rHwvuMrspBtxc-KTvMIwlUJAUSKJfMXly-IRulEdLrkBv7eY9L4mxcjp8RKfTpt1wLAP8Ob6g-SZrjxg2Z7rQqs6HE6MMM1CaR8ZSdJZm6zo_GjIBv5-PjcIii-FIY-pBJFC52DsCIYFvL4Ii3FXHxUM6hrlLZcL150PlR4Otdc0 Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a622fa01676b457e8bc242b060df727a Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesAdminNegativeTest-1982012281 Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:42:42.175184 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a622fa01676b457e8bc242b060df727a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a622fa01676b457e8bc242b060df727a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a622fa01676b457e8bc242b060df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a622fa01676b457e8bc242b060df727a"}]}] Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesAdminNegativeTest-1982012281 Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a622fa01676b457e8bc242b060df727a Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1982012281 Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesAdminNegativeTest-1982012281-project-admin Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: d6b7cd8a80a14209a18d66171186acaf Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesAdminNegativeTest-1982012281-project-admin Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: {"volumeAttachment": {"volumeId": "025bf24f-ff9a-49be-bb25-751533929b5c"}} Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:42:42.176645 n-d-836830-13 devstack@n-api.service[129133]: exception: Volume 71ceb576-2e0e-46b1-82fd-01883ed7a2e9 could not be found. Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '0279f9d2-7281-49ed-909b-c7aefacba4dc', 'id': '71ceb576-2e0e-46b1-82fd-01883ed7a2e9', 'body': {'volumeAttachment': {'volumeId': '025bf24f-ff9a-49be-bb25-751533929b5c'}}} Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:42:42.177674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71ceb576-2e0e-46b1-82fd-01883ed7a2e9 could not be found. (HTTP 404) (Request-ID: req-ab5e3375-6f92-416e-a4b4-a49acc60998c) Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:42:42.178764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71ceb576-2e0e-46b1-82fd-01883ed7a2e9 could not be found. Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:42.180154 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71ceb576-2e0e-46b1-82fd-01883ed7a2e9 could not be found. Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71ceb576-2e0e-46b1-82fd-01883ed7a2e9 could not be found. Aug 29 15:42:42.181423 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:42.184427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] Returning 404 to user: Volume 71ceb576-2e0e-46b1-82fd-01883ed7a2e9 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:42.184427 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8421d2d-43f3-4f3b-adbd-1947a8afec27 tempest-VolumesAdminNegativeTest-1982012281 tempest-VolumesAdminNegativeTest-1982012281-project-admin] 10.222.0.83 "PUT /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc/os-volume_attachments/71ceb576-2e0e-46b1-82fd-01883ed7a2e9" status: 404 len: 109 microversion: 2.1 time: 0.170729 Aug 29 15:42:42.194159 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 763/1465] 10.222.0.83 () {60 vars in 1433 bytes} [Mon Aug 29 15:42:42 2022] PUT /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc/os-volume_attachments/71ceb576-2e0e-46b1-82fd-01883ed7a2e9 => generated 109 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:42.207649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:42.210093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:42.224349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.227498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.228041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.231514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.232104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.233369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.428154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.443639 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d856ee55-aff4-4013-bd22-15e16f47b116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.325161 Aug 29 15:42:42.462344 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 703/1466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:42 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:42.481552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-593d7cd4-e80c-418b-adf6-ef4c94b7e199 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:42.482397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-593d7cd4-e80c-418b-adf6-ef4c94b7e199 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:42.781981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-593d7cd4-e80c-418b-adf6-ef4c94b7e199 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:42.801833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-593d7cd4-e80c-418b-adf6-ef4c94b7e199 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1214 microversion: 2.1 time: 0.327173 Aug 29 15:42:42.804791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 704/1467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:42 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1214 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:42.828833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:42.834121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:42.870140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.879946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.883035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:42.883937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:42.892146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:42.893164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.008254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.026791 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d390983f-9794-4646-8b90-ed0e00748a16 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1376 microversion: 2.1 time: 0.827515 Aug 29 15:42:43.029818 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 764/1468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:42 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1376 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:43.052041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.053942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:43.069049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.069943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.070552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.072094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.075571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.076224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.313296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.344781 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fcd8a614-1e07-4290-9320-ca06b864466e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1266 microversion: 2.1 time: 0.310566 Aug 29 15:42:43.346017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 765/1469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:43.353146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9bf62741-a002-4d31-87a7-1a6c914ca23b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee4f8af0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.438703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9bf62741-a002-4d31-87a7-1a6c914ca23b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.091323 Aug 29 15:42:43.443051 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 766/1470] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:43.473462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.474393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:43.491703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.493794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.495218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.496321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.498965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.499627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.599737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.616308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.618026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:43.620768 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f3d47879-96fe-4faf-b887-c7e002515a1a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.814810 Aug 29 15:42:43.622023 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 705/1471] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:42 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:43.831550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:43.832834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:43.866567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.871860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.872584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:43.875890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:43.877705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:43.877705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.153063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:44.162174 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a17fa262-c8a3-4708-a086-4e02656cbab4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1266 microversion: 2.1 time: 0.339403 Aug 29 15:42:44.166620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 706/1472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:44.178187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:44.181492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:44.195520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.196716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.198118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.199002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.202387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.202387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.529438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:44.563531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2976ffba-6243-4c05-8835-43b637b69f20 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1376 microversion: 2.1 time: 0.394001 Aug 29 15:42:44.584946 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 707/1473] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:44 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1376 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:44.623392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:44.626489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:44.630932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:44.641392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.641897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.647965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.648773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.649270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.649716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.652616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aabe71ae-a8b5-48cf-8270-e9c4799a1e61 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 1.185872 Aug 29 15:42:44.667549 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 767/1474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:43 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:44.672767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cdbdeeba-26ed-4ce2-9ea4-bbc8485eadc6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2aa7ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:44.757648 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cdbdeeba-26ed-4ce2-9ea4-bbc8485eadc6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1454 microversion: 2.1 time: 0.088508 Aug 29 15:42:44.758242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 768/1475] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:44 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:44.781398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:44.782029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:44.807939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.810256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.811199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:44.811923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:44.812376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:44.812796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.136590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.152327 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40d2b77c-bbcb-4751-b8df-8a1a38787b6d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.566043 Aug 29 15:42:45.155815 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 708/1476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:44 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:45.190385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:45.193189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:45.201037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.201572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.202019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.203134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.203641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.204119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.340763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.350213 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-129895f8-99d9-4707-9d2c-6f4482272670 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1272 microversion: 2.1 time: 0.166400 Aug 29 15:42:45.351627 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 709/1477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:45 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:45.371852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.388556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.390948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.392297 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-033cb82d-94dd-46c6-929b-b878ab5dce14 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.631405 Aug 29 15:42:45.393202 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 769/1478] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:44 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:45.593300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:45.594194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:45.603568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.605270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.605965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.606871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.607605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.608255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.668734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:45.686227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:45.687648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:45.700204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.701255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.704579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.706205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.707466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.708226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.903559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:45.913770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ac221f0-1da7-4c50-8fa6-a17245e0275a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1376 microversion: 2.1 time: 0.327736 Aug 29 15:42:45.914909 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 710/1479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:45 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1376 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:45.921292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-29c92965-817d-404f-8171-2a55d17c3bce req-9df953b2-16b3-4d22-8139-18c426e1c813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f1aebf-dfb9-406c-b132-1081aacd03ef", "tag": "265b876b-61d8-4605-ae5a-385b99f6c59b"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:45.965368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29c92965-817d-404f-8171-2a55d17c3bce req-9df953b2-16b3-4d22-8139-18c426e1c813 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:45.966172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29c92965-817d-404f-8171-2a55d17c3bce req-9df953b2-16b3-4d22-8139-18c426e1c813 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:45.966833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29c92965-817d-404f-8171-2a55d17c3bce req-9df953b2-16b3-4d22-8139-18c426e1c813 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:45.993841 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-29c92965-817d-404f-8171-2a55d17c3bce req-9df953b2-16b3-4d22-8139-18c426e1c813 service nova] Creating event network-changed:265b876b-61d8-4605-ae5a-385b99f6c59b for instance 47f1aebf-dfb9-406c-b132-1081aacd03ef on n-h1-836830-13 Aug 29 15:42:46.022690 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-29c92965-817d-404f-8171-2a55d17c3bce req-9df953b2-16b3-4d22-8139-18c426e1c813 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086838 Aug 29 15:42:46.023568 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 711/1480] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:46.040043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0225559b-c3aa-4f01-8261-dd646d339e90 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3c4dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.118441 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0225559b-c3aa-4f01-8261-dd646d339e90 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1463 microversion: 2.1 time: 0.090167 Aug 29 15:42:46.119058 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 712/1481] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1463 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:46.132754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-88a5c992-9bde-4f20-914a-584d8a3a24de req-7bdd7121-3671-4909-ac54-6aad171a4f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "name": "network-vif-plugged", "status": "completed", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:46.142818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-88a5c992-9bde-4f20-914a-584d8a3a24de req-7bdd7121-3671-4909-ac54-6aad171a4f00 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.146462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-88a5c992-9bde-4f20-914a-584d8a3a24de req-7bdd7121-3671-4909-ac54-6aad171a4f00 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.147120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-88a5c992-9bde-4f20-914a-584d8a3a24de req-7bdd7121-3671-4909-ac54-6aad171a4f00 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.162061 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-88a5c992-9bde-4f20-914a-584d8a3a24de req-7bdd7121-3671-4909-ac54-6aad171a4f00 service nova] Creating event network-vif-plugged:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h1-836830-13 Aug 29 15:42:46.170574 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-88a5c992-9bde-4f20-914a-584d8a3a24de req-7bdd7121-3671-4909-ac54-6aad171a4f00 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049994 Aug 29 15:42:46.171911 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 713/1482] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:46.179217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8efc1e4c-e368-4671-b41a-47d2898dc9b1 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2aa1dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.296617 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8efc1e4c-e368-4671-b41a-47d2898dc9b1 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 200 len: 1463 microversion: 2.1 time: 0.123302 Aug 29 15:42:46.306078 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 714/1483] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 1463 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:46.328706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.329476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:46.344385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.349261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.349744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.350505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.350985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.351443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.752615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.768504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c83b033c-fa56-4ef9-a2fb-0d2e0ed11b1e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.461142 Aug 29 15:42:46.770774 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 715/1484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:46.776115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.778037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:46.784994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.785486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.785918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.786800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.787465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.787891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.858950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:46.876419 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e035e0c0-c5d1-4455-bbf2-fb3dd2cd0d2e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 1.206023 Aug 29 15:42:46.877616 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 770/1485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:45 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:46.885374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:46.886350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:46.893513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:46.899327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.900372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.901617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:46.902689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:46.905344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:46.906878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.093401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.105075 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f94f87ca-0a52-4afc-ac70-0ffed5de9ec3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1468 microversion: 2.1 time: 0.333015 Aug 29 15:42:47.106025 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 716/1486] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:47.111787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.112725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.138800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.139351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.139794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.140507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.140968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.141398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.346356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.357331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29ab25cb-eb2e-44c2-8107-36fe2c796b1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.477192 Aug 29 15:42:47.375357 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 771/1487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:46 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:47.382412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.383230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.392010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.393263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.394016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.395507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.396157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.397385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.406870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.423172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.424813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.431778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19910834-bb22-47b9-b197-65aa62a31243 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.323353 Aug 29 15:42:47.432422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 717/1488] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:47.449787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.450745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.452715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:42:47.458248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.461173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.462498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.465500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.466238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.468563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.579453 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7f51769-8f6c-48b5-bb6f-c34e3d1a254c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 204 len: 0 microversion: 2.1 time: 0.201527 Aug 29 15:42:47.592246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 772/1489] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:47 2022] DELETE /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:47.607263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-320809636"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:47.610808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.621251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.621753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.622259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.622972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.623501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.623933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.663763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:47.789322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:47.798848 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2bd292f6-fda9-4e8b-b64d-79f0a5054627 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1376 microversion: 2.1 time: 0.362317 Aug 29 15:42:47.801348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 718/1490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1376 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:47.825230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.826322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.835504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:47.838793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.839631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.840285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.841232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.841848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.842623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.901944 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2d189a41-229e-41ca-843b-ce7229f294be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "POST /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4/action" status: 202 len: 0 microversion: 2.1 time: 0.299336 Aug 29 15:42:47.904055 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 773/1491] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:47 2022] POST /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:42:47.916284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-16504915-6b5c-4587-9dc9-ac02cc85bea3 req-43faf65b-e63f-42b8-9637-993854b9c928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b09ab0-6837-4646-8938-c0c1b194ee07", "tag": "152dee39-1c4e-4075-8756-09aa9ea27e0d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:47.929451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-16504915-6b5c-4587-9dc9-ac02cc85bea3 req-43faf65b-e63f-42b8-9637-993854b9c928 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:47.931164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-16504915-6b5c-4587-9dc9-ac02cc85bea3 req-43faf65b-e63f-42b8-9637-993854b9c928 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:47.932342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-16504915-6b5c-4587-9dc9-ac02cc85bea3 req-43faf65b-e63f-42b8-9637-993854b9c928 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:47.954458 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-16504915-6b5c-4587-9dc9-ac02cc85bea3 req-43faf65b-e63f-42b8-9637-993854b9c928 service nova] Creating event network-changed:152dee39-1c4e-4075-8756-09aa9ea27e0d for instance 71b09ab0-6837-4646-8938-c0c1b194ee07 on n-h2-836830-13 Aug 29 15:42:47.962670 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-16504915-6b5c-4587-9dc9-ac02cc85bea3 req-43faf65b-e63f-42b8-9637-993854b9c928 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056686 Aug 29 15:42:47.963997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 774/1492] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:47.976376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:47.977089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:47.989366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.002248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.003113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.005023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.009170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.009856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.071613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.080374 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3d53480-7c57-433d-b73e-81925a58e872 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1515 microversion: 2.1 time: 0.277579 Aug 29 15:42:48.081763 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 719/1493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:48.087390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.088474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:48.094844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.095527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.096079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.096916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.097528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.098060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.320017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.331972 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aebc498a-b59a-4625-a4d2-37c4f185dab5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.247488 Aug 29 15:42:48.333562 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 720/1494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:48.341651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a39802e2-540b-4efa-9f7c-e949dadf3e03 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee404280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.440975 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a39802e2-540b-4efa-9f7c-e949dadf3e03 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.105443 Aug 29 15:42:48.443231 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 721/1495] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:48.448201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d944dcaa-093c-41f8-a3c5-e31dd6620a66 req-5cc7b5ba-4c84-4de0-930f-005885e7d4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84f455ce-786c-4f29-8e9f-e57a09dfe48b", "tag": "a8350ae2-bf24-4dff-9da2-2d4e60a21cc0"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:48.451096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.462112 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ceb9236b-cc08-4098-a013-dcfd1c269b74 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.496328 Aug 29 15:42:48.462581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d944dcaa-093c-41f8-a3c5-e31dd6620a66 req-5cc7b5ba-4c84-4de0-930f-005885e7d4d7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.463239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d944dcaa-093c-41f8-a3c5-e31dd6620a66 req-5cc7b5ba-4c84-4de0-930f-005885e7d4d7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.463456 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 775/1496] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:47 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:48.463680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d944dcaa-093c-41f8-a3c5-e31dd6620a66 req-5cc7b5ba-4c84-4de0-930f-005885e7d4d7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.477544 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d944dcaa-093c-41f8-a3c5-e31dd6620a66 req-5cc7b5ba-4c84-4de0-930f-005885e7d4d7 service nova] Creating event network-changed:a8350ae2-bf24-4dff-9da2-2d4e60a21cc0 for instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b on n-h2-836830-13 Aug 29 15:42:48.481861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.482477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:48.482928 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d944dcaa-093c-41f8-a3c5-e31dd6620a66 req-5cc7b5ba-4c84-4de0-930f-005885e7d4d7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038668 Aug 29 15:42:48.484231 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 722/1497] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:48.489735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.490489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:48.500876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.501080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.501368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.501785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.501917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.502295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.502554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.503015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.503225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.505367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.505818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.509795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.687831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.705308 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cc4da39-1aef-4ea5-9b4e-f797761b29fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.227671 Aug 29 15:42:48.706254 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 776/1498] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:48.722563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.734615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.736661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.738652 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02ff7b0f-f5a9-4b52-9c86-a3439b1123a0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.253150 Aug 29 15:42:48.743505 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 723/1499] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:48.821569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:48.822293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:48.829045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.829675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.830216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.831057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:48.831429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:48.832663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:48.978201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:48.986836 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8192d09a-1d62-4ab7-84eb-3f94060f3df6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1526 microversion: 2.1 time: 0.170617 Aug 29 15:42:48.987744 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 777/1500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:48 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:49.009100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.010031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.018044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.018543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.018978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.019822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.020530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.020953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.106724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.107457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.121704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.122369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.123673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.133180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.135798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.136584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.172317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.181533 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-daefa15d-8af3-4dae-a0b1-0702cdcce669 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1526 microversion: 2.1 time: 0.177255 Aug 29 15:42:49.182721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 724/1501] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1526 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:49.201516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36da3117-5fff-44b9-8450-787f50fdd09f tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.221521 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36da3117-5fff-44b9-8450-787f50fdd09f tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/b901882a-7ad5-4c57-b2d4-b994550de20b" status: 202 len: 0 microversion: 2.1 time: 0.023649 Aug 29 15:42:49.223013 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 725/1502] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:42:49 2022] DELETE /compute/v2.1/flavors/b901882a-7ad5-4c57-b2d4-b994550de20b => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:42:49.232318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9f9ad9b-58e7-4d1e-8e64-4f7aaf1c81d7 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.257727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9f9ad9b-58e7-4d1e-8e64-4f7aaf1c81d7 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029147 Aug 29 15:42:49.271810 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 726/1503] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:49.277720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:49.280022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.291701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.292421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.292901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.299992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.303005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.303484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.435567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.445348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Old instance type tempest-test_resize_flavor_-383544663, new instance type m1.heat {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:42:49.453911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:49.454276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:42:49.454650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:42:49.455387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:42:49.455860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:42:49.456222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:42:49.463146 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b37a0e3c-feb7-439f-beb0-7d500a17b9be tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1515 microversion: 2.1 time: 0.361035 Aug 29 15:42:49.464282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 778/1504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1515 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:49.469474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.470267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.478256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.479000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.479613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.480468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.481068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.481690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.633081 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab898182-7c0a-4f19-b1c7-2ba53d6635cc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236/action" status: 202 len: 0 microversion: 2.1 time: 0.356363 Aug 29 15:42:49.633700 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 727/1505] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:42:49 2022] POST /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:42:49.646339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a95c68f-eefd-42b9-92db-f0681f23b78d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee47d430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.726999 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a95c68f-eefd-42b9-92db-f0681f23b78d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.092119 Aug 29 15:42:49.741353 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 728/1506] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:49.747883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:49.749205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:49.759302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.760113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.760943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:49.763332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:49.764064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:49.764693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.001033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.013555 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23c0a2f4-b41d-4620-ad51-1975f4181f6b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.547937 Aug 29 15:42:50.014157 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 779/1507] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:50.035496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.036585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.051122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.060622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.061321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.062360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.063601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.065771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.643539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:50.673008 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c8c8396f-9ef9-4fee-9a6f-ff994bc162e1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1535 microversion: 2.1 time: 0.649487 Aug 29 15:42:50.677280 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 780/1508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1535 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:50.682467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:50.686079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:50.703129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.705251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.708038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:50.710344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:50.711730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:50.713924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.334143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.352656 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-129dbe0d-60d5-4202-b820-5910e916b93a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 1.601897 Aug 29 15:42:51.353510 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 729/1509] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:49 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:51.370762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.380936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:51.381690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:51.386576 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3137463-ab6c-4a59-b1d5-5e63978d2f1b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.706059 Aug 29 15:42:51.388016 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 781/1510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:50 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:51.393943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5cf8995a-d7c4-479a-9ab3-b90354f925ff req-d618eebe-7b1c-4149-bdf3-ec7168b4b3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c1c64a-0520-432c-8c72-608633f27d35", "name": "network-vif-unplugged", "status": "completed", "tag": "38a41bff-78ab-411e-8d27-7a0d76ee3a93"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:51.408511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5cf8995a-d7c4-479a-9ab3-b90354f925ff req-d618eebe-7b1c-4149-bdf3-ec7168b4b3b1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.410551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5cf8995a-d7c4-479a-9ab3-b90354f925ff req-d618eebe-7b1c-4149-bdf3-ec7168b4b3b1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.411595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.412050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5cf8995a-d7c4-479a-9ab3-b90354f925ff req-d618eebe-7b1c-4149-bdf3-ec7168b4b3b1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.412214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.412536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.416923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.417480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.418544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.448056 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5cf8995a-d7c4-479a-9ab3-b90354f925ff req-d618eebe-7b1c-4149-bdf3-ec7168b4b3b1 service nova] Creating event network-vif-unplugged:38a41bff-78ab-411e-8d27-7a0d76ee3a93 for instance 55c1c64a-0520-432c-8c72-608633f27d35 on n-h1-836830-13 Aug 29 15:42:51.476580 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5cf8995a-d7c4-479a-9ab3-b90354f925ff req-d618eebe-7b1c-4149-bdf3-ec7168b4b3b1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086869 Aug 29 15:42:51.485778 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 782/1511] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:51.500620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:51.501332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:51.528283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.531639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.533121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.538249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:51.539719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:51.540581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:51.774217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.807232 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd81c129-cb85-4c3c-9044-0b8f9391ef01 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1473 microversion: 2.1 time: 0.320036 Aug 29 15:42:51.811232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:51.816590 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 783/1512] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1473 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:51.836620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f49adb1-6718-4382-aa80-f7faa92a3710 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee244040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:51.943126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.970884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.978090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:51.992352 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-588fac86-7260-40b3-a98f-a1e2f461a0f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.625476 Aug 29 15:42:51.995304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 730/1513] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:52.017633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.028605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.047660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.048198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.053201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.066525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.067744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.074132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.243573 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f49adb1-6718-4382-aa80-f7faa92a3710 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.422553 Aug 29 15:42:52.246212 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 784/1514] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:52.255564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.256574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.264945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.266731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.267372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.268386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.270990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.271673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.656645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:52.669340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30d3d5d7-710c-413f-ada5-cf5031bf13c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.672459 Aug 29 15:42:52.674938 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 731/1515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:51 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:52.691715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bf165d86-72dc-44ab-b745-939dae6a1223 req-ace21e9d-6015-4037-9635-eab9d333b94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0279f9d2-7281-49ed-909b-c7aefacba4dc", "name": "network-vif-deleted", "tag": "5e744617-4cca-49fe-af24-450eb780b7b5"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:52.713623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:52.716898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf165d86-72dc-44ab-b745-939dae6a1223 req-ace21e9d-6015-4037-9635-eab9d333b94e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.719399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf165d86-72dc-44ab-b745-939dae6a1223 req-ace21e9d-6015-4037-9635-eab9d333b94e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.720010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf165d86-72dc-44ab-b745-939dae6a1223 req-ace21e9d-6015-4037-9635-eab9d333b94e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.726713 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d3137df7-0e20-4776-a558-98498c556e47 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1535 microversion: 2.1 time: 0.478002 Aug 29 15:42:52.736721 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bf165d86-72dc-44ab-b745-939dae6a1223 req-ace21e9d-6015-4037-9635-eab9d333b94e service nova] Creating event network-vif-deleted:5e744617-4cca-49fe-af24-450eb780b7b5 for instance 0279f9d2-7281-49ed-909b-c7aefacba4dc on n-h2-836830-13 Aug 29 15:42:52.741886 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 785/1516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:52 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1535 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:52.750122 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bf165d86-72dc-44ab-b745-939dae6a1223 req-ace21e9d-6015-4037-9635-eab9d333b94e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072594 Aug 29 15:42:52.750721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 732/1517] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:52.752758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.753537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.756780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.757758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.761368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.762499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.763087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.764199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.764764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.765289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.766488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.767212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.767861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.768843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.770050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.770993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.792863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=22 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:52.946131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:52.958220 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aebce095-55b9-4973-9be1-562d946f2c44 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.206009 Aug 29 15:42:52.960223 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 733/1518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:52 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:52.965947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:52.966873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:52.976024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.976935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.977607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:52.979801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:52.980721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:52.981410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.010604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:53.057883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.060852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.062411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.063548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lazy-loading 'fault' on Instance uuid 0279f9d2-7281-49ed-909b-c7aefacba4dc {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:53.171165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.189063 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-696ab71c-e067-4dc8-ba4f-c95079e689b4 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 200 len: 1308 microversion: 2.1 time: 0.221159 Aug 29 15:42:53.189652 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 734/1519] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:52 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:53.210310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.210939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.217510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.218019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.218456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.219201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.219665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.220088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.475580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.490959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.492835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.496087 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39eaef75-282a-4922-943a-555cd86d4b4b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.304745 Aug 29 15:42:53.499365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 735/1520] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:53.502487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:53.516414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3abd260-25e8-430d-83aa-2423ca20f6af tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee446430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.518700 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b7a56e4-c2b0-43f8-aabd-3f0367452dcb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.774246 Aug 29 15:42:53.522292 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 786/1521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:52 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:53.599716 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3abd260-25e8-430d-83aa-2423ca20f6af tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.098750 Aug 29 15:42:53.600617 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 736/1522] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:53.708236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.712487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.720782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.721422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.724119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.724980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.726707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.730108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.755252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:53.757052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:53.781118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.785100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.785638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:53.788196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:53.789791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:53.792002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.017222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.029167 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3354459-0dff-4076-ac6b-28af9c4d5922 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1535 microversion: 2.1 time: 0.281901 Aug 29 15:42:54.029843 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 737/1523] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1535 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:54.037447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.038349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.045226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.045977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.046628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.047378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.047839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.048267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.208514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.219917 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-730e294a-7b9d-4df5-a17b-cede2d1e0348 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.523406 Aug 29 15:42:54.224895 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 787/1524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:53 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:54.235635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.236536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: 0279f9d2-7281-49ed-909b-c7aefacba4dc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.251538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.254945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.255890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.257016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.259576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.260215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.309296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] HTTP exception thrown: Instance 0279f9d2-7281-49ed-909b-c7aefacba4dc could not be found. Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Request method failure captured: Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc HTTP/1.1 Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2Zt9fJ8sN9CuyTWT0wpW3C8SBqhb4grQXxKBT9dHIvPfBLEMW5oAzT0zKNUQTRh-pOH9Ngk0WcqezflfGfEHLzU1O-IjUW8RZyomTNQ0I30oGNnyVk__bMDlqaA2JJ5JAIR3aZzuvU_mwPi30J31rrmuO8cFhA6BC8C7P5DcEA32I Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b14d17b6ccdc4d4d874ff1e303d3eb6c Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesAdminNegativeTest-400798360 Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:42:54.319586 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b14d17b6ccdc4d4d874ff1e303d3eb6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b14d17b6ccdc4d4d874ff1e303d3eb6c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b14d17b6ccdc4d4d874ff1e303d3eb6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b14d17b6ccdc4d4d874ff1e303d3eb6c"}]}] Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesAdminNegativeTest-400798360 Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b14d17b6ccdc4d4d874ff1e303d3eb6c Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-400798360 Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesAdminNegativeTest-400798360-project Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 53387bcdf14248b9bdf716e782b786d7 Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesAdminNegativeTest-400798360-project Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 0279f9d2-7281-49ed-909b-c7aefacba4dc could not be found. Aug 29 15:42:54.321459 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '0279f9d2-7281-49ed-909b-c7aefacba4dc'} Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0279f9d2-7281-49ed-909b-c7aefacba4dc could not be found. Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:42:54.322437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0279f9d2-7281-49ed-909b-c7aefacba4dc could not be found. Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0279f9d2-7281-49ed-909b-c7aefacba4dc could not be found. Aug 29 15:42:54.324385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:42:54.326667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.329800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Returning 404 to user: Instance 0279f9d2-7281-49ed-909b-c7aefacba4dc could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:42:54.331970 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a415553-8c1b-4582-b926-97decf2de9ba tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc" status: 404 len: 111 microversion: 2.1 time: 0.104860 Aug 29 15:42:54.333621 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 788/1525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/0279f9d2-7281-49ed-909b-c7aefacba4dc => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:42:54.341464 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbc367d3-ae5c-4da8-92bc-c2423d3d213c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.302064 Aug 29 15:42:54.343053 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 738/1526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:54.523299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.529238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.542285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:54.542908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:54.544647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.545314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.545854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.546677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.547245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.547745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.549030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.549754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.550554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.551558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:54.552287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:54.552936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:54.931230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:54.946320 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-753baf81-71c1-4c63-817f-6724018a8d12 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.406366 Aug 29 15:42:54.949589 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 739/1527] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:54.961011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-16b396a2-6408-42c6-a33e-c8032281d091 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee411f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:55.000709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.025457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.035856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.041070 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4905b5e-804d-4555-bdf8-5e6a18479eff tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.521480 Aug 29 15:42:55.044268 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 789/1528] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:55.064367 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-16b396a2-6408-42c6-a33e-c8032281d091 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.112356 Aug 29 15:42:55.072435 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 740/1529] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:54 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:55.072736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:55.072736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.099876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.100384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.100827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.103523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.103523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.111284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.245805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:55.246440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.262204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.262702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.263182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.264525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.264987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.265415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.529843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.544612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.556220 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f434edc-9717-48ca-a4de-b21fdc279c7d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.314296 Aug 29 15:42:55.557621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a903b23-23c8-453c-8ae6-873f5bcff76d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.507867 Aug 29 15:42:55.558750 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 790/1530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:55 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:55.573085 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 741/1531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:55 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:55.575349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:55.576198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.586493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.586984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.587635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.588488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:55.589083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:55.595732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:55.976181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:55.978077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:55.985828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:55.996258 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b1bdd468-81f4-4669-a505-1fcbb9acafcf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.436169 Aug 29 15:42:55.999738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 791/1532] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:55 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:56.011231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.011956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.021975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.023754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.024345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.024895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.070384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.071943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:56.119336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.120000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.120575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.121705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.122468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.124564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.155570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:56.311353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.322574 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fe7d783-0b54-4b52-bb53-11c39fadf994 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.352195 Aug 29 15:42:56.336046 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 742/1533] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:55 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:56.362052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c3c9f85-0acd-4c29-bfdf-51993d272b9a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3d0a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.449978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c3c9f85-0acd-4c29-bfdf-51993d272b9a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.111349 Aug 29 15:42:56.451785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 743/1534] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:56.470672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e510dab5-e5d1-4232-8f84-16aff185368d req-5b067d05-b29f-4414-aac1-54f1569380e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb580cd6-da8c-430a-8c23-39f4a6c236b4", "name": "network-vif-plugged", "status": "completed", "tag": "1495779a-a585-4e87-b55b-b1050fd3f0b5"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:56.496001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e510dab5-e5d1-4232-8f84-16aff185368d req-5b067d05-b29f-4414-aac1-54f1569380e3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.496593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e510dab5-e5d1-4232-8f84-16aff185368d req-5b067d05-b29f-4414-aac1-54f1569380e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.497137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e510dab5-e5d1-4232-8f84-16aff185368d req-5b067d05-b29f-4414-aac1-54f1569380e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.528038 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e510dab5-e5d1-4232-8f84-16aff185368d req-5b067d05-b29f-4414-aac1-54f1569380e3 service nova] Creating event network-vif-plugged:1495779a-a585-4e87-b55b-b1050fd3f0b5 for instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 on n-h1-836830-13 Aug 29 15:42:56.539761 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e510dab5-e5d1-4232-8f84-16aff185368d req-5b067d05-b29f-4414-aac1-54f1569380e3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074089 Aug 29 15:42:56.540509 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 744/1535] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:42:56.546687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.565277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.566850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.583520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.585213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:56.588245 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf1bfa33-82b9-4c84-abe6-4a55b8ad691d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1814 microversion: 2.25 time: 0.521519 Aug 29 15:42:56.591156 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 792/1536] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1814 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:56.606187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.609170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:56.609841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.610287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.611000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.613145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:56.616147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.619922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.641908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.645874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.648246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.651444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:56.654561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:56.655624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:56.940054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:56.968445 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbf55f9d-f8aa-4121-bac0-4d5a85ed5ac9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.393774 Aug 29 15:42:56.988221 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 745/1537] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:57.027267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.028710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.039998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.047410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.048837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.049743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.050945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.054705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.285830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.294073 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7f40c60-1106-44d7-89fe-b9f7a002d84a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.701847 Aug 29 15:42:57.313113 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 793/1538] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:56 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:57.347316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.348238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.348872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.357869 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a592324-063c-4bf9-8d46-fe5be57b0b67 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.334962 Aug 29 15:42:57.361719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.362211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.363278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.364068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.364471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.364905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.369497 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 746/1539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:57.464472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e628e2f-3560-44a2-b283-99cedd9cb568 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3c4940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.536559 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e628e2f-3560-44a2-b283-99cedd9cb568 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.076370 Aug 29 15:42:57.537721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 747/1540] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:57.617545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.618164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.626269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.627208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.627859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.629769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.630456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.631418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.638901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.650990 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-805238ce-3ce6-4afc-96c2-c84a1e754d70 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.307642 Aug 29 15:42:57.651645 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 794/1541] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:57.846260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.859905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.861821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:57.863901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26d2cf16-788d-4a4b-918c-cd4c6487f675 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1804 microversion: 2.25 time: 0.251978 Aug 29 15:42:57.864863 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 748/1542] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1804 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:42:57.889697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-de63c427-f4e6-4783-b056-3197d37a835d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '.version_select at 0x7f32ee37b790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.893456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de63c427-f4e6-4783-b056-3197d37a835d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.899941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de63c427-f4e6-4783-b056-3197d37a835d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.900647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de63c427-f4e6-4783-b056-3197d37a835d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.920129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-de63c427-f4e6-4783-b056-3197d37a835d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 2810 microversion: 2.25 time: 0.034142 Aug 29 15:42:57.921297 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 795/1543] 10.222.0.83 () {60 vars in 1184 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/os-migrations => generated 2810 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:57.939552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.940481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:57.947219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.947992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.948591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.950011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:57.950629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:57.951258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:57.993636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:57.994176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.000789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.002933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.007564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.008503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.015282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.015939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.276537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:58.308168 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d713c47-805c-4b8d-8c6c-f8b1adf8a37a tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 2424 microversion: 2.25 time: 0.372220 Aug 29 15:42:58.308783 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 749/1544] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 2424 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:58.320721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.321369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.337815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.338318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.338760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.339539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.339998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.340433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.651656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:58.662431 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a718779e-348b-4de0-9e29-6239e1f940de tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.345751 Aug 29 15:42:58.667361 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 750/1545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:58.676841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:58.679984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:58.695266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.695785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.696229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.696968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:58.697430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:58.697867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:58.968230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:58.998625 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cee962f-2c81-4467-a6dd-82704837e44d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 2424 microversion: 2.25 time: 0.330290 Aug 29 15:42:58.999250 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 751/1546] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 2424 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:42:59.027334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.027994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.036163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.036895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.037530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.038869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.039686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.040313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.157723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.177419 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10263d23-d318-46e9-9ed4-e3e651f03ecd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 1.187485 Aug 29 15:42:59.183404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 796/1547] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:57 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:42:59.193273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-130b5658-03d9-45d9-85df-bc7d202f3f1e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee2464c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.254053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.263524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a9b1787f-96f9-47ea-8c78-61a130c50b2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.262543 Aug 29 15:42:59.289133 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-130b5658-03d9-45d9-85df-bc7d202f3f1e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.104405 Aug 29 15:42:59.290418 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 752/1548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:58 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:59.292082 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 797/1549] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:42:59.297962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-621ed230-5cbc-4bea-b743-6e0e97b09dc8 req-bbbb69b4-a325-4961-a5fe-48c533509bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f1aebf-dfb9-406c-b132-1081aacd03ef", "name": "network-vif-plugged", "status": "completed", "tag": "265b876b-61d8-4605-ae5a-385b99f6c59b"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:42:59.309637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.310497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.322000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.325120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-621ed230-5cbc-4bea-b743-6e0e97b09dc8 req-bbbb69b4-a325-4961-a5fe-48c533509bd6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.325621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.326872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.327867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.328517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-621ed230-5cbc-4bea-b743-6e0e97b09dc8 req-bbbb69b4-a325-4961-a5fe-48c533509bd6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.329101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-621ed230-5cbc-4bea-b743-6e0e97b09dc8 req-bbbb69b4-a325-4961-a5fe-48c533509bd6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.329720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.333352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.372706 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-621ed230-5cbc-4bea-b743-6e0e97b09dc8 req-bbbb69b4-a325-4961-a5fe-48c533509bd6 service nova] Creating event network-vif-plugged:265b876b-61d8-4605-ae5a-385b99f6c59b for instance 47f1aebf-dfb9-406c-b132-1081aacd03ef on n-h1-836830-13 Aug 29 15:42:59.386805 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-621ed230-5cbc-4bea-b743-6e0e97b09dc8 req-bbbb69b4-a325-4961-a5fe-48c533509bd6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088221 Aug 29 15:42:59.387539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 753/1550] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:42:59.395584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.396161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.416881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.417687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.423794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.426734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.427331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.429964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.708681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'services' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:42:59.924863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:42:59.951170 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3489b765-1700-4f88-bcef-edc0d68f5a06 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "DELETE /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments/24b9c11a-04ca-4533-b52b-d2145ff3bea0" status: 202 len: 0 microversion: 2.25 time: 0.560066 Aug 29 15:42:59.952664 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 754/1551] 10.222.0.83 () {60 vars in 1457 bytes} [Mon Aug 29 15:42:59 2022] DELETE /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments/24b9c11a-04ca-4533-b52b-d2145ff3bea0 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:42:59.962738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:42:59.964419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:42:59.972858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.973758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.974431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.975470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:42:59.976095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:42:59.976729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:42:59.984210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:42:59.995823 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6aee3dbf-9df7-41c6-a17b-ee55c4ce75f5 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.702550 Aug 29 15:42:59.997261 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 798/1552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:00.002669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.006599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:00.031461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.034433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.035393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.045155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.045660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.048857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.123666 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b66165f-55b1-4eb7-9aba-727fdee7f3f8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125029 Aug 29 15:43:00.124932 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 799/1553] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:43:00.131443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.132198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:00.141816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.142813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.143522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.145559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.146197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.146790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.200675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:00.314383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:00.328173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-60c9080a-7f8c-4c8a-9c32-360b2d449bd2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.372429 Aug 29 15:43:00.329357 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 755/1554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:42:59 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:00.335621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.336594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:00.347723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5dfea5c6-b637-4d27-a16c-6109c6086a7e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 204 len: 0 microversion: 2.1 time: 0.219912 Aug 29 15:43:00.350639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.351409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.352011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.353140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 800/1555] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:00 2022] DELETE /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:00.358485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.359310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.361514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.372497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.376741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:00.415606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.418783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.419501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.421555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.422309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.423211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.718456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:00.747898 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6d673a2-7602-4404-a34e-af15d39cbf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.414113 Aug 29 15:43:00.750535 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 756/1556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:00 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:00.762894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b034f35b-ee3a-4a83-a440-fb6def90a746 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2aa7b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.841265 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b034f35b-ee3a-4a83-a440-fb6def90a746 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.089461 Aug 29 15:43:00.846885 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 757/1557] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:00 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:00.852418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:00.853044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:00.868995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.869505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.869951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.870685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:00.871180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:00.875567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:00.944293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.003838 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b825a2c2-6f75-46f8-92ef-7bcaaac8a1f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.647452 Aug 29 15:43:01.006030 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 801/1558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:00 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:01.024909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:01.028215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:01.089192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.095902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.096353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.097143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.097605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.098241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.298544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.308845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e8c2aeb-ed8e-42a4-8f12-26a83bf20365 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1681 microversion: 2.1 time: 0.460384 Aug 29 15:43:01.310014 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 758/1559] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:00 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1681 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:01.315067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:01.318866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:01.326058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.327070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.328325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.329251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.329872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.331314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.382722 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-89d86581-0ee3-4af1-b67e-6b08a21c198f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071424 Aug 29 15:43:01.383661 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 759/1560] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:43:01 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:43:01.402877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:01.403662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:01.412957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.413737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.414329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.415324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.415974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.416651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.642096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.664655 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f410d94-64b3-481c-b949-116a40dd3463 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.643583 Aug 29 15:43:01.665596 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 802/1561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:01 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:01.677435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4e396988-f934-4ac0-8d2a-9c65b4731484 req-2340bcee-9a53-416c-9159-094b36fdc18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f455ce-786c-4f29-8e9f-e57a09dfe48b", "name": "network-vif-plugged", "status": "completed", "tag": "a8350ae2-bf24-4dff-9da2-2d4e60a21cc0"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:01.705697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:01.724439 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c6050d25-ed44-4ac6-8505-9afb9b9d1aca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.339193 Aug 29 15:43:01.732441 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 760/1562] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:01 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:01.763370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e396988-f934-4ac0-8d2a-9c65b4731484 req-2340bcee-9a53-416c-9159-094b36fdc18c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.766204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e396988-f934-4ac0-8d2a-9c65b4731484 req-2340bcee-9a53-416c-9159-094b36fdc18c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.767422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e396988-f934-4ac0-8d2a-9c65b4731484 req-2340bcee-9a53-416c-9159-094b36fdc18c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.773022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:01.773931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:01.787450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.788128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.789019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.790899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:01.794732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:01.795521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:01.803364 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4e396988-f934-4ac0-8d2a-9c65b4731484 req-2340bcee-9a53-416c-9159-094b36fdc18c service nova] Creating event network-vif-plugged:a8350ae2-bf24-4dff-9da2-2d4e60a21cc0 for instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b on n-h2-836830-13 Aug 29 15:43:01.814889 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4e396988-f934-4ac0-8d2a-9c65b4731484 req-2340bcee-9a53-416c-9159-094b36fdc18c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147753 Aug 29 15:43:01.816522 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 803/1563] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:01.859899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-264b507a-4465-4617-b359-0a28adaf7f20 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2a471f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:01.952494 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-264b507a-4465-4617-b359-0a28adaf7f20 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.099028 Aug 29 15:43:01.958450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 804/1564] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:01 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:02.030488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.031646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.045678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.048259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.048906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.051561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.053720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.054920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.116657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.119005 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 15:43:02.119482 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 15:43:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 (ip 10.222.0.83) !!! Aug 29 15:43:02.125451 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40041d2b-42db-4bf9-b39a-3510e996d1bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1317 microversion: 2.1 time: 0.357645 Aug 29 15:43:02.126186 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 761/1565] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:01 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:02.331106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.337248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.353276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.354339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.356262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.357845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.359394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.360035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.580856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.594090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f678a4bf-8dff-4f20-8a1e-7b48bb090b0e tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1681 microversion: 2.1 time: 0.266295 Aug 29 15:43:02.595279 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 762/1566] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:02.601359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.604334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.612172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.613749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.614701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.615717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.616402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.617032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.704391 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6a4086e7-39fe-4f3c-a7f7-65b7d4ec2519 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.107676 Aug 29 15:43:02.705810 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 763/1567] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:43:02.717115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.717719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.724658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:02.747255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-093903c6-1dd9-4619-908c-61c1bbb4ca31 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.711688 Aug 29 15:43:02.747966 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 805/1568] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:02.764616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.765124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.765567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.766284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.766749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.767202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.785325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:02.785962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:02.806248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.806747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.807216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:02.820115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:02.820615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:02.824758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.238427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.249586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a6e3137-afbd-4366-92df-df791a28463f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.541831 Aug 29 15:43:03.263132 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 764/1569] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:03.263132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcae264f-34a0-4254-9115-ce3d9d92d77b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2aa7430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.303619 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcae264f-34a0-4254-9115-ce3d9d92d77b tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.051955 Aug 29 15:43:03.305177 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 765/1570] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:03.310135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.310925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:03.316052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.318571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.319272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.320037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.320928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.321543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.322129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.335750 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c77ce88-ba3d-4753-9037-55c33721b05b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.563011 Aug 29 15:43:03.336410 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 806/1571] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:02 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:03.525973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:03.540312 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-325a6e6d-4351-461d-8f7d-6f2501a0b0fb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1467 microversion: 2.1 time: 0.233303 Aug 29 15:43:03.541435 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 766/1572] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1467 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:03.622832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.623882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:03.634731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.635306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.640528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.641344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.641837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.642277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.898375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:03.898997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:03.916027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.916530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.916976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:03.917734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:03.918241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:03.918678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.179907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.196145 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07f18a04-5e9f-415f-b7a9-05fc8b4a6188 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1681 microversion: 2.1 time: 0.578134 Aug 29 15:43:04.196743 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 767/1573] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1681 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:04.214901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.217288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.249323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.249841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.250294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.251055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.251525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.251964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.349131 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-776d02ea-0416-495b-9590-cb182a658023 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151200 Aug 29 15:43:04.356876 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 768/1574] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:43:04.362111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.371015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.382872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.384064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.387629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.388575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.389216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.389809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.524356 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dc9b3ef0-9cba-4b51-8705-2522c87a8ffe tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1620 microversion: 2.1 time: 0.964783 Aug 29 15:43:04.528636 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 807/1575] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:03 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1620 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:04.550550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:04.574040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:04.595567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.600810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.601843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.603801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:04.604481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:04.605147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:04.942333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:04.950181 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb67ef1e-9906-42c9-9f17-a33446b2e52f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1308 microversion: 2.1 time: 0.417810 Aug 29 15:43:04.957793 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 808/1576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:04.989221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-55185d0f-cafb-4c18-a6aa-4f5b9a43ef47 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2aa7700>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.021554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.049099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02929082-fcd9-41bd-acf9-a41aa2650e36 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.690225 Aug 29 15:43:05.056932 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 769/1577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:05.074709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.078395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.102175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.102678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.103148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.103867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.104323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.104749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.110855 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-55185d0f-cafb-4c18-a6aa-4f5b9a43ef47 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1454 microversion: 2.1 time: 0.151006 Aug 29 15:43:05.120758 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 809/1578] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:04 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:05.126923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d0a5a2d-bbe9-496f-a2bb-1025ec625e71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: .version_select at 0x7f32ee242160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-327410201", "policies": ["affinity"]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:05.179448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4d0a5a2d-bbe9-496f-a2bb-1025ec625e71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:05.204849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4d0a5a2d-bbe9-496f-a2bb-1025ec625e71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:05.355909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4d0a5a2d-bbe9-496f-a2bb-1025ec625e71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:05.357860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:05.370167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4d0a5a2d-bbe9-496f-a2bb-1025ec625e71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:05.416927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d0a5a2d-bbe9-496f-a2bb-1025ec625e71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.294377 Aug 29 15:43:05.417652 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 810/1579] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 15:43:05 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:05.435887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b313c813-2f2e-49ed-96be-bbddd54e661a req-d01abc9d-e3b1-46eb-b14c-f2dc282313df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b09ab0-6837-4646-8938-c0c1b194ee07", "name": "network-vif-plugged", "status": "completed", "tag": "152dee39-1c4e-4075-8756-09aa9ea27e0d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:05.451623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b313c813-2f2e-49ed-96be-bbddd54e661a req-d01abc9d-e3b1-46eb-b14c-f2dc282313df service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.454465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b313c813-2f2e-49ed-96be-bbddd54e661a req-d01abc9d-e3b1-46eb-b14c-f2dc282313df service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.455472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b313c813-2f2e-49ed-96be-bbddd54e661a req-d01abc9d-e3b1-46eb-b14c-f2dc282313df service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.486624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b313c813-2f2e-49ed-96be-bbddd54e661a req-d01abc9d-e3b1-46eb-b14c-f2dc282313df service nova] Creating event network-vif-plugged:152dee39-1c4e-4075-8756-09aa9ea27e0d for instance 71b09ab0-6837-4646-8938-c0c1b194ee07 on n-h2-836830-13 Aug 29 15:43:05.498136 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b313c813-2f2e-49ed-96be-bbddd54e661a req-d01abc9d-e3b1-46eb-b14c-f2dc282313df service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079273 Aug 29 15:43:05.501782 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 811/1580] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:05.510291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.522656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.546017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.554256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.554829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.555727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.558567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.559321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.754883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.771166 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30461fdb-e36b-41ef-9b4a-d4caa9cb80ea tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.712723 Aug 29 15:43:05.773167 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 770/1581] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:05.779160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.781689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.793228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.793733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.794175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.794894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.795423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.806511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.822150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:05.838355 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e615b206-99b3-4e28-b421-c152d3c6fc70 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1613 microversion: 2.1 time: 0.335044 Aug 29 15:43:05.845870 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 812/1582] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1613 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:05.861486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-496362173", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1478d0e9-432e-48f3-beab-fd90e1b1a6eb"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:05.934552 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-df5b8802-d349-4662-9ac6-75d8f6aa2c4c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.159619 Aug 29 15:43:05.945751 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 771/1583] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:43:05.976364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:05.977501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:05.981783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:05.989671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:05.992296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:05.996788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:05.998756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:05.999760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.001945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.002629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.486863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:06.499259 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40fd012f-b5b4-4e17-8ed8-850602f0ee62 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1488 microversion: 2.1 time: 0.531652 Aug 29 15:43:06.500817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:06.501351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:06.502536 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 772/1584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:05 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1488 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:06.502849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:06.504073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:06.504887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:06.513253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:06.513890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:06.526816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.542681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.552773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.554318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.556550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.557158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.608995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.609493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.609936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.610825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:06.625831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:06.626502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:06.630603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:06.634235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:06.710873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:06.739763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:06.811202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Going to run 2 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:06.814027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:06.904469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129133) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 15:43:06.963365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:06.983609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:06.991620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:06.993494 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-10012660-df3b-43ad-8ee2-edd82ee9c576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1314 microversion: 2.1 time: 0.489269 Aug 29 15:43:07.017965 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 773/1585] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:06 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:07.024729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-58fd8b8d-669a-47d6-97c5-2642327386c7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee47d310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:07.137467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:07.158706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:07.266199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=eeb436cc-a387-48b8-8883-7308ff1103de,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:07.500170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:07.518049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:07.635528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:07.649001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:07.751940 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f76882e-14e4-4ee6-83d9-3a96bc75fbf4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.904848 Aug 29 15:43:07.756270 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 813/1586] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:05 2022] POST /compute/v2.1/servers => generated 32 bytes in 1906 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:43:07.762735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:07.773504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:07.783472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:07.783974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:07.784467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:07.785319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:07.785649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:07.786086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:07.851193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lazy-loading 'flavor' on Instance uuid 84f455ce-786c-4f29-8e9f-e57a09dfe48b {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:08.163745 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18008b89-97ed-439a-9ad8-c132452adf42 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b/action" status: 202 len: 0 microversion: 2.1 time: 0.409314 Aug 29 15:43:08.165685 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 814/1587] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:43:07 2022] POST /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:43:08.349267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-96eb33bf-9cb8-4e04-ab79-572ef4e4a013 req-24c226e6-908d-44d4-8312-5471da5363f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f4e3dc-31bd-4a4c-9227-6f82b15689dd", "name": "network-vif-deleted", "tag": "8ef28b6f-7fba-4c28-abcf-33308d70c8af"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:08.366875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-96eb33bf-9cb8-4e04-ab79-572ef4e4a013 req-24c226e6-908d-44d4-8312-5471da5363f5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.369943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-96eb33bf-9cb8-4e04-ab79-572ef4e4a013 req-24c226e6-908d-44d4-8312-5471da5363f5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.371265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-96eb33bf-9cb8-4e04-ab79-572ef4e4a013 req-24c226e6-908d-44d4-8312-5471da5363f5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.427621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-96eb33bf-9cb8-4e04-ab79-572ef4e4a013 req-24c226e6-908d-44d4-8312-5471da5363f5 service nova] Creating event network-vif-deleted:8ef28b6f-7fba-4c28-abcf-33308d70c8af for instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd on n-h2-836830-13 Aug 29 15:43:08.443909 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-96eb33bf-9cb8-4e04-ab79-572ef4e4a013 req-24c226e6-908d-44d4-8312-5471da5363f5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276399 Aug 29 15:43:08.448900 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 815/1588] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:08.467139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:08.469786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:08.492418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.492929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.493371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.494101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.494716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.494975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.880071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:08.890618 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7826d4e4-c9a9-4d0d-9a7b-ecfaaaeb08ee tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.437385 Aug 29 15:43:08.891736 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 816/1589] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:08 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:08.911390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:08.912917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:08.921983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.923358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.924155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:08.925558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:08.926721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:08.957687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.004729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.005647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.007271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.009806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lazy-loading 'fault' on Instance uuid f2f4e3dc-31bd-4a4c-9227-6f82b15689dd {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:09.175107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53387bcdf14248b9bdf716e782b786d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14d17b6ccdc4d4d874ff1e303d3eb6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:09.195130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9136faa-0858-448d-8353-ab4dbe1a9a2c tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 200 len: 1330 microversion: 2.1 time: 0.301125 Aug 29 15:43:09.196197 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 817/1590] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:08 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 1330 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:09.221343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:09.227552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:09.255787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.258668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.261064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.263990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.266158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.272222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.399152 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f011af11-fcda-4806-bad1-9dbd8b479819 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.196645 Aug 29 15:43:09.400019 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 818/1591] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:43:09 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:43:09.417554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:09.437731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:09.442483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Searching by: {'deleted': False, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:43:09.506270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.506779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.514390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.515250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.515735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.516138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.790054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:43:09.887293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ee20956-2e32-4858-b4e0-70ff74c69b62 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.483064 Aug 29 15:43:09.898091 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 819/1592] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:43:09 2022] GET /compute/v2.1/servers => generated 1002 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:09.927105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:09.928439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:09.939064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.939560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.940932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:09.941916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:09.942379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:09.943073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.347257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.361323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5abac829-41d7-4002-b32b-3ffd03eadb6d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1501 microversion: 2.1 time: 0.461642 Aug 29 15:43:10.379051 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 820/1593] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:09 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1501 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:10.379857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:10.380955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:10.398589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.399135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.399800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.401087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.401859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.403893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.805255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:10.823793 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88f3ad9b-b8b1-4fa0-a792-1f5bc66ba6c4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 200 len: 1479 microversion: 2.1 time: 0.456927 Aug 29 15:43:10.824738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 821/1594] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:10 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 1479 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:10.850583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:10.851483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:10.854727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:10.860485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.861301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.863430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:10.864403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:10.865099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:10.865765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.036320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:11.051409 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d88a9c2e-33a2-4001-b1cb-ba19f5992329 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1270 microversion: 2.1 time: 0.210739 Aug 29 15:43:11.052720 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 822/1595] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:10 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:11.063112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.063796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.079558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.081526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.082159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.082937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.083399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.083795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.418607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:11.426903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b40b9099-3f9b-47cb-bfc8-bd88a4b7877a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.372941 Aug 29 15:43:11.452591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 823/1596] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:11.458718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.459569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] [instance: f2f4e3dc-31bd-4a4c-9227-6f82b15689dd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.477205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.477912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.478512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.479400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.480008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.480812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.496074 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] HTTP exception thrown: Instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd could not be found. Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Request method failure captured: Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd HTTP/1.1 Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2Zt9fJ8sN9CuyTWT0wpW3C8SBqhb4grQXxKBT9dHIvPfBLEMW5oAzT0zKNUQTRh-pOH9Ngk0WcqezflfGfEHLzU1O-IjUW8RZyomTNQ0I30oGNnyVk__bMDlqaA2JJ5JAIR3aZzuvU_mwPi30J31rrmuO8cFhA6BC8C7P5DcEA32I Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b14d17b6ccdc4d4d874ff1e303d3eb6c Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesAdminNegativeTest-400798360 Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:43:11.498143 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b14d17b6ccdc4d4d874ff1e303d3eb6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b14d17b6ccdc4d4d874ff1e303d3eb6c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b14d17b6ccdc4d4d874ff1e303d3eb6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b14d17b6ccdc4d4d874ff1e303d3eb6c"}]}] Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesAdminNegativeTest-400798360 Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b14d17b6ccdc4d4d874ff1e303d3eb6c Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-400798360 Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesAdminNegativeTest-400798360-project Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 53387bcdf14248b9bdf716e782b786d7 Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesAdminNegativeTest-400798360-project Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd could not be found. Aug 29 15:43:11.499878 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'f2f4e3dc-31bd-4a4c-9227-6f82b15689dd'} Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd could not be found. Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:43:11.500806 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd could not be found. Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd could not be found. Aug 29 15:43:11.502426 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:43:11.505291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Returning 404 to user: Instance f2f4e3dc-31bd-4a4c-9227-6f82b15689dd could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:43:11.506394 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f113f37-3723-4f43-9d2e-f5270117f36d tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd" status: 404 len: 111 microversion: 2.1 time: 0.052345 Aug 29 15:43:11.507581 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 824/1597] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/f2f4e3dc-31bd-4a4c-9227-6f82b15689dd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:43:11.513112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:11.515628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.526469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.527749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.535484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.536788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.537444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.538309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.601947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-48f5f174-b29f-4f65-a4ce-36756e5d66d2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089495 Aug 29 15:43:11.604057 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 825/1598] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:43:11 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:43:11.617173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-962679666"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:11.621868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:11.632800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.633505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.634165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:11.635129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:11.635735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:11.637300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.526226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:16.932367 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-58fd8b8d-669a-47d6-97c5-2642327386c7 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1463 microversion: 2.1 time: 9.912449 Aug 29 15:43:16.932977 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 774/1599] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:07 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1463 bytes in 9914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:16.946043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce34902c-09f0-4c85-ab09-60009095f183 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] Calling method '.version_select at 0x7f32ee4043a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.970918 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce34902c-09f0-4c85-ab09-60009095f183 tempest-VolumesAdminNegativeTest-400798360 tempest-VolumesAdminNegativeTest-400798360-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375066813" status: 202 len: 0 microversion: 2.1 time: 0.027477 Aug 29 15:43:16.975793 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 775/1600] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375066813 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:43:16.979914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:16.981262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:16.988425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:16.990620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.991760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.992513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:16.993937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:16.994934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:16.995798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.091296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c852de0b-ec98-4d66-be3e-97862873f55d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b/action" status: 202 len: 0 microversion: 2.1 time: 5.485738 Aug 29 15:43:17.093047 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 826/1601] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:43:11 2022] POST /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b/action => generated 0 bytes in 5488 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:43:17.098970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.099635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.105995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.106478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.106910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.107624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.108069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.108484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.201519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.211166 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe6994fc-b45e-4a77-a67c-603945691eb2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1318 microversion: 2.1 time: 0.236623 Aug 29 15:43:17.224095 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 776/1602] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:16 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.231897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.234327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.241593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.242095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.242532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.243284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.244040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.244630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.281800 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04c42ec1-dcda-48d3-b440-98e9ea382c25 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.056474 Aug 29 15:43:17.282703 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 777/1603] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.292183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e43ab450-7fb9-4c9c-8bdc-d672268e3604"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:17.294551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.314596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.319684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.322587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.323604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.324260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.325129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.334390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.344866 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e025845d-2f22-49fd-ae53-a75287bffe0b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.250456 Aug 29 15:43:17.345943 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 827/1604] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.351962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f50a9e67-0ade-4d6a-bef8-8f6d789830e9 req-4a75284a-709a-4748-aa70-e977a1068c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb436cc-a387-48b8-8883-7308ff1103de", "tag": "d12af6c1-2acd-4fae-ba3e-a07a9dd19696"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:17.364423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f50a9e67-0ade-4d6a-bef8-8f6d789830e9 req-4a75284a-709a-4748-aa70-e977a1068c87 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.365136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f50a9e67-0ade-4d6a-bef8-8f6d789830e9 req-4a75284a-709a-4748-aa70-e977a1068c87 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.365572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f50a9e67-0ade-4d6a-bef8-8f6d789830e9 req-4a75284a-709a-4748-aa70-e977a1068c87 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.370498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:17.413406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f50a9e67-0ade-4d6a-bef8-8f6d789830e9 req-4a75284a-709a-4748-aa70-e977a1068c87 service nova] Creating event network-changed:d12af6c1-2acd-4fae-ba3e-a07a9dd19696 for instance eeb436cc-a387-48b8-8883-7308ff1103de on n-h2-836830-13 Aug 29 15:43:17.423190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f50a9e67-0ade-4d6a-bef8-8f6d789830e9 req-4a75284a-709a-4748-aa70-e977a1068c87 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074721 Aug 29 15:43:17.423973 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 828/1605] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:17.431702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8370a40a-3c63-4049-b1ac-3ede97439842 req-d47c0d60-cc01-4f97-9332-caee81552acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0", "tag": "455f92df-2866-44da-8e9c-bdfab88822ef"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:17.445597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8370a40a-3c63-4049-b1ac-3ede97439842 req-d47c0d60-cc01-4f97-9332-caee81552acb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.446285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8370a40a-3c63-4049-b1ac-3ede97439842 req-d47c0d60-cc01-4f97-9332-caee81552acb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.447153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8370a40a-3c63-4049-b1ac-3ede97439842 req-d47c0d60-cc01-4f97-9332-caee81552acb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.465156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8370a40a-3c63-4049-b1ac-3ede97439842 req-d47c0d60-cc01-4f97-9332-caee81552acb service nova] Creating event network-changed:455f92df-2866-44da-8e9c-bdfab88822ef for instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 on n-h2-836830-13 Aug 29 15:43:17.472171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8370a40a-3c63-4049-b1ac-3ede97439842 req-d47c0d60-cc01-4f97-9332-caee81552acb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045407 Aug 29 15:43:17.473801 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 829/1606] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:17.482187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f2dbe48-92ab-44ca-a6a0-133004c9c4d5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee37b430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.551598 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f2dbe48-92ab-44ca-a6a0-133004c9c4d5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 200 len: 1463 microversion: 2.1 time: 0.075773 Aug 29 15:43:17.552708 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 830/1607] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 1463 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.567805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a9fd8d4-1c42-49b6-8554-0e3beda408bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee2461f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.624246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a9fd8d4-1c42-49b6-8554-0e3beda408bb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.060517 Aug 29 15:43:17.625453 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 831/1608] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.631358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:17.632100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.640736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.641234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.641742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.642718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.645390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.645844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.671274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=30 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:17.836860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:17.847042 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d945b84-1faa-468b-bd0b-e74384c73785 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1467 microversion: 2.1 time: 0.219770 Aug 29 15:43:17.860483 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 832/1609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:17 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1467 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:17.869925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1393134827"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:17.876199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:17.885691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.886280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.886622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:17.887743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:17.888229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:17.888903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.220802 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d0d78df5-7083-435f-a6f4-6b2a563db922 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "POST /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35/action" status: 202 len: 0 microversion: 2.1 time: 0.356167 Aug 29 15:43:18.224770 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 833/1610] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:43:17 2022] POST /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:43:18.244441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:18.245524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:18.253196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.254337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.255053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.255983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:18.256630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:18.257388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:18.465260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:18.475862 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-00863af9-a703-4da0-bbb5-e951cc5c1dea tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1318 microversion: 2.1 time: 0.240124 Aug 29 15:43:18.476768 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 834/1611] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:18 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:18.481481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e4cc397f-0b6b-4384-9e29-3c984ca9ef81 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f29bc3a0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:19.672361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:21.858883 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96af51b0-ecb0-4e27-a164-0fbc725291b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.570456 Aug 29 15:43:21.860682 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 778/1612] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:43:17 2022] POST /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07/os-volume_attachments => generated 194 bytes in 4577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:21.886313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:21.903400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:21.942314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.950051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.951318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:21.952098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:21.957034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:21.958818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:22.545197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:22.562174 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5697341-7466-4dca-b1f3-d0aff06a9f14 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.694633 Aug 29 15:43:22.564447 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 779/1613] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:21 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:22.570133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f466366-6a64-4f59-87f0-a6a1c88c820d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee4fe670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.291819 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e4cc397f-0b6b-4384-9e29-3c984ca9ef81 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173" status: 200 len: 1455 microversion: 2.1 time: 7.813921 Aug 29 15:43:26.293747 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 835/1614] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:18 2022] GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173 => generated 1455 bytes in 7817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:26.318838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.321341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.342743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.345176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.345874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.348541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.349211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.351053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.421573 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f466366-6a64-4f59-87f0-a6a1c88c820d tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 3.849936 Aug 29 15:43:26.426575 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 780/1615] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:22 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 3861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:26.550656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bc58f06f-384e-47bf-b908-c04596a482ba req-38298faf-3501-4cfb-a113-2ac0c3fcbf43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb580cd6-da8c-430a-8c23-39f4a6c236b4", "name": "network-vif-unplugged", "status": "completed", "tag": "1495779a-a585-4e87-b55b-b1050fd3f0b5"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:26.562850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc58f06f-384e-47bf-b908-c04596a482ba req-38298faf-3501-4cfb-a113-2ac0c3fcbf43 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.563630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc58f06f-384e-47bf-b908-c04596a482ba req-38298faf-3501-4cfb-a113-2ac0c3fcbf43 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.564249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc58f06f-384e-47bf-b908-c04596a482ba req-38298faf-3501-4cfb-a113-2ac0c3fcbf43 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.578496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bc58f06f-384e-47bf-b908-c04596a482ba req-38298faf-3501-4cfb-a113-2ac0c3fcbf43 service nova] Creating event network-vif-unplugged:1495779a-a585-4e87-b55b-b1050fd3f0b5 for instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 on n-h1-836830-13 Aug 29 15:43:26.585024 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bc58f06f-384e-47bf-b908-c04596a482ba req-38298faf-3501-4cfb-a113-2ac0c3fcbf43 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151732 Aug 29 15:43:26.587209 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 781/1616] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:26.604738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:26.605466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:26.633009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.633564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.634068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.634830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:26.635344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:26.635796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:26.944127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:26.956271 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ede3f61-a8f8-46b2-bb0e-e549a80c5d1f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1540 microversion: 2.1 time: 0.356518 Aug 29 15:43:26.957154 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 782/1617] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:26 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1540 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:27.098269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:27.111651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4cfcce7f-f5e1-4696-a2af-52dac7da937f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1318 microversion: 2.1 time: 0.816247 Aug 29 15:43:27.113060 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 836/1618] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:26 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:27.309466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a515c58-518d-48b7-a69d-60aaa052dcd9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee63f280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:27.449051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76ce1c82-a174-43be-afbd-c4c2a2f27914 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32f295ff70>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:27.623192 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a515c58-518d-48b7-a69d-60aaa052dcd9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173" status: 200 len: 1455 microversion: 2.1 time: 0.318166 Aug 29 15:43:27.624819 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 783/1619] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:27 2022] GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173 => generated 1455 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:27.979683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:27.980463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:28.008395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.010547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.011923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.013471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.014909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.016997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.479903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:28.491225 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-451c7adf-ac02-4a46-8a7d-98d99caf2462 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1539 microversion: 2.1 time: 0.517153 Aug 29 15:43:28.491821 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 784/1620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:27 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1539 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:43:28.517697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:28.518965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:28.561354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.561968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.565393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:28.566394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:28.573703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:28.574261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.011718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:29.026259 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbc78740-61ba-41dc-a756-741e97894c04 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1318 microversion: 2.1 time: 0.508982 Aug 29 15:43:29.027575 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 785/1621] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:28 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:29.036428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b3d20c1d-2c3c-4bd6-baef-22d3311b4890 req-06b1cbf9-5a84-403f-9344-016d727aa13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb436cc-a387-48b8-8883-7308ff1103de", "name": "network-vif-plugged", "status": "completed", "tag": "d12af6c1-2acd-4fae-ba3e-a07a9dd19696"}, {"server_uuid": "55c1c64a-0520-432c-8c72-608633f27d35", "name": "network-vif-plugged", "status": "completed", "tag": "38a41bff-78ab-411e-8d27-7a0d76ee3a93"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:29.069821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b3d20c1d-2c3c-4bd6-baef-22d3311b4890 req-06b1cbf9-5a84-403f-9344-016d727aa13d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:29.070516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b3d20c1d-2c3c-4bd6-baef-22d3311b4890 req-06b1cbf9-5a84-403f-9344-016d727aa13d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:29.071178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b3d20c1d-2c3c-4bd6-baef-22d3311b4890 req-06b1cbf9-5a84-403f-9344-016d727aa13d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:29.088871 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b3d20c1d-2c3c-4bd6-baef-22d3311b4890 req-06b1cbf9-5a84-403f-9344-016d727aa13d service nova] Creating event network-vif-plugged:d12af6c1-2acd-4fae-ba3e-a07a9dd19696 for instance eeb436cc-a387-48b8-8883-7308ff1103de on n-h2-836830-13 Aug 29 15:43:29.091702 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b3d20c1d-2c3c-4bd6-baef-22d3311b4890 req-06b1cbf9-5a84-403f-9344-016d727aa13d service nova] Creating event network-vif-plugged:38a41bff-78ab-411e-8d27-7a0d76ee3a93 for instance 55c1c64a-0520-432c-8c72-608633f27d35 on n-h1-836830-13 Aug 29 15:43:29.112917 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b3d20c1d-2c3c-4bd6-baef-22d3311b4890 req-06b1cbf9-5a84-403f-9344-016d727aa13d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083801 Aug 29 15:43:29.115760 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 786/1622] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:29.171702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d47e229-0e60-4245-8782-d7e737917abd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee411f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:36.332075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=23 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:37.105953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:38.949500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76ce1c82-a174-43be-afbd-c4c2a2f27914 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 11.512069 Aug 29 15:43:38.950207 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 837/1623] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:27 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 11514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:39.055080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:39.077716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:39.199017 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d47e229-0e60-4245-8782-d7e737917abd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173" status: 200 len: 1455 microversion: 2.1 time: 10.059796 Aug 29 15:43:39.199923 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 787/1624] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:29 2022] GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173 => generated 1455 bytes in 10071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:39.214302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:39.224491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:39.234905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-68cf16a7-e67a-4c93-ad81-8ceb96e510c2 req-f1989260-35dc-4622-8970-866993f8e470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "name": "network-vif-unplugged", "status": "completed", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:39.244022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.244780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.246928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.248284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.249193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.250061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.266989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-68cf16a7-e67a-4c93-ad81-8ceb96e510c2 req-f1989260-35dc-4622-8970-866993f8e470 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.268342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-68cf16a7-e67a-4c93-ad81-8ceb96e510c2 req-f1989260-35dc-4622-8970-866993f8e470 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.269343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-68cf16a7-e67a-4c93-ad81-8ceb96e510c2 req-f1989260-35dc-4622-8970-866993f8e470 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.291303 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-68cf16a7-e67a-4c93-ad81-8ceb96e510c2 req-f1989260-35dc-4622-8970-866993f8e470 service nova] Creating event network-vif-unplugged:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h2-836830-13 Aug 29 15:43:39.304745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-68cf16a7-e67a-4c93-ad81-8ceb96e510c2 req-f1989260-35dc-4622-8970-866993f8e470 service nova] Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:43:39.433769 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-68cf16a7-e67a-4c93-ad81-8ceb96e510c2 req-f1989260-35dc-4622-8970-866993f8e470 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.480631 Aug 29 15:43:39.437177 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 838/1625] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:39.477165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:39.483660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:39.536503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.537140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.537447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:39.538168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:39.549377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:39.549958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.246907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:40.262074 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ad0feb2-8366-41aa-b41d-47a09ad5408b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1318 microversion: 2.1 time: 0.814463 Aug 29 15:43:40.263537 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 839/1626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:39 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1318 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:40.289369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1659104e-f3ac-4526-a6ac-b8f541b6fcfb req-48aabd23-136e-44b8-a7bd-551978c615f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f455ce-786c-4f29-8e9f-e57a09dfe48b", "name": "network-vif-plugged", "status": "completed", "tag": "a8350ae2-bf24-4dff-9da2-2d4e60a21cc0"}, {"server_uuid": "3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0", "name": "network-vif-plugged", "status": "completed", "tag": "455f92df-2866-44da-8e9c-bdfab88822ef"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:40.344191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1659104e-f3ac-4526-a6ac-b8f541b6fcfb req-48aabd23-136e-44b8-a7bd-551978c615f0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.350983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1659104e-f3ac-4526-a6ac-b8f541b6fcfb req-48aabd23-136e-44b8-a7bd-551978c615f0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.351565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1659104e-f3ac-4526-a6ac-b8f541b6fcfb req-48aabd23-136e-44b8-a7bd-551978c615f0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.394280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:40.402570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1659104e-f3ac-4526-a6ac-b8f541b6fcfb req-48aabd23-136e-44b8-a7bd-551978c615f0 service nova] Creating event network-vif-plugged:a8350ae2-bf24-4dff-9da2-2d4e60a21cc0 for instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b on n-h2-836830-13 Aug 29 15:43:40.406495 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3eea9ad8-bfa4-4b67-8036-29d58ef33bed tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1468 microversion: 2.1 time: 1.204876 Aug 29 15:43:40.407330 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 788/1627] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:39 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1468 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:40.413572 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1659104e-f3ac-4526-a6ac-b8f541b6fcfb req-48aabd23-136e-44b8-a7bd-551978c615f0 service nova] Creating event network-vif-plugged:455f92df-2866-44da-8e9c-bdfab88822ef for instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 on n-h2-836830-13 Aug 29 15:43:40.440274 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1659104e-f3ac-4526-a6ac-b8f541b6fcfb req-48aabd23-136e-44b8-a7bd-551978c615f0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.167510 Aug 29 15:43:40.450224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:40.451368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:40.466809 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 840/1628] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:40.468896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.469569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.470168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.471836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:40.472481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:40.473209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:40.507484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4a76dd2-a33e-44e3-80c6-3f8ea95b9128 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32f297bf70>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:40.544630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:43:40.862881 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ab539fc-7ae2-4772-a5ca-bb8a23e39d2a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 204 len: 0 microversion: 2.1 time: 0.423241 Aug 29 15:43:40.869776 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 789/1629] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:43:40 2022] DELETE /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:43:40.886579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5aa16d48-4b3c-4b4a-8473-c8bc37b2d47e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3f84c0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:45.570154 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4a76dd2-a33e-44e3-80c6-3f8ea95b9128 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 5.101277 Aug 29 15:43:45.574621 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 841/1630] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:40 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 5106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:45.588994 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5aa16d48-4b3c-4b4a-8473-c8bc37b2d47e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173" status: 200 len: 1464 microversion: 2.1 time: 4.713792 Aug 29 15:43:45.591356 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 790/1631] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:40 2022] GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173 => generated 1464 bytes in 4721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:45.599167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:45.600287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:45.610440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.610968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.611906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.612835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.613450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.614025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.632627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:45.633413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:45.674515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.691986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.692458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.693235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.693693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.696807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.697306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.697851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.699149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:45.699751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:45.700313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.706917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:45.769139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:45.784176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for user cc90d88d1e574a94858bbe2523855caa and project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:46.168840 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2fde8062-7775-441c-8bba-5fa6cae76877 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236/action" status: 202 len: 0 microversion: 2.1 time: 0.592509 Aug 29 15:43:46.177286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.186092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 842/1632] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:43:45 2022] POST /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:43:46.194077 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-754eb7c6-0770-4567-92ff-624de9442e17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1553 microversion: 2.1 time: 0.598800 Aug 29 15:43:46.196364 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 791/1633] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:45 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1553 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:46.209563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.210358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:46.234458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.235204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.236372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.237856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.239851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.240597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.325996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2996216", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "8ad56b1a-bc38-44b2-bfec-6f75ca507357"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:46.520652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] validate_networks() for [('8ad56b1a-bc38-44b2-bfec-6f75ca507357', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:46.612589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:46.625856 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2b5ee186-a544-494f-9cf2-44656c43444d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1468 microversion: 2.1 time: 0.428050 Aug 29 15:43:46.629378 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 792/1634] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1468 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:46.634935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-68d81cb2-6b61-4dfe-b8ff-ef65896bbb9d req-9c028b44-24c0-46ed-9c36-5758f5e6f711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:46.665343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-68d81cb2-6b61-4dfe-b8ff-ef65896bbb9d req-9c028b44-24c0-46ed-9c36-5758f5e6f711 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.666192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-68d81cb2-6b61-4dfe-b8ff-ef65896bbb9d req-9c028b44-24c0-46ed-9c36-5758f5e6f711 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.666851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-68d81cb2-6b61-4dfe-b8ff-ef65896bbb9d req-9c028b44-24c0-46ed-9c36-5758f5e6f711 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.695276 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-68d81cb2-6b61-4dfe-b8ff-ef65896bbb9d req-9c028b44-24c0-46ed-9c36-5758f5e6f711 service nova] Creating event network-changed:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h2-836830-13 Aug 29 15:43:46.709166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-68d81cb2-6b61-4dfe-b8ff-ef65896bbb9d req-9c028b44-24c0-46ed-9c36-5758f5e6f711 service nova] Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:43:46.722510 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-68d81cb2-6b61-4dfe-b8ff-ef65896bbb9d req-9c028b44-24c0-46ed-9c36-5758f5e6f711 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091697 Aug 29 15:43:46.725110 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 793/1635] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:46.731879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3b39c226-450a-4e34-bbc0-8cc8bafef833 req-2e62ee8f-1249-4008-a5a4-653c8e1ae334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "name": "network-vif-plugged", "status": "completed", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:46.757080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3b39c226-450a-4e34-bbc0-8cc8bafef833 req-2e62ee8f-1249-4008-a5a4-653c8e1ae334 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.757885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3b39c226-450a-4e34-bbc0-8cc8bafef833 req-2e62ee8f-1249-4008-a5a4-653c8e1ae334 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.760849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3b39c226-450a-4e34-bbc0-8cc8bafef833 req-2e62ee8f-1249-4008-a5a4-653c8e1ae334 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.777233 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3b39c226-450a-4e34-bbc0-8cc8bafef833 req-2e62ee8f-1249-4008-a5a4-653c8e1ae334 service nova] Creating event network-vif-plugged:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h2-836830-13 Aug 29 15:43:46.783937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-3b39c226-450a-4e34-bbc0-8cc8bafef833 req-2e62ee8f-1249-4008-a5a4-653c8e1ae334 service nova] Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:43:46.796072 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3b39c226-450a-4e34-bbc0-8cc8bafef833 req-2e62ee8f-1249-4008-a5a4-653c8e1ae334 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069246 Aug 29 15:43:46.797055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 794/1636] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:46.808090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8fb51be6-49e0-4511-bf37-c6ac84e84974 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee68d0d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.871892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8fb51be6-49e0-4511-bf37-c6ac84e84974 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173" status: 200 len: 1464 microversion: 2.1 time: 0.068173 Aug 29 15:43:46.872478 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 795/1637] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173 => generated 1464 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:46.887180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:46.890032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:46.912305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.912799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.913232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:46.913940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:46.914389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:46.914809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.679088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:47.702004 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a2241200-7b7c-4fa1-8bde-e4d4dbce1fd9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1467 microversion: 2.1 time: 0.828375 Aug 29 15:43:47.707810 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 796/1638] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:46 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1467 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:47.727462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d09411a-83cd-4873-b1a6-74d740303068 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee4fe700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:47.919120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:47.920075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:47.920710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:47.921284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:47.922504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:47.965448 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d09411a-83cd-4873-b1a6-74d740303068 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.255798 Aug 29 15:43:47.966145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 797/1639] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:47 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:47.994839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:47.995935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.996633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:47.997916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:47.998822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:47.999940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:48.000603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.001208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.032126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.042012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.048066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.052905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.053450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.060619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.074972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Getting quotas for project bd150e4d120d4c6584c650e747abb6a4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:48.103633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Getting quotas for user 0c19d2e9ffa64e7586e35035176f1c26 and project bd150e4d120d4c6584c650e747abb6a4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:48.159014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:48.172558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:48.337761 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c94e603b-5599-410b-8d82-74e974449945 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.146109 Aug 29 15:43:48.344983 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 843/1640] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:43:48.355492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:48.360566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:48.377938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.378649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.379287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.396426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.397210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.397816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.617113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.634095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0f6897e1-f00f-4f6b-8b31-0a015771a044 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 200 len: 1468 microversion: 2.1 time: 0.663284 Aug 29 15:43:48.654518 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 798/1641] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:47 2022] GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 1468 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:48.666992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:48.676618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:48.701319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.708224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.708779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.709543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:48.712090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:48.712547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:48.927534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:48.949808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-995a7e71-e980-4f45-9cea-24b6c8e70fe0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1345 microversion: 2.1 time: 0.293775 Aug 29 15:43:48.950494 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 799/1642] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:48 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1345 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:48.957124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9109e446-cc93-4df6-b948-faa097a69e56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:48.957754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9109e446-cc93-4df6-b948-faa097a69e56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:49.005402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:49.021529 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5bc50b4c-54d2-472b-839f-5eb6b4aedf7a tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1468 microversion: 2.1 time: 0.670197 Aug 29 15:43:49.023142 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 844/1643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:48 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1468 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:49.057517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.070713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:49.072260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Searching by: {'reservation_id': 'r-0nl55bv3', 'deleted': False, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:43:49.080256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.081435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.082182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.083256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.084044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.084634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.182589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9109e446-cc93-4df6-b948-faa097a69e56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:49.197329 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9109e446-cc93-4df6-b948-faa097a69e56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1221 microversion: 2.1 time: 0.244132 Aug 29 15:43:49.201175 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 800/1644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:48 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1221 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:49.230067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.234206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:49.265690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.266196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.266640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.281248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.281752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.282190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.551269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:43:49.793986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:49.808783 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b6034ab-f930-4893-bd63-19e1cc49a8bb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1467 microversion: 2.1 time: 0.600647 Aug 29 15:43:49.832352 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 801/1645] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1467 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:49.843115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:49.852341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3cd24689-9128-468e-8d79-414099557e28 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee3c4940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:49.875087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:49.875761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:49.876206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:49.987269 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3cd24689-9128-468e-8d79-414099557e28 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.150298 Aug 29 15:43:49.996070 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 802/1646] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:49.996070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c437675a-42f5-497f-98e7-fc96b180b019 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee3e9310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.186369 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f160fa0-e557-42b0-819f-37a42f95994f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/detail?reservation_id=r-0nl55bv3" status: 200 len: 2929 microversion: 2.1 time: 1.143434 Aug 29 15:43:50.187143 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 845/1647] 10.222.0.83 () {58 vars in 1197 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0nl55bv3 => generated 2929 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:50.192674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7b469096-874a-4757-b2f7-01f3c7f6536d req-3f8b5d72-5a6d-4a62-8559-e0f963b65bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b09ab0-6837-4646-8938-c0c1b194ee07", "name": "network-vif-deleted", "tag": "152dee39-1c4e-4075-8756-09aa9ea27e0d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:50.211505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b469096-874a-4757-b2f7-01f3c7f6536d req-3f8b5d72-5a6d-4a62-8559-e0f963b65bf5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.212049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b469096-874a-4757-b2f7-01f3c7f6536d req-3f8b5d72-5a6d-4a62-8559-e0f963b65bf5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.212526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b469096-874a-4757-b2f7-01f3c7f6536d req-3f8b5d72-5a6d-4a62-8559-e0f963b65bf5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.240909 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7b469096-874a-4757-b2f7-01f3c7f6536d req-3f8b5d72-5a6d-4a62-8559-e0f963b65bf5 service nova] Creating event network-vif-deleted:152dee39-1c4e-4075-8756-09aa9ea27e0d for instance 71b09ab0-6837-4646-8938-c0c1b194ee07 on n-h2-836830-13 Aug 29 15:43:50.252873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7b469096-874a-4757-b2f7-01f3c7f6536d req-3f8b5d72-5a6d-4a62-8559-e0f963b65bf5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064335 Aug 29 15:43:50.253495 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 846/1648] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:50.260295 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c437675a-42f5-497f-98e7-fc96b180b019 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?changes-since=2022-08-29T15%3A41%3A46Z" status: 200 len: 1901 microversion: 2.1 time: 0.268533 Aug 29 15:43:50.262771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.265253 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 803/1649] 10.222.0.83 () {58 vars in 1199 bytes} [Mon Aug 29 15:43:49 2022] GET /compute/v2.1/images?changes-since=2022-08-29T15%3A41%3A46Z => generated 1901 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:50.266196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:50.277206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbd36a6a-25c3-4fee-ba1e-dec9e8576f71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.282317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.283588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.288847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.290030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.290657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.291301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.420863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.server_groups [None req-dbd36a6a-25c3-4fee-ba1e-dec9e8576f71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Querying cell 28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) for 2 instances {{(pid=129132) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:43:50.422085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd36a6a-25c3-4fee-ba1e-dec9e8576f71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.422578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd36a6a-25c3-4fee-ba1e-dec9e8576f71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.423040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd36a6a-25c3-4fee-ba1e-dec9e8576f71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.601964 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbd36a6a-25c3-4fee-ba1e-dec9e8576f71 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups/1478d0e9-432e-48f3-beab-fd90e1b1a6eb" status: 200 len: 265 microversion: 2.1 time: 0.333974 Aug 29 15:43:50.602635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 804/1650] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/os-server-groups/1478d0e9-432e-48f3-beab-fd90e1b1a6eb => generated 265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:50.618348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.618348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:50.639817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.640322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.640779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.654809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.655414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.655890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.813029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.822759 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-021d5385-4986-4ec2-befa-6705b1785ec9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1345 microversion: 2.1 time: 0.568074 Aug 29 15:43:50.836675 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 847/1651] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1345 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:50.862946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f7e4548-957d-4f70-8e6c-8426886a9af6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f297b550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.903984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:50.925564 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee8562c5-5d32-4dd8-8a3e-7746cd587b10 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1273 microversion: 2.1 time: 0.321870 Aug 29 15:43:50.928344 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 805/1652] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:50.946356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:50.947544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:50.967051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.979209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.980059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:50.981072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:50.986854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:50.987445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.241056 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f7e4548-957d-4f70-8e6c-8426886a9af6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1020772058" status: 200 len: 485 microversion: 2.1 time: 0.402739 Aug 29 15:43:51.252034 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 848/1653] 10.222.0.83 () {58 vars in 1231 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1020772058 => generated 485 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:51.266253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.267961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:51.283941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.286351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.290144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.291213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.292493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.293115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.713505 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f6ed212c-87e0-4f41-9b18-e3598064ab47 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 200 len: 1621 microversion: 2.1 time: 0.780223 Aug 29 15:43:51.730161 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 806/1654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:50 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 1621 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:51.737652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-775eae42-ae99-4e4f-97a6-5227a7984320 req-1980f124-e974-4fe6-b37c-f3097be89563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c1c64a-0520-432c-8c72-608633f27d35", "name": "network-vif-unplugged", "status": "completed", "tag": "38a41bff-78ab-411e-8d27-7a0d76ee3a93"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:51.755517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-775eae42-ae99-4e4f-97a6-5227a7984320 req-1980f124-e974-4fe6-b37c-f3097be89563 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:51.755993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-775eae42-ae99-4e4f-97a6-5227a7984320 req-1980f124-e974-4fe6-b37c-f3097be89563 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:51.756419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-775eae42-ae99-4e4f-97a6-5227a7984320 req-1980f124-e974-4fe6-b37c-f3097be89563 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:51.778282 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-775eae42-ae99-4e4f-97a6-5227a7984320 req-1980f124-e974-4fe6-b37c-f3097be89563 service nova] Creating event network-vif-unplugged:38a41bff-78ab-411e-8d27-7a0d76ee3a93 for instance 55c1c64a-0520-432c-8c72-608633f27d35 on n-h1-836830-13 Aug 29 15:43:51.803643 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-775eae42-ae99-4e4f-97a6-5227a7984320 req-1980f124-e974-4fe6-b37c-f3097be89563 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072040 Aug 29 15:43:51.804456 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 807/1655] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:51.818362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a4337c5-5e6b-4c41-ae91-09736834efaa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee691280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.901403 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5a4337c5-5e6b-4c41-ae91-09736834efaa tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.087214 Aug 29 15:43:51.909293 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 808/1656] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:51.913802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0cefbde-7a6c-4f87-9b7f-9398706b4fb4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee68d3a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.958305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:51.967118 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1bb33de0-347b-4e90-9247-9d327231f8fd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1467 microversion: 2.1 time: 0.711367 Aug 29 15:43:51.974975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 849/1657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1467 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:51.983554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:51.984168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:52.003523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.004011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.004440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.005131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.005578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.005993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.126864 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0cefbde-7a6c-4f87-9b7f-9398706b4fb4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?server=55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 957 microversion: 2.1 time: 0.223464 Aug 29 15:43:52.131632 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 809/1658] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/images?server=55c1c64a-0520-432c-8c72-608633f27d35 => generated 957 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:52.179165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:52.180391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:52.210275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.211091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.218571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.223162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.224693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.225340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.483306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.494268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73961951-cdc6-4afe-8878-a0c56639e665 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1345 microversion: 2.1 time: 0.358465 Aug 29 15:43:52.502292 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 810/1659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1345 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:52.526438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:52.548095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:52.573284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.574071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.574641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.575545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:52.576119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:52.576663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:52.834562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:52.843331 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8ec63de-7e9a-43b1-b6a5-84e2215d97c2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1279 microversion: 2.1 time: 0.325406 Aug 29 15:43:52.867070 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 811/1660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:52.868698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b0d1463-092c-4fd1-a105-bc6acb1b47fb tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee5069d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:52.969133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b0d1463-092c-4fd1-a105-bc6acb1b47fb tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fv2.1%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 484 microversion: 2.1 time: 0.113698 Aug 29 15:43:52.977587 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 812/1661] 10.222.0.83 () {58 vars in 1317 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fv2.1%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 484 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:52.987010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e216143-daf4-4d5b-8a1a-e51ce05241bf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee63f0d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.082609 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e216143-daf4-4d5b-8a1a-e51ce05241bf tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.103706 Aug 29 15:43:53.087764 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 813/1662] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:52 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:53.121596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8835248-0d93-4c37-86b3-f0c4ca58947c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee5068b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.277716 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8835248-0d93-4c37-86b3-f0c4ca58947c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 484 microversion: 2.1 time: 0.184096 Aug 29 15:43:53.278856 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 814/1663] 10.222.0.83 () {58 vars in 1303 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 484 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:53.310124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.310975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:53.333396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.333910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.334339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.335076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.337139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.337599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.382968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:53.598746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:53.612208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2380872-c4a6-4c96-8a5c-868908ca1dca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1533 microversion: 2.1 time: 0.320887 Aug 29 15:43:53.615641 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 815/1664] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1533 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:53.623529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e112474b-f41f-419b-9d06-246d1135f7be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee4040d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.748964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-41976bd3-69fa-4372-ace8-b4e77314cf76 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 200 len: 1621 microversion: 2.1 time: 1.772817 Aug 29 15:43:53.750633 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 850/1665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:51 2022] GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 1621 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:53.777361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:53.778855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:53.788328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.789150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.790941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.794374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:53.795705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:53.797737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:53.897519 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e112474b-f41f-419b-9d06-246d1135f7be tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.277605 Aug 29 15:43:53.899874 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 816/1666] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:53.916105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-888780a2-de6b-45bf-9358-4d095f7f61dd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: .version_select at 0x7f32ee3f8310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-38952731", "policies": ["anti-affinity"]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:53.971309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-888780a2-de6b-45bf-9358-4d095f7f61dd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:53.982526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-888780a2-de6b-45bf-9358-4d095f7f61dd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:54.105527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-888780a2-de6b-45bf-9358-4d095f7f61dd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:54.117460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-888780a2-de6b-45bf-9358-4d095f7f61dd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:54.150575 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-888780a2-de6b-45bf-9358-4d095f7f61dd tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.245648 Aug 29 15:43:54.151910 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 817/1667] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 15:43:53 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:54.164750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.179684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.183361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:54.188300 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3ac969a-979a-45aa-ae03-b22f4bf04ba1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1345 microversion: 2.1 time: 0.436395 Aug 29 15:43:54.196000 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 851/1668] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:53 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1345 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:54.200927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7dfc065d-78ea-44d7-9ceb-d067a34e0233 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2ab0160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.203642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.212498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.213250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.214188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.216217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.220445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.368967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.383808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f924ba63-8592-4255-a9a8-97977a3be67c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1279 microversion: 2.1 time: 0.230345 Aug 29 15:43:54.386580 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 818/1669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:54.398083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32146620-86fe-4ea8-8b0a-6ca02bc272e3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee68d310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.455887 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7dfc065d-78ea-44d7-9ceb-d067a34e0233 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.258635 Aug 29 15:43:54.464694 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 852/1670] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:54.472217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-645519560", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "ef25c095-969b-4641-b2fb-b56d46aeb61f"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:54.535612 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32146620-86fe-4ea8-8b0a-6ca02bc272e3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.145891 Aug 29 15:43:54.542155 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 819/1671] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:54.560965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21d213f0-3a2f-480a-ad7d-0e3c3def478e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee5421f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.587190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:43:54.703570 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21d213f0-3a2f-480a-ad7d-0e3c3def478e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.149994 Aug 29 15:43:54.705379 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 820/1672] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:54.716418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:54.717393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:54.734191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.736880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.738965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.739990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:54.740615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:54.741209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:54.950371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:54.970618 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c7a34587-7fe2-4f1a-a059-59cb4b6015e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1533 microversion: 2.1 time: 0.254119 Aug 29 15:43:54.972233 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 821/1673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1533 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:54.990836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a2c3542-81bb-46fe-af56-131de43c6fbd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee5deaf0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.279458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a2c3542-81bb-46fe-af56-131de43c6fbd tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/detail?changes-since=2022-08-29T15%3A41%3A41Z" status: 200 len: 6333 microversion: 2.1 time: 0.303030 Aug 29 15:43:55.300999 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 822/1674] 10.222.0.83 () {58 vars in 1220 bytes} [Mon Aug 29 15:43:54 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-29T15%3A41%3A41Z => generated 6333 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:55.322014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.322718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:55.345639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.347754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.348373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.350221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.351421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.351870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.512958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:55.527537 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b42c47e-5928-4b89-9fc1-3917acbc10b4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1345 microversion: 2.1 time: 0.225283 Aug 29 15:43:55.535353 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 823/1675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:55.540535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6711f93c-6577-4371-b20f-cae4689caaf7 req-f8776ca1-5c21-43ce-baee-8aea3af8882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "name": "network-vif-unplugged", "status": "completed", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:55.556639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6711f93c-6577-4371-b20f-cae4689caaf7 req-f8776ca1-5c21-43ce-baee-8aea3af8882d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.557127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6711f93c-6577-4371-b20f-cae4689caaf7 req-f8776ca1-5c21-43ce-baee-8aea3af8882d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.558053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6711f93c-6577-4371-b20f-cae4689caaf7 req-f8776ca1-5c21-43ce-baee-8aea3af8882d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.600027 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6711f93c-6577-4371-b20f-cae4689caaf7 req-f8776ca1-5c21-43ce-baee-8aea3af8882d service nova] Creating event network-vif-unplugged:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h1-836830-13 Aug 29 15:43:55.614845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-6711f93c-6577-4371-b20f-cae4689caaf7 req-f8776ca1-5c21-43ce-baee-8aea3af8882d service nova] Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:43:55.656846 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6711f93c-6577-4371-b20f-cae4689caaf7 req-f8776ca1-5c21-43ce-baee-8aea3af8882d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117479 Aug 29 15:43:55.663683 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 824/1676] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:55.678488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-012d467b-6997-431d-bd3f-182ff274a2d9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee446550>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.758575 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-012d467b-6997-431d-bd3f-182ff274a2d9 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1020772058" status: 200 len: 665 microversion: 2.1 time: 0.089944 Aug 29 15:43:55.759797 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 825/1677] 10.222.0.83 () {58 vars in 1252 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1020772058 => generated 665 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:55.776597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:55.777692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:55.793023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.793771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.795682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:55.802689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:55.804386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:55.805051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.404503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:56.422497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:43:56.424708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:43:56.425535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:43:56.426336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:43:56.427238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:43:56.435913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-436da507-a1ef-4401-b685-43188c442284 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.674831 Aug 29 15:43:56.457229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 826/1678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:55 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:56.479820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8e0ef6d-373b-4501-837b-7497d770919a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee424160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.510646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.511277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.514813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.516407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.522062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.522786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.571013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:56.583431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:56.659610 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8e0ef6d-373b-4501-837b-7497d770919a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.200784 Aug 29 15:43:56.667363 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 827/1679] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:56.667742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Going to run 2 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:43:56.685445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:56.688351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2bad77e-a571-4bd7-809e-6535031fbe16 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee7808b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.770523 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2bad77e-a571-4bd7-809e-6535031fbe16 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fv2.1%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1466 microversion: 2.1 time: 0.105759 Aug 29 15:43:56.781704 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 828/1680] 10.222.0.83 () {58 vars in 1338 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fv2.1%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1466 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:56.798741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:56.798741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:56.806540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.808087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.808726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.809766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:56.812920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:56.813742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:56.944133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:56.979834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:57.108399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:57.134883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:57.190304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=a91019f2-48d5-4ac8-b793-5f2a1ae48274,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:43:57.199218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.222571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:57.230880 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7602d5a-1502-4b49-8a98-5ec35cc82bb0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1533 microversion: 2.1 time: 0.447244 Aug 29 15:43:57.232091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 829/1681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:56 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1533 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.244422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.245578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.259387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.260259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.260865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.262406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.263042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.263684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.375376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:57.383708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:57.448994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.463806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:43:57.473699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'server_group_members'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:43:57.484695 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-74ccee22-d6c2-4fce-8514-10bfaeb28138 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1345 microversion: 2.1 time: 0.249793 Aug 29 15:43:57.493569 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 830/1682] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1345 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.515608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce3ebce9-f360-445a-819f-5658b7252aa4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee672700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.572321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d8dd8d2-ad8b-4b85-adcb-7aff8f7fc0ab tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.106343 Aug 29 15:43:57.580050 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 853/1683] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:43:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 3112 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:43:57.591067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.591878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:57.606369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.612080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.612692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.615963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.616594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.617029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.619199 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce3ebce9-f360-445a-819f-5658b7252aa4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1466 microversion: 2.1 time: 0.120662 Aug 29 15:43:57.619993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 831/1684] 10.222.0.83 () {58 vars in 1324 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.83%2Fcompute%2Fservers%2Feb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1466 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.625131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:57.645355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:57.648067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Searching by: {'deleted': False, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:43:57.667644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.670041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.670714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.671865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:57.672534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:57.674655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:57.835527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:43:57.983383 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-97ad0888-7e4a-4401-bdeb-341b8a541aac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.362166 Aug 29 15:43:57.992468 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 832/1685] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/servers => generated 1662 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:57.998577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a756765-0096-460d-a64c-44054725e40c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee5ff1f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.322533 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a756765-0096-460d-a64c-44054725e40c tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.327005 Aug 29 15:43:58.339917 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 833/1686] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.359745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:58.375411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57e4ac26-eb81-45a0-b2e4-71002443d213 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee780160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.378364 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4936380e-a254-457b-9f92-70ddf703ec6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.796508 Aug 29 15:43:58.379479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 854/1687] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:57 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.395275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-080095dd-90eb-4707-8892-4bab477c48bc req-f7d64add-a602-44ec-a680-aae0fea44b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:43:58.437912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-080095dd-90eb-4707-8892-4bab477c48bc req-f7d64add-a602-44ec-a680-aae0fea44b9e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.442657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-080095dd-90eb-4707-8892-4bab477c48bc req-f7d64add-a602-44ec-a680-aae0fea44b9e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.444302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-080095dd-90eb-4707-8892-4bab477c48bc req-f7d64add-a602-44ec-a680-aae0fea44b9e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.496900 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-080095dd-90eb-4707-8892-4bab477c48bc req-f7d64add-a602-44ec-a680-aae0fea44b9e service nova] Creating event network-changed:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h1-836830-13 Aug 29 15:43:58.500128 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57e4ac26-eb81-45a0-b2e4-71002443d213 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.154294 Aug 29 15:43:58.502353 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 834/1688] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.510752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a795783-b585-4efc-bc96-a10f22eea8bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.518821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a795783-b585-4efc-bc96-a10f22eea8bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.537146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-080095dd-90eb-4707-8892-4bab477c48bc req-f7d64add-a602-44ec-a680-aae0fea44b9e service nova] Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:43:58.568958 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-080095dd-90eb-4707-8892-4bab477c48bc req-f7d64add-a602-44ec-a680-aae0fea44b9e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188015 Aug 29 15:43:58.572048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 855/1689] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:58.580494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.594130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:58.617312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.635118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.635969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.639786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:58.640587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:58.641294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:58.755883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a795783-b585-4efc-bc96-a10f22eea8bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:58.775104 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a795783-b585-4efc-bc96-a10f22eea8bb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1218 microversion: 2.1 time: 0.271297 Aug 29 15:43:58.780634 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 835/1690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1218 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.788128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6dbf7e5e-51dc-44b2-880a-a196fb4689c3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f2a88a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.958274 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6dbf7e5e-51dc-44b2-880a-a196fb4689c3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.170805 Aug 29 15:43:58.966934 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 836/1691] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:58.977503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:58.978676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.003176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.003960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.004653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.005769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.006487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.019648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.136718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.139429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.139910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.140374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'fault' on Instance uuid 71b09ab0-6837-4646-8938-c0c1b194ee07 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:43:59.209701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.218531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bea11a9b-3112-4659-9d04-ebfddc5360fb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 200 len: 1350 microversion: 2.1 time: 0.250129 Aug 29 15:43:59.219130 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 837/1692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 1350 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.257799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cc78185-3a19-4a50-9b26-8269bb64ef17 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee506820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.356874 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cc78185-3a19-4a50-9b26-8269bb64ef17 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/648e7a49-e66c-42cf-859c-64f1df130787" status: 200 len: 784 microversion: 2.1 time: 0.114487 Aug 29 15:43:59.357645 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 838/1693] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/images/648e7a49-e66c-42cf-859c-64f1df130787 => generated 784 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:43:59.377059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-db990f5e-adc0-4c42-9a39-aff61ed203c1 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee780d30>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.500411 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-db990f5e-adc0-4c42-9a39-aff61ed203c1 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.125663 Aug 29 15:43:59.511607 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 839/1694] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.516117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.518893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.532469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.533264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.533700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.534462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.534922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.535450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.638723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.668915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c61a23e9-9f09-4f48-a428-58b469d61ca4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1533 microversion: 2.1 time: 1.090760 Aug 29 15:43:59.676000 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 856/1695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:58 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1533 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.712116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f225ad5f-8515-4ec0-93f2-bfb21d7a27ca tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32f285b310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.851894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f225ad5f-8515-4ec0-93f2-bfb21d7a27ca tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.174710 Aug 29 15:43:59.854784 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 857/1696] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.868199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20e553e0-b21b-442c-ad4a-c479ec565a5d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f285be50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.940655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:43:59.950589 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd3e241b-cf52-4a0c-80a6-54c95226f92e tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.442295 Aug 29 15:43:59.951436 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 840/1697] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:43:59.957250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:43:59.959242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:43:59.960132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:43:59.972874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.973640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.974109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:43:59.974900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:43:59.975646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:43:59.976487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.087585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:00.098374 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de8ac242-4fdc-49a9-b58e-ff6363ded8da tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1222 microversion: 2.1 time: 0.145757 Aug 29 15:44:00.117903 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 841/1698] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:00.245976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.246595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.264826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.276576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.277262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.279371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.283202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.284068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.312410 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 HTTP/1.1 Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:44:00.323884 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.326033 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '71b09ab0-6837-4646-8938-c0c1b194ee07'} Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:00.326996 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.332179 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.337693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:00.339769 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f7ee73c0-a532-4161-9dd3-9cf781671e13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 404 len: 111 microversion: 2.1 time: 0.097764 Aug 29 15:44:00.343171 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 842/1699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:44:00.519307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.537356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.547222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.548192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.548963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.549934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.551286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.551958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.581803 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07/os-volume_attachments HTTP/1.1 Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:44:00.598445 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.600498 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': '71b09ab0-6837-4646-8938-c0c1b194ee07'} Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:00.601336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:44:00.602671 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:00.611753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:00.611753 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe36d2ec-ad2f-4e93-9e3d-5ccf5b590d8c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.087657 Aug 29 15:44:00.611753 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 843/1700] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07/os-volume_attachments => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:44:00.649839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-06959db7-f8fc-4655-90cd-6b8a21eee79e req-a5cb6f7e-8cdc-4444-b2ae-b94d72b2fb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a08bf6-6f38-4ab4-80a3-d5c26296e83e", "tag": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:00.702523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-06959db7-f8fc-4655-90cd-6b8a21eee79e req-a5cb6f7e-8cdc-4444-b2ae-b94d72b2fb29 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.709670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-06959db7-f8fc-4655-90cd-6b8a21eee79e req-a5cb6f7e-8cdc-4444-b2ae-b94d72b2fb29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.723339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-06959db7-f8fc-4655-90cd-6b8a21eee79e req-a5cb6f7e-8cdc-4444-b2ae-b94d72b2fb29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.769674 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-06959db7-f8fc-4655-90cd-6b8a21eee79e req-a5cb6f7e-8cdc-4444-b2ae-b94d72b2fb29 service nova] Creating event network-changed:c5328c8d-11b9-4c00-ac75-59302bfaa5d4 for instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e on n-h1-836830-13 Aug 29 15:44:00.786160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-06959db7-f8fc-4655-90cd-6b8a21eee79e req-a5cb6f7e-8cdc-4444-b2ae-b94d72b2fb29 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139996 Aug 29 15:44:00.787072 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 844/1701] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:00.805217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:00.806297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:00.835660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.842513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.842955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:00.843730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:00.844188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:00.844608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.051122 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20e553e0-b21b-442c-ad4a-c479ec565a5d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173" status: 204 len: 0 microversion: 2.1 time: 1.194778 Aug 29 15:44:01.054580 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 858/1702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:43:59 2022] DELETE /compute/v2.1/images/a9c9aa31-b263-43e1-9830-9f4f2e763173 => generated 0 bytes in 1196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:01.056692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d8c76df-1e9a-408d-aa42-43d5e9172145 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32f285b4c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.175138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d8c76df-1e9a-408d-aa42-43d5e9172145 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1439 microversion: 2.1 time: 0.121312 Aug 29 15:44:01.176237 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 859/1703] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1439 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.201275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.205244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:01.227833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.230176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.231071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.233012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:01.234572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:01.235315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:01.247972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.256531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-495c73c0-3556-47f0-90a0-133037e74fd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1533 microversion: 2.1 time: 0.461962 Aug 29 15:44:01.271846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:01.276692 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 845/1704] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:00 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1533 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.289279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7b92a4c0-5611-491f-a6aa-5cdd246806b1 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee5068b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:01.913174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:01.933054 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dac9a24a-e099-47c8-97ea-b403da569f56 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.755366 Aug 29 15:44:01.934518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 860/1705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:01 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:01.941036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1388533018", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9bbf042d-13bc-4426-83e8-c7e73123f015"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:02.759745 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7b92a4c0-5611-491f-a6aa-5cdd246806b1 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc" status: 204 len: 0 microversion: 2.1 time: 1.481693 Aug 29 15:44:02.761731 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 846/1706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:01 2022] DELETE /compute/v2.1/images/a090f20f-69a7-44e2-90c5-fed898b39fcc => generated 0 bytes in 1484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:02.774761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:02.779580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:02.804724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.806391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.809820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.812785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:02.820301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:02.827183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:02.861773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] validate_networks() for [('9bbf042d-13bc-4426-83e8-c7e73123f015', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:03.432132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:03.443338 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9901448f-5597-46f1-90e0-4d96e607e739 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1276 microversion: 2.1 time: 0.679337 Aug 29 15:44:03.444211 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 847/1707] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:02 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1276 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:03.464568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-459922675", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "ebc91776-3d70-481a-8f9a-8935c9cd12b8"}], "block_device_mapping_v2": [{"uuid": "06e4493c-3449-434f-b838-a4de00d74db1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:03.566726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] validate_networks() for [('ebc91776-3d70-481a-8f9a-8935c9cd12b8', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:03.656207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:03.656623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:03.657152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:03.658503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:03.659307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:03.668645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.669123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.669574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.670281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.670946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.671389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.689910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:03.695467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for user 853f8300f9bb403b9cea4834c5a1edcb and project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:03.710316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:03.713150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:03.763077 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8244ddd-8688-416e-a1b1-fc8d2dd51e48 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827304 Aug 29 15:44:03.763840 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 861/1708] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:03.769313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e39af2a0-702a-4a78-b14b-1927adefb8c9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32f292b040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.849118 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e39af2a0-702a-4a78-b14b-1927adefb8c9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1448 microversion: 2.1 time: 0.084014 Aug 29 15:44:03.859713 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 862/1709] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1448 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:03.869487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:03.870252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:03.878753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.879409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.879937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:03.880733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:03.881957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:03.882497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:04.170285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:04.179954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f45e4c5b-8762-4982-963e-805304da4373 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1526 microversion: 2.1 time: 0.317722 Aug 29 15:44:04.182534 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 863/1710] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:03 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1526 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:04.190985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-abc61332-472e-4373-a270-a0c64dc62be6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32f291b4c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.963391 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-abc61332-472e-4373-a270-a0c64dc62be6 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6" status: 204 len: 0 microversion: 2.1 time: 0.778716 Aug 29 15:44:04.968063 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 864/1711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:04 2022] DELETE /compute/v2.1/images/c477b037-4317-40e0-8026-0c4cb7a2f5b6 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:04.971345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:04.971841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:04.988399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.006312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.007016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.013394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.013894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.014344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.040742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:05.042501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:05.043450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:05.044052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:05.044649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:05.061693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.064373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.069601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.070504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.071095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.071600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.146431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:05.153498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Getting quotas for user f12698b45a114720af9c98b163077f59 and project 70d66d1258d14a39b174734f9865c070. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:05.283445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:05.286640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06e4493c-3449-434f-b838-a4de00d74db1',volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:05.460597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:05.471348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6bf23a1e-5460-424c-9380-4fd4ded88302 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.504415 Aug 29 15:44:05.485308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 865/1712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:04 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.485308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.485308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.500354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.503303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.504326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.505978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.507418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.508917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.556285 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e2eb881-20a5-4793-8d87-e4ece504be0c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.110723 Aug 29 15:44:05.562283 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 848/1713] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:44:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:44:05.589455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5de1225b-79bd-416b-b577-61c31bdd7fa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee7471f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.663007 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5de1225b-79bd-416b-b577-61c31bdd7fa4 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 200 len: 1448 microversion: 2.1 time: 0.098517 Aug 29 15:44:05.663640 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 849/1714] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 1448 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.675746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.677499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.693561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.696954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.697497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.698693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.699222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.699661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.785288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:05.808348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc14d341-6a1f-4e28-9cab-52610989af58 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1267 microversion: 2.1 time: 0.332878 Aug 29 15:44:05.819563 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 866/1715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:05.830234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:05.832785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:05.842799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.843317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.853720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:05.854686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:05.856461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:05.857162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.123823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.144854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e550200a-6d44-49ee-a319-5a512da25459 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1526 microversion: 2.1 time: 0.480090 Aug 29 15:44:06.148440 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 850/1716] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1526 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:06.160108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.163082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.174764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.176341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.177446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.180535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.181386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.182367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.209313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:06.222776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:06.244818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.259505 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75951357-bfdf-419f-b125-ed7ab5794650 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1318 microversion: 2.1 time: 0.438371 Aug 29 15:44:06.262608 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 867/1717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:05 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:06.281290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-85e240d9-9d7c-48ca-b1c3-4e51ac54838a req-c7305f47-413d-4b6a-baf4-9d679ec2d825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "name": "network-vif-plugged", "status": "completed", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:06.310623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-85e240d9-9d7c-48ca-b1c3-4e51ac54838a req-c7305f47-413d-4b6a-baf4-9d679ec2d825 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.319871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-85e240d9-9d7c-48ca-b1c3-4e51ac54838a req-c7305f47-413d-4b6a-baf4-9d679ec2d825 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.321532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-85e240d9-9d7c-48ca-b1c3-4e51ac54838a req-c7305f47-413d-4b6a-baf4-9d679ec2d825 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.358647 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-85e240d9-9d7c-48ca-b1c3-4e51ac54838a req-c7305f47-413d-4b6a-baf4-9d679ec2d825 service nova] Creating event network-vif-plugged:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h1-836830-13 Aug 29 15:44:06.371366 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-85e240d9-9d7c-48ca-b1c3-4e51ac54838a req-c7305f47-413d-4b6a-baf4-9d679ec2d825 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105718 Aug 29 15:44:06.373962 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 868/1718] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:06.387414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f69e7252-e753-4cb9-84da-e13a7ae5c801 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.388546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f69e7252-e753-4cb9-84da-e13a7ae5c801 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.397359 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76d21b53-1be7-4df8-9a22-63cc2251dc4f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 204 len: 0 microversion: 2.1 time: 0.245241 Aug 29 15:44:06.398165 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 851/1719] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:06 2022] DELETE /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:06.422302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4be81e2f-de35-401c-8a99-539d9c551ec0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32ee72bdc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.463116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f69e7252-e753-4cb9-84da-e13a7ae5c801 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.474518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f69e7252-e753-4cb9-84da-e13a7ae5c801 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.477136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f69e7252-e753-4cb9-84da-e13a7ae5c801 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:06.478608 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f69e7252-e753-4cb9-84da-e13a7ae5c801 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1103 microversion: 2.25 time: 0.103160 Aug 29 15:44:06.493919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 869/1720] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:06 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1103 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:06.499955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.500652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.524993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.525610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.526188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.527833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.528485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.531190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.569807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:06.736026 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60948de7-3e6e-486f-b473-f1e09568c1eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 204 len: 0 microversion: 2.1 time: 0.234224 Aug 29 15:44:06.736572 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 870/1721] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:06 2022] DELETE /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:06.756018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecbc34da-5c53-4f80-9cf7-bd2b12789b88 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.773229 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ecbc34da-5c53-4f80-9cf7-bd2b12789b88 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] HTTP exception thrown: Flavor b901882a-7ad5-4c57-b2d4-b994550de20b could not be found. Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecbc34da-5c53-4f80-9cf7-bd2b12789b88 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Request method failure captured: Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/flavors/b901882a-7ad5-4c57-b2d4-b994550de20b HTTP/1.1 Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN20MTB4bNY05eREKyFqKT7n0KdrhjbqkiuHkZwm3sKrEuJON-9pES4IRtyZXV9ctEmDsAJe0EprQY8iNFVPQkU_S4aaYvp60Guh7be4bOA7y2biNXsLabXVt0Dh-4BmfClc_a1X20eX9gzEukPT82GOokQ-xP3uR3oiy58hhbHxJ_A Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 1c4d01c4eddd43e09ec8e7efc2bdc2a5 Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-MigrationsAdminTest-1671626282 Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 15:44:06.783556 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1c4d01c4eddd43e09ec8e7efc2bdc2a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1c4d01c4eddd43e09ec8e7efc2bdc2a5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1c4d01c4eddd43e09ec8e7efc2bdc2a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1c4d01c4eddd43e09ec8e7efc2bdc2a5"}]}] Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-MigrationsAdminTest-1671626282 Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 1c4d01c4eddd43e09ec8e7efc2bdc2a5 Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-MigrationsAdminTest-1671626282 Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-MigrationsAdminTest-1671626282-project-admin Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: daf5d8de71074057871a3091617bda2a Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-MigrationsAdminTest-1671626282-project-admin Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: exception: Flavor b901882a-7ad5-4c57-b2d4-b994550de20b could not be found. Aug 29 15:44:06.786390 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b901882a-7ad5-4c57-b2d4-b994550de20b'} Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b901882a-7ad5-4c57-b2d4-b994550de20b could not be found. Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:06.787705 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b901882a-7ad5-4c57-b2d4-b994550de20b could not be found. Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b901882a-7ad5-4c57-b2d4-b994550de20b could not be found. Aug 29 15:44:06.789764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:06.796402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecbc34da-5c53-4f80-9cf7-bd2b12789b88 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Returning 404 to user: Flavor b901882a-7ad5-4c57-b2d4-b994550de20b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:06.801679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ecbc34da-5c53-4f80-9cf7-bd2b12789b88 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/b901882a-7ad5-4c57-b2d4-b994550de20b" status: 404 len: 109 microversion: 2.1 time: 0.055512 Aug 29 15:44:06.809061 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 871/1722] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:06 2022] DELETE /compute/v2.1/flavors/b901882a-7ad5-4c57-b2d4-b994550de20b => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:06.828854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:06.829812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:06.840067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.841470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.842403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:06.843840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:06.846726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:06.847364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.173644 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4be81e2f-de35-401c-8a99-539d9c551ec0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 204 len: 0 microversion: 2.1 time: 0.773706 Aug 29 15:44:07.174159 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 852/1723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] DELETE /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:07.181603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.182542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:07.194422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.195232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.195827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.197646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.198281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.198984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.276633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.292311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-889faf89-ed36-4cca-b55a-7e51944ea0f3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1473 microversion: 2.1 time: 0.477082 Aug 29 15:44:07.312601 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 872/1724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:06 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1473 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:07.323573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.324734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:07.336743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.337332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.338199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.338932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.342086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.343430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.457047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.479570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e84afa34-19e0-4dcc-87e4-87f13b871fe7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1273 microversion: 2.1 time: 0.164266 Aug 29 15:44:07.480876 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 873/1725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:07 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:07.493213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-593bca93-23bb-4858-a972-bf642afb77c4 req-0c5e6c83-4b67-4baa-89ec-07e88132ad5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91019f2-48d5-4ac8-b793-5f2a1ae48274", "tag": "92a35708-d0a7-4eb6-8e3c-0c967ab3663d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:07.505717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-593bca93-23bb-4858-a972-bf642afb77c4 req-0c5e6c83-4b67-4baa-89ec-07e88132ad5f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.506442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-593bca93-23bb-4858-a972-bf642afb77c4 req-0c5e6c83-4b67-4baa-89ec-07e88132ad5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.507157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-593bca93-23bb-4858-a972-bf642afb77c4 req-0c5e6c83-4b67-4baa-89ec-07e88132ad5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.523755 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-593bca93-23bb-4858-a972-bf642afb77c4 req-0c5e6c83-4b67-4baa-89ec-07e88132ad5f service nova] Creating event network-changed:92a35708-d0a7-4eb6-8e3c-0c967ab3663d for instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 on n-h2-836830-13 Aug 29 15:44:07.531472 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-593bca93-23bb-4858-a972-bf642afb77c4 req-0c5e6c83-4b67-4baa-89ec-07e88132ad5f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048790 Aug 29 15:44:07.532258 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 874/1726] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:07.538066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-611319580", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:07.550347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:07.562006 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0bb56bfc-573b-4414-82ce-a13fcedce5cc tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.385826 Aug 29 15:44:07.562779 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 853/1727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:07 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:07.573125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.574852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:07.583981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.585684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.586944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.587858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.588540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.588979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.613886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:07.620145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:07.720983 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8bc2f4b4-78b5-4401-bf45-af7f65c8bbab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 204 len: 0 microversion: 2.1 time: 0.155982 Aug 29 15:44:07.721585 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 854/1728] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:07 2022] DELETE /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:07.735836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:07.735836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:07.749632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.750380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.751814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:07.753092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:07.754440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:07.755054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.079605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:08.081596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:08.082467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:08.082983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:08.083532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:08.107924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.112391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.114163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.115266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.115852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.116274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.139285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:08.146612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Getting quotas for user cc90d88d1e574a94858bbe2523855caa and project 95b8e2179e1f4fa6bf596a8dd85f761c. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:08.162851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:08.167144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:08.176695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.192152 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b760b1c-4ba3-474c-a6a2-838aeeaa86a5 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1318 microversion: 2.1 time: 0.464687 Aug 29 15:44:08.193939 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 855/1729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:07 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:08.205056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:08.206941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.217321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.218546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.219724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.221274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.225383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.227637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.259345 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a991661-2667-4162-b9a7-84771f98c880 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725483 Aug 29 15:44:08.267287 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 875/1730] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:08.275202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-7029072", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "10e124fc-0fc1-4d6c-9bea-015d572a2eb7"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:08.340899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] validate_networks() for [('10e124fc-0fc1-4d6c-9bea-015d572a2eb7', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:08.489307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.518488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.526776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.532779 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82c0243b-197a-4a6a-a7b1-ee861e9e7a7e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1240 microversion: 2.25 time: 0.332600 Aug 29 15:44:08.537328 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 856/1731] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1240 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:08.562037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b17d4256-7781-47cd-b941-a861a46133b2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:08.568754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b17d4256-7781-47cd-b941-a861a46133b2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.683781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b17d4256-7781-47cd-b941-a861a46133b2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:08.693640 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b17d4256-7781-47cd-b941-a861a46133b2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1212 microversion: 2.1 time: 0.135375 Aug 29 15:44:08.708604 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 857/1732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1212 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:08.714540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:08.717689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:08.726264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.731496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.733436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:08.736489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:08.737200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:08.737646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.015969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.026107 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5ac2d5aa-3818-4a9a-bf60-056d97eac61e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1473 microversion: 2.1 time: 0.320563 Aug 29 15:44:09.026809 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 858/1733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:08 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:09.033631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.034595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.040625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.041306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.041741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.042439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.048906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.049371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.183473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.192097 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e5b40aa-22d5-4455-b534-ffea40d913bf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.163956 Aug 29 15:44:09.192687 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 859/1734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:09.197859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.198806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.205155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.205646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.206084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.206791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.207292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.207712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.356871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.367059 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4969d396-da0f-457a-b6c7-6864ec4e8619 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.173047 Aug 29 15:44:09.367680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 860/1735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:09.385195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-0e41218b-9c91-4425-b052-657c87dad1a6 req-6107ad37-ae4d-401e-bea8-6a3e769aa37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a08bf6-6f38-4ab4-80a3-d5c26296e83e", "name": "network-vif-plugged", "status": "completed", "tag": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:09.396102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0e41218b-9c91-4425-b052-657c87dad1a6 req-6107ad37-ae4d-401e-bea8-6a3e769aa37a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.396635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0e41218b-9c91-4425-b052-657c87dad1a6 req-6107ad37-ae4d-401e-bea8-6a3e769aa37a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.397217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0e41218b-9c91-4425-b052-657c87dad1a6 req-6107ad37-ae4d-401e-bea8-6a3e769aa37a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.409857 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-0e41218b-9c91-4425-b052-657c87dad1a6 req-6107ad37-ae4d-401e-bea8-6a3e769aa37a service nova] Creating event network-vif-plugged:c5328c8d-11b9-4c00-ac75-59302bfaa5d4 for instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e on n-h1-836830-13 Aug 29 15:44:09.415205 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-0e41218b-9c91-4425-b052-657c87dad1a6 req-6107ad37-ae4d-401e-bea8-6a3e769aa37a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033672 Aug 29 15:44:09.415982 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 861/1736] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:09.421052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.421753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.429238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.429821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.430341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.431175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.431636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.432066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.587331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.595582 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-daaa61eb-c3fa-42c7-a731-c01ec6090245 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1318 microversion: 2.1 time: 0.178282 Aug 29 15:44:09.596244 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 862/1737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:09.602977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9f81b489-8a71-4048-9f26-f6127f1fc072 req-7222a7c9-47fc-437e-a10c-f95e2c50102d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3685c60-cfca-4c4f-b754-960d478aa207", "tag": "5919f625-39ab-4106-a5fe-021441163394"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:09.611176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:09.612436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:09.613005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:09.613403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:09.613816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:09.614283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9f81b489-8a71-4048-9f26-f6127f1fc072 req-7222a7c9-47fc-437e-a10c-f95e2c50102d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.614848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9f81b489-8a71-4048-9f26-f6127f1fc072 req-7222a7c9-47fc-437e-a10c-f95e2c50102d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.616490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9f81b489-8a71-4048-9f26-f6127f1fc072 req-7222a7c9-47fc-437e-a10c-f95e2c50102d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.623189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.623670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.624279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.625165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.626635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.627100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.632424 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9f81b489-8a71-4048-9f26-f6127f1fc072 req-7222a7c9-47fc-437e-a10c-f95e2c50102d service nova] Creating event network-changed:5919f625-39ab-4106-a5fe-021441163394 for instance e3685c60-cfca-4c4f-b754-960d478aa207 on n-h1-836830-13 Aug 29 15:44:09.637639 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9f81b489-8a71-4048-9f26-f6127f1fc072 req-7222a7c9-47fc-437e-a10c-f95e2c50102d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040176 Aug 29 15:44:09.638729 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 863/1738] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:09.639362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:09.645682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.646528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.649998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:09.653681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.654441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.654870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.655749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.656361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.656641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Getting quotas for user 09663bec61af43278da1d69c37594558 and project b0c4051fa5084b638108f191a7c1365b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:09.657140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.676325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:09.678328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:09.737995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.739233 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ecc9ca4-b56f-4a74-8801-61c8a9e151cc tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.470125 Aug 29 15:44:09.750849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.752511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.753770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e6fb1c4-4df3-446a-90a2-3e235d9d8991 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1240 microversion: 2.25 time: 0.113457 Aug 29 15:44:09.753916 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 876/1739] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:09.754191 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 864/1740] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:09.758956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-aadaf471-a037-46a6-9fed-cce0ab9f980c req-5ef3278e-52ed-4849-918d-61eb09c61764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb580cd6-da8c-430a-8c23-39f4a6c236b4", "name": "network-vif-deleted", "tag": "1495779a-a585-4e87-b55b-b1050fd3f0b5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:09.769518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aadaf471-a037-46a6-9fed-cce0ab9f980c req-5ef3278e-52ed-4849-918d-61eb09c61764 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.770255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aadaf471-a037-46a6-9fed-cce0ab9f980c req-5ef3278e-52ed-4849-918d-61eb09c61764 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.770690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aadaf471-a037-46a6-9fed-cce0ab9f980c req-5ef3278e-52ed-4849-918d-61eb09c61764 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.774636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.775302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.786525 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-aadaf471-a037-46a6-9fed-cce0ab9f980c req-5ef3278e-52ed-4849-918d-61eb09c61764 service nova] Creating event network-vif-deleted:1495779a-a585-4e87-b55b-b1050fd3f0b5 for instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 on n-h1-836830-13 Aug 29 15:44:09.790338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.791521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.791970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.792678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:09.793207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:09.793630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:09.805170 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-aadaf471-a037-46a6-9fed-cce0ab9f980c req-5ef3278e-52ed-4849-918d-61eb09c61764 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038200 Aug 29 15:44:09.805854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 877/1741] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:09.820209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c2c2fd5-c071-4fb4-96d1-b6ae961a06ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:09.823090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c2c2fd5-c071-4fb4-96d1-b6ae961a06ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:09.903885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1c2c2fd5-c071-4fb4-96d1-b6ae961a06ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.916171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c2c2fd5-c071-4fb4-96d1-b6ae961a06ab tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1205 microversion: 2.1 time: 0.106943 Aug 29 15:44:09.917005 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 878/1742] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:09.944025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:09.974273 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2b4c89ac-eb77-435a-896a-ea85effbf9cf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1216 microversion: 2.1 time: 0.218368 Aug 29 15:44:09.992192 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 865/1743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:09 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:10.052926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.053777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.081324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.085172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.085995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.087374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.088193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.090006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.218357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.219514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.233691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.236110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.236995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.243184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.245059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.246753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.261956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.274237 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8fe28360-39c0-4ddf-9b34-a99396b7d3a5 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 200 len: 1302 microversion: 2.1 time: 0.228921 Aug 29 15:44:10.283447 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 879/1744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 1302 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:10.388569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.390788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.400539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.403120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.407606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.408784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.409442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.410467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.936585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.945132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:10.946056 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37599a19-aab7-4959-8faa-db4df4818e7f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.561341 Aug 29 15:44:10.959860 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3951ec32-e05f-425d-83a5-2c27fd68e344 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.743991 Aug 29 15:44:10.960108 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 880/1745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:10.960208 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 866/1746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:10.963705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.964325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.968877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:10.970071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:10.977161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.977656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.978522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.979436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.980059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.980654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.991727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.992228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:10.992666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:10.998126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:10.999716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.000056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.078651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.088917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.090800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.092315 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9dc2900e-7bf0-475c-b8d1-fb26ef7914e9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1240 microversion: 2.25 time: 0.135032 Aug 29 15:44:11.093405 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 867/1747] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:11.101293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.102139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.119156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.120053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.120786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.124076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.124834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.126742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.132194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:11.230167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.249750 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-169db18e-96d6-44e1-9cc4-7bf690e08c23 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1209 microversion: 2.1 time: 0.152608 Aug 29 15:44:11.264333 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 868/1748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:11.264333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.264333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.293538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.293949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.294378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.300504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.302292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.304291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.458738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.473626 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8926bd88-67ee-437d-a647-538720b4bc40 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1318 microversion: 2.1 time: 0.513410 Aug 29 15:44:11.474107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:11.478314 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 881/1749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:10 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:11.491343 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e37dfda-af5f-4daa-93af-a04dfa836ea0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1216 microversion: 2.1 time: 0.230874 Aug 29 15:44:11.491343 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 869/1750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:11.495990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b9e0b8b6-e021-497a-86eb-576ce7e4c65f req-18dfb024-8fe8-4d35-ae5a-3486cff08ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f455ce-786c-4f29-8e9f-e57a09dfe48b", "name": "network-vif-unplugged", "status": "completed", "tag": "a8350ae2-bf24-4dff-9da2-2d4e60a21cc0"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:11.519667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.520375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: eb580cd6-da8c-430a-8c23-39f4a6c236b4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.521202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b9e0b8b6-e021-497a-86eb-576ce7e4c65f req-18dfb024-8fe8-4d35-ae5a-3486cff08ada service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.521692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b9e0b8b6-e021-497a-86eb-576ce7e4c65f req-18dfb024-8fe8-4d35-ae5a-3486cff08ada service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.522126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b9e0b8b6-e021-497a-86eb-576ce7e4c65f req-18dfb024-8fe8-4d35-ae5a-3486cff08ada service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.534403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.537944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.540422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.541483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.546355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.547166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.574258 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] HTTP exception thrown: Instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 could not be found. Aug 29 15:44:11.580411 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b9e0b8b6-e021-497a-86eb-576ce7e4c65f req-18dfb024-8fe8-4d35-ae5a-3486cff08ada service nova] Creating event network-vif-unplugged:a8350ae2-bf24-4dff-9da2-2d4e60a21cc0 for instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b on n-h2-836830-13 Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Request method failure captured: Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 HTTP/1.1 Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN408qwYYvdQzAc_gUkCMcyFwRCq9V7aHa_BobWPk794I1Q8pLCOPrck30r0xuSETXJG3NMSGezEBwW6YyoJ2p_50DJWqRQ3IufU4vBbijruTyawr94tIdDjUz9Uq-es0UWGv3rasCk9wE8uihQ804fQKpmhtCN1sf_5hAPPgM3POBg Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d41e3c60ee6c4e41bb046e0e585ae41d Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListImageFiltersTestJSON-1365498200 Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:44:11.581373 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d41e3c60ee6c4e41bb046e0e585ae41d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d41e3c60ee6c4e41bb046e0e585ae41d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d41e3c60ee6c4e41bb046e0e585ae41d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d41e3c60ee6c4e41bb046e0e585ae41d"}]}] Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListImageFiltersTestJSON-1365498200 Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d41e3c60ee6c4e41bb046e0e585ae41d Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1365498200 Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListImageFiltersTestJSON-1365498200-project Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 29fa4fbf7bb34c13952163feeaafe738 Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListImageFiltersTestJSON-1365498200-project Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 could not be found. Aug 29 15:44:11.583478 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'eb580cd6-da8c-430a-8c23-39f4a6c236b4'} Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 could not be found. Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:11.584857 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 could not be found. Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 could not be found. Aug 29 15:44:11.587141 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:11.590023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Returning 404 to user: Instance eb580cd6-da8c-430a-8c23-39f4a6c236b4 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:11.591663 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b9e0b8b6-e021-497a-86eb-576ce7e4c65f req-18dfb024-8fe8-4d35-ae5a-3486cff08ada service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099044 Aug 29 15:44:11.592326 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 870/1751] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:11.593563 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68cf4b98-3a52-4fd8-ae95-2f64e902a6ec tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4" status: 404 len: 111 microversion: 2.1 time: 0.110687 Aug 29 15:44:11.596120 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 882/1752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/eb580cd6-da8c-430a-8c23-39f4a6c236b4 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:11.605007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.606108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.613257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.613881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.614166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.614865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.615344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.615765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.648969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:44:11.762157 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-201fdf01-7c5e-49d4-8532-b69e4b95e0a3 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 204 len: 0 microversion: 2.1 time: 0.161221 Aug 29 15:44:11.763077 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 871/1753] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:44:11 2022] DELETE /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:44:11.774580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.775587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.792582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.793468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.795667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.796412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.796872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.797294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.826262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b7027ead-8426-4fe8-823a-a47f3db24897 req-a5acf4f2-8a87-4590-a6c7-b3d2c55f2b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a905e81-88ea-4a7b-b20f-c32d13e84a8c", "tag": "25c3e9e4-d572-4e78-8fcd-88394647708e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:11.839256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7027ead-8426-4fe8-823a-a47f3db24897 req-a5acf4f2-8a87-4590-a6c7-b3d2c55f2b50 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.839739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7027ead-8426-4fe8-823a-a47f3db24897 req-a5acf4f2-8a87-4590-a6c7-b3d2c55f2b50 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.840169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7027ead-8426-4fe8-823a-a47f3db24897 req-a5acf4f2-8a87-4590-a6c7-b3d2c55f2b50 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.853655 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b7027ead-8426-4fe8-823a-a47f3db24897 req-a5acf4f2-8a87-4590-a6c7-b3d2c55f2b50 service nova] Creating event network-changed:25c3e9e4-d572-4e78-8fcd-88394647708e for instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c on n-h2-836830-13 Aug 29 15:44:11.879617 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b7027ead-8426-4fe8-823a-a47f3db24897 req-a5acf4f2-8a87-4590-a6c7-b3d2c55f2b50 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057847 Aug 29 15:44:11.880543 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 872/1754] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:11.971257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:11.971257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:11.981512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.982007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.982444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:11.983179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:11.984146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:11.984146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.099290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.110698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76741522-e492-4f3c-9b4b-394d8225166f tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1474 microversion: 2.1 time: 0.341858 Aug 29 15:44:12.111432 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 883/1755] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:12.121523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.122132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.134357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.135195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.136508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.137776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.138412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.139014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.273627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.293745 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f629b64-4ace-45b4-b052-468203bf1cfb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.329232 Aug 29 15:44:12.311560 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 873/1756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:11 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:12.319662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.320630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.330058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.330442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.330609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.330879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.331652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.332246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.332898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.334038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:12.339709 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a0e10c7-4d1d-403c-a153-4c4028ca449f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.226513 Aug 29 15:44:12.340276 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 884/1757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:12.355497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.362151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.374536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.375290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.376304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.377089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.380325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.380868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.440557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.452502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.462305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.464896 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6730bfda-085c-4245-9a79-2a0779d1c81e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1209 microversion: 2.1 time: 0.113548 Aug 29 15:44:12.465618 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 885/1758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:12.466291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.471082 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e76ce42-3edc-4752-9052-9ab300b4c25a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1240 microversion: 2.25 time: 0.157707 Aug 29 15:44:12.471962 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 874/1759] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1240 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:12.497750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.499078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.507920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.508853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.509704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.512454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.513121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.514413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.527467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:12.528219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:12.558427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.566849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.567333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.568076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:12.570798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:12.571662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:12.806727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.818295 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73b27bfa-2d55-4a6c-bc51-f1818883fff1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1318 microversion: 2.1 time: 0.324332 Aug 29 15:44:12.819260 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 886/1760] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:12.827753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:12.838878 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0aec1e02-7894-4e54-955a-4a7f64a79635 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1216 microversion: 2.1 time: 0.324942 Aug 29 15:44:12.841546 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 875/1761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:12 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1216 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:13.134710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:13.136244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:13.149687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.150428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.151016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.152144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.152794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.153809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.318551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:13.319774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:13.331962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.332461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.335240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.336091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:13.336948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:13.340588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:13.934466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:13.959897 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-770983b5-44dc-44f6-a95c-668350aba827 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1474 microversion: 2.1 time: 0.830702 Aug 29 15:44:13.962433 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 887/1762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:13 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1474 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:13.975515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:13.978624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:13.998467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.002421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.003010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.005305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.007041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.008138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.058073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.078957 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25633f91-cfde-4f9c-838a-ad56d13bd0eb tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1321 microversion: 2.1 time: 0.761439 Aug 29 15:44:14.081065 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 876/1763] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:13 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1321 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:14.100824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:14.105042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:14.107239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:14.130222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.131681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.132344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.133236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.134114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.140142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.483703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.518599 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bcc5b61-80f7-426c-ad32-0b22eaa7ad45 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1257 microversion: 2.1 time: 0.423908 Aug 29 15:44:14.520991 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 877/1764] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:14 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1257 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:14.542135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:14.543733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:14.569277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.569790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.570262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.583340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.584190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.585895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.847651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.859465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.861642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:14.865307 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4bccf0f8-528c-497f-8cca-f3196b6e3395 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1250 microversion: 2.25 time: 0.342029 Aug 29 15:44:14.865970 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 878/1765] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:14 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1250 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:14.895744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:14.896448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:14.913451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.913949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.919530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:14.920736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:14.921810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:14.922751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.101335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:15.223612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.238239 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5122acb-5032-4a02-9da8-eee42fd376b6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 1.270764 Aug 29 15:44:15.239274 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 888/1766] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:13 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:15.246876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:15.247529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:15.269024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.269530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.270218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.270923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.271450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.272165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.410810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.440770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b7c78c4-999e-446f-b5dc-bfa242bbecc8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1264 microversion: 2.1 time: 0.197679 Aug 29 15:44:15.441451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 889/1767] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:15 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:15.446182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:15.458676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:15.477016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.477428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.478077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.479015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.479656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.480250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.486871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:15.512107 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b4706a3c-c4cf-4cfc-8970-5ca1c7044b57 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1318 microversion: 2.1 time: 0.631351 Aug 29 15:44:15.520601 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 879/1768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:14 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:15.536121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:15.539806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:15.556016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.556873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.557543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:15.561918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:15.562713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:15.564161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.218432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.227492 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3b4c268-96cf-4086-baba-f9bd95651c0f tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1517 microversion: 2.1 time: 0.705425 Aug 29 15:44:16.243108 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 880/1769] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:15 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1517 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:16.248200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-64c494eb-cc21-4984-bbd4-87202a846cc4 req-b7f7481d-ca10-4841-9bfa-b3c6b963b2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84f455ce-786c-4f29-8e9f-e57a09dfe48b", "name": "network-vif-deleted", "tag": "a8350ae2-bf24-4dff-9da2-2d4e60a21cc0"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:16.273952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-64c494eb-cc21-4984-bbd4-87202a846cc4 req-b7f7481d-ca10-4841-9bfa-b3c6b963b2e2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.274435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-64c494eb-cc21-4984-bbd4-87202a846cc4 req-b7f7481d-ca10-4841-9bfa-b3c6b963b2e2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.274864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-64c494eb-cc21-4984-bbd4-87202a846cc4 req-b7f7481d-ca10-4841-9bfa-b3c6b963b2e2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.299850 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-64c494eb-cc21-4984-bbd4-87202a846cc4 req-b7f7481d-ca10-4841-9bfa-b3c6b963b2e2 service nova] Creating event network-vif-deleted:a8350ae2-bf24-4dff-9da2-2d4e60a21cc0 for instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b on n-h2-836830-13 Aug 29 15:44:16.308214 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-64c494eb-cc21-4984-bbd4-87202a846cc4 req-b7f7481d-ca10-4841-9bfa-b3c6b963b2e2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063133 Aug 29 15:44:16.308743 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 881/1770] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:16.320651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:16.321803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:16.347355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.347981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.348442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.350800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.351513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.351966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.627763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.638905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b5c6a97-5152-46ba-adc3-6989c549346d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1474 microversion: 2.1 time: 1.196358 Aug 29 15:44:16.673039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 890/1771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:15 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1474 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:16.683702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:16.696206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:16.721851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.722571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.723155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.724001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:16.724601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:16.725201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:16.868922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:16.880265 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b7e06f0-e470-4e7f-b64c-c7805723801a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1263 microversion: 2.1 time: 0.570011 Aug 29 15:44:16.880867 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 882/1772] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:16 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1263 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:16.893403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ccd3aec3-ef2f-4e52-86b5-3655e08328f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'create', calling method: .version_select at 0x7f32ee751a60>, body: {"pool": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:17.283174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.294045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.295749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.297301 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd1da588-ead2-49dc-b19f-671243827ba6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1292 microversion: 2.25 time: 0.622963 Aug 29 15:44:17.299060 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 891/1773] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:16 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1292 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:17.304370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.305396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.318884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.319775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.320364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.321264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.322671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.325188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.718072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.730808 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76023120-975f-4e96-9371-d7bab33e6eb6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.430442 Aug 29 15:44:17.731800 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 892/1774] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:17.771662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.775834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.789848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.790849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.791785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.793014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.794654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.795400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.900879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:17.920075 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b426dfe5-e24e-4a2a-a0bc-c02a44a5b1f9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1270 microversion: 2.1 time: 0.168408 Aug 29 15:44:17.921696 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 893/1775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:17.929822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:17.930581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:17.939641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.940294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.940914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:17.941965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:17.942531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:17.943118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.204574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:18.214728 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-372edec5-0681-469d-8d48-2f245185227c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1318 microversion: 2.1 time: 0.290688 Aug 29 15:44:18.215374 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 894/1776] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:17 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:18.221088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-65c3d085-e18a-4ba7-8755-6dd604115f6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Action: 'create', calling method: .version_select at 0x7f32f285b160>, body: {"keypair": {"name": "tempest-keypair-2056769755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm5Z5abIKju0BaYYYqOhBzk6/HZ/lBqLu8awmxvJLTDU1B4rr57U2K85gNtuRuooEVTZ2Ps6bl/QtHno7uGAECQsZ59nsBRcPX0J3dCaWIiSxxzkXSZY29quN9HT9eUSA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:18.250490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=53 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:18.253312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-65c3d085-e18a-4ba7-8755-6dd604115f6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Getting quotas for project d2f8b491e736447ebb4436c6bdd9125f. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:18.259821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-65c3d085-e18a-4ba7-8755-6dd604115f6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Getting quotas for user f4abb1099f2648998f7542cd84a737c4 and project d2f8b491e736447ebb4436c6bdd9125f. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:18.290003 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-65c3d085-e18a-4ba7-8755-6dd604115f6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.073244 Aug 29 15:44:18.291294 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 895/1777] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 15:44:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:44:18.296567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fc0706cc-cd5d-4eea-bbed-b8e5729bee31 req-e35251ef-87e2-4cd3-9165-000883ba3907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3685c60-cfca-4c4f-b754-960d478aa207", "name": "network-vif-plugged", "status": "completed", "tag": "5919f625-39ab-4106-a5fe-021441163394"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:18.312688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fc0706cc-cd5d-4eea-bbed-b8e5729bee31 req-e35251ef-87e2-4cd3-9165-000883ba3907 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.313570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fc0706cc-cd5d-4eea-bbed-b8e5729bee31 req-e35251ef-87e2-4cd3-9165-000883ba3907 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.314334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fc0706cc-cd5d-4eea-bbed-b8e5729bee31 req-e35251ef-87e2-4cd3-9165-000883ba3907 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.332368 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fc0706cc-cd5d-4eea-bbed-b8e5729bee31 req-e35251ef-87e2-4cd3-9165-000883ba3907 service nova] Creating event network-vif-plugged:5919f625-39ab-4106-a5fe-021441163394 for instance e3685c60-cfca-4c4f-b754-960d478aa207 on n-h1-836830-13 Aug 29 15:44:18.339153 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fc0706cc-cd5d-4eea-bbed-b8e5729bee31 req-e35251ef-87e2-4cd3-9165-000883ba3907 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045768 Aug 29 15:44:18.340793 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 896/1778] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:18.349078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.350352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.359220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.360761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.361544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.362513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.363238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.363864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.416946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.418356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.419173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.419900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lazy-loading 'fault' on Instance uuid 55c1c64a-0520-432c-8c72-608633f27d35 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:18.534520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29fa4fbf7bb34c13952163feeaafe738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd41e3c60ee6c4e41bb046e0e585ae41d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:18.551218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-304de227-28aa-4b20-a92e-5fa47a666ab8 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 200 len: 1308 microversion: 2.1 time: 0.208910 Aug 29 15:44:18.566172 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 897/1779] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:18.586480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.590373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.605269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.605874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.606402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.607945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.608605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.609227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.690925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=20 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:18.920605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:18.940576 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cfcdabd1-aea6-4d49-89f6-24382f59a9c1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.384055 Aug 29 15:44:18.942305 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 898/1780] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:18.956694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:18.957594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:18.976695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.980903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.982049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:18.987235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:18.991391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:18.995801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.253947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.267624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.269444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.271092 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-58c023e4-7dce-4c23-b3c8-a38b9669b6c8 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1292 microversion: 2.25 time: 0.325452 Aug 29 15:44:19.291408 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 899/1781] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:18 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1292 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:19.299620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c5415671-577f-4437-832a-c4126252b2f1 req-25436739-048a-46d0-84a1-eeeb79e37508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c1c64a-0520-432c-8c72-608633f27d35", "name": "network-vif-deleted", "tag": "38a41bff-78ab-411e-8d27-7a0d76ee3a93"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:19.314540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c5415671-577f-4437-832a-c4126252b2f1 req-25436739-048a-46d0-84a1-eeeb79e37508 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.315350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c5415671-577f-4437-832a-c4126252b2f1 req-25436739-048a-46d0-84a1-eeeb79e37508 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.316811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c5415671-577f-4437-832a-c4126252b2f1 req-25436739-048a-46d0-84a1-eeeb79e37508 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.346712 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c5415671-577f-4437-832a-c4126252b2f1 req-25436739-048a-46d0-84a1-eeeb79e37508 service nova] Creating event network-vif-deleted:38a41bff-78ab-411e-8d27-7a0d76ee3a93 for instance 55c1c64a-0520-432c-8c72-608633f27d35 on n-h1-836830-13 Aug 29 15:44:19.373936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c5415671-577f-4437-832a-c4126252b2f1 req-25436739-048a-46d0-84a1-eeeb79e37508 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078312 Aug 29 15:44:19.376703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 900/1782] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:19.392977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:19.394079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.402030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.402791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.403422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.404350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.404974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.405571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.636414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=15 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:19.845861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:19.859157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1fe5f7a5-ecf7-4751-a0f2-3f201f88ce17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.480338 Aug 29 15:44:19.860600 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 901/1783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:19 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:19.865862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:19.866747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:19.883966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.887134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.887753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:19.888954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:19.890176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:19.893601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.321422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.333385 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f2a7cc0-3d7b-4225-ad81-341743f2d7b1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.471472 Aug 29 15:44:20.336363 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 902/1784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:19 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:20.342205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.343241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.359525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.360335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.360780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.361533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.361997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.364658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.385703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:20.630232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.644205 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d1814131-3ace-46ca-80ff-3316b3722366 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1468 microversion: 2.1 time: 0.306211 Aug 29 15:44:20.660108 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 903/1785] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1468 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:20.666012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.666840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] [instance: 55c1c64a-0520-432c-8c72-608633f27d35] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.674754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.675473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.676074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.676944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.677566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.678158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.694568 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] HTTP exception thrown: Instance 55c1c64a-0520-432c-8c72-608633f27d35 could not be found. Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Request method failure captured: Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 HTTP/1.1 Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN408qwYYvdQzAc_gUkCMcyFwRCq9V7aHa_BobWPk794I1Q8pLCOPrck30r0xuSETXJG3NMSGezEBwW6YyoJ2p_50DJWqRQ3IufU4vBbijruTyawr94tIdDjUz9Uq-es0UWGv3rasCk9wE8uihQ804fQKpmhtCN1sf_5hAPPgM3POBg Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d41e3c60ee6c4e41bb046e0e585ae41d Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListImageFiltersTestJSON-1365498200 Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:44:20.696602 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d41e3c60ee6c4e41bb046e0e585ae41d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d41e3c60ee6c4e41bb046e0e585ae41d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d41e3c60ee6c4e41bb046e0e585ae41d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d41e3c60ee6c4e41bb046e0e585ae41d"}]}] Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListImageFiltersTestJSON-1365498200 Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d41e3c60ee6c4e41bb046e0e585ae41d Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1365498200 Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListImageFiltersTestJSON-1365498200-project Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 29fa4fbf7bb34c13952163feeaafe738 Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListImageFiltersTestJSON-1365498200-project Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 55c1c64a-0520-432c-8c72-608633f27d35 could not be found. Aug 29 15:44:20.698569 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '55c1c64a-0520-432c-8c72-608633f27d35'} Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c1c64a-0520-432c-8c72-608633f27d35 could not be found. Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:20.699518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c1c64a-0520-432c-8c72-608633f27d35 could not be found. Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c1c64a-0520-432c-8c72-608633f27d35 could not be found. Aug 29 15:44:20.701197 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:20.702668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Returning 404 to user: Instance 55c1c64a-0520-432c-8c72-608633f27d35 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:20.703389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-015fb851-9084-4a16-a183-6a36911d76c4 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35" status: 404 len: 111 microversion: 2.1 time: 0.041947 Aug 29 15:44:20.706364 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 904/1786] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/55c1c64a-0520-432c-8c72-608633f27d35 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:20.712585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f75ecad8-feda-4788-85e7-07d92893d86a req-f0a2a482-edda-4788-b156-135a6e9b3031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c69654a-6a13-4653-9c37-04df93393b26", "tag": "b976629e-c63c-432c-89e0-f9d9bfd35a55"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:20.724078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f75ecad8-feda-4788-85e7-07d92893d86a req-f0a2a482-edda-4788-b156-135a6e9b3031 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.724822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f75ecad8-feda-4788-85e7-07d92893d86a req-f0a2a482-edda-4788-b156-135a6e9b3031 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.725610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f75ecad8-feda-4788-85e7-07d92893d86a req-f0a2a482-edda-4788-b156-135a6e9b3031 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.740203 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f75ecad8-feda-4788-85e7-07d92893d86a req-f0a2a482-edda-4788-b156-135a6e9b3031 service nova] Creating event network-changed:b976629e-c63c-432c-89e0-f9d9bfd35a55 for instance 2c69654a-6a13-4653-9c37-04df93393b26 on n-h2-836830-13 Aug 29 15:44:20.746473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f75ecad8-feda-4788-85e7-07d92893d86a req-f0a2a482-edda-4788-b156-135a6e9b3031 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038480 Aug 29 15:44:20.747956 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 905/1787] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:20.754245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.755681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.762996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.763606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.764050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.764752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.765265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.765789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.796420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ccd3aec3-ef2f-4e52-86b5-3655e08328f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.911566 Aug 29 15:44:20.798313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 883/1788] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:44:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:20.803560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:20.804479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:20.814258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.816026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.816762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.817906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:20.818634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:20.819456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:20.968943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.980001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.981730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:20.983052 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2f104fa9-99de-4591-89e3-314a3eb42ea9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1292 microversion: 2.25 time: 0.183185 Aug 29 15:44:20.999072 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 884/1789] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1292 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:21.004461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-675ca3a3-c72d-40cb-8703-3577e45a3607 req-d53dff32-1704-4d19-b5ec-47189df601b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91019f2-48d5-4ac8-b793-5f2a1ae48274", "name": "network-vif-plugged", "status": "completed", "tag": "92a35708-d0a7-4eb6-8e3c-0c967ab3663d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:21.014265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.014974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-675ca3a3-c72d-40cb-8703-3577e45a3607 req-d53dff32-1704-4d19-b5ec-47189df601b5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.015561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-675ca3a3-c72d-40cb-8703-3577e45a3607 req-d53dff32-1704-4d19-b5ec-47189df601b5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.016231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-675ca3a3-c72d-40cb-8703-3577e45a3607 req-d53dff32-1704-4d19-b5ec-47189df601b5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.029041 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-675ca3a3-c72d-40cb-8703-3577e45a3607 req-d53dff32-1704-4d19-b5ec-47189df601b5 service nova] Creating event network-vif-plugged:92a35708-d0a7-4eb6-8e3c-0c967ab3663d for instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 on n-h2-836830-13 Aug 29 15:44:21.029290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5d96796-30dd-40e5-af60-0a8dda5dc398 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.279849 Aug 29 15:44:21.040819 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 906/1790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:20 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.041785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-675ca3a3-c72d-40cb-8703-3577e45a3607 req-d53dff32-1704-4d19-b5ec-47189df601b5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040731 Aug 29 15:44:21.042809 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 885/1791] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:21.052479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.053095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.053891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9a3e52a-cc76-4041-9c1b-e156948b760d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee5de940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.064682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.065181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.065615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.066307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.066753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.067204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.303667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.312404 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8737a2e1-6048-4bd1-829b-7080812ee256 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 200 len: 1318 microversion: 2.1 time: 0.270426 Aug 29 15:44:21.313459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 907/1792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.319154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-468993502", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "8ad56b1a-bc38-44b2-bfec-6f75ca507357"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:21.331108 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9a3e52a-cc76-4041-9c1b-e156948b760d tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/images/d757a595-9cdc-4776-a74a-8698b73bb77b" status: 204 len: 0 microversion: 2.1 time: 0.282062 Aug 29 15:44:21.332291 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 886/1793] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] DELETE /compute/v2.1/images/d757a595-9cdc-4776-a74a-8698b73bb77b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:21.338187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.339305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.350195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.351207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.351716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.352489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.353013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.353669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.396280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] validate_networks() for [('8ad56b1a-bc38-44b2-bfec-6f75ca507357', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:21.489377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.493174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:21.498374 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a1bf6192-186f-48f9-9f33-2a53d902f75b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.164620 Aug 29 15:44:21.498970 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 887/1794] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.504081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0a3c1d2-a837-4b98-9e5d-0a1f13d39573 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee404ca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.737509 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0a3c1d2-a837-4b98-9e5d-0a1f13d39573 tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/images/3ccb43ed-5792-4868-9a94-ff01650c134c" status: 204 len: 0 microversion: 2.1 time: 0.237384 Aug 29 15:44:21.738123 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 888/1795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] DELETE /compute/v2.1/images/3ccb43ed-5792-4868-9a94-ff01650c134c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:21.753121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.753602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:21.760952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.761453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.761895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.762646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.763080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.763519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.913821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:21.923994 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d1d4326-1b67-43a5-a9ad-c023e77ebc1d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.183927 Aug 29 15:44:21.937037 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 889/1796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:21.942559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2297d6bd-cf64-4785-9130-8600bd4edc5a req-f327fccd-a2e6-461f-9c33-eabc82cf29ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2924710b-a966-48bf-9d93-26705f6e999c", "tag": "3aa203c7-29ff-450c-aa85-ae77c7dff94e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:21.952032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2297d6bd-cf64-4785-9130-8600bd4edc5a req-f327fccd-a2e6-461f-9c33-eabc82cf29ad service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.952520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2297d6bd-cf64-4785-9130-8600bd4edc5a req-f327fccd-a2e6-461f-9c33-eabc82cf29ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.952946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2297d6bd-cf64-4785-9130-8600bd4edc5a req-f327fccd-a2e6-461f-9c33-eabc82cf29ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.965447 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2297d6bd-cf64-4785-9130-8600bd4edc5a req-f327fccd-a2e6-461f-9c33-eabc82cf29ad service nova] Creating event network-changed:3aa203c7-29ff-450c-aa85-ae77c7dff94e for instance 2924710b-a966-48bf-9d93-26705f6e999c on n-h2-836830-13 Aug 29 15:44:21.971859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:21.972068 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2297d6bd-cf64-4785-9130-8600bd4edc5a req-f327fccd-a2e6-461f-9c33-eabc82cf29ad service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033521 Aug 29 15:44:21.972474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:21.972621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 890/1797] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:21.973583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:21.975614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:21.976131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:21.977584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa9e22c4-2ab0-4314-be8e-2314f11bbf9e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] Calling method '.version_select at 0x7f32ee8a78b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:21.987847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.988529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.989180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:21.990001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:21.990553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:21.991164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.010255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Getting quotas for project bd150e4d120d4c6584c650e747abb6a4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:22.017691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Getting quotas for user 0c19d2e9ffa64e7586e35035176f1c26 and project bd150e4d120d4c6584c650e747abb6a4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:22.035584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:22.037916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:22.052507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:22.103441 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eddff43c-6760-43e3-a595-a78c79571e30 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788167 Aug 29 15:44:22.111535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 908/1798] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:22.122996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-599192378", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cfcf9f3c-729f-4211-b545-53c60799a14e"}, {"port": "c9522880-8b9a-466b-815f-947dc37f0279", "tag": "port-1"}, {"port": "19608bdd-c953-4f2d-93c6-86f485a25fc3", "tag": "port-2"}, {"uuid": "440fad58-5d2d-436b-b576-c082ec61f5e8", "tag": "net-1"}, {"uuid": "440fad58-5d2d-436b-b576-c082ec61f5e8"}, {"uuid": "dfaaa90b-4737-4276-ae87-efad4136f161", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "dfaaa90b-4737-4276-ae87-efad4136f161", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1657f6fe-cc75-462f-8d49-6e4158063a40", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1f2a5729-e248-40fd-9d2b-4bd6fe140ea9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8c40101f-6242-4e76-825a-32ca215538dc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--367538832"}], "key_name": "tempest-keypair-2056769755", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:22.288623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] validate_networks() for [('cfcf9f3c-729f-4211-b545-53c60799a14e', None, None, None, None, None), (None, None, 'c9522880-8b9a-466b-815f-947dc37f0279', None, None, None), (None, None, '19608bdd-c953-4f2d-93c6-86f485a25fc3', None, None, None), ('440fad58-5d2d-436b-b576-c082ec61f5e8', None, None, None, None, None), ('440fad58-5d2d-436b-b576-c082ec61f5e8', None, None, None, None, None), ('dfaaa90b-4737-4276-ae87-efad4136f161', '10.2.2.100', None, None, None, None), ('dfaaa90b-4737-4276-ae87-efad4136f161', '10.2.2.200', None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:22.312344 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aa9e22c4-2ab0-4314-be8e-2314f11bbf9e tempest-ListImageFiltersTestJSON-1365498200 tempest-ListImageFiltersTestJSON-1365498200-project] 10.222.0.83 "DELETE /compute/v2.1/images/89f296a5-7780-4b36-9d52-318fb9b5f21e" status: 204 len: 0 microversion: 2.1 time: 0.338552 Aug 29 15:44:22.317159 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 891/1799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:21 2022] DELETE /compute/v2.1/images/89f296a5-7780-4b36-9d52-318fb9b5f21e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:22.339993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:22.340422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:22.370224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.380338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.380805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:22.385093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:22.385667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:22.386119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.061994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.078679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.080878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.082466 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-062bf43e-16bf-406b-84bd-c9a00c3b8fd3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1292 microversion: 2.25 time: 0.767353 Aug 29 15:44:23.085575 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 892/1800] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:22 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1292 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:23.096071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.098597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.112072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.114169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.115757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.122569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.123147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.123511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.889549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:23.898016 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-debbd3f0-038b-4e06-bd44-c3ec299544dd tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.810741 Aug 29 15:44:23.902541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 893/1801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:23.913710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:23.914483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:23.925754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.926961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.927706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:23.929094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:23.929740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:23.930329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.045941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.066482 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14f57b38-e84f-47d2-9d83-50bcb14312d2 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1275 microversion: 2.1 time: 0.161218 Aug 29 15:44:24.069880 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 894/1802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:23 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:24.077181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.077868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.091927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.092431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.092867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.093577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.099788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.100298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.429000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.449208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2abb14fe-e510-4112-9c58-86f265591fe7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 200 len: 1318 microversion: 2.1 time: 0.375432 Aug 29 15:44:24.451183 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 895/1803] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:24.457368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.458233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.466952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.468079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.468744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.470309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.472061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.472673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.754261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:24.762212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-72c3d372-4f6b-4326-b0ae-3ed95d3ab10b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.309626 Aug 29 15:44:24.762802 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 896/1804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:24.768412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:24.769248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:24.776223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.776919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.777744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:24.778641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:24.779144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:24.779751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.122433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.134251 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b5c7144-9c1e-436e-a33a-8d57d266a35d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.370349 Aug 29 15:44:25.147045 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 897/1805] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:24 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:25.153648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.154367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.163337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.164274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.164788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.165566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.166323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.166876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.330142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.338764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.340379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.341496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-03b9efdb-ba43-4f0b-95b0-4fe7fe6b76c7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.204410 Aug 29 15:44:25.342057 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 898/1806] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:25.347259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-55d4dcc3-a8b4-408a-aab9-3a05418d4631 req-7501c043-b616-4eee-91b9-f4f9028ff0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:25.357060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-55d4dcc3-a8b4-408a-aab9-3a05418d4631 req-7501c043-b616-4eee-91b9-f4f9028ff0dc service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.357511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-55d4dcc3-a8b4-408a-aab9-3a05418d4631 req-7501c043-b616-4eee-91b9-f4f9028ff0dc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.357962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-55d4dcc3-a8b4-408a-aab9-3a05418d4631 req-7501c043-b616-4eee-91b9-f4f9028ff0dc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.370282 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-55d4dcc3-a8b4-408a-aab9-3a05418d4631 req-7501c043-b616-4eee-91b9-f4f9028ff0dc service nova] Creating event network-changed:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h2-836830-13 Aug 29 15:44:25.374790 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-55d4dcc3-a8b4-408a-aab9-3a05418d4631 req-7501c043-b616-4eee-91b9-f4f9028ff0dc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031624 Aug 29 15:44:25.375721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 899/1807] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:25.393453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.395538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.403765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.404909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.405495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.407417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.408080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.408837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.791159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:25.803522 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a03d2904-9f3c-41b2-a6d3-ff2200437152 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.418091 Aug 29 15:44:25.804755 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 900/1808] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:25.817021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6c666013-332a-445c-81eb-432ebbab9a1d req-fa480218-df7e-4db5-a4bb-750ab56c5b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a905e81-88ea-4a7b-b20f-c32d13e84a8c", "name": "network-vif-plugged", "status": "completed", "tag": "25c3e9e4-d572-4e78-8fcd-88394647708e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:25.829857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6c666013-332a-445c-81eb-432ebbab9a1d req-fa480218-df7e-4db5-a4bb-750ab56c5b4b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.830756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6c666013-332a-445c-81eb-432ebbab9a1d req-fa480218-df7e-4db5-a4bb-750ab56c5b4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.831461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6c666013-332a-445c-81eb-432ebbab9a1d req-fa480218-df7e-4db5-a4bb-750ab56c5b4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.857996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6c666013-332a-445c-81eb-432ebbab9a1d req-fa480218-df7e-4db5-a4bb-750ab56c5b4b service nova] Creating event network-vif-plugged:25c3e9e4-d572-4e78-8fcd-88394647708e for instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c on n-h2-836830-13 Aug 29 15:44:25.865265 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6c666013-332a-445c-81eb-432ebbab9a1d req-fa480218-df7e-4db5-a4bb-750ab56c5b4b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059022 Aug 29 15:44:25.866213 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 901/1809] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:25.873239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:25.874191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:25.883538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.884037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.884543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:25.885472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:25.886230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:25.886867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.156341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.165098 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0f17da90-8060-43c1-8e5f-db76c7a7ac9c tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1323 microversion: 2.1 time: 0.297507 Aug 29 15:44:26.170955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 902/1810] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:25 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:26.310186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be5a2352-ccaa-4388-8e90-3a4c152b60d5 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Action: 'create', calling method: .version_select at 0x7f32ee63c160>, body: {"keypair": {"name": "tempest-keypair-1385699324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1bTluxesYcO5UUu/d0pXi737Z6zVjzv11NLNJjGDbFSZgvPGBQRK7b1jTjmNvfJUNgFRiqTo4ZNp244tGftkUXp6I4HaB/DmtMWe43c/iPXfbdNltulj7lON+MAubj5A=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:26.327483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-be5a2352-ccaa-4388-8e90-3a4c152b60d5 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:26.333917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-be5a2352-ccaa-4388-8e90-3a4c152b60d5 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for user df4b0974fc1847f28842a4a18e97eb25 and project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:26.370062 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be5a2352-ccaa-4388-8e90-3a4c152b60d5 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197519 Aug 29 15:44:26.376649 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 903/1811] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:26.376649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.377032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.383359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.383983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.384427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.385182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.385697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.386196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.534653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.542846 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-101f0279-8dda-4b50-9a36-d1ce4072ca73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 200 len: 1467 microversion: 2.1 time: 0.171231 Aug 29 15:44:26.543512 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 904/1812] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 1467 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:26.548814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:26.549806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:26.550469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:26.551249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:26.551812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:26.565511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.566595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.571770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.572341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.572772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.573690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.574138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.577108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.582203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.584163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.584654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.585330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.585789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.586216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.609335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Getting quotas for project d2f8b491e736447ebb4436c6bdd9125f. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:26.616047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Getting quotas for user f4abb1099f2648998f7542cd84a737c4 and project d2f8b491e736447ebb4436c6bdd9125f. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:26.765195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:26.780037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8f15bb5-a86e-4bb7-ac00-a0d698f11a7e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.223254 Aug 29 15:44:26.780951 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 905/1813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:26.804155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:26.804793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:26.811883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.812385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.812868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.813983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:26.814507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:26.815809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:26.847449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:26.852328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1657f6fe-cc75-462f-8d49-6e4158063a40',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1f2a5729-e248-40fd-9d2b-4bd6fe140ea9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c40101f-6242-4e76-825a-32ca215538dc',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:27.009341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.022959 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aef60513-0bcc-4993-8ef1-56efd1785410 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.239144 Aug 29 15:44:27.034419 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 906/1814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:26 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:27.043305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.043943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.054558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.055630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.056069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.057058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.057744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.058371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.228778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.238368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.240815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.242049 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-86d98c30-d9f8-4b5e-9636-77a235bcd1e5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.206380 Aug 29 15:44:27.254065 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 907/1815] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:27.267196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1e9bd9c-c03c-4e23-8fdb-b29dded1f3b3 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32ee751ee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.283305 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1e9bd9c-c03c-4e23-8fdb-b29dded1f3b3 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs/tempest-keypair-1385699324" status: 200 len: 497 microversion: 2.1 time: 0.027713 Aug 29 15:44:27.290920 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 908/1816] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1385699324 => generated 497 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:27.299714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.308515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.309408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Searching by: {'reservation_id': 'r-0to3y366', 'deleted': False, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:44:27.318860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a9637f5-8685-4101-97ae-7a4ee33dad5f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.200093 Aug 29 15:44:27.320729 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 909/1817] 10.222.0.83 () {62 vars in 1189 bytes} [Mon Aug 29 15:44:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 5203 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:44:27.329355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.330167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.330670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.331468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.331930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.332365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.337428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.338341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.352065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.352841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.353512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.355487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.356230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.356951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.441244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:44:27.520370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.528523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.529012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.529481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.533857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:27.659368 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de76552e-81a3-403b-9f0c-dc138e7bb357 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/detail?reservation_id=r-0to3y366" status: 200 len: 2928 microversion: 2.1 time: 0.366385 Aug 29 15:44:27.659970 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 909/1818] 10.222.0.83 () {58 vars in 1197 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0to3y366 => generated 2928 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:27.663316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.666675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.667813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.671257 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-274e5f1a-8918-432c-b1c5-12878e30ce18 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.349224 Aug 29 15:44:27.681809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.682506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.683007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.683743 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 910/1819] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:27.687202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.688164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.688595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.689467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ff025da2-0531-4b84-b955-e78c4a3f9e37 req-0ac061af-a02d-48ae-afc1-03ad08ab3962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e7bb8c-484f-4cc8-a02b-bbfdff92e1db", "tag": "ebd2914e-a315-4a97-ba1e-b991f741a72c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:27.711792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff025da2-0531-4b84-b955-e78c4a3f9e37 req-0ac061af-a02d-48ae-afc1-03ad08ab3962 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.712277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff025da2-0531-4b84-b955-e78c4a3f9e37 req-0ac061af-a02d-48ae-afc1-03ad08ab3962 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.712711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff025da2-0531-4b84-b955-e78c4a3f9e37 req-0ac061af-a02d-48ae-afc1-03ad08ab3962 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.725717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ff025da2-0531-4b84-b955-e78c4a3f9e37 req-0ac061af-a02d-48ae-afc1-03ad08ab3962 service nova] Creating event network-changed:ebd2914e-a315-4a97-ba1e-b991f741a72c for instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db on n-h1-836830-13 Aug 29 15:44:27.732048 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ff025da2-0531-4b84-b955-e78c4a3f9e37 req-0ac061af-a02d-48ae-afc1-03ad08ab3962 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046806 Aug 29 15:44:27.732972 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 911/1820] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:27.738831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c395709f-5436-4603-a3e7-752aee660733 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32f2895ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.764582 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c395709f-5436-4603-a3e7-752aee660733 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385699324" status: 202 len: 0 microversion: 2.1 time: 0.030287 Aug 29 15:44:27.765927 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 912/1821] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385699324 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:27.774805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-55bbe52a-0480-4855-b289-decf3a5cf98c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.775849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-55bbe52a-0480-4855-b289-decf3a5cf98c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.863827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-55bbe52a-0480-4855-b289-decf3a5cf98c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.875887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.882612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-55bbe52a-0480-4855-b289-decf3a5cf98c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.884832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-55bbe52a-0480-4855-b289-decf3a5cf98c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:27.886409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-45b5c42a-02ee-47ef-82ef-41e7b9349e6b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1323 microversion: 2.1 time: 0.225198 Aug 29 15:44:27.886785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-55bbe52a-0480-4855-b289-decf3a5cf98c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1285 microversion: 2.42 time: 0.118919 Aug 29 15:44:27.887422 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 913/1822] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:27.902265 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 910/1823] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:27.909867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a613236b-f14c-4ee2-a2ec-38718639ac8c tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Action: 'create', calling method: .version_select at 0x7f32ee925550>, body: {"keypair": {"name": "tempest-keypair-2082610050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0nCGP1Jb4w0afw7g2jIZVnPSpSXAR0ATtHxL65zWjV77+btbX0HWHVmuT5d4ovb50Fa2ojiUldPzWHu5rjgM2ScMbgNw/+hWk9cPGg6RAv0fEEjCO2MeSqk/2TOTSUUA=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:27.911789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-69a40d03-f291-4d4e-beb7-202be54efa86 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.928186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a613236b-f14c-4ee2-a2ec-38718639ac8c tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:27.931494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.server_groups [None req-69a40d03-f291-4d4e-beb7-202be54efa86 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Querying cell 28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) for 2 instances {{(pid=129133) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:44:27.932214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69a40d03-f291-4d4e-beb7-202be54efa86 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.932694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69a40d03-f291-4d4e-beb7-202be54efa86 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.933267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69a40d03-f291-4d4e-beb7-202be54efa86 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.936475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a613236b-f14c-4ee2-a2ec-38718639ac8c tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for user df4b0974fc1847f28842a4a18e97eb25 and project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:27.972684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a613236b-f14c-4ee2-a2ec-38718639ac8c tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068887 Aug 29 15:44:27.976760 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-69a40d03-f291-4d4e-beb7-202be54efa86 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups/ef25c095-969b-4641-b2fb-b56d46aeb61f" status: 200 len: 269 microversion: 2.1 time: 0.062489 Aug 29 15:44:27.978966 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 911/1824] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:27.980496 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 914/1825] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/os-server-groups/ef25c095-969b-4641-b2fb-b56d46aeb61f => generated 269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:27.988445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8222ed9-e461-406b-9026-07eb90ecb69f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32f286b8b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.989119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:27.989971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:27.996549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.997303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.997915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:27.998787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:27.999270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:27.999683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.012115 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8222ed9-e461-406b-9026-07eb90ecb69f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082610050" status: 202 len: 0 microversion: 2.1 time: 0.030486 Aug 29 15:44:28.013045 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 915/1826] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082610050 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:28.018528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.019361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.026492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.027182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.027612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.028295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.028924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.029349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.154824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.163250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-335c2d81-2951-4dd9-9525-0e8516820414 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.182733 Aug 29 15:44:28.163831 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 912/1827] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:27 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.168504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-415508b9-9f10-411d-ac81-ff67135678f0 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Action: 'create', calling method: .version_select at 0x7f32ee8e48b0>, body: {"keypair": {"name": "tempest-keypair-360547083", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:28.184769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-415508b9-9f10-411d-ac81-ff67135678f0 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:28.187187 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53a829a3-9aad-4ca8-b334-f5b6a2266061 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 200 len: 1621 microversion: 2.1 time: 0.172873 Aug 29 15:44:28.188726 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 916/1828] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 1621 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.190834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-415508b9-9f10-411d-ac81-ff67135678f0 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for user df4b0974fc1847f28842a4a18e97eb25 and project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:28.193046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.193645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.199928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.200371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.200796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.201486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.201957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.202324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.221048 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-415508b9-9f10-411d-ac81-ff67135678f0 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.056148 Aug 29 15:44:28.221769 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 913/1829] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:28 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:28.226569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.227354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.233489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.234128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.234387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.235948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.236613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.237045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.340173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.348620 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-14f2d9f2-3651-4e45-92e4-623400128977 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.159005 Aug 29 15:44:28.349204 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 917/1830] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.357710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0278fb4-fd44-4fa7-9c58-860b0d5cf54a tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32edcb0af0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.372650 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8bf65a91-e023-4cc1-9d2c-d9c07aadda65 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 200 len: 1620 microversion: 2.1 time: 0.149759 Aug 29 15:44:28.373309 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 914/1831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 1620 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.378800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.383287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.383287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:28.386397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.386882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.387345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.388038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.388491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.388917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.389126 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0278fb4-fd44-4fa7-9c58-860b0d5cf54a tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-360547083" status: 202 len: 0 microversion: 2.1 time: 0.038871 Aug 29 15:44:28.389879 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 918/1832] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:44:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-360547083 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:28.402266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8ca9a7de-8d44-40c3-8d6a-4aacaf3d4f10 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Action: 'create', calling method: .version_select at 0x7f32edcaa310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1374872764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjoaJ80jUMGHD9mbWGwb+DJ6ORsDS3Vt8PBN9vzbjCsmJ1G/t0ZIinYG087nVrzFxZHQ1+FyaFVKDziT+UkcPiPVN8pwmoIFislOKbXXtK1f3ajYYLCME3sjAoWVd0gpg=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:28.421241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8ca9a7de-8d44-40c3-8d6a-4aacaf3d4f10 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:28.432411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8ca9a7de-8d44-40c3-8d6a-4aacaf3d4f10 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for user df4b0974fc1847f28842a4a18e97eb25 and project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:28.461749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8ca9a7de-8d44-40c3-8d6a-4aacaf3d4f10 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063420 Aug 29 15:44:28.470801 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 919/1833] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:28.476052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1778476f-6b13-40eb-8acc-0fbc597506bd tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Action: 'create', calling method: .version_select at 0x7f32f295fca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-266400570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHVAOHEZkWBVN3bom5wn+m84Y5zm+hAfVrIr4zB4BPc4Ry94sVB3nXhc8Nnl9J5fM6P77MH3146soMnv/4sTgfnVOdmt3zsAvnEDvPbCeqo7YY8/YEsIY4jZJtrV5d+VQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:28.491847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-1778476f-6b13-40eb-8acc-0fbc597506bd tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:28.496962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-1778476f-6b13-40eb-8acc-0fbc597506bd tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for user df4b0974fc1847f28842a4a18e97eb25 and project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:28.521381 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1778476f-6b13-40eb-8acc-0fbc597506bd tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049182 Aug 29 15:44:28.521973 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 920/1834] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:44:28.526519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-607004642", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "47f1aebf-dfb9-406c-b132-1081aacd03ef"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:28.556135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.565134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.566583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.567741 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae4d6475-a6e4-485b-8f28-65631edc0997 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.193429 Aug 29 15:44:28.568694 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 915/1835] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:28.573224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f62ea2d2-2250-4186-b69d-aa647e04667f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Action: 'create', calling method: .version_select at 0x7f32ee855550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1084151442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFRliqyXtuX2Ic3/PWFreXLxBtxdxFZD68X2SsxKsmSZJUKXK5KJiothnUU/mJqC9E0IAuw/LZ1DeqaaRmKIg2H6tSpgHe5cXd7ENs8WOR8BZfsVU+XN8ZdHgdFCun7Sg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:28.582731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:28.588823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f62ea2d2-2250-4186-b69d-aa647e04667f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:28.594476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f62ea2d2-2250-4186-b69d-aa647e04667f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Getting quotas for user df4b0974fc1847f28842a4a18e97eb25 and project edc5a47442874025810a8512b46ede66. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:28.621832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f62ea2d2-2250-4186-b69d-aa647e04667f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052074 Aug 29 15:44:28.622446 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 916/1836] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:44:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:28.632450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a068d3d-f2ae-430c-90fa-df3b7fa5be75 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32ee8a7af0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.636334 n-d-836830-13 devstack@n-api.service[129132]: WARNING oslo_db.sqlalchemy.utils [None req-7a068d3d-f2ae-430c-90fa-df3b7fa5be75 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:44:28.644301 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a068d3d-f2ae-430c-90fa-df3b7fa5be75 tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.015512 Aug 29 15:44:28.645133 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 917/1837] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:28.655219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-749f4800-4aa7-453c-baa1-294f4257a0de tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32ee9931f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.675823 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-749f4800-4aa7-453c-baa1-294f4257a0de tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1084151442" status: 202 len: 0 microversion: 2.1 time: 0.024189 Aug 29 15:44:28.676523 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 918/1838] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 15:44:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1084151442 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:44:28.684418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71512f9f-d2bb-41c5-b21a-fbaff22deb7f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32ee3d0a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.708346 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71512f9f-d2bb-41c5-b21a-fbaff22deb7f tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-266400570" status: 202 len: 0 microversion: 2.1 time: 0.027526 Aug 29 15:44:28.709142 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 919/1839] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:44:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-266400570 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:44:28.713800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.714347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.721351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.721830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.722255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.722943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.723412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.723833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.810424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:28.810944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:28.811334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:28.811765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:28.812172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:28.821290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.821764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.822216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.822925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.823621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.824046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.842093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:28.848319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:28.861115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:28.861481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:28.863842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:28.868842 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-588d3b48-6e8f-42c7-b858-9d4333618f53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.158949 Aug 29 15:44:28.869462 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 920/1840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:28.873974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c010d151-944c-4284-b71a-7f3dfd5c74ce tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] Calling method '.version_select at 0x7f32ee8a7040>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.894023 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c010d151-944c-4284-b71a-7f3dfd5c74ce tempest-KeyPairsV2TestJSON-1784560359 tempest-KeyPairsV2TestJSON-1784560359-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1374872764" status: 202 len: 0 microversion: 2.1 time: 0.023558 Aug 29 15:44:28.894604 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 921/1841] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 15:44:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1374872764 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:28.911921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.912532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.920319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.920810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.920995 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31ff9d7e-df99-4f27-a67e-54f370d4f00d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.398011 Aug 29 15:44:28.921241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.922736 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 921/1842] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:28.923229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.923958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.924532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.932667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:28.933296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:28.941228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.941714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.942405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:28.943407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:28.944014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:28.944601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.091674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.104905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.106355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.116828 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7349f9b-0089-4121-8e6a-f860e79055a5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1527 microversion: 2.42 time: 0.209226 Aug 29 15:44:29.117871 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 922/1843] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:29.127036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7b5aff7-a53b-45c5-8d04-a55c99e2a345 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.128570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e7b5aff7-a53b-45c5-8d04-a55c99e2a345 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.139045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.150925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9924602d-61d2-4424-8142-d79a3403b264 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1323 microversion: 2.1 time: 0.226748 Aug 29 15:44:29.151610 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 922/1844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:28 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:29.189469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.190100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.204497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.205359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.205984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.207846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.208615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.209216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.264583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e7b5aff7-a53b-45c5-8d04-a55c99e2a345 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.273779 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7b5aff7-a53b-45c5-8d04-a55c99e2a345 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1216 microversion: 2.1 time: 0.154262 Aug 29 15:44:29.274702 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 923/1845] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:29.371269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.372662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.387125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.387793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.388259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.391492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.392044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.393704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.536613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.544464 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aecf716a-b5fd-4a4e-9482-0a054a47e747 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.360427 Aug 29 15:44:29.547488 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 923/1846] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:29.591726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.592422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.601789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.602634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.603876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.604801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.605627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.606854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.639993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.651462 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3826da8a-60a6-44c9-98d5-cba15c5398f6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.285070 Aug 29 15:44:29.652285 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 924/1847] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:29.813733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.829212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.830962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:29.832451 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-afb253a1-a21e-4663-a945-5db49c0fe90d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.245522 Aug 29 15:44:29.834113 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 924/1848] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:29.891292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:29.891946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:29.899561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.900069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.900500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:29.901210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:29.901657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:29.902073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.058005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.066828 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69a2466f-8eb6-49c3-b703-a307dcb64fdb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.179895 Aug 29 15:44:30.067440 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 925/1849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:29 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:30.143455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.144184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.155150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.155927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.157743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.160560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.161223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.161820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.174085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.174693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.183600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.188831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.190369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.193519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.194011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.194614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.378672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.388149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.389892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.391463 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aafee999-f4cc-4afb-b3be-f7ebce869531 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1583 microversion: 2.42 time: 0.252450 Aug 29 15:44:30.392565 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 925/1850] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1583 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:44:30.397575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.398420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.405293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.405784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.406445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.407628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.408253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.409412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.476331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.487852 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1c79834c-e190-47aa-994b-e7a4ddc8e0a9 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1323 microversion: 2.1 time: 0.317294 Aug 29 15:44:30.500055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 926/1851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:30.509022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.518097 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c018d18f-04e1-49dd-b03c-1b37ffb8ce0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1220 microversion: 2.1 time: 0.124280 Aug 29 15:44:30.532537 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 926/1852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:30.570772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.571577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.577680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.578776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.579286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.581450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.581450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.581450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.676616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.677242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.687455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=86,nova_api:DELETE=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:30.696167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.696679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.697296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.698028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.698485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.701461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.874545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.899955 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee348c3b-688b-400b-b76a-918edd7d9456 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.333897 Aug 29 15:44:30.900853 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 927/1853] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:30.909504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:30.912490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:30.928399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.930844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.932670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.933921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:30.935965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:30.936580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:30.940504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:30.952397 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20533cc1-fe81-40fb-8822-34b85b100dd8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.283032 Aug 29 15:44:30.953732 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 927/1854] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:31.089002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.089954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.112889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.114604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.115392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.116362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.117226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.117948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.235802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.246006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.247980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.249429 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bdac536-a64b-47d3-9d6f-7da0e3fe7903 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.347201 Aug 29 15:44:31.250207 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 928/1855] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:30 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:31.294783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.303813 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2dec4c7-3853-4e6a-946b-48b28b42abef tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.219377 Aug 29 15:44:31.304639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 928/1856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.417088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.418544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.442639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.443295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.443923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.445294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.445294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.445653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.513916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.514665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.522426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.523372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.524019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.524907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.525515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.526762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.553143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.572389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.574441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.576571 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69b94647-106a-4c5b-82e5-c711c48e9dc4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1593 microversion: 2.42 time: 0.163853 Aug 29 15:44:31.577682 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 929/1857] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:31.598385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.599013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.608480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.610830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.611754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.612970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.613845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.614528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.713595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.723636 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5c48184a-a984-4595-a82b-997ea98c50e8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1323 microversion: 2.1 time: 0.213657 Aug 29 15:44:31.724655 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 929/1858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.744658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:31.754811 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b50c3ee0-c4e0-4d9f-81c6-70c15be9cb17 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1220 microversion: 2.1 time: 0.175079 Aug 29 15:44:31.756216 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 930/1859] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:31.920451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.921347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.928160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.928966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.929608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.930619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.931421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.931998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.952094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:31.975486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:31.976957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:31.984723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.993859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.994313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:31.995082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:31.995728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:31.996333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.138849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.153614 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ab7c9b39-79b9-48e3-8425-ac1cd6ee3e5b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.237006 Aug 29 15:44:32.157959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 930/1860] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:32.278775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.279740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.301107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.302625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.303949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.305035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.305833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.306495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.308509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.325415 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a9333f7-9881-48bb-853a-2974d300fb40 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.354122 Aug 29 15:44:32.326778 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 931/1861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:31 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:32.335533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.336525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.359165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.365343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.365967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.368036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.368787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.369409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.559317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.569630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.583009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.586994 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-69f5ad8a-f2c5-42e8-a619-3b093747437f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.315720 Aug 29 15:44:32.587824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 931/1862] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:32.622045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.622906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.636615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.637638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.638498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.642941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.643722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.645632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.738911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:32.753765 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32a7702b-ff36-448d-b5b9-c3d72883d4d9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.423623 Aug 29 15:44:32.754715 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 932/1863] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:32.765163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:32.766870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:32.786369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.787667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.788311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:32.789867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:32.790497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:32.791110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.011147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.030367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.033606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.036723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dcf52889-5b91-4966-a0ea-d24217d0eb27 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1660 microversion: 2.42 time: 0.432670 Aug 29 15:44:33.038499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 932/1864] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1660 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:33.058486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.059174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.071217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.071722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.072172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.073541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.074005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.076283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.207060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.219973 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca55be40-3718-469f-be5e-ea3e8cc9ce52 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1220 microversion: 2.1 time: 0.180042 Aug 29 15:44:33.220732 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 933/1865] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:33.228885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.229479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.247284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.263261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.264112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.265050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.266275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.270171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.377732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.400137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-05366947-023f-46bf-b45c-abd729b838f1 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1323 microversion: 2.1 time: 0.643909 Aug 29 15:44:33.419361 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 933/1866] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:32 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1323 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:33.429064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e8b4e806-4864-4276-80f9-843c65b3af69 req-f05938c2-b110-4da4-8075-726ad98eed0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e7bb8c-484f-4cc8-a02b-bbfdff92e1db", "name": "network-vif-plugged", "status": "completed", "tag": "ebd2914e-a315-4a97-ba1e-b991f741a72c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:33.454573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e8b4e806-4864-4276-80f9-843c65b3af69 req-f05938c2-b110-4da4-8075-726ad98eed0f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.456758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e8b4e806-4864-4276-80f9-843c65b3af69 req-f05938c2-b110-4da4-8075-726ad98eed0f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.458921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e8b4e806-4864-4276-80f9-843c65b3af69 req-f05938c2-b110-4da4-8075-726ad98eed0f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.487967 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e8b4e806-4864-4276-80f9-843c65b3af69 req-f05938c2-b110-4da4-8075-726ad98eed0f service nova] Creating event network-vif-plugged:ebd2914e-a315-4a97-ba1e-b991f741a72c for instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db on n-h1-836830-13 Aug 29 15:44:33.511296 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e8b4e806-4864-4276-80f9-843c65b3af69 req-f05938c2-b110-4da4-8075-726ad98eed0f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090392 Aug 29 15:44:33.517139 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 934/1867] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:33.675386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:33.712073 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-912a8b79-be1b-4eec-a11d-48bf3b11c71f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.486640 Aug 29 15:44:33.712883 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 934/1868] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:33.726306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:33.734824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:33.758643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.759607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.760518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:33.761979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:33.762828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:33.763576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.014821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.017225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.029256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.029809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.030550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.032294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.033248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.034008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.063629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:34.223975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.238173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.239722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.243441 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54746a39-b21a-4eef-92ad-f9ac20483eb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.527748 Aug 29 15:44:34.245204 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 935/1869] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:34.270910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.272901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.289535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.294905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.295649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.296878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.299689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.300130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.445750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.454303 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1642d8c9-eb67-4a19-aac6-1cfb7f698e07 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.935509 Aug 29 15:44:34.454954 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 935/1870] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:33 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:34.473194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.475750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.489721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.492627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.495936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.496977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.497658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.499501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.721104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.729959 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cfe29dbb-6d9f-46fd-b345-4b667af95856 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.470686 Aug 29 15:44:34.734627 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 936/1871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:34.743261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.744756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.768693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.769564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.770313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.771263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.771932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.772557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.906430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.915595 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67f50b62-74ca-460a-babf-56e9e9f38eb0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1220 microversion: 2.1 time: 0.179676 Aug 29 15:44:34.916684 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 937/1872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:34.921612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:34.923458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:34.930270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.931218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.933754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.936099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:34.937418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:34.939376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:34.978295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.995015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:34.998427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.001642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6f83c83-afe5-4167-938c-2a86dc5171aa tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1706 microversion: 2.42 time: 0.538990 Aug 29 15:44:35.002744 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 936/1873] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1706 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:35.026054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.033148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.041129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.041639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.042078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.042822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.043502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.044100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.269548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.279497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d2c5a87a-5e89-428d-b6f3-348ca3a06043 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1323 microversion: 2.1 time: 0.361577 Aug 29 15:44:35.280681 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 938/1874] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:34 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1323 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:35.286523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.291520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.306520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.317585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.318446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.319708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.320334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.320917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.391664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.403490 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6027c8e-4aff-416d-bb14-b7dfca5eb771 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.383890 Aug 29 15:44:35.404758 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 937/1875] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:35.478319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.479439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.504291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.505265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.506478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.507514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.508175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.508890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.681560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.702159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.710177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:35.712967 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3aa1d14-973f-4efc-b3bd-59f17d20484f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.430508 Aug 29 15:44:35.714850 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 939/1876] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:35.733860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0ec92d80-9558-4aad-8064-590c8d7e6e94 req-ed64b99c-dbc6-4a7b-bc31-5bd2ff8b42ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2924710b-a966-48bf-9d93-26705f6e999c", "name": "network-vif-plugged", "status": "completed", "tag": "3aa203c7-29ff-450c-aa85-ae77c7dff94e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:35.757360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0ec92d80-9558-4aad-8064-590c8d7e6e94 req-ed64b99c-dbc6-4a7b-bc31-5bd2ff8b42ad service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.757781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0ec92d80-9558-4aad-8064-590c8d7e6e94 req-ed64b99c-dbc6-4a7b-bc31-5bd2ff8b42ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.758192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0ec92d80-9558-4aad-8064-590c8d7e6e94 req-ed64b99c-dbc6-4a7b-bc31-5bd2ff8b42ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.786307 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0ec92d80-9558-4aad-8064-590c8d7e6e94 req-ed64b99c-dbc6-4a7b-bc31-5bd2ff8b42ad service nova] Creating event network-vif-plugged:3aa203c7-29ff-450c-aa85-ae77c7dff94e for instance 2924710b-a966-48bf-9d93-26705f6e999c on n-h2-836830-13 Aug 29 15:44:35.804919 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0ec92d80-9558-4aad-8064-590c8d7e6e94 req-ed64b99c-dbc6-4a7b-bc31-5bd2ff8b42ad service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087375 Aug 29 15:44:35.809859 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 940/1877] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:35.816080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:35.817009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:35.826121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.827880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.827880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:35.832756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:35.833288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:35.833740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.191248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.210293 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2fdeb294-8adf-4b37-b226-03006228a593 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.735649 Aug 29 15:44:36.212689 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 938/1878] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:44:36.223430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.224453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.231614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.232561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.233210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.234155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.235657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.236550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.551422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.568463 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57c62b50-46e4-4728-bedb-6f74cee56e79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1268 microversion: 2.1 time: 0.352698 Aug 29 15:44:36.582835 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 939/1879] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1268 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:36.582835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:36.582835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:36.599266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.599878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.600386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.604083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:36.605654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:36.606109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:36.977543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:36.992724 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d74f90d6-13e0-41cb-94b5-d6eefaf9fb29 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 1.178356 Aug 29 15:44:36.993957 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 941/1880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:35 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:37.004879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.009129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.024658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.030249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.031117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.032256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.033089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.033689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.255657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.269709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.280751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.283501 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac48a78b-cf96-4964-9e29-b0043b3a9741 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1752 microversion: 2.42 time: 0.710501 Aug 29 15:44:37.285422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 940/1881] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1752 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:37.297934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.299539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.315108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.315609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.316050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.316760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.317210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.317633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.392997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:37.480231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.492224 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-65451aff-f8a7-43bc-a6f6-40377d69df18 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 200 len: 1520 microversion: 2.1 time: 0.496890 Aug 29 15:44:37.500919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 942/1882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:36 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 1520 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:37.513216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.515332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.529511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.532542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.534276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.538115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.542465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.543316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.658602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.676504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd579e76-ea8a-4660-945d-18c5fda8ff70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1315 microversion: 2.1 time: 0.387688 Aug 29 15:44:37.677686 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 941/1883] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:37.692275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:37.695408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.704072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.704860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.705665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.707190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.708375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.709411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:37.926017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.941048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.946934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:37.948872 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-806ec70f-9fbb-470a-aa57-067b8b421a64 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.446534 Aug 29 15:44:37.951861 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 943/1884] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:37.971493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'action', calling method: .version_select at 0x7f32f033d280>, body: {"addFloatingIp": {"address": "172.25.0.108"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:37.979059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:37.997678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:37.998189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:37.998627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.004794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.006160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.007459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.210617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:44:38.213665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquired lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:44:38.257667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:38.270397 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38945c92-eab8-44e7-8b16-11ce1689edca tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.587571 Aug 29 15:44:38.271857 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 942/1885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:37 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:38.284186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:38.287463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:38.298144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.298617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.299074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.299789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:38.306797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:38.307285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:38.822860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:38.833061 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28ab8976-ff36-4d60-b63f-e3bb204b24a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1268 microversion: 2.1 time: 0.558871 Aug 29 15:44:38.833433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:38.837388 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 943/1886] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:38 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1268 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:38.856933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=31 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:39.084474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.085097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.096850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.097345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.097782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.098486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.102387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.103182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.272911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=20 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:39.537484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:39.555141 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e1ca428-8e7e-4edc-bf46-e70718d33eb7 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1305 microversion: 2.1 time: 0.712589 Aug 29 15:44:39.555908 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 944/1887] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:38 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1305 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:39.571685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-07d7f79b-d505-4264-ab2f-390ba08f8a4e req-246faab1-2bef-413f-a09c-6634145ce202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a905e81-88ea-4a7b-b20f-c32d13e84a8c", "name": "network-vif-deleted", "tag": "25c3e9e4-d572-4e78-8fcd-88394647708e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:39.595872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-07d7f79b-d505-4264-ab2f-390ba08f8a4e req-246faab1-2bef-413f-a09c-6634145ce202 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.597922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-07d7f79b-d505-4264-ab2f-390ba08f8a4e req-246faab1-2bef-413f-a09c-6634145ce202 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.598381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-07d7f79b-d505-4264-ab2f-390ba08f8a4e req-246faab1-2bef-413f-a09c-6634145ce202 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.624878 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-07d7f79b-d505-4264-ab2f-390ba08f8a4e req-246faab1-2bef-413f-a09c-6634145ce202 service nova] Creating event network-vif-deleted:25c3e9e4-d572-4e78-8fcd-88394647708e for instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c on n-h2-836830-13 Aug 29 15:44:39.633541 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-07d7f79b-d505-4264-ab2f-390ba08f8a4e req-246faab1-2bef-413f-a09c-6634145ce202 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076282 Aug 29 15:44:39.636119 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 945/1888] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:39.655440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:39.664932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:39.682724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.683377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.683715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:39.685388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:39.686234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:39.686844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.312965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.323537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.327555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.329173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b47871f6-f013-4717-a2b6-aa4bf26d1dd4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1844 microversion: 2.42 time: 0.689383 Aug 29 15:44:40.362050 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 946/1889] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:39 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1844 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:40.369312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.370923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.381947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.382710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.383378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.384254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.386275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.387206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.525508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:40.540161 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84a66d33-89b5-4be8-9f1e-d9866f43e1f8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1294 microversion: 2.1 time: 0.173781 Aug 29 15:44:40.551075 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 947/1890] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1294 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:40.557246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:40.557246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:40.577427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.578047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.579652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:40.580467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:40.580998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:40.581519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.154326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.164144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.166317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.168137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2aa0f275-6f69-4133-9d4f-5ffea0052c16 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.624768 Aug 29 15:44:41.184344 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 948/1891] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:40 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:41.191227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.200009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.207548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.210032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.210032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.210032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.211334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.212015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.366754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Building network info cache for instance {{(pid=129133) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:44:41.562440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.580361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-517f6208-4055-4190-9b51-c268e22f9489 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.390410 Aug 29 15:44:41.582460 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 949/1892] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:41.597072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.598179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.606608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.607662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.608651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.609881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.610570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.611201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.754185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:41.763774 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed7b316d-3d38-44cd-aa6d-bc886e295dce tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1274 microversion: 2.1 time: 0.176035 Aug 29 15:44:41.767682 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 950/1893] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:41.780716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-31e0199e-708f-40e9-b483-85f132f52bec req-86d733e3-0585-4819-b276-5669d0cb7bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "name": "network-vif-plugged", "status": "completed", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:41.814317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31e0199e-708f-40e9-b483-85f132f52bec req-86d733e3-0585-4819-b276-5669d0cb7bbc service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.821603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31e0199e-708f-40e9-b483-85f132f52bec req-86d733e3-0585-4819-b276-5669d0cb7bbc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.822340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31e0199e-708f-40e9-b483-85f132f52bec req-86d733e3-0585-4819-b276-5669d0cb7bbc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.839963 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-31e0199e-708f-40e9-b483-85f132f52bec req-86d733e3-0585-4819-b276-5669d0cb7bbc service nova] Creating event network-vif-plugged:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h2-836830-13 Aug 29 15:44:41.863572 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-31e0199e-708f-40e9-b483-85f132f52bec req-86d733e3-0585-4819-b276-5669d0cb7bbc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094652 Aug 29 15:44:41.864436 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 951/1894] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:41.869935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:41.872172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:41.886709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.889367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.892582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:41.893768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:41.894406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:41.899278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.575852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:42.587343 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2608c0f3-6b77-45c2-8a51-6db328729829 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1486 microversion: 2.1 time: 0.721383 Aug 29 15:44:42.587945 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 952/1895] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:41 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1486 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:42.604394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.608219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.622246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.622813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.630034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.630813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.632014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.632463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.645138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:42.884234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Updating instance_info_cache with network_info: [{"id": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4", "address": "fa:16:3e:39:44:1a", "network": {"id": "8ad56b1a-bc38-44b2-bfec-6f75ca507357", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1824525816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd150e4d120d4c6584c650e747abb6a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5328c8d-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129133) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:44:42.908686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Releasing lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:44:42.910220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79a68d7e-82ff-4865-a4d8-ebfa647442f8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action" status: 202 len: 0 microversion: 2.1 time: 4.955914 Aug 29 15:44:42.911630 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 944/1896] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:37 2022] POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action => generated 0 bytes in 4959 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:44:42.921271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:42.926388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:42.970801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.971562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.972154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:42.973312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:42.973965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:42.975247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.130438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.144447 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91eaf214-723e-4c06-9420-549075b49876 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1294 microversion: 2.1 time: 0.231473 Aug 29 15:44:43.159065 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 945/1897] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1294 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:43.159065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7e8af6c7-7e53-4dc0-9a8f-faeb362ddeb0 req-485c27e9-d1cd-4eee-98e9-401a5b002fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a08bf6-6f38-4ab4-80a3-d5c26296e83e", "tag": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:43.166704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7e8af6c7-7e53-4dc0-9a8f-faeb362ddeb0 req-485c27e9-d1cd-4eee-98e9-401a5b002fc9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.167739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7e8af6c7-7e53-4dc0-9a8f-faeb362ddeb0 req-485c27e9-d1cd-4eee-98e9-401a5b002fc9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.168905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7e8af6c7-7e53-4dc0-9a8f-faeb362ddeb0 req-485c27e9-d1cd-4eee-98e9-401a5b002fc9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.188840 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7e8af6c7-7e53-4dc0-9a8f-faeb362ddeb0 req-485c27e9-d1cd-4eee-98e9-401a5b002fc9 service nova] Creating event network-changed:c5328c8d-11b9-4c00-ac75-59302bfaa5d4 for instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e on n-h1-836830-13 Aug 29 15:44:43.194989 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7e8af6c7-7e53-4dc0-9a8f-faeb362ddeb0 req-485c27e9-d1cd-4eee-98e9-401a5b002fc9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047694 Aug 29 15:44:43.200553 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 946/1898] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:43.211348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.212563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.238189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.240300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.241548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.245957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.246967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.249424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.429927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.441276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.442731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.443935 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-da5df0b9-3e07-4742-b76e-88432febc6d1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1844 microversion: 2.42 time: 0.853731 Aug 29 15:44:43.444741 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 953/1899] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:42 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1844 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:43.478324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6b800f22-54fc-4b45-b264-d5c65c134f7b req-317df27d-3cb7-4c7b-9b78-809e066ef5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "1ff5da3d-8e87-4515-81d9-3b8ba6e95e80"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:43.505377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6b800f22-54fc-4b45-b264-d5c65c134f7b req-317df27d-3cb7-4c7b-9b78-809e066ef5b5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.505868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6b800f22-54fc-4b45-b264-d5c65c134f7b req-317df27d-3cb7-4c7b-9b78-809e066ef5b5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.506309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6b800f22-54fc-4b45-b264-d5c65c134f7b req-317df27d-3cb7-4c7b-9b78-809e066ef5b5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.536444 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6b800f22-54fc-4b45-b264-d5c65c134f7b req-317df27d-3cb7-4c7b-9b78-809e066ef5b5 service nova] Creating event network-changed:1ff5da3d-8e87-4515-81d9-3b8ba6e95e80 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:44:43.546080 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6b800f22-54fc-4b45-b264-d5c65c134f7b req-317df27d-3cb7-4c7b-9b78-809e066ef5b5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071341 Aug 29 15:44:43.547214 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 954/1900] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:43.552555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:43.553147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.570633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.571191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.571641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.572361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.572820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.573411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.687873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.707880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:43.715290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.721978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:43.725454 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7fb95e2d-7019-44f8-89ad-0cf28318f4e6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.520889 Aug 29 15:44:43.730387 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 947/1901] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:43.744067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-681408564"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:43.753356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:43.770991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.772067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.773437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:43.774667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:43.775311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:43.777222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.147662 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8ac6a443-9d62-4d61-9678-87056cb0f25f tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "POST /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c/action" status: 202 len: 0 microversion: 2.1 time: 0.415410 Aug 29 15:44:44.151718 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 948/1902] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:43 2022] POST /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:44:44.166305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:44.167055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.183151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.183151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.183151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.183151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.190798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.191309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.229931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.243081 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2bc6817d-37ab-47ad-a1dd-662f88daac60 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.694593 Aug 29 15:44:44.245342 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 955/1903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:43 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:44.278834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'action', calling method: .version_select at 0x7f32f02fa8b0>, body: {"addFloatingIp": {"address": "172.25.0.108"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:44.286598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:44.290209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:44.310370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.310881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.318408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.319778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:44.320281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:44.320729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:44.428289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "refresh_cache-28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:44:44.429262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquired lock "refresh_cache-28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:44:44.966379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:44.980808 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bd078cf-ea74-4d80-811a-3be946ff5c9b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.827647 Aug 29 15:44:44.982042 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 949/1904] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:44 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.120217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98985c86-3af9-403f-b41f-bb742b9c8712 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32edc08b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1330189978", "description": "tempest-description-678042480"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:45.577013 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98985c86-3af9-403f-b41f-bb742b9c8712 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.581095 Aug 29 15:44:45.577639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 950/1905] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:44:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:45.592823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31e9e1f6-57a0-4184-91d1-cd6e4b606e54 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edba98b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.662347 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31e9e1f6-57a0-4184-91d1-cd6e4b606e54 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d" status: 200 len: 1413 microversion: 2.1 time: 0.073016 Aug 29 15:44:45.663283 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 951/1906] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.668132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.668735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.676162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.676662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.677108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.677794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.678245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.678663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.764207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:45.774814 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5bf0fb43-7fd7-4af7-9229-20f605581100 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1294 microversion: 2.1 time: 0.109476 Aug 29 15:44:45.775840 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 952/1907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:45.780401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:45.781097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:45.787854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.788561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.789376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:45.790326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:45.791065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:45.791644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.011757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.022315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.023802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.025212 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b0c0949-9ee0-4f07-8434-11251a104f01 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1865 microversion: 2.42 time: 0.248368 Aug 29 15:44:46.026501 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 953/1908] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:45 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1865 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:46.032052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.032854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.039760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.040511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.041161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.042062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.042685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.043305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.217019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.228993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.230561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.231860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-44affcf9-5144-48a1-bf27-6d52fda811b7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.204004 Aug 29 15:44:46.232432 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 954/1909] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:46.237414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.238027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.244864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.245353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.245789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.246476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.246927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.247449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.414192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:46.422926 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b19d269-57a3-459b-8e77-8c9ddfa7ae00 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1312 microversion: 2.1 time: 0.189440 Aug 29 15:44:46.424078 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 955/1910] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:46.429258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc02eb57-870d-4f6b-b350-913247e8bd19 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32edd05280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-153689607", "description": "tempest-description-467903499"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:46.636282 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc02eb57-870d-4f6b-b350-913247e8bd19 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.210886 Aug 29 15:44:46.650801 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 956/1911] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:44:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:46.659488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-152401df-bf48-4f68-a1e4-6ac5f03a5eb1 req-b1cb857d-3566-487d-8153-13cd0373029d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "c9522880-8b9a-466b-815f-947dc37f0279"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:46.681194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-152401df-bf48-4f68-a1e4-6ac5f03a5eb1 req-b1cb857d-3566-487d-8153-13cd0373029d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.685591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-152401df-bf48-4f68-a1e4-6ac5f03a5eb1 req-b1cb857d-3566-487d-8153-13cd0373029d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.686311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-152401df-bf48-4f68-a1e4-6ac5f03a5eb1 req-b1cb857d-3566-487d-8153-13cd0373029d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.728084 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-152401df-bf48-4f68-a1e4-6ac5f03a5eb1 req-b1cb857d-3566-487d-8153-13cd0373029d service nova] Creating event network-changed:c9522880-8b9a-466b-815f-947dc37f0279 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:44:46.750163 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-152401df-bf48-4f68-a1e4-6ac5f03a5eb1 req-b1cb857d-3566-487d-8153-13cd0373029d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097340 Aug 29 15:44:46.751517 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 957/1912] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:46.756924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-837bb2f2-cd62-4a62-80d4-d3d7307b2832 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edbfc040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.866942 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-837bb2f2-cd62-4a62-80d4-d3d7307b2832 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d" status: 200 len: 1413 microversion: 2.1 time: 0.114010 Aug 29 15:44:46.878971 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 958/1913] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:46.891446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:46.894849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:46.903072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.906047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.906784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:46.907924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:46.910086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:46.910696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.195435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:47.207577 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1bbfc3ec-9edd-421a-be69-665648a4bad6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.327039 Aug 29 15:44:47.212090 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 959/1914] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:46 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:47.227433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-798911737", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "d0e545d3-95a8-49be-9c49-585beb9d4250"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:47.335765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] validate_networks() for [('d0e545d3-95a8-49be-9c49-585beb9d4250', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:47.877998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:47.879380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:47.880061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:47.880856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:47.881487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:47.899312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.901861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.903010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.904073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:47.906362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:47.907413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:47.945721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Getting quotas for project a27922448d754caea1e19340b11bfd64. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:47.951560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Getting quotas for user a9fcf93e985b4a09a67b719508d8f812 and project a27922448d754caea1e19340b11bfd64. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:47.964673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:47.967003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:48.019255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e6a381b-bc0b-4dcb-81f9-fea9742125e1 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805816 Aug 29 15:44:48.021398 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 960/1915] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:48.026430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.027160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.035400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.036137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.036571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.037273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.037745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.038166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.075182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.076040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.076727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.077509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'fault' on Instance uuid 7a905e81-88ea-4a7b-b20f-c32d13e84a8c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:44:48.150934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.160786 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-22a70bc7-f85a-466c-b12e-e95d2e6ded29 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 200 len: 1305 microversion: 2.1 time: 0.137769 Aug 29 15:44:48.161393 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 961/1916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:48.165944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48448fcf-4df7-4307-8145-ff68c68b0464 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edb6a1f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.366017 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-48448fcf-4df7-4307-8145-ff68c68b0464 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d" status: 204 len: 0 microversion: 2.1 time: 0.203419 Aug 29 15:44:48.367497 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 962/1917] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:48 2022] DELETE /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:44:48.373500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.374176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.384153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.384641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.385065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.386249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.386770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.387259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.730436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.751738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.756149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:48.758099 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ef79a3a-a3cb-40a4-baa7-f35342988853 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1886 microversion: 2.42 time: 0.389287 Aug 29 15:44:48.773868 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 963/1918] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1886 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:48.800954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:48.801662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:48.808694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.810544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.811379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:48.812826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:48.813606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:48.814663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.101284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.115142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.116848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.118138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e88d39e0-95cf-48d6-b292-26b0663cd462 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.342546 Aug 29 15:44:49.133009 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 964/1919] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:48 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:49.143830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.144690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.157842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.158859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.161674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.162741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.163658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.164422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.363006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.371885 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0af03289-2c5f-4f94-b77d-3fd1591ebac9 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1461 microversion: 2.1 time: 0.236746 Aug 29 15:44:49.373799 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 965/1920] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1461 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:49.380104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.381144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.388339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.389097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.389649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.391918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.392456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.393035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.536900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.549720 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a5f6011-9322-458f-a2bd-df7ae596e6d4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1267 microversion: 2.1 time: 0.173954 Aug 29 15:44:49.562822 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 966/1921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:49.562822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.562822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.573887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.575604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.575977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.580253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.583229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.583750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.767542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:49.780481 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd400567-9cb0-44b4-b54d-f6e08c1f300c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.228434 Aug 29 15:44:49.781849 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 967/1922] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:49.786901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e94d3372-edab-4214-92e6-89613ae6937c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edb7e160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.813316 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e94d3372-edab-4214-92e6-89613ae6937c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Image not found. Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e94d3372-edab-4214-92e6-89613ae6937c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d HTTP/1.1 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: exception: Image not found. Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5ebd92b6-fb9d-437f-8295-cee86671ac9d'} Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5ebd92b6-fb9d-437f-8295-cee86671ac9d Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:44:49.815611 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ebd92b6-fb9d-437f-8295-cee86671ac9d could not be found. Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e94d3372-edab-4214-92e6-89613ae6937c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Image not found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e94d3372-edab-4214-92e6-89613ae6937c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d" status: 404 len: 62 microversion: 2.1 time: 0.034181 Aug 29 15:44:49.822527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 968/1923] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:44:49.834504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f3cd53fc-9435-4e10-80a3-0aec7b2bf463 req-4cb8feac-d7cc-4cac-97f0-1139108f8c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "19608bdd-c953-4f2d-93c6-86f485a25fc3"}, {"name": "network-changed", "server_uuid": "742dab4b-1817-4408-b02f-3aa64ab6440e", "tag": "4a22f332-ddc6-4cbb-89f0-4cc50b419e63"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:49.842702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3cd53fc-9435-4e10-80a3-0aec7b2bf463 req-4cb8feac-d7cc-4cac-97f0-1139108f8c5b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.845964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3cd53fc-9435-4e10-80a3-0aec7b2bf463 req-4cb8feac-d7cc-4cac-97f0-1139108f8c5b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.846347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3cd53fc-9435-4e10-80a3-0aec7b2bf463 req-4cb8feac-d7cc-4cac-97f0-1139108f8c5b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.865144 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f3cd53fc-9435-4e10-80a3-0aec7b2bf463 req-4cb8feac-d7cc-4cac-97f0-1139108f8c5b service nova] Creating event network-changed:19608bdd-c953-4f2d-93c6-86f485a25fc3 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:44:49.867063 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f3cd53fc-9435-4e10-80a3-0aec7b2bf463 req-4cb8feac-d7cc-4cac-97f0-1139108f8c5b service nova] Creating event network-changed:4a22f332-ddc6-4cbb-89f0-4cc50b419e63 for instance 742dab4b-1817-4408-b02f-3aa64ab6440e on n-h2-836830-13 Aug 29 15:44:49.877786 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f3cd53fc-9435-4e10-80a3-0aec7b2bf463 req-4cb8feac-d7cc-4cac-97f0-1139108f8c5b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058444 Aug 29 15:44:49.878926 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 969/1924] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:49.885279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.885989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.894265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.894756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.895755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.897273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.897815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.898421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.919726 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c HTTP/1.1 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '7a905e81-88ea-4a7b-b20f-c32d13e84a8c'} Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:49.922331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bbcea4a-8dfd-4e2a-b100-52e810b4614a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 404 len: 111 microversion: 2.1 time: 0.043246 Aug 29 15:44:49.927472 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 970/1925] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:44:49.933108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:49.933108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:49.937782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.938224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.939470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.939824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:49.940318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:49.940941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:49.958916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:50.156977 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aba2c4f1-ce8b-49d1-bd37-8ab119a08923 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1614 microversion: 2.1 time: 0.230370 Aug 29 15:44:50.157951 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 971/1926] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:49 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1614 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:50.165105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:50.168611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:50.181352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.181845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.182288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:50.186648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:50.187694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:50.191770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.235860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.256500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.288054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.296029 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-db373a3f-5f20-4885-b27e-32d47712c956 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1886 microversion: 2.42 time: 1.137027 Aug 29 15:44:51.317390 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 972/1927] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:50 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1886 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:51.337805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:51.338781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:51.348661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.349637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.350309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.351259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:51.352665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:51.353311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:51.612767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:51.620922 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45ca310d-c33a-47c0-9403-e6fe948f1855 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1504 microversion: 2.1 time: 0.302040 Aug 29 15:44:51.631773 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 973/1928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:51 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:51.642488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2144026303", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9bbf042d-13bc-4426-83e8-c7e73123f015"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:51.652212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.network.neutron [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] re-assign floating IP 172.25.0.108 from instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e Aug 29 15:44:51.720055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] validate_networks() for [('9bbf042d-13bc-4426-83e8-c7e73123f015', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:44:51.728162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Building network info cache for instance {{(pid=129132) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:44:52.727352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:44:52.728729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:44:52.729764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:44:52.730643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:44:52.732427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:44:52.740307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:52.752817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.753996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.754785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.755805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:52.756605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:52.757666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:52.825780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:44:52.850492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for user 853f8300f9bb403b9cea4834c5a1edcb and project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:44:52.901031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:44:52.914309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:44:53.020943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88a1e5b4-a3be-47a5-b958-43407fc90935 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388128 Aug 29 15:44:53.031265 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 974/1929] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:44:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:44:53.036758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:53.037390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.052954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.053432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.054057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.055139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.055755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.076057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.089474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Updating instance_info_cache with network_info: [{"id": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4", "address": "fa:16:3e:39:44:1a", "network": {"id": "8ad56b1a-bc38-44b2-bfec-6f75ca507357", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1824525816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd150e4d120d4c6584c650e747abb6a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5328c8d-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129132) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:44:53.115435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Building network info cache for instance {{(pid=129132) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:44:53.402365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.419218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.421165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.425564 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ad18417-4f25-4327-a9de-e8cdc03e8150 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.392795 Aug 29 15:44:53.429589 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 975/1930] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:53 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:53.437582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:53.439869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:53.452351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.453190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.453856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.455172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:53.456589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:53.457988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:53.497142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'daf5d8de71074057871a3091617bda2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4d01c4eddd43e09ec8e7efc2bdc2a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:53.498383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] flavor_id is None. Assuming migration. {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 15:44:53.499136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 15:44:54.028511 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-599c9a13-e1d3-48e2-9cc3-69f7dfd3e2e1 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea/action" status: 202 len: 0 microversion: 2.1 time: 0.597066 Aug 29 15:44:54.034429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 976/1931] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:53 2022] POST /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:44:54.042839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.043862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.053502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.054444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.055719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.056878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.057553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.058621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.252192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Updating instance_info_cache with network_info: [{"id": "ebd2914e-a315-4a97-ba1e-b991f741a72c", "address": "fa:16:3e:07:97:f9", "network": {"id": "8ad56b1a-bc38-44b2-bfec-6f75ca507357", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1824525816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd150e4d120d4c6584c650e747abb6a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapebd2914e-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129132) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:44:54.273279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Releasing lock "refresh_cache-28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:44:54.274334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5154a512-30ce-4453-8b2c-037e9c05dbf0 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db/action" status: 202 len: 0 microversion: 2.1 time: 10.016480 Aug 29 15:44:54.282375 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 956/1932] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:44 2022] POST /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db/action => generated 0 bytes in 10035 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:44:54.305538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4ad91d9e-4776-49b8-94b4-e46d02053637 req-69e25b96-86d9-4d29-8b1d-a5476683c341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c69654a-6a13-4653-9c37-04df93393b26", "name": "network-vif-plugged", "status": "completed", "tag": "b976629e-c63c-432c-89e0-f9d9bfd35a55"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:54.330081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:54.333482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4ad91d9e-4776-49b8-94b4-e46d02053637 req-69e25b96-86d9-4d29-8b1d-a5476683c341 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.333976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4ad91d9e-4776-49b8-94b4-e46d02053637 req-69e25b96-86d9-4d29-8b1d-a5476683c341 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.334405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4ad91d9e-4776-49b8-94b4-e46d02053637 req-69e25b96-86d9-4d29-8b1d-a5476683c341 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.367766 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4ad91d9e-4776-49b8-94b4-e46d02053637 req-69e25b96-86d9-4d29-8b1d-a5476683c341 service nova] Creating event network-vif-plugged:b976629e-c63c-432c-89e0-f9d9bfd35a55 for instance 2c69654a-6a13-4653-9c37-04df93393b26 on n-h2-836830-13 Aug 29 15:44:54.384529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4ad91d9e-4776-49b8-94b4-e46d02053637 req-69e25b96-86d9-4d29-8b1d-a5476683c341 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099145 Aug 29 15:44:54.385315 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 957/1933] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:54.408784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.410846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.413240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.424036 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b923a20b-e927-497e-a884-dbc5904d438e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1315 microversion: 2.1 time: 0.385300 Aug 29 15:44:54.426078 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 977/1934] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:54.426765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.432976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.433493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.434239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.434716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.439375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.444814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "e65b0349-4179-4165-9636-d17fd8a0a033"}, {"name": "network-changed", "server_uuid": "17a08bf6-6f38-4ab4-80a3-d5c26296e83e", "tag": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4"}, {"name": "network-changed", "server_uuid": "28e7bb8c-484f-4cc8-a02b-bbfdff92e1db", "tag": "ebd2914e-a315-4a97-ba1e-b991f741a72c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:54.488551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.489836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.490782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.522595 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] Creating event network-changed:e65b0349-4179-4165-9636-d17fd8a0a033 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:44:54.523928 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] Creating event network-changed:c5328c8d-11b9-4c00-ac75-59302bfaa5d4 for instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e on n-h1-836830-13 Aug 29 15:44:54.524538 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] Creating event network-changed:ebd2914e-a315-4a97-ba1e-b991f741a72c for instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db on n-h1-836830-13 Aug 29 15:44:54.533947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4ceb7600-87f8-46ba-857c-170b09ba26f3 req-12fae833-2f16-492d-94b9-1786e069c3a0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.104702 Aug 29 15:44:54.535095 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 978/1935] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:54.540889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.541937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.558885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.559526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.560027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.560817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.561381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.562189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.824305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:54.840742 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e43b6d8-40ee-4b11-9dc9-75f9fee2d5c0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.452098 Aug 29 15:44:54.841358 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 958/1936] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:54.872276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:54.875721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:54.885895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.886396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.886831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:54.887557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:54.888183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:54.888617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.022455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.035737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.037574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.039627 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57fae527-d8b8-4b2c-96e9-f742b8216cda tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1886 microversion: 2.42 time: 0.503224 Aug 29 15:44:55.040187 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 979/1937] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1886 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:55.045253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.045836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.053412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.053897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.054594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.055764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.056636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.057211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.108605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.117790 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1f47742-a5a3-4fec-9261-85525dfe0c53 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1504 microversion: 2.1 time: 0.263566 Aug 29 15:44:55.118214 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 959/1938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:54 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:55.123637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3dfd8926-2c71-4eeb-9f34-8f4a1c66d4d8 req-dcadcc50-04bc-4345-9c43-6f0ce1830e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c38b478-d0f1-43a7-9258-2e2f07800774", "tag": "a053a1d8-5fcb-4d22-ab96-a10b16caa325"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:55.141377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.144017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3dfd8926-2c71-4eeb-9f34-8f4a1c66d4d8 req-dcadcc50-04bc-4345-9c43-6f0ce1830e01 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.144574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3dfd8926-2c71-4eeb-9f34-8f4a1c66d4d8 req-dcadcc50-04bc-4345-9c43-6f0ce1830e01 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.145259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3dfd8926-2c71-4eeb-9f34-8f4a1c66d4d8 req-dcadcc50-04bc-4345-9c43-6f0ce1830e01 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.150936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ac0855d-508a-44e4-b511-dba618b1d69e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1267 microversion: 2.1 time: 0.109596 Aug 29 15:44:55.151628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 980/1939] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:55.157139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.157832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.171158 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3dfd8926-2c71-4eeb-9f34-8f4a1c66d4d8 req-dcadcc50-04bc-4345-9c43-6f0ce1830e01 service nova] Creating event network-changed:a053a1d8-5fcb-4d22-ab96-a10b16caa325 for instance 9c38b478-d0f1-43a7-9258-2e2f07800774 on n-h1-836830-13 Aug 29 15:44:55.174733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.175870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.176879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.177930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3dfd8926-2c71-4eeb-9f34-8f4a1c66d4d8 req-dcadcc50-04bc-4345-9c43-6f0ce1830e01 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058294 Aug 29 15:44:55.178840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.179503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 960/1940] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:55.184113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.184661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.185088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'action', calling method: .version_select at 0x7f32f02fa940>, body: {"removeFloatingIp": {"address": "172.25.0.108"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:55.568981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.581267 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0401f043-7836-4cb4-ae0d-21d0a701adde tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1470 microversion: 2.1 time: 0.428486 Aug 29 15:44:55.581896 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 981/1941] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1470 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:55.588337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.590610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.600677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.603821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.606417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.609191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.610433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.612009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.767635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.776472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.777944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.779095 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c13ac1e-7e6e-4eaa-a92a-89c18152e70b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.196067 Aug 29 15:44:55.779659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 982/1942] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:55.784074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.784680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.792214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.792966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.793507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.795013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.795644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.796101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.883535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.891511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.892333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.892826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.893658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.894231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.894778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.949505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:55.957482 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f1d9591-d658-4b2f-815c-09c1f2953f04 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1315 microversion: 2.1 time: 0.176849 Aug 29 15:44:55.958062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 983/1943] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:55.962568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:55.963202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:55.969379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.969534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.969865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:55.970557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:55.971014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:55.971464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.123575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.133788 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c6c196f7-9046-4f95-a0f8-74f8598b4060 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.173385 Aug 29 15:44:56.133788 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 984/1944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:55 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.138143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.138736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.145410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.145894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.146319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.146995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.147459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.147873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.337876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.349593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.350947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.352133 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02147d00-2234-412f-97e0-ff930ca0ec0e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.217510 Aug 29 15:44:56.367826 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 985/1945] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:56.374309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.375211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.381616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.382108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.382726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.383267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.383716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.384188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.441570 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] HTTP exception thrown: Floating IP 172.25.0.108 is not associated with instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e. Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Request method failure captured: Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action HTTP/1.1 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 49 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN6sk77of2skLPg9myVWR49uSF9YZ0eJrkmr9y7W_uo80L3MMlziPY4ccEXWT9hcMUK-yfs3c-8HPQIINo04BvFEJyMoPRNA5MLSEpjvIRefdUcmFv8_59XnLxKIa_YvVs1Q8nI3bvAuuHcx6Bn3_6NktaW5OIrAqQGg2FH17RMh8T0 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bd150e4d120d4c6584c650e747abb6a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bd150e4d120d4c6584c650e747abb6a4"}]}] Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 0c19d2e9ffa64e7586e35035176f1c26 Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: {"removeFloatingIp": {"address": "172.25.0.108"}} Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: exception: Floating IP 172.25.0.108 is not associated with instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e. Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '17a08bf6-6f38-4ab4-80a3-d5c26296e83e', 'body': {'removeFloatingIp': {'address': '172.25.0.108'}}} Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.108 is not associated with instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e. Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.108 is not associated with instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e. Aug 29 15:44:56.444290 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:44:56.451084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Returning 409 to user: Floating IP 172.25.0.108 is not associated with instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:44:56.453628 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0cd39820-2950-4d7b-aa47-7fba585a92ec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action" status: 409 len: 146 microversion: 2.1 time: 1.272527 Aug 29 15:44:56.457711 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 961/1946] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:55 2022] POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action => generated 146 bytes in 1276 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:44:56.463116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.464320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.474966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.476381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.478015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.479545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.480092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.480770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.539628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.547990 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7fed031d-9c38-4b0b-a650-ad3e0ad3a4b0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1504 microversion: 2.1 time: 0.178857 Aug 29 15:44:56.548762 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 986/1947] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.553249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-40458670-b781-4fa5-ba1b-147281ec13f2 req-56b5b1ed-b076-4af3-bf49-bcffe756b37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2924710b-a966-48bf-9d93-26705f6e999c", "name": "network-vif-plugged", "status": "completed", "tag": "3aa203c7-29ff-450c-aa85-ae77c7dff94e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:56.564211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-40458670-b781-4fa5-ba1b-147281ec13f2 req-56b5b1ed-b076-4af3-bf49-bcffe756b37d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.564652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-40458670-b781-4fa5-ba1b-147281ec13f2 req-56b5b1ed-b076-4af3-bf49-bcffe756b37d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.565166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-40458670-b781-4fa5-ba1b-147281ec13f2 req-56b5b1ed-b076-4af3-bf49-bcffe756b37d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.579641 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-40458670-b781-4fa5-ba1b-147281ec13f2 req-56b5b1ed-b076-4af3-bf49-bcffe756b37d service nova] Creating event network-vif-plugged:3aa203c7-29ff-450c-aa85-ae77c7dff94e for instance 2924710b-a966-48bf-9d93-26705f6e999c on n-h2-836830-13 Aug 29 15:44:56.582574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.585344 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-40458670-b781-4fa5-ba1b-147281ec13f2 req-56b5b1ed-b076-4af3-bf49-bcffe756b37d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035438 Aug 29 15:44:56.585975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 987/1948] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:56.592620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'action', calling method: .version_select at 0x7f32f033d310>, body: {"removeFloatingIp": {"address": "172.25.0.108"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:56.597277 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b3d1580-47cb-4ddf-ab3a-e9ec8ac7f0d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1273 microversion: 2.1 time: 0.139960 Aug 29 15:44:56.612579 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 962/1949] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.617737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.618362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.625523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.625956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.626579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.627491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.627955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.628385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.773679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.780074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.781254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.781847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.782621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.783174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.783596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.798578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:56.847951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:56.858621 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba659dc0-47f5-49b7-a3fa-a2a3a478f40e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1470 microversion: 2.1 time: 0.244727 Aug 29 15:44:56.860463 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 963/1950] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:56.866122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6770b9d4-0c29-4c97-ac46-d7e5b88e77db req-288a6f51-4534-4cbb-b6cf-f6a8dc693966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "ecd0e964-9c43-41f4-b26c-045a5a86c754"}, {"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "d1de827f-efc1-4f79-bef5-1c199a88d94d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:44:56.878797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6770b9d4-0c29-4c97-ac46-d7e5b88e77db req-288a6f51-4534-4cbb-b6cf-f6a8dc693966 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.879577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6770b9d4-0c29-4c97-ac46-d7e5b88e77db req-288a6f51-4534-4cbb-b6cf-f6a8dc693966 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.881355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6770b9d4-0c29-4c97-ac46-d7e5b88e77db req-288a6f51-4534-4cbb-b6cf-f6a8dc693966 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.894366 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6770b9d4-0c29-4c97-ac46-d7e5b88e77db req-288a6f51-4534-4cbb-b6cf-f6a8dc693966 service nova] Creating event network-changed:ecd0e964-9c43-41f4-b26c-045a5a86c754 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:44:56.896069 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6770b9d4-0c29-4c97-ac46-d7e5b88e77db req-288a6f51-4534-4cbb-b6cf-f6a8dc693966 service nova] Creating event network-changed:d1de827f-efc1-4f79-bef5-1c199a88d94d for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:44:56.901757 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6770b9d4-0c29-4c97-ac46-d7e5b88e77db req-288a6f51-4534-4cbb-b6cf-f6a8dc693966 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039873 Aug 29 15:44:56.902929 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 964/1951] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:44:56.909775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:56.910723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:56.917758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.919304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.920488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:56.922150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:56.923088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:56.923730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.241570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "refresh_cache-28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:44:57.242146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquired lock "refresh_cache-28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:44:57.368165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.380211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.384194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.385396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99fb8f89-d6f7-4e90-a3b9-2c2878c07093 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1280 microversion: 2.25 time: 0.481166 Aug 29 15:44:57.403068 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 965/1952] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:56 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1280 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:57.403792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.404482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.413331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.414100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.414752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.417316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.418019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.418643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.742274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:57.756055 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-564631e5-75e7-463f-8361-4b4fb6617dfb tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1315 microversion: 2.1 time: 0.362194 Aug 29 15:44:57.757002 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 966/1953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:57.762288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:57.762954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:57.770201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.770695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.771233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:57.771935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:57.772440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:57.772863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.108670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.118966 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71261ec7-dd23-4877-9449-37df4b8d0709 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.360875 Aug 29 15:44:58.132679 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 967/1954] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:57 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:58.137668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:58.138318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:58.147172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.147747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.148257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.149329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.149856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.150348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.726173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.746620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.750840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:58.755062 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-37bbd880-6d97-464d-b5f1-66dd2570d3b6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.633681 Aug 29 15:44:58.758856 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 968/1955] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:44:58 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:44:58.763908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:58.770307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:58.789603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.790544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.791248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:58.792223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:58.797672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:58.798206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.096470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Building network info cache for instance {{(pid=129133) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:44:59.595620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:44:59.612220 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c934df0-7f21-4b3d-a82f-362f091c22fb tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1504 microversion: 2.1 time: 0.851939 Aug 29 15:44:59.626839 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 969/1956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:58 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1504 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:44:59.632445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:59.633377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.639679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.641536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.642267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.643319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:44:59.644000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:44:59.644662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:44:59.666454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:44:59.972519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Updating instance_info_cache with network_info: [{"id": "ebd2914e-a315-4a97-ba1e-b991f741a72c", "address": "fa:16:3e:07:97:f9", "network": {"id": "8ad56b1a-bc38-44b2-bfec-6f75ca507357", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1824525816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd150e4d120d4c6584c650e747abb6a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapebd2914e-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129133) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:44:59.982044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Releasing lock "refresh_cache-28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:44:59.982965 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e46d22e-0b5f-474c-b762-969ee056df1b tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db/action" status: 202 len: 0 microversion: 2.1 time: 3.395731 Aug 29 15:44:59.985188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 988/1957] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:44:56 2022] POST /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db/action => generated 0 bytes in 3399 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:44:59.990615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:44:59.991451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:44:59.998825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.000520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.001069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.001863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.002624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.003152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.045663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.055386 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd321ab5-ba77-4944-8e23-de8fa45ad7e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1315 microversion: 2.1 time: 0.427062 Aug 29 15:45:00.056716 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 970/1958] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:59 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.061637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.062825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.071116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.071949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.077261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.078152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.078763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.079455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.208439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.221524 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a2ae551-cf3e-46c7-84db-6cd59608844a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1470 microversion: 2.1 time: 0.234923 Aug 29 15:45:00.222975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 989/1959] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:44:59 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.228533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.230401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.241384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.242328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.243037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.244145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.244662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.245411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.414710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.425842 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1dbbbb95-f7c5-4c6a-9492-c9cbc341b033 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1315 microversion: 2.1 time: 0.201062 Aug 29 15:45:00.426574 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 990/1960] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.432573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-781d2fde-4b09-4273-a04e-18f84dbfa0c4 req-7d4b45b3-2de8-49c3-a3c4-873313b3576a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "3d078389-4765-402b-87e7-e088b9a2e62a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:00.445714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-781d2fde-4b09-4273-a04e-18f84dbfa0c4 req-7d4b45b3-2de8-49c3-a3c4-873313b3576a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.446941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-781d2fde-4b09-4273-a04e-18f84dbfa0c4 req-7d4b45b3-2de8-49c3-a3c4-873313b3576a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.447656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-781d2fde-4b09-4273-a04e-18f84dbfa0c4 req-7d4b45b3-2de8-49c3-a3c4-873313b3576a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.461397 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-781d2fde-4b09-4273-a04e-18f84dbfa0c4 req-7d4b45b3-2de8-49c3-a3c4-873313b3576a service nova] Creating event network-changed:3d078389-4765-402b-87e7-e088b9a2e62a for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:00.466965 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-781d2fde-4b09-4273-a04e-18f84dbfa0c4 req-7d4b45b3-2de8-49c3-a3c4-873313b3576a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038584 Aug 29 15:45:00.467707 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 991/1961] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:00.473071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-97e8816c-cc2c-4998-9c8b-459afe3f301b req-a91bb996-921d-417b-80b5-d65dc5a59b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e7bb8c-484f-4cc8-a02b-bbfdff92e1db", "tag": "ebd2914e-a315-4a97-ba1e-b991f741a72c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:00.485009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-97e8816c-cc2c-4998-9c8b-459afe3f301b req-a91bb996-921d-417b-80b5-d65dc5a59b4b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.485531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-97e8816c-cc2c-4998-9c8b-459afe3f301b req-a91bb996-921d-417b-80b5-d65dc5a59b4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.486459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-97e8816c-cc2c-4998-9c8b-459afe3f301b req-a91bb996-921d-417b-80b5-d65dc5a59b4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.506857 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-97e8816c-cc2c-4998-9c8b-459afe3f301b req-a91bb996-921d-417b-80b5-d65dc5a59b4b service nova] Creating event network-changed:ebd2914e-a315-4a97-ba1e-b991f741a72c for instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db on n-h1-836830-13 Aug 29 15:45:00.512941 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-97e8816c-cc2c-4998-9c8b-459afe3f301b req-a91bb996-921d-417b-80b5-d65dc5a59b4b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043828 Aug 29 15:45:00.514205 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 992/1962] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:00.520304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.521239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.529229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.529992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.530653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.531928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.532559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.533153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.736159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.749104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.757895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.759630 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30b11421-720a-4d58-98e9-f18fc848992e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1477 microversion: 2.25 time: 0.701735 Aug 29 15:45:00.780934 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 971/1963] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1477 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:00.789498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.793084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.811042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.812469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.813877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.814892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.815740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.816407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.863103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:00.879885 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ae22a32-cf5a-40fe-971e-ac5010b0c099 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.358630 Aug 29 15:45:00.884621 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 993/1964] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:00.899743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:00.900356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:00.913405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.913914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.915515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.917171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:00.917638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:00.918327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:00.973686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:01.074801 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d0fc7d8-5dab-4e13-8920-4104950e0097 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "DELETE /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 204 len: 0 microversion: 2.1 time: 0.188651 Aug 29 15:45:01.078742 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 994/1965] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:00 2022] DELETE /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:01.088334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-cfa129b2-f12e-424f-b99b-08c903550434 req-5d5e88f5-fb56-45b0-af77-087bce065321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742dab4b-1817-4408-b02f-3aa64ab6440e", "name": "network-vif-plugged", "status": "completed", "tag": "4a22f332-ddc6-4cbb-89f0-4cc50b419e63"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:01.109096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cfa129b2-f12e-424f-b99b-08c903550434 req-5d5e88f5-fb56-45b0-af77-087bce065321 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.109579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cfa129b2-f12e-424f-b99b-08c903550434 req-5d5e88f5-fb56-45b0-af77-087bce065321 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.110002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cfa129b2-f12e-424f-b99b-08c903550434 req-5d5e88f5-fb56-45b0-af77-087bce065321 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.121771 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-cfa129b2-f12e-424f-b99b-08c903550434 req-5d5e88f5-fb56-45b0-af77-087bce065321 service nova] Creating event network-vif-plugged:4a22f332-ddc6-4cbb-89f0-4cc50b419e63 for instance 742dab4b-1817-4408-b02f-3aa64ab6440e on n-h2-836830-13 Aug 29 15:45:01.126977 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-cfa129b2-f12e-424f-b99b-08c903550434 req-5d5e88f5-fb56-45b0-af77-087bce065321 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046415 Aug 29 15:45:01.127594 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 995/1966] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:01.132869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.133556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.139767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.140798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.141236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.141924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.142373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.142793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.288522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.297325 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-527f7344-1d20-41b1-8d56-dded9d99a9c3 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1486 microversion: 2.1 time: 0.167445 Aug 29 15:45:01.298212 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 996/1967] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1486 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:01.325554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.339996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.341895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.343747 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b3fe46b-4afa-4691-ac7f-d0f3d959e1d6 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.559806 Aug 29 15:45:01.344791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 972/1968] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:00 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:01.349991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.350823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.357071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.357761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.359900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.360824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.361284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.361748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.442358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.443160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.449890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.450747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.451221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.451911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.452420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.453010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.594760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.601246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 2c69654a-6a13-4653-9c37-04df93393b26 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:01.602334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-880050b7-dc67-4397-95ad-7ae0a3446ccf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1315 microversion: 2.1 time: 0.256270 Aug 29 15:45:01.602919 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 973/1969] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:01.607625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.108"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:01.611047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.618034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.618800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.619294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.620007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.620465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.620936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.621890 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7fd358e5-cacd-467c-ae7b-480f5ff0ffa9 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1971 microversion: 2.25 time: 0.322415 Aug 29 15:45:01.622482 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 997/1970] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1971 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:01.627518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.628332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.634974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.635718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.636395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.637270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.637891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.638498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.657508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:45:01.657916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquired lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:45:01.774701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:01.783805 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90d70c0e-9194-4271-ba84-c6070211f699 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1470 microversion: 2.1 time: 0.160075 Aug 29 15:45:01.784484 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 998/1971] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:01.789300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.790003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.796793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.797746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.797891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.798491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.798941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.799390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.824931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:01.904334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e300a579-18c7-4b60-a89a-456bf7934ca2 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 204 len: 0 microversion: 2.1 time: 0.118548 Aug 29 15:45:01.904923 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 999/1972] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:01 2022] DELETE /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:01.913182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:01.913182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:01.918145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.918734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.919345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:01.920182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:01.920643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:01.921153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.052078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.059910 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e42bb6e5-b095-4f8a-a878-35d0425f69ff tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1315 microversion: 2.1 time: 0.153797 Aug 29 15:45:02.060475 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1000/1973] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:01 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:02.065146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.065749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.073242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.073658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.074071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.074804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.075439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.075863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.212943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 2c69654a-6a13-4653-9c37-04df93393b26 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:02.228709 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-13b0f2a4-3729-4860-bf24-a72ca1db9a53 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1971 microversion: 2.25 time: 0.167153 Aug 29 15:45:02.229303 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1001/1974] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1971 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:02.243228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.243228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.246580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.247206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.247710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.248483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.249008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.249572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.275761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:02.479197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:02.488305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5be73709-c07a-40e8-9648-ce2434caf002 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.253991 Aug 29 15:45:02.488895 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1002/1975] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:02.494335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd9d9323-10fe-456b-96a2-4c54e18dccd9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edb9b1f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.521113 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-fd9d9323-10fe-456b-96a2-4c54e18dccd9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Image not found. Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd9d9323-10fe-456b-96a2-4c54e18dccd9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d HTTP/1.1 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: exception: Image not found. Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5ebd92b6-fb9d-437f-8295-cee86671ac9d'} Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5ebd92b6-fb9d-437f-8295-cee86671ac9d to delete Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ebd92b6-fb9d-437f-8295-cee86671ac9d could not be found. Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:02.524581 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:02.529901 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:02.533608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd9d9323-10fe-456b-96a2-4c54e18dccd9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Image not found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:02.534713 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd9d9323-10fe-456b-96a2-4c54e18dccd9 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d" status: 404 len: 62 microversion: 2.1 time: 0.044741 Aug 29 15:45:02.535470 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1003/1976] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:02 2022] DELETE /compute/v2.1/images/5ebd92b6-fb9d-437f-8295-cee86671ac9d => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:02.540421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.545682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.546951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.547941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.548692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.549146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.549568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.574350 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d20f91e9-97eb-492d-ae52-b79f2360ac6d tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.037642 Aug 29 15:45:02.575299 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1004/1977] 10.222.0.83 () {60 vars in 1217 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:45:02.584440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:02.585378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:02.591989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.592852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.593775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.594715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:02.595260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:02.595899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:02.874044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=12 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:03.176193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.186163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.188653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:03.190113 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8faeb36-ebbb-4356-968e-f215702b5ddd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.612435 Aug 29 15:45:03.205917 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1005/1978] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:02 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:03.205917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ff34493a-3318-432f-a756-ab953dffaaa3 req-3eca0d1d-17c2-43bd-aaf2-3c095954ef81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336ce67a-6ab6-43ab-9ae8-1cc6dcd015db", "tag": "71f6896f-9d65-4919-bfe6-00f6281e1d3c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:03.214823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff34493a-3318-432f-a756-ab953dffaaa3 req-3eca0d1d-17c2-43bd-aaf2-3c095954ef81 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.215335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff34493a-3318-432f-a756-ab953dffaaa3 req-3eca0d1d-17c2-43bd-aaf2-3c095954ef81 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.215765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff34493a-3318-432f-a756-ab953dffaaa3 req-3eca0d1d-17c2-43bd-aaf2-3c095954ef81 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.227385 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ff34493a-3318-432f-a756-ab953dffaaa3 req-3eca0d1d-17c2-43bd-aaf2-3c095954ef81 service nova] Creating event network-changed:71f6896f-9d65-4919-bfe6-00f6281e1d3c for instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db on n-h1-836830-13 Aug 29 15:45:03.232310 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ff34493a-3318-432f-a756-ab953dffaaa3 req-3eca0d1d-17c2-43bd-aaf2-3c095954ef81 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033074 Aug 29 15:45:03.232912 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1006/1979] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:03.238922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:03.239523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:03.245586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.246071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.246503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.247615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.247738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.248089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.282247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:03.342828 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.compute.api [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Instance is already in deleting state, ignoring this request Aug 29 15:45:03.343904 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f316e74e-904f-4468-b695-daf94e501e25 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 204 len: 0 microversion: 2.1 time: 0.109128 Aug 29 15:45:03.344644 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1007/1980] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:03 2022] DELETE /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:03.349670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-13", "block_migration": "auto"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:03.352395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:03.358373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.359499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.360202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.360993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:03.361509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:03.361993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:03.387843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'flavor' on Instance uuid 2c69654a-6a13-4653-9c37-04df93393b26 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:03.402139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Going to try to live migrate instance to n-h1-836830-13 {{(pid=129133) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:45:03.734556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Building network info cache for instance {{(pid=129132) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:45:04.310900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Updating instance_info_cache with network_info: [{"id": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4", "address": "fa:16:3e:39:44:1a", "network": {"id": "8ad56b1a-bc38-44b2-bfec-6f75ca507357", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1824525816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd150e4d120d4c6584c650e747abb6a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5328c8d-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129132) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:45:04.324390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Releasing lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:45:04.325246 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-98d73099-3ee1-4c2b-8aca-26dc1a853dac tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action" status: 202 len: 0 microversion: 2.1 time: 2.721205 Aug 29 15:45:04.325899 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 974/1981] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:01 2022] POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action => generated 0 bytes in 2722 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:45:04.335080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.335695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.343152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.343478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.344112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.344803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.345252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.345669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.486076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.494474 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa45c4bd-ed5a-4e74-a31c-d6cbc628e6dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1315 microversion: 2.1 time: 0.163065 Aug 29 15:45:04.495100 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 975/1982] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:04.499848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.500466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.506322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.506810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.507617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.507988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.508446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.508874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.755456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:04.763675 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5bd2ed98-b856-4f42-bf23-681f03947f2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.267548 Aug 29 15:45:04.764310 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 976/1983] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:04.795632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:04.797003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:04.804256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.804757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.805192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:04.806144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:04.807008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:04.807976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.360939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:05.368567 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-01a7fc23-1c89-4449-b219-b36326531e31 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1315 microversion: 2.1 time: 0.578702 Aug 29 15:45:05.369127 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 977/1984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:04 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:05.373413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e2aa3b9f-20fb-4eb4-bd11-0b97f6d23d52 req-f6c3e2a5-bd06-4b9b-b455-50443c8b7202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c38b478-d0f1-43a7-9258-2e2f07800774", "name": "network-vif-plugged", "status": "completed", "tag": "a053a1d8-5fcb-4d22-ab96-a10b16caa325"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:05.383566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2aa3b9f-20fb-4eb4-bd11-0b97f6d23d52 req-f6c3e2a5-bd06-4b9b-b455-50443c8b7202 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.384035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2aa3b9f-20fb-4eb4-bd11-0b97f6d23d52 req-f6c3e2a5-bd06-4b9b-b455-50443c8b7202 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.384460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2aa3b9f-20fb-4eb4-bd11-0b97f6d23d52 req-f6c3e2a5-bd06-4b9b-b455-50443c8b7202 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.396423 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e2aa3b9f-20fb-4eb4-bd11-0b97f6d23d52 req-f6c3e2a5-bd06-4b9b-b455-50443c8b7202 service nova] Creating event network-vif-plugged:a053a1d8-5fcb-4d22-ab96-a10b16caa325 for instance 9c38b478-d0f1-43a7-9258-2e2f07800774 on n-h1-836830-13 Aug 29 15:45:05.401445 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e2aa3b9f-20fb-4eb4-bd11-0b97f6d23d52 req-f6c3e2a5-bd06-4b9b-b455-50443c8b7202 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031121 Aug 29 15:45:05.402071 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 978/1985] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:05.407241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:05.408165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:05.414513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.414996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.415454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.416255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.416706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.417122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.570090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:05.578209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff6815bb-771b-4ea1-aa06-9ccea929c6f0 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1492 microversion: 2.1 time: 0.174972 Aug 29 15:45:05.578785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 979/1986] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:05 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1492 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:05.583219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:05.584034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:05.590573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.591292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.591733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.592426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.592957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.593421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.822718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:05.831355 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0f60dc98-7072-434e-8cba-c06552ae7b0e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1316 microversion: 2.1 time: 0.251559 Aug 29 15:45:05.831923 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 980/1987] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:05 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:05.836408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3ddd64ff-90ef-4b70-8018-f76f4a704456 req-d6897741-b02a-4b10-bc46-9d948fb0c953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e7bb8c-484f-4cc8-a02b-bbfdff92e1db", "name": "network-vif-deleted", "tag": "ebd2914e-a315-4a97-ba1e-b991f741a72c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:05.846358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3ddd64ff-90ef-4b70-8018-f76f4a704456 req-d6897741-b02a-4b10-bc46-9d948fb0c953 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.846833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3ddd64ff-90ef-4b70-8018-f76f4a704456 req-d6897741-b02a-4b10-bc46-9d948fb0c953 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.847296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3ddd64ff-90ef-4b70-8018-f76f4a704456 req-d6897741-b02a-4b10-bc46-9d948fb0c953 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.858110 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3ddd64ff-90ef-4b70-8018-f76f4a704456 req-d6897741-b02a-4b10-bc46-9d948fb0c953 service nova] Creating event network-vif-deleted:ebd2914e-a315-4a97-ba1e-b991f741a72c for instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db on n-h1-836830-13 Aug 29 15:45:05.862904 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3ddd64ff-90ef-4b70-8018-f76f4a704456 req-d6897741-b02a-4b10-bc46-9d948fb0c953 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029901 Aug 29 15:45:05.863518 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 981/1988] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:05.868486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:05.869168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:05.875186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.875666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.876097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:05.876775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:05.877219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:05.877638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.135644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:06.146761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:06.148248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:06.149430 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b580d2f4-37b1-4e1a-ada1-2e1e0e7f30d8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.284771 Aug 29 15:45:06.149998 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 982/1989] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:05 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:06.154537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e2cdbce7-e216-4bca-b511-717d820d2da8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '.version_select at 0x7f32ee99cee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:06.337180 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e2cdbce7-e216-4bca-b511-717d820d2da8 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips/94c25023-f50a-49ff-b70f-7d597be65f7d" status: 200 len: 184 microversion: 2.1 time: 0.186086 Aug 29 15:45:06.337808 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 983/1990] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:45:06 2022] GET /compute/v2.1/os-floating-ips/94c25023-f50a-49ff-b70f-7d597be65f7d => generated 184 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:06.342243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-fa914a08-76ed-45dd-a552-bd89ec1845ab req-0b901bd8-65c5-4b0d-9ee3-48dbf33c0120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a08bf6-6f38-4ab4-80a3-d5c26296e83e", "tag": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:06.352930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fa914a08-76ed-45dd-a552-bd89ec1845ab req-0b901bd8-65c5-4b0d-9ee3-48dbf33c0120 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.353422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fa914a08-76ed-45dd-a552-bd89ec1845ab req-0b901bd8-65c5-4b0d-9ee3-48dbf33c0120 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.353832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fa914a08-76ed-45dd-a552-bd89ec1845ab req-0b901bd8-65c5-4b0d-9ee3-48dbf33c0120 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.365930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-fa914a08-76ed-45dd-a552-bd89ec1845ab req-0b901bd8-65c5-4b0d-9ee3-48dbf33c0120 service nova] Creating event network-changed:c5328c8d-11b9-4c00-ac75-59302bfaa5d4 for instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e on n-h1-836830-13 Aug 29 15:45:06.370928 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-fa914a08-76ed-45dd-a552-bd89ec1845ab req-0b901bd8-65c5-4b0d-9ee3-48dbf33c0120 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032022 Aug 29 15:45:06.372064 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 984/1991] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:06.377459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:06.378175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:06.384648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.385013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.385423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.387396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.387912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.388405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.648799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:06.657971 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e507b5c7-26f8-4407-8839-3bc5fc370d64 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1315 microversion: 2.1 time: 0.285206 Aug 29 15:45:06.664658 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 985/1992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:06 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:06.672671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:06.674714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:06.685768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.687301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.688405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:06.689376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:06.690064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:06.690734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.184109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:07.194370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5a22073c-dfbc-48f6-80fa-19679b022cba tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.528562 Aug 29 15:45:07.200812 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 986/1993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:06 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:07.206445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.108"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:07.561587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:07.568023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:07.568572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:07.569075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.569883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:07.570429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:07.570924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.841214 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-762ee87f-1345-4106-aac2-e5415454d9ef tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26/action" status: 202 len: 0 microversion: 2.25 time: 4.495271 Aug 29 15:45:07.845889 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1008/1994] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:45:03 2022] POST /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26/action => generated 0 bytes in 4500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:07.851014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:07.856694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:07.868170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:07.868658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:07.869086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:07.869784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:07.874796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:07.875590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.056119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.065499 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-605b9d80-12ee-4a1a-8d2e-6827e7c0c16e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1503 microversion: 2.1 time: 0.218216 Aug 29 15:45:08.066279 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1009/1995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:07 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:08.071121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.071958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.087944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:08.090134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.090618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.091099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.092014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.092646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.093831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.213811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09663bec61af43278da1d69c37594558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0c4051fa5084b638108f191a7c1365b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.222672 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82deb10a-d2e7-43d3-b785-7d9d21d70e0a tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 200 len: 1450 microversion: 2.1 time: 0.155161 Aug 29 15:45:08.223388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1010/1996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:08.228290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.229179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.236287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.237093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.237532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.238243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.238691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.239150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.370351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:45:08.371664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquired lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:45:08.490380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.498713 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf9034ed-32ef-48d3-a50c-234c7089ec8b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1465 microversion: 2.1 time: 0.274058 Aug 29 15:45:08.499884 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1011/1997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1465 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:08.505134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.506036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.512396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.513180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.513818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.515772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.517210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.518023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.835377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.851673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.853180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:08.854408 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b6d2cf4-0c57-43e1-a4e1-ef26d0a846b1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.353243 Aug 29 15:45:08.854999 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1012/1998] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:08.863672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b460845c-1e9a-4cc6-9de2-243f39188d07 req-7fc7bc0d-9ad3-41a8-942d-bd2e39e5148d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2924710b-a966-48bf-9d93-26705f6e999c", "name": "network-vif-unplugged", "status": "completed", "tag": "3aa203c7-29ff-450c-aa85-ae77c7dff94e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:08.893328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b460845c-1e9a-4cc6-9de2-243f39188d07 req-7fc7bc0d-9ad3-41a8-942d-bd2e39e5148d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.893607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b460845c-1e9a-4cc6-9de2-243f39188d07 req-7fc7bc0d-9ad3-41a8-942d-bd2e39e5148d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.894463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b460845c-1e9a-4cc6-9de2-243f39188d07 req-7fc7bc0d-9ad3-41a8-942d-bd2e39e5148d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.911164 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b460845c-1e9a-4cc6-9de2-243f39188d07 req-7fc7bc0d-9ad3-41a8-942d-bd2e39e5148d service nova] Creating event network-vif-unplugged:3aa203c7-29ff-450c-aa85-ae77c7dff94e for instance 2924710b-a966-48bf-9d93-26705f6e999c on n-h2-836830-13 Aug 29 15:45:08.917270 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b460845c-1e9a-4cc6-9de2-243f39188d07 req-7fc7bc0d-9ad3-41a8-942d-bd2e39e5148d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060711 Aug 29 15:45:08.919792 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1013/1999] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:08.926550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:08.927682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:08.943859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.944604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.945243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:08.946166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:08.947098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:08.947841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.133497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.142994 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e86a5463-ab91-4da2-aa21-91a6103feb05 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1315 microversion: 2.1 time: 0.221644 Aug 29 15:45:09.144845 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1014/2000] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:08 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:09.151187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:09.152287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:09.162898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.163642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.164302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.166568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.167131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.167780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.329449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.338420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.340136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:09.341394 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-40f6f738-8b1a-4c54-826d-43cc0c645c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.194972 Aug 29 15:45:09.342004 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1015/2001] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:09 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:09.346735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1330189978"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:09.347664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:09.355174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.356081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.356728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.357686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:09.358946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:09.359749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:09.458038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Building network info cache for instance {{(pid=129132) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:45:09.588965 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.network.security_group_api [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Adding security group 1f6da4c6-ed29-493b-8da2-32ade760088e to port a053a1d8-5fcb-4d22-ab96-a10b16caa325 Aug 29 15:45:10.047255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4f8bb5a-4e84-40ba-a2be-d3b00227a047 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774/action" status: 202 len: 0 microversion: 2.1 time: 0.702700 Aug 29 15:45:10.048045 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1016/2002] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:09 2022] POST /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:10.053245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:10.055664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.071818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.072055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.072734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.073627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.074081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.078606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.310853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:10.320798 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f39d1eef-b957-4c49-84f2-2bb98b771d13 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.271575 Aug 29 15:45:10.329373 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1017/2003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:10 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:10.335715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e461c669-7583-45b7-b6ab-d2ca684d987e req-c40d6bd6-6ee3-41ef-b6b7-f7c629a3eb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2924710b-a966-48bf-9d93-26705f6e999c", "name": "network-vif-deleted", "tag": "3aa203c7-29ff-450c-aa85-ae77c7dff94e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:10.350154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e461c669-7583-45b7-b6ab-d2ca684d987e req-c40d6bd6-6ee3-41ef-b6b7-f7c629a3eb9d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.350795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e461c669-7583-45b7-b6ab-d2ca684d987e req-c40d6bd6-6ee3-41ef-b6b7-f7c629a3eb9d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.351922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e461c669-7583-45b7-b6ab-d2ca684d987e req-c40d6bd6-6ee3-41ef-b6b7-f7c629a3eb9d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.370914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e461c669-7583-45b7-b6ab-d2ca684d987e req-c40d6bd6-6ee3-41ef-b6b7-f7c629a3eb9d service nova] Creating event network-vif-deleted:3aa203c7-29ff-450c-aa85-ae77c7dff94e for instance 2924710b-a966-48bf-9d93-26705f6e999c on n-h2-836830-13 Aug 29 15:45:10.378051 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e461c669-7583-45b7-b6ab-d2ca684d987e req-c40d6bd6-6ee3-41ef-b6b7-f7c629a3eb9d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047300 Aug 29 15:45:10.379560 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1018/2004] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:10.385522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:10.386655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.394346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.395489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.396165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.397276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.398071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.400788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.405508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Updating instance_info_cache with network_info: [{"id": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4", "address": "fa:16:3e:39:44:1a", "network": {"id": "8ad56b1a-bc38-44b2-bfec-6f75ca507357", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1824525816-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bd150e4d120d4c6584c650e747abb6a4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5328c8d-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129132) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:45:10.426808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Releasing lock "refresh_cache-17a08bf6-6f38-4ab4-80a3-d5c26296e83e" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:45:10.430433 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1cbd7b65-2aeb-42a0-8907-15911b1e1593 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action" status: 202 len: 0 microversion: 2.1 time: 3.226821 Aug 29 15:45:10.431893 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 987/2005] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:07 2022] POST /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e/action => generated 0 bytes in 3231 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:45:10.448675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:10.450568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 2924710b-a966-48bf-9d93-26705f6e999c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.463423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.464628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.465259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.466158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.466786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.467418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.486408 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Instance 2924710b-a966-48bf-9d93-26705f6e999c could not be found. Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c HTTP/1.1 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 2924710b-a966-48bf-9d93-26705f6e999c could not be found. Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '2924710b-a966-48bf-9d93-26705f6e999c'} Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2924710b-a966-48bf-9d93-26705f6e999c could not be found. Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2924710b-a966-48bf-9d93-26705f6e999c could not be found. Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:10.489136 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2924710b-a966-48bf-9d93-26705f6e999c could not be found. Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Instance 2924710b-a966-48bf-9d93-26705f6e999c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:10.494687 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1af96bf5-52f8-4a0c-baa3-b1068412ecd1 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c" status: 404 len: 111 microversion: 2.1 time: 0.054609 Aug 29 15:45:10.498637 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 988/2006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:10 2022] GET /compute/v2.1/servers/2924710b-a966-48bf-9d93-26705f6e999c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:10.502792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:10.503441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.510123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.510734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.511321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.512394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.512851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.513272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.519159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:10.650333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:10.667347 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23cd4143-d3d2-44d1-b55c-d40e15177473 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1618 microversion: 2.1 time: 0.286159 Aug 29 15:45:10.669115 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1019/2007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:10 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1618 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:10.678110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-153689607"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:10.678903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:10.688440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.689215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.689968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.706347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:10.708401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:10.710393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:10.899048 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.network.security_group_api [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Adding security group 4d12c280-62d2-4311-bf18-bbf8e0d24a57 to port a053a1d8-5fcb-4d22-ab96-a10b16caa325 Aug 29 15:45:10.960758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:10.975778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:10.977736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:10.979094 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9bc25086-d728-412f-abd3-2809a5fa5033 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.482487 Aug 29 15:45:10.980238 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 989/2008] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:10 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:10.985647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-dd5af166-87d1-4419-b04d-5cb7ffc838f7 req-c61b7cb3-618f-46d3-8d89-1501968e3840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c38b478-d0f1-43a7-9258-2e2f07800774", "tag": "a053a1d8-5fcb-4d22-ab96-a10b16caa325"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:11.000198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dd5af166-87d1-4419-b04d-5cb7ffc838f7 req-c61b7cb3-618f-46d3-8d89-1501968e3840 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.002372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dd5af166-87d1-4419-b04d-5cb7ffc838f7 req-c61b7cb3-618f-46d3-8d89-1501968e3840 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.005227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dd5af166-87d1-4419-b04d-5cb7ffc838f7 req-c61b7cb3-618f-46d3-8d89-1501968e3840 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.026246 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-dd5af166-87d1-4419-b04d-5cb7ffc838f7 req-c61b7cb3-618f-46d3-8d89-1501968e3840 service nova] Creating event network-changed:a053a1d8-5fcb-4d22-ab96-a10b16caa325 for instance 9c38b478-d0f1-43a7-9258-2e2f07800774 on n-h1-836830-13 Aug 29 15:45:11.036907 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-dd5af166-87d1-4419-b04d-5cb7ffc838f7 req-c61b7cb3-618f-46d3-8d89-1501968e3840 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054634 Aug 29 15:45:11.037830 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 990/2009] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:11.045432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:11.046658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:11.058805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.059796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.060857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.062087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.062851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.063319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.300708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.312248 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-23332fb7-8d67-45c0-a900-a9c0e7300823 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1315 microversion: 2.1 time: 0.272418 Aug 29 15:45:11.313073 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 991/2010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:11 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:11.326317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:11.326936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:11.340082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.340630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.341173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.342067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.343228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.343906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.416447 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83f501e7-2497-4aea-a8a6-e69458d5ccf2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774/action" status: 202 len: 0 microversion: 2.1 time: 0.746011 Aug 29 15:45:11.417128 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1020/2011] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:10 2022] POST /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:11.423598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:11.424283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:11.440649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.441189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.444439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.445285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.445801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.446275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.477628 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] HTTP exception thrown: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Request method failure captured: Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db HTTP/1.1 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN6sk77of2skLPg9myVWR49uSF9YZ0eJrkmr9y7W_uo80L3MMlziPY4ccEXWT9hcMUK-yfs3c-8HPQIINo04BvFEJyMoPRNA5MLSEpjvIRefdUcmFv8_59XnLxKIa_YvVs1Q8nI3bvAuuHcx6Bn3_6NktaW5OIrAqQGg2FH17RMh8T0 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bd150e4d120d4c6584c650e747abb6a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bd150e4d120d4c6584c650e747abb6a4"}]}] Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 0c19d2e9ffa64e7586e35035176f1c26 Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '28e7bb8c-484f-4cc8-a02b-bbfdff92e1db'} Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:11.484725 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Returning 404 to user: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c9519f0a-1209-4a06-ae11-b6891ea0ff82 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "DELETE /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 404 len: 111 microversion: 2.1 time: 0.069982 Aug 29 15:45:11.494651 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1021/2012] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:11 2022] DELETE /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:11.502633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03c351a2-92a4-41eb-abd0-279bfad63093 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edae2940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:11.536666 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-03c351a2-92a4-41eb-abd0-279bfad63093 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Image not found. Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03c351a2-92a4-41eb-abd0-279bfad63093 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 HTTP/1.1 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: exception: Image not found. Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b68b3a21-c0a3-4566-b2d9-ee7b17d05f71'} Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 to delete Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 could not be found. Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.538596 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03c351a2-92a4-41eb-abd0-279bfad63093 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Image not found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-03c351a2-92a4-41eb-abd0-279bfad63093 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71" status: 404 len: 62 microversion: 2.1 time: 0.046764 Aug 29 15:45:11.545020 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1022/2013] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:11 2022] DELETE /compute/v2.1/images/b68b3a21-c0a3-4566-b2d9-ee7b17d05f71 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:11.552269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-798157381", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["47f1aebf-dfb9-406c-b132-1081aacd03ef"]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:11.615912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.630067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.633565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:11.634909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:11.636156 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dfb08e53-c9a8-420c-905e-d982e8f3d459 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.322183 Aug 29 15:45:11.636711 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 992/2014] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:11 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:11.649181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-29e7d518-11d8-42f6-b518-0c3f15a1cf4c req-45cdd7ee-e1eb-46c0-98b7-0bc7779abb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336ce67a-6ab6-43ab-9ae8-1cc6dcd015db", "name": "network-vif-plugged", "status": "completed", "tag": "71f6896f-9d65-4919-bfe6-00f6281e1d3c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:11.672085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29e7d518-11d8-42f6-b518-0c3f15a1cf4c req-45cdd7ee-e1eb-46c0-98b7-0bc7779abb52 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.672567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29e7d518-11d8-42f6-b518-0c3f15a1cf4c req-45cdd7ee-e1eb-46c0-98b7-0bc7779abb52 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.674339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29e7d518-11d8-42f6-b518-0c3f15a1cf4c req-45cdd7ee-e1eb-46c0-98b7-0bc7779abb52 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.705738 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-29e7d518-11d8-42f6-b518-0c3f15a1cf4c req-45cdd7ee-e1eb-46c0-98b7-0bc7779abb52 service nova] Creating event network-vif-plugged:71f6896f-9d65-4919-bfe6-00f6281e1d3c for instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db on n-h1-836830-13 Aug 29 15:45:11.713148 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-29e7d518-11d8-42f6-b518-0c3f15a1cf4c req-45cdd7ee-e1eb-46c0-98b7-0bc7779abb52 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075234 Aug 29 15:45:11.719405 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 993/2015] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:11.727271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:11.728292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:11.739900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.740785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.741415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:11.742356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:11.743006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:11.743654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.037172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:12.038142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:12.038893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:12.039563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:12.043361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.043871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:12.053750 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6a0c566-034e-4aa2-8636-39bf56252ec5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.331967 Aug 29 15:45:12.067056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.067056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.067056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.067056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.067056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.067056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.069033 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 994/2016] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:11 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:12.071783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:12.077293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.078702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.081917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:12.086945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.088128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:12.088728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.089362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.090301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.091055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.091249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.104499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:12.106718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:12.166962 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7e3524d-57e7-4996-b939-279003110934 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622363 Aug 29 15:45:12.168031 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1023/2017] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:12.173929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.174567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.285906 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d6f9997-6ab8-4368-a8d8-0ef5dd084420 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.215470 Aug 29 15:45:12.286584 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 995/2018] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774/os-security-groups => generated 1156 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:12.291120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.291597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.302722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.303259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.303700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.304434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.304941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.305368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.322251 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b HTTP/1.1 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '84f455ce-786c-4f29-8e9f-e57a09dfe48b'} Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:12.324041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8e38a2f-c22f-4108-b6c7-7803b0456854 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 404 len: 111 microversion: 2.1 time: 0.037906 Aug 29 15:45:12.330413 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 996/2019] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:12 2022] DELETE /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:12.334343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.334976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.346864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.348147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.348640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.349526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.350000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.350431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.447254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.447909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.448426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.449230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.449787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.450278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.466485 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] HTTP exception thrown: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Request method failure captured: Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db HTTP/1.1 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN6sk77of2skLPg9myVWR49uSF9YZ0eJrkmr9y7W_uo80L3MMlziPY4ccEXWT9hcMUK-yfs3c-8HPQIINo04BvFEJyMoPRNA5MLSEpjvIRefdUcmFv8_59XnLxKIa_YvVs1Q8nI3bvAuuHcx6Bn3_6NktaW5OIrAqQGg2FH17RMh8T0 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bd150e4d120d4c6584c650e747abb6a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bd150e4d120d4c6584c650e747abb6a4"}]}] Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 0c19d2e9ffa64e7586e35035176f1c26 Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '28e7bb8c-484f-4cc8-a02b-bbfdff92e1db'} Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.468609 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Returning 404 to user: Instance 28e7bb8c-484f-4cc8-a02b-bbfdff92e1db could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:12.474541 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0eefc476-ef3f-4762-b763-4dac496cf084 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db" status: 404 len: 111 microversion: 2.1 time: 0.303648 Aug 29 15:45:12.479391 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1024/2020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/28e7bb8c-484f-4cc8-a02b-bbfdff92e1db => generated 111 bytes in 311 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:12.485122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-14336bad-29da-48d4-9523-d078e7d75842 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.485838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-14336bad-29da-48d4-9523-d078e7d75842 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.548100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14336bad-29da-48d4-9523-d078e7d75842 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.557902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-14336bad-29da-48d4-9523-d078e7d75842 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1216 microversion: 2.1 time: 0.077168 Aug 29 15:45:12.559293 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1025/2021] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:12.566587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b21a14d6-7400-40a9-a495-4c4e05cf10fe tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32eda6c1f0>, body: {"security_group": {"name": " tempest-securitygroup -1240728416 ", "description": "tempest-description-1843149115"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:12.756308 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b21a14d6-7400-40a9-a495-4c4e05cf10fe tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.195634 Aug 29 15:45:12.757654 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1026/2022] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:45:12 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:12.762879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.763611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.777842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.778687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.779875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.781544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.782909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.783560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.917087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.927570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.930328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.932137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d37d803-d3f9-4d74-9337-2568cfb392c8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.601729 Aug 29 15:45:12.947444 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 997/2023] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:12.955764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:12.956702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 84f455ce-786c-4f29-8e9f-e57a09dfe48b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:12.962844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.963649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.964266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.965141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:12.965884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:12.966348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:12.979053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:12.984669 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b HTTP/1.1 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '84f455ce-786c-4f29-8e9f-e57a09dfe48b'} Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.986500 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Instance 84f455ce-786c-4f29-8e9f-e57a09dfe48b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99973156-5172-4218-89c7-b4fe96227654 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b" status: 404 len: 111 microversion: 2.1 time: 0.039308 Aug 29 15:45:12.991989 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 998/2024] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/84f455ce-786c-4f29-8e9f-e57a09dfe48b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:12.993563 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da68e967-4d22-4fd8-8e7e-9c09c06a8dae tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1315 microversion: 2.1 time: 0.234831 Aug 29 15:45:12.996226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f7df466c-aef0-473b-b9bb-4664b4359d9c req-ec03b32c-bf8c-46c9-8629-cb1068dff5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a08bf6-6f38-4ab4-80a3-d5c26296e83e", "tag": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:13.006802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f7df466c-aef0-473b-b9bb-4664b4359d9c req-ec03b32c-bf8c-46c9-8629-cb1068dff5f6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.007317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f7df466c-aef0-473b-b9bb-4664b4359d9c req-ec03b32c-bf8c-46c9-8629-cb1068dff5f6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.007742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f7df466c-aef0-473b-b9bb-4664b4359d9c req-ec03b32c-bf8c-46c9-8629-cb1068dff5f6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.010526 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1027/2025] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:12 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:13.016456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d9d10a8e-fe4b-41fe-a998-706e44e18dcf tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '.version_select at 0x7f32eda6cdc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.020750 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f7df466c-aef0-473b-b9bb-4664b4359d9c req-ec03b32c-bf8c-46c9-8629-cb1068dff5f6 service nova] Creating event network-changed:c5328c8d-11b9-4c00-ac75-59302bfaa5d4 for instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e on n-h1-836830-13 Aug 29 15:45:13.026020 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f7df466c-aef0-473b-b9bb-4664b4359d9c req-ec03b32c-bf8c-46c9-8629-cb1068dff5f6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033151 Aug 29 15:45:13.027076 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 999/2026] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:13.034044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.034901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.041109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.041701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.042151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.043237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.043726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.044144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.271387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.282109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.292018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.295275 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ab2ab0b-434b-4ae6-86e8-9687345d46a3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.266799 Aug 29 15:45:13.297052 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1000/2027] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:13 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:13.311325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-63a6dc8d-b6bf-4335-9586-04fa6a1fb46b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edc6e9d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.417349 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-63a6dc8d-b6bf-4335-9586-04fa6a1fb46b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158" status: 200 len: 224 microversion: 2.1 time: 0.118873 Aug 29 15:45:13.417938 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1001/2028] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:45:13 2022] GET /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 => generated 224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:13.422929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-428ea35a-c68d-4eb6-a62a-dc10d1d2474c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edc8cdc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.467370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-428ea35a-c68d-4eb6-a62a-dc10d1d2474c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Image not found. Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-428ea35a-c68d-4eb6-a62a-dc10d1d2474c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 HTTP/1.1 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9f47cd2b-f8bd-43e7-a054-835ae5a797d2'} Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9f47cd2b-f8bd-43e7-a054-835ae5a797d2 to delete Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f47cd2b-f8bd-43e7-a054-835ae5a797d2 could not be found. Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:13.469710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:13.475152 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:13.478074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-428ea35a-c68d-4eb6-a62a-dc10d1d2474c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:13.479839 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-428ea35a-c68d-4eb6-a62a-dc10d1d2474c tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2" status: 404 len: 62 microversion: 2.1 time: 0.060967 Aug 29 15:45:13.480438 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1002/2029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:13 2022] DELETE /compute/v2.1/images/9f47cd2b-f8bd-43e7-a054-835ae5a797d2 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:13.485479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:13.486104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:13.493310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.493810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.494247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.495219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.495862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.496540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.750823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:13.762113 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25861a16-ebe4-4dfd-8ce8-f58e09315ac5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.279718 Aug 29 15:45:13.765533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1003/2030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:13 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:13.771155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-96c45eb0-df89-4c75-b8f9-e478d05571ed req-dd8ac9a5-a19f-4432-862c-7c34451c8dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c38b478-d0f1-43a7-9258-2e2f07800774", "tag": "a053a1d8-5fcb-4d22-ab96-a10b16caa325"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:13.799555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96c45eb0-df89-4c75-b8f9-e478d05571ed req-dd8ac9a5-a19f-4432-862c-7c34451c8dd7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:13.800421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96c45eb0-df89-4c75-b8f9-e478d05571ed req-dd8ac9a5-a19f-4432-862c-7c34451c8dd7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:13.802254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96c45eb0-df89-4c75-b8f9-e478d05571ed req-dd8ac9a5-a19f-4432-862c-7c34451c8dd7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:13.819911 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-96c45eb0-df89-4c75-b8f9-e478d05571ed req-dd8ac9a5-a19f-4432-862c-7c34451c8dd7 service nova] Creating event network-changed:a053a1d8-5fcb-4d22-ab96-a10b16caa325 for instance 9c38b478-d0f1-43a7-9258-2e2f07800774 on n-h1-836830-13 Aug 29 15:45:13.826395 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-96c45eb0-df89-4c75-b8f9-e478d05571ed req-dd8ac9a5-a19f-4432-862c-7c34451c8dd7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058431 Aug 29 15:45:13.828033 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1004/2031] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:13.835703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd84722f-e0eb-41ec-96b0-8507c4c115e5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edc6e4c0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.041425 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d9d10a8e-fe4b-41fe-a998-706e44e18dcf tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/94c25023-f50a-49ff-b70f-7d597be65f7d" status: 202 len: 0 microversion: 2.1 time: 1.029590 Aug 29 15:45:14.042315 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1028/2032] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:45:13 2022] DELETE /compute/v2.1/os-floating-ips/94c25023-f50a-49ff-b70f-7d597be65f7d => generated 0 bytes in 1031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:14.046998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.047829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.059998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.064075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.064738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.065643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.066268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.066895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.090173 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 HTTP/1.1 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '09a5660c-ddba-4fd7-a7e8-a87e38ea1f40'} Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:14.096156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3debedd3-a25b-4779-b6fa-5ace1c9df809 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 404 len: 111 microversion: 2.1 time: 0.054436 Aug 29 15:45:14.101345 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1029/2033] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:14 2022] DELETE /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:14.104734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.105350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.119533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.121323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.123325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.128967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.129732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.130277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.133113 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd84722f-e0eb-41ec-96b0-8507c4c115e5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158" status: 202 len: 0 microversion: 2.1 time: 0.303555 Aug 29 15:45:14.133730 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1005/2034] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:45:13 2022] DELETE /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:14.141045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.142079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.165737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.166538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.167286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.168182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.168985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.169983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.237938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.249446 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-07800f07-f0c7-4d44-a296-bf46e59fc341 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1268 microversion: 2.1 time: 0.149639 Aug 29 15:45:14.251353 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1030/2035] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:14.256829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.257780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.264154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.264686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.265412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.266146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.266611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.267057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.567137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.582474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.592708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.595487 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-172dba9e-1679-4be1-b973-7dcff4156529 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.459928 Aug 29 15:45:14.598380 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1006/2036] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:14.603808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.604583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.612026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.613366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.614023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.614967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.615841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.616539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.647916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:14.755503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:14.767629 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0b85694-1040-4cd2-9d88-4c1a228739e4 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "DELETE /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 204 len: 0 microversion: 2.1 time: 0.167166 Aug 29 15:45:14.771732 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1007/2037] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:14 2022] DELETE /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:14.775550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.776329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.785480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.785985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.786427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.787450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.787916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.788345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.807907 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 HTTP/1.1 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '09a5660c-ddba-4fd7-a7e8-a87e38ea1f40'} Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.809898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Instance 09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-951e190e-c01e-4fcb-a087-8628a593c114 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40" status: 404 len: 111 microversion: 2.1 time: 0.041255 Aug 29 15:45:14.817058 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1008/2038] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/09a5660c-ddba-4fd7-a7e8-a87e38ea1f40 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:14.822730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f1338f1-2c27-4f7a-9db1-caa54fd16cf6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edc85f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.869636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-1f1338f1-2c27-4f7a-9db1-caa54fd16cf6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:45:14.870312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.security_group_api [None req-1f1338f1-2c27-4f7a-9db1-caa54fd16cf6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 not found {{(pid=129132) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:45:14.870832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1f1338f1-2c27-4f7a-9db1-caa54fd16cf6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:45:14.870832 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-5343cddd-a418-4632-8bf0-e26cd2c4f38c'] Aug 29 15:45:14.874624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:14.882816 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5052d5e1-6d17-453e-ae2a-58b063c846ec tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1503 microversion: 2.1 time: 0.630199 Aug 29 15:45:14.883683 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1031/2039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1503 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f1338f1-2c27-4f7a-9db1-caa54fd16cf6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 HTTP/1.1 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: exception: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-5343cddd-a418-4632-8bf0-e26cd2c4f38c'] Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158'} Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:45:14.887164 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343cddd-a418-4632-8bf0-e26cd2c4f38c'] Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343cddd-a418-4632-8bf0-e26cd2c4f38c'] Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343cddd-a418-4632-8bf0-e26cd2c4f38c'] Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343cddd-a418-4632-8bf0-e26cd2c4f38c'] Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f1338f1-2c27-4f7a-9db1-caa54fd16cf6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-5343cddd-a418-4632-8bf0-e26cd2c4f38c'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f1338f1-2c27-4f7a-9db1-caa54fd16cf6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158" status: 404 len: 194 microversion: 2.1 time: 0.070676 Aug 29 15:45:14.891757 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1009/2040] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:14.896470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.897248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.898628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:14.903804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:14.911004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.911857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.912723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.913424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.914045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.914786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.915299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.915448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.915813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:14.916664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:14.919239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:14.919965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.076954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.093237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.094755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.097721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ca0e848-d999-4c2e-97fd-f39d4db67ca6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.211716 Aug 29 15:45:15.098858 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1032/2041] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:15.104109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.104970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.112466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.113182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.113830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.114920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.115717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.116460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.134891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.147209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75125546-b8cf-4fd3-b961-95c19f3a1503 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1523 microversion: 2.1 time: 0.256105 Aug 29 15:45:15.148124 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1010/2042] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:14 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:15.159742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-978488a5-bc1d-4f52-9118-15720265ff01 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '.version_select at 0x7f32edc6eb80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.190397 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-978488a5-bc1d-4f52-9118-15720265ff01 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Image not found. Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-978488a5-bc1d-4f52-9118-15720265ff01 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab HTTP/1.1 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '49917c1d-f792-4a25-960c-90a69ba343ab'} Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 49917c1d-f792-4a25-960c-90a69ba343ab to delete Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49917c1d-f792-4a25-960c-90a69ba343ab could not be found. Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.192715 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-978488a5-bc1d-4f52-9118-15720265ff01 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:15.198048 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-978488a5-bc1d-4f52-9118-15720265ff01 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab" status: 404 len: 62 microversion: 2.1 time: 0.041460 Aug 29 15:45:15.205960 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1011/2043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] DELETE /compute/v2.1/images/49917c1d-f792-4a25-960c-90a69ba343ab => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:45:15.212816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99e2e4ab-6c4f-486e-92ac-3f8d0644e15d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32edc85820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1819508093", "description": "tempest-description-2085208387"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:15.303260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.313518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d91d48d8-c73b-4afe-a76e-cecec653a16d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.213214 Aug 29 15:45:15.314104 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1033/2044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:15.333024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:15.334034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.341908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.342707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.343178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.344072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.345179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.345179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.428604 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7aa459c5-25d3-423b-9843-230d03be4394 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db/action" status: 202 len: 0 microversion: 2.1 time: 0.099476 Aug 29 15:45:15.429241 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1034/2045] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:15 2022] POST /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:15.434808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.435455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.442833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.443369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.443795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.444489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.444945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.445370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.459748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f HTTP/1.1 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '7eb03030-409e-4060-8428-d865da5f212f'} Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:15.462129 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7d353281-b947-4461-95c5-378d0a3e020e tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 404 len: 111 microversion: 2.1 time: 0.033389 Aug 29 15:45:15.467588 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1035/2046] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:15 2022] DELETE /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:15.472816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.473492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.480056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.480585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.481036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.481763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.482243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.482705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.530368 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99e2e4ab-6c4f-486e-92ac-3f8d0644e15d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.322768 Aug 29 15:45:15.531593 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1012/2047] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:45:15 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:15.537637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.538804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.547404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.548135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.548731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.549675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.551087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.552043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.579797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.590958 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8660ee91-0981-4fd8-9f64-2e54ca8086cb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1274 microversion: 2.1 time: 0.122349 Aug 29 15:45:15.592015 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1036/2048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:15.597955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.598805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] [instance: 7eb03030-409e-4060-8428-d865da5f212f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.604776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.605508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.605973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.606650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.607138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.607557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.621561 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] HTTP exception thrown: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Request method failure captured: Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f HTTP/1.1 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN26aHdEPS76GBoXeF-6W62APIw7V46VKQ8Z7R3midZUslRzvASqjDcqHNirwGUzplPMJICP0fPQr_auPK8XxF68YVKdHYQVtqnfbbaOJkB1m6qkwkEP4Btt1NczIatv9rttLIf6W79I9lZa1BRPqd9HhJSymIBOSi_lmIGqn8nv0yg Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b0c4051fa5084b638108f191a7c1365b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b0c4051fa5084b638108f191a7c1365b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b0c4051fa5084b638108f191a7c1365b"}]}] Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b0c4051fa5084b638108f191a7c1365b Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesTestJSON-1749722474 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 09663bec61af43278da1d69c37594558 Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesTestJSON-1749722474-project Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '7eb03030-409e-4060-8428-d865da5f212f'} Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.623399 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] Returning 404 to user: Instance 7eb03030-409e-4060-8428-d865da5f212f could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-adf2ad20-2049-4112-b7d5-6ffac82f6069 tempest-ImagesTestJSON-1749722474 tempest-ImagesTestJSON-1749722474-project] 10.222.0.83 "GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f" status: 404 len: 111 microversion: 2.1 time: 0.030752 Aug 29 15:45:15.629248 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1037/2049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/7eb03030-409e-4060-8428-d865da5f212f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:15.633727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a20df16f-ab44-4774-b3df-5d5336e0dea5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32edb7e790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-956853788", "description": "tempest-description-1834417293"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:15.795444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:15.828925 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-890b8a7f-8721-4c08-ac62-7cb2a871d6f2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1508 microversion: 2.1 time: 0.295756 Aug 29 15:45:15.842492 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1013/2050] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:15.846514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:15.850717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:15.865086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.865949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.866660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.867661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:15.868522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:15.869805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:15.997824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a20df16f-ab44-4774-b3df-5d5336e0dea5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.367903 Aug 29 15:45:15.999569 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1038/2051] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:45:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:16.012077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0747316f-1fed-431a-aa56-a588a627ed26 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32edacc3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1753264785", "description": "tempest-description-2041126163"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:16.168046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.181451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.185155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.188662 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-002bddc5-ff96-4824-85bb-c7f5ec864561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.357401 Aug 29 15:45:16.189754 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1014/2052] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:15 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:16.222176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.223718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:16.236620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.237974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.239140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.240733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.241853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.242878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.253312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:16.486180 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0747316f-1fed-431a-aa56-a588a627ed26 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.478351 Aug 29 15:45:16.486797 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1039/2053] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:45:16 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:45:16.491646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.492254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:16.510661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.511185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.511808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.512802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.513447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.514039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.571329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.585048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.587827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.591664 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6275997e-9364-4ffc-8044-9aeea1f4b436 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.400727 Aug 29 15:45:16.594007 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1015/2054] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:16.600424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.601668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:16.609375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.610119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.611171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.612074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.612678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.613259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.874956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.885619 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b118fd74-673e-4eb2-bc21-78e87a1de827 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1523 microversion: 2.1 time: 0.397698 Aug 29 15:45:16.886192 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1040/2055] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:16.902479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:16.913557 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-23aba9d5-091e-4308-b7e5-7068532421bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.318072 Aug 29 15:45:16.914391 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1016/2056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:16.925080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0f88735-99c1-4f5f-ab0c-7ad2a5031cc9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edb7e3a0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.944590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:16.945411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:16.952694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.953353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.953968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:16.954690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:16.955642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:16.956144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.186010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.195675 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1951c0d-abe5-4420-823a-f34941ad5a3c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.261338 Aug 29 15:45:17.196506 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1017/2057] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:17.201440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.202136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.208896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.209429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.209827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.210723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.211203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.211728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.461031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.478280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c74da475-2732-4725-9b8e-2bfd3af8bc85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1488 microversion: 2.1 time: 0.280605 Aug 29 15:45:17.489011 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1018/2058] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1488 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:17.489011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-50d5f4ed-a789-4d76-be42-d987348f4b64 req-fddacdb2-12d6-4c20-8288-7ac1fe2d7e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a59b56d-57a1-4efa-876c-9eb4ffe3caf7", "tag": "c6c851cd-bc07-4beb-8aa2-14e69e41d52d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:17.502218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-50d5f4ed-a789-4d76-be42-d987348f4b64 req-fddacdb2-12d6-4c20-8288-7ac1fe2d7e7e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.502996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-50d5f4ed-a789-4d76-be42-d987348f4b64 req-fddacdb2-12d6-4c20-8288-7ac1fe2d7e7e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.503612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-50d5f4ed-a789-4d76-be42-d987348f4b64 req-fddacdb2-12d6-4c20-8288-7ac1fe2d7e7e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.516851 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-50d5f4ed-a789-4d76-be42-d987348f4b64 req-fddacdb2-12d6-4c20-8288-7ac1fe2d7e7e service nova] Creating event network-changed:c6c851cd-bc07-4beb-8aa2-14e69e41d52d for instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 on n-h2-836830-13 Aug 29 15:45:17.523140 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-50d5f4ed-a789-4d76-be42-d987348f4b64 req-fddacdb2-12d6-4c20-8288-7ac1fe2d7e7e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042866 Aug 29 15:45:17.524261 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1019/2059] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:17.530542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.531498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.538501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.539257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.539694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.540398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.540851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.541273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.592292 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0f88735-99c1-4f5f-ab0c-7ad2a5031cc9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.704831 Aug 29 15:45:17.595319 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1041/2060] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:45:16 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:17.600771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.601563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.629032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.637978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.638615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.639578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.640163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.641078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.672446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:17.786278 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d7aaa28-b622-4a9f-83e1-b9a082208e24 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 204 len: 0 microversion: 2.1 time: 0.186450 Aug 29 15:45:17.793294 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1042/2061] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:45:17 2022] DELETE /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:45:17.800619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c57e2ac0-9875-498e-91be-017a790f1ba9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edb8b700>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.898762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.914429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.916275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:17.917936 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15b313bc-97f5-4f88-8238-044fb31512df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.392153 Aug 29 15:45:17.920023 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1020/2062] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:17.926923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:17.929011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:17.936514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.937830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.939074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:17.939978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:17.940615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:17.941039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.121131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.138613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.143169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.144748 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-918445b3-3206-4cc6-8047-cb9cdd3385f9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.223057 Aug 29 15:45:18.145663 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1021/2063] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:17 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:18.150545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7db64a68-d063-4e0d-878f-ac7edcef18be req-1d5a2220-c91a-482d-b5a9-623dd0025558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a08bf6-6f38-4ab4-80a3-d5c26296e83e", "name": "network-vif-deleted", "tag": "c5328c8d-11b9-4c00-ac75-59302bfaa5d4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:18.162350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7db64a68-d063-4e0d-878f-ac7edcef18be req-1d5a2220-c91a-482d-b5a9-623dd0025558 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.162932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7db64a68-d063-4e0d-878f-ac7edcef18be req-1d5a2220-c91a-482d-b5a9-623dd0025558 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.163569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7db64a68-d063-4e0d-878f-ac7edcef18be req-1d5a2220-c91a-482d-b5a9-623dd0025558 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.178567 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7db64a68-d063-4e0d-878f-ac7edcef18be req-1d5a2220-c91a-482d-b5a9-623dd0025558 service nova] Creating event network-vif-deleted:c5328c8d-11b9-4c00-ac75-59302bfaa5d4 for instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e on n-h1-836830-13 Aug 29 15:45:18.184457 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7db64a68-d063-4e0d-878f-ac7edcef18be req-1d5a2220-c91a-482d-b5a9-623dd0025558 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037399 Aug 29 15:45:18.185360 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1022/2064] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:18.192293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.193093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.199801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.200287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.200719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.201409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.201888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.203216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.345108 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c57e2ac0-9875-498e-91be-017a790f1ba9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11" status: 202 len: 0 microversion: 2.1 time: 0.551979 Aug 29 15:45:18.346012 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1043/2065] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:45:17 2022] DELETE /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:18.352940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.353899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.357959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.368596 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3b25d4f3-aa74-4d8c-bd7a-f10f13f0d226 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1494 microversion: 2.1 time: 0.181919 Aug 29 15:45:18.369500 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1023/2066] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:18.374061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.374571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.375189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.376015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.376190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.377231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.378010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.378817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.383168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.383817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.384531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.385402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.385954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.388038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.472890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.481526 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0fca65df-9722-41d8-a892-5b876b60eeec tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1306 microversion: 2.1 time: 0.134171 Aug 29 15:45:18.482109 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1044/2067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1306 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:18.490854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.491546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.500253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.500755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.501196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.501933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.502413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.502835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.541526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.550835 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6aec0b9d-56c3-4397-a8eb-88ffada720c8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.180205 Aug 29 15:45:18.551775 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1024/2068] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:18.557178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c13cce0-984b-4bf8-86d9-bc75631412a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edca5a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.581036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-2c13cce0-984b-4bf8-86d9-bc75631412a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:45:18.581674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.security_group_api [None req-2c13cce0-984b-4bf8-86d9-bc75631412a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 91f45970-bb74-44e1-8094-8512b4fbaa11 not found {{(pid=129132) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:45:18.582202 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-2c13cce0-984b-4bf8-86d9-bc75631412a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:45:18.582202 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-780952a1-b604-45f4-aa29-2b839cf5cbb1'] Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c13cce0-984b-4bf8-86d9-bc75631412a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11 HTTP/1.1 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: exception: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-780952a1-b604-45f4-aa29-2b839cf5cbb1'] Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '91f45970-bb74-44e1-8094-8512b4fbaa11'} Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:45:18.584300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780952a1-b604-45f4-aa29-2b839cf5cbb1'] Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780952a1-b604-45f4-aa29-2b839cf5cbb1'] Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780952a1-b604-45f4-aa29-2b839cf5cbb1'] Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-780952a1-b604-45f4-aa29-2b839cf5cbb1'] Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c13cce0-984b-4bf8-86d9-bc75631412a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-780952a1-b604-45f4-aa29-2b839cf5cbb1'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2c13cce0-984b-4bf8-86d9-bc75631412a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11" status: 404 len: 194 microversion: 2.1 time: 0.033016 Aug 29 15:45:18.592570 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1025/2069] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11 => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:18.602932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e9286df-3426-4003-bd81-4e2df2dcfae8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32eebec5e0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.677473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:18.691737 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b08a9088-2c93-4aff-b40e-e317712cd1ac tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.207368 Aug 29 15:45:18.692348 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1045/2070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:18.956638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:18.958491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:18.972776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.974417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.975619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.977234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:18.978525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:18.979917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:18.990247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:19.300757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.315315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.316808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.318015 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a6c8b59-e1fe-44d6-b5de-83c2b432cc99 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.372070 Aug 29 15:45:19.318938 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1046/2071] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:18 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:19.326547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.327231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.343937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.344536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.345040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.345816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.346357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.346849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.453085 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e9286df-3426-4003-bd81-4e2df2dcfae8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433" status: 202 len: 0 microversion: 2.1 time: 0.862047 Aug 29 15:45:19.454876 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1026/2072] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:45:18 2022] DELETE /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433 => generated 0 bytes in 864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:45:19.461778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.462818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.493781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.494288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.494731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.495472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.503928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.504631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.654891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.666467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.668819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.672277 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-99c235e0-265b-4c1f-8fa5-4844099e5d33 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.350648 Aug 29 15:45:19.673476 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1047/2073] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:19.679899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0db24823-24c0-4608-8ce4-c39ee9be11da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edacc790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.744038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-0db24823-24c0-4608-8ce4-c39ee9be11da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:45:19.745455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-0db24823-24c0-4608-8ce4-c39ee9be11da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:45:19.751887 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0db24823-24c0-4608-8ce4-c39ee9be11da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:45:19.751887 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-b3062681-af70-409f-81e9-e333717327dc'] Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0db24823-24c0-4608-8ce4-c39ee9be11da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433 HTTP/1.1 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-b3062681-af70-409f-81e9-e333717327dc'] Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '16bc40f5-392b-4cc0-808a-ea27d8c27433'} Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:45:19.757038 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3062681-af70-409f-81e9-e333717327dc'] Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3062681-af70-409f-81e9-e333717327dc'] Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3062681-af70-409f-81e9-e333717327dc'] Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3062681-af70-409f-81e9-e333717327dc'] Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0db24823-24c0-4608-8ce4-c39ee9be11da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:45:19.761368 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-b3062681-af70-409f-81e9-e333717327dc'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:19.769832 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0db24823-24c0-4608-8ce4-c39ee9be11da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433" status: 404 len: 194 microversion: 2.1 time: 0.089858 Aug 29 15:45:19.769832 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1048/2074] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:19.776268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.776934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.794881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.795555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.796724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.797639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.798096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.798521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.815767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.826322 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3cf24d8e-a422-428d-8267-3986eb1dbced tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1494 microversion: 2.1 time: 0.370057 Aug 29 15:45:19.839270 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1027/2075] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1494 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:19.848485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.850528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.851186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.851876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.852516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.853152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lazy-loading 'fault' on Instance uuid 17a08bf6-6f38-4ab4-80a3-d5c26296e83e {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:19.867950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.868477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.869117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.870032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.870495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.870912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.911617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c19d2e9ffa64e7586e35035176f1c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd150e4d120d4c6584c650e747abb6a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:19.920776 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5e299a2-5cbc-4bd3-b8db-aa3fcfb595e6 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 200 len: 1311 microversion: 2.1 time: 0.151855 Aug 29 15:45:19.926574 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1049/2076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 1311 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:19.931401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:19.932017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:19.938846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.939279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.939723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:19.940426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:19.940878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:19.941306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.198443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.217261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b46df08d-a646-4b3c-8565-1aaad7ea43f8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.380782 Aug 29 15:45:20.232108 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1028/2077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:20.238207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1bf5cca0-cb4a-4cbc-a60f-519e37f4b4b9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edc5d670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:20.559388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:20.577773 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-61bfc728-c4e9-4da9-8cf8-7425eb7cdc54 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.650040 Aug 29 15:45:20.578362 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1050/2078] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:19 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:20.585994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:20.587124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:20.596766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.597288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.597878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.598428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.598892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.599782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.767378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1bf5cca0-cb4a-4cbc-a60f-519e37f4b4b9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4" status: 202 len: 0 microversion: 2.1 time: 0.533585 Aug 29 15:45:20.772429 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1029/2079] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:45:20 2022] DELETE /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:20.777784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a0ea968f-ff27-43cb-9572-bbb2dda439ac req-36c341ef-e424-44c3-9136-d9df8733fe28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336ce67a-6ab6-43ab-9ae8-1cc6dcd015db", "name": "network-vif-deleted", "tag": "71f6896f-9d65-4919-bfe6-00f6281e1d3c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:20.795219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a0ea968f-ff27-43cb-9572-bbb2dda439ac req-36c341ef-e424-44c3-9136-d9df8733fe28 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.796830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a0ea968f-ff27-43cb-9572-bbb2dda439ac req-36c341ef-e424-44c3-9136-d9df8733fe28 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.797433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a0ea968f-ff27-43cb-9572-bbb2dda439ac req-36c341ef-e424-44c3-9136-d9df8733fe28 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.812854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a0ea968f-ff27-43cb-9572-bbb2dda439ac req-36c341ef-e424-44c3-9136-d9df8733fe28 service nova] Creating event network-vif-deleted:71f6896f-9d65-4919-bfe6-00f6281e1d3c for instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db on n-h1-836830-13 Aug 29 15:45:20.818580 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a0ea968f-ff27-43cb-9572-bbb2dda439ac req-36c341ef-e424-44c3-9136-d9df8733fe28 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044234 Aug 29 15:45:20.820393 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1030/2080] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:20.828187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:20.830995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:20.839081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.839759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.841215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:20.842276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:20.843841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:20.844371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.048752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.054640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.060740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.062974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.064632 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3abeb0a5-a39a-4b70-a6e9-b6a6875ddd70 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.485174 Aug 29 15:45:21.065695 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1051/2081] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:20 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:21.066443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.069830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.071161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7298b18d-3daa-44c2-89b9-07c9e0528725 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edba9a60>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.073307 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8efc2d6b-4d1a-4d4a-bb60-d77acacb8828 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.249733 Aug 29 15:45:21.074849 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1031/2082] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:20 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:21.080646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.081517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.089022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.089638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.090169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.090964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.091570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.092085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.126648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-7298b18d-3daa-44c2-89b9-07c9e0528725 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:45:21.127347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-7298b18d-3daa-44c2-89b9-07c9e0528725 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 00f3c891-f006-4c20-92bc-f27acf7288f4 not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:45:21.127989 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7298b18d-3daa-44c2-89b9-07c9e0528725 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:45:21.127989 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-fca0bcc9-1a5c-4d01-a174-cd1a2058a3e1'] Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7298b18d-3daa-44c2-89b9-07c9e0528725 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4 HTTP/1.1 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-fca0bcc9-1a5c-4d01-a174-cd1a2058a3e1'] Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '00f3c891-f006-4c20-92bc-f27acf7288f4'} Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:45:21.130363 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fca0bcc9-1a5c-4d01-a174-cd1a2058a3e1'] Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fca0bcc9-1a5c-4d01-a174-cd1a2058a3e1'] Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fca0bcc9-1a5c-4d01-a174-cd1a2058a3e1'] Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fca0bcc9-1a5c-4d01-a174-cd1a2058a3e1'] Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7298b18d-3daa-44c2-89b9-07c9e0528725 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-fca0bcc9-1a5c-4d01-a174-cd1a2058a3e1'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7298b18d-3daa-44c2-89b9-07c9e0528725 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4" status: 404 len: 194 microversion: 2.1 time: 0.066493 Aug 29 15:45:21.135703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1052/2083] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:21.144502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.145380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] [instance: 17a08bf6-6f38-4ab4-80a3-d5c26296e83e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.151136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.151768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.152562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.153174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'fault' on Instance uuid 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:21.165116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.167907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.168438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.169292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.170187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.171392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.195905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] HTTP exception thrown: Instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e could not be found. Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Request method failure captured: Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e HTTP/1.1 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN6sk77of2skLPg9myVWR49uSF9YZ0eJrkmr9y7W_uo80L3MMlziPY4ccEXWT9hcMUK-yfs3c-8HPQIINo04BvFEJyMoPRNA5MLSEpjvIRefdUcmFv8_59XnLxKIa_YvVs1Q8nI3bvAuuHcx6Bn3_6NktaW5OIrAqQGg2FH17RMh8T0 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bd150e4d120d4c6584c650e747abb6a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd150e4d120d4c6584c650e747abb6a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bd150e4d120d4c6584c650e747abb6a4"}]}] Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bd150e4d120d4c6584c650e747abb6a4 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1176349840 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 0c19d2e9ffa64e7586e35035176f1c26 Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1176349840-project Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e could not be found. Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '17a08bf6-6f38-4ab4-80a3-d5c26296e83e'} Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e could not be found. Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e could not be found. Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.197498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e could not be found. Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] Returning 404 to user: Instance 17a08bf6-6f38-4ab4-80a3-d5c26296e83e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2f8f0f60-4808-4e3a-b2c5-57a8387be784 tempest-FloatingIPsAssociationTestJSON-1176349840 tempest-FloatingIPsAssociationTestJSON-1176349840-project] 10.222.0.83 "GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e" status: 404 len: 111 microversion: 2.1 time: 0.062514 Aug 29 15:45:21.203739 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1053/2084] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/17a08bf6-6f38-4ab4-80a3-d5c26296e83e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:21.208992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.217387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f7b72b4b-5893-4fe7-b9f2-d7bd159a71a2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edc08ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.221739 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5cd975f-fbf2-4ba6-8ca2-9608740565ad tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1305 microversion: 2.1 time: 0.145405 Aug 29 15:45:21.223167 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1032/2085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:21.246040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.249768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.258640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.259193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.259624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.260877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.261527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.262115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.417292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.426957 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b9ca12d-052d-48dc-ab05-a114dde3b269 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.184525 Aug 29 15:45:21.428092 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1033/2086] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:21.598520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:21.599327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:21.608499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.609168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.609691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.610417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:21.610868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:21.611316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:21.752205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:21.760385 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac38289b-489b-4505-8486-8a0e2fd39797 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.165727 Aug 29 15:45:21.760958 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1034/2087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:21.817599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f7b72b4b-5893-4fe7-b9f2-d7bd159a71a2 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.606150 Aug 29 15:45:21.818286 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1054/2088] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:45:21 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:21.833988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b5cfc6e-05e1-4703-92eb-389b73d488a6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32edc630d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-359302689", "description": "tempest-description-171986292"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:21.983477 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b5cfc6e-05e1-4703-92eb-389b73d488a6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.153213 Aug 29 15:45:21.993163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1035/2089] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:45:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:21.999856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6259653c-6c96-4755-8661-737009a56c5f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32edbfc940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-309043066", "description": "tempest-description-19521053"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:22.076344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:22.092558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.093470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.101076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.103768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.105379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.106897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.107423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.109582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.395721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.408464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.410058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.411234 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0cb7c456-9c0a-473f-9dfc-9d00daf4f245 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.322713 Aug 29 15:45:22.412372 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1036/2090] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:22.413765 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6259653c-6c96-4755-8661-737009a56c5f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.419455 Aug 29 15:45:22.422618 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1055/2091] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:45:21 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:22.422618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.422618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.433057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.433613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.433752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.434371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.435495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.435854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.436843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.437521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.455485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.456298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.456968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.457853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.458472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.459145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.481167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:22.489305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.491362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.492332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.493044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'fault' on Instance uuid 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:22.546876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.552686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:22.559261 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d3b9f00d-e4cb-4541-8e2c-b3f158ffba9e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 200 len: 1305 microversion: 2.1 time: 0.143792 Aug 29 15:45:22.559922 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1056/2092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:22.566635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.567395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.574525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.575156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.575689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.576598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.577890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.578314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.722534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.754563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.762203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.763778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6054c891-5d95-4745-beb6-a2949e7527f2 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.350030 Aug 29 15:45:22.767539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1037/2093] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:22.780567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-899137579", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "d0e545d3-95a8-49be-9c49-585beb9d4250"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:22.833639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:22.846204 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-153f6714-1768-41a7-afcf-34afd868a27a tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.284988 Aug 29 15:45:22.849188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1057/2094] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:22.857879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:22.860572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:22.868034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:22.883159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.883738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.884264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:22.885213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:22.886513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] validate_networks() for [('d0e545d3-95a8-49be-9c49-585beb9d4250', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:22.887752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:22.888205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.241705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.253241 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca6c89a9-53ab-4259-a3bb-722c286b194e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.402701 Aug 29 15:45:23.266746 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1058/2095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:22 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:23.436656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.437427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.456716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.457216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.457649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.458358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.484860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.491975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.597879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:23.600981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:23.602737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:23.603199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:23.603631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:23.624832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.626307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.626984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.629600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.631261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.631924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.660999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Getting quotas for project a27922448d754caea1e19340b11bfd64. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:23.668150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Getting quotas for user a9fcf93e985b4a09a67b719508d8f812 and project a27922448d754caea1e19340b11bfd64. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:23.683446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:23.688379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:23.754764 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d65b52c6-d83e-462b-b4eb-d61f78a637b5 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985466 Aug 29 15:45:23.756474 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1038/2096] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:23.761556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.762402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.772315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.773718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.774383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.775384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.776843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.777923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.810565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db HTTP/1.1 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '336ce67a-6ab6-43ab-9ae8-1cc6dcd015db'} Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:23.815559 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:23.820260 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:23.820260 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:23.820260 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:23.820260 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:23.820260 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:23.820260 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:45:23.820260 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:45:23.826779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:23.828540 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44ecc106-3310-436f-b083-4e5b5c4b7b5e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 404 len: 111 microversion: 2.1 time: 0.071038 Aug 29 15:45:23.832428 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1039/2097] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:45:23.849078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-014f2c07-e692-47a2-8b2f-fdc48e820a46 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.849709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-014f2c07-e692-47a2-8b2f-fdc48e820a46 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.952171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-014f2c07-e692-47a2-8b2f-fdc48e820a46 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:23.964922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-014f2c07-e692-47a2-8b2f-fdc48e820a46 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1215 microversion: 2.1 time: 0.131405 Aug 29 15:45:23.965843 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1040/2098] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:23.971892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:23.973753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:23.982204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.983636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.984902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:23.985828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:23.986497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:23.987163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.190054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.199667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.200371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.201211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.202959 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c0d0185-1098-44e6-9e02-ffe41c468b3b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.235963 Aug 29 15:45:24.203553 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1041/2099] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:24.209345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.210171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.217660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.218539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.219231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.220457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.223651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.224438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.225807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.227455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.228624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a1c5c48c-0009-4286-aab4-37eade938f91 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.797400 Aug 29 15:45:24.229173 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1059/2100] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:23 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:24.249794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1911799208", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9bbf042d-13bc-4426-83e8-c7e73123f015"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:24.318837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] validate_networks() for [('9bbf042d-13bc-4426-83e8-c7e73123f015', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:24.480317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.503436 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f909480d-d207-4689-8a1c-24b4a3bae7bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.298048 Aug 29 15:45:24.508800 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1042/2101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:24.526118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.528019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:24.543919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.545298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.546192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.548061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.560665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.561421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.846246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:24.864364 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1aa4bfd6-28ed-4318-9f20-3462e72fb8e3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.353925 Aug 29 15:45:24.865568 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1043/2102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:24.871883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-087b950b-0fc5-4bc8-a3d6-ae2fbfed8869 req-d9178389-73e0-4112-966d-9c7ac6ae398b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c69654a-6a13-4653-9c37-04df93393b26", "name": "network-vif-unplugged", "status": "completed", "tag": "b976629e-c63c-432c-89e0-f9d9bfd35a55"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:24.888040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-087b950b-0fc5-4bc8-a3d6-ae2fbfed8869 req-d9178389-73e0-4112-966d-9c7ac6ae398b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:24.892177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-087b950b-0fc5-4bc8-a3d6-ae2fbfed8869 req-d9178389-73e0-4112-966d-9c7ac6ae398b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:24.893368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-087b950b-0fc5-4bc8-a3d6-ae2fbfed8869 req-d9178389-73e0-4112-966d-9c7ac6ae398b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:24.915124 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-087b950b-0fc5-4bc8-a3d6-ae2fbfed8869 req-d9178389-73e0-4112-966d-9c7ac6ae398b service nova] Creating event network-vif-unplugged:b976629e-c63c-432c-89e0-f9d9bfd35a55 for instance 2c69654a-6a13-4653-9c37-04df93393b26 on n-h2-836830-13 Aug 29 15:45:24.924481 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-087b950b-0fc5-4bc8-a3d6-ae2fbfed8869 req-d9178389-73e0-4112-966d-9c7ac6ae398b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057346 Aug 29 15:45:24.925437 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1044/2103] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:24.991693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:24.993441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.010599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.015809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.017478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.018910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.020963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.022463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.222918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.232565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-414d4fa6-fc29-4f7e-b7b7-d3862ed67c2d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1267 microversion: 2.1 time: 0.247449 Aug 29 15:45:25.233163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1045/2104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:24 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:25.251161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.252169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.268200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.273703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.274991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.276040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.276939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.278116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.574158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.588203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.590287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:25.591733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e47a4e9a-623e-41d5-b17b-1ccfe42819b9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.351824 Aug 29 15:45:25.592799 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1046/2105] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:25.598633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.599647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.608529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.609531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.609981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.610724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.611702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.611702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.650627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:25.651807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:25.652464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:25.653031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:25.653596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:25.673735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.676456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.677065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.679411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.681120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.681895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.709658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:25.718526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for user 853f8300f9bb403b9cea4834c5a1edcb and project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:25.733155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:25.736418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:25.824396 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79f815a7-fdc7-4d45-af03-7ae047ccdad4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579560 Aug 29 15:45:25.825206 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1060/2106] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:25.831757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:25.832855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:25.841249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.842048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.842905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:25.843849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:25.844493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:25.845076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.181233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.192403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.193860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.195049 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73d48653-c9ea-471b-a515-bffc1d42d2c1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.600826 Aug 29 15:45:26.219328 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1047/2107] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:26.223983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-629a0c9d-f743-428d-8233-6e304ea154e7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.224621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-629a0c9d-f743-428d-8233-6e304ea154e7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:26.298781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.312216 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d93e1081-32c4-4533-9649-9bd4be3a1039 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.483837 Aug 29 15:45:26.322527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1061/2108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:25 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:26.334474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.339547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:26.353870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.356294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.357032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.358406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.361472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.361927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.828225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-629a0c9d-f743-428d-8233-6e304ea154e7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.847232 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-629a0c9d-f743-428d-8233-6e304ea154e7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1215 microversion: 2.1 time: 0.639661 Aug 29 15:45:26.855443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1048/2109] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1215 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:26.867335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:26.868585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:26.878146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.878942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.879627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.880610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:26.882042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:26.882539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:26.964660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:26.978937 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6fcaa61c-d9af-4373-911e-7755cc017526 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1273 microversion: 2.1 time: 0.120023 Aug 29 15:45:26.979679 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1049/2110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:27.011971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:27.012590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:27.030386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.030842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.031312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.032034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.032487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.032908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.053196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.064906 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-488a3253-c819-4b16-acfa-9e0a16c66896 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.740973 Aug 29 15:45:27.065516 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1062/2111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:27.081022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4c362592-9f85-45fe-9a9b-1fdf4e7ef7ff req-6c6d8bec-6e03-4bbe-ba24-510e3f7166d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c69654a-6a13-4653-9c37-04df93393b26", "tag": "b976629e-c63c-432c-89e0-f9d9bfd35a55"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:27.109425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c362592-9f85-45fe-9a9b-1fdf4e7ef7ff req-6c6d8bec-6e03-4bbe-ba24-510e3f7166d0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.110011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c362592-9f85-45fe-9a9b-1fdf4e7ef7ff req-6c6d8bec-6e03-4bbe-ba24-510e3f7166d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.110542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c362592-9f85-45fe-9a9b-1fdf4e7ef7ff req-6c6d8bec-6e03-4bbe-ba24-510e3f7166d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.133169 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4c362592-9f85-45fe-9a9b-1fdf4e7ef7ff req-6c6d8bec-6e03-4bbe-ba24-510e3f7166d0 service nova] Creating event network-changed:b976629e-c63c-432c-89e0-f9d9bfd35a55 for instance 2c69654a-6a13-4653-9c37-04df93393b26 on n-h2-836830-13 Aug 29 15:45:27.144672 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4c362592-9f85-45fe-9a9b-1fdf4e7ef7ff req-6c6d8bec-6e03-4bbe-ba24-510e3f7166d0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077767 Aug 29 15:45:27.149322 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1063/2112] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:27.234734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:27.235615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:27.245643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.250370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.253621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.258741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.259469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.260079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.621997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.632427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.642237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:27.643712 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f7ec74b5-24f6-445c-8ff2-716aa1fc5eaf tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.648298 Aug 29 15:45:27.654335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1050/2113] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:26 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:27.660109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:27.661772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:27.675619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.676515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.677142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:27.678001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:27.685820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:27.687999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.175701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.211418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.213584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.216317 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37366aa7-e0ff-4be4-b201-555d39ff6cce tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.986596 Aug 29 15:45:28.238896 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1064/2114] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:27 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:28.249580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.250460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.259491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.271258 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2cee213f-2a96-48fb-ae8f-bcffbc3f1178 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.614818 Aug 29 15:45:28.271855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1051/2115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:27 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.272844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.273564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.274257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.275509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.276851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.277527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.311086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2d882cd1-c542-4fe2-b8fe-7f1f538da7b7 req-5f688e3c-a0e4-4724-90e8-6b3ecbd5a8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a59b56d-57a1-4efa-876c-9eb4ffe3caf7", "name": "network-vif-plugged", "status": "completed", "tag": "c6c851cd-bc07-4beb-8aa2-14e69e41d52d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:28.342511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d882cd1-c542-4fe2-b8fe-7f1f538da7b7 req-5f688e3c-a0e4-4724-90e8-6b3ecbd5a8e9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.343250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d882cd1-c542-4fe2-b8fe-7f1f538da7b7 req-5f688e3c-a0e4-4724-90e8-6b3ecbd5a8e9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.344000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d882cd1-c542-4fe2-b8fe-7f1f538da7b7 req-5f688e3c-a0e4-4724-90e8-6b3ecbd5a8e9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.382378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2d882cd1-c542-4fe2-b8fe-7f1f538da7b7 req-5f688e3c-a0e4-4724-90e8-6b3ecbd5a8e9 service nova] Creating event network-vif-plugged:c6c851cd-bc07-4beb-8aa2-14e69e41d52d for instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 on n-h2-836830-13 Aug 29 15:45:28.400388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2d882cd1-c542-4fe2-b8fe-7f1f538da7b7 req-5f688e3c-a0e4-4724-90e8-6b3ecbd5a8e9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106405 Aug 29 15:45:28.401004 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1052/2116] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:28.408142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.409152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.416779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.417415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.418021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.418850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.419393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.419965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.461713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.474885 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d8c3e37-d2d0-404b-b243-8fc2e1a71eca tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1267 microversion: 2.1 time: 0.234447 Aug 29 15:45:28.487059 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1065/2117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.487059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.487059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.506606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.507315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.507848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.508834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.509537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.510199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.743777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.785670 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-387ab332-b163-495c-a31c-cec5f862881f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.308131 Aug 29 15:45:28.786660 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1066/2118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.796915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:28.811516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:28.825078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:28.828169 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed87edc9-a5a5-4894-943f-234ef57cfd41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.414649 Aug 29 15:45:28.828844 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1053/2119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:28.841525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.842173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.843350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:28.844863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:28.845643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:28.846701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.255456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.256500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.266204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:29.282594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.283418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.284309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.285307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.285976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.286598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.363479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.388197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.391423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.395807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42d9f0da-febe-4b56-827d-089dbe996274 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.605168 Aug 29 15:45:29.402432 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1067/2120] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:28 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:29.412604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.413431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.420972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.422114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.422957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.424067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.424765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.425426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.431400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:29.637556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.664839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72aa169f-ae49-4dab-b256-625a88f8d20b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.260891 Aug 29 15:45:29.665546 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1068/2121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:29.672659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.674055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.687105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.687684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.688224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.689246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.689780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.690291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.766601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.775949 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a14d230d-ac0f-49c2-b860-4a76bc86c9b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1273 microversion: 2.1 time: 0.109326 Aug 29 15:45:29.776630 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1069/2122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:29.782755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-86607ad9-d623-4518-b3ac-eec9c7281156 req-3fc5b3cc-9500-42a6-8f63-47276ab408a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84901dc8-b1fb-4b33-ba18-4f5ac98666ca", "tag": "f68364fe-308b-47e5-b6fa-d75a66d8d8d5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:29.795297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-86607ad9-d623-4518-b3ac-eec9c7281156 req-3fc5b3cc-9500-42a6-8f63-47276ab408a8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.796662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-86607ad9-d623-4518-b3ac-eec9c7281156 req-3fc5b3cc-9500-42a6-8f63-47276ab408a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.797319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-86607ad9-d623-4518-b3ac-eec9c7281156 req-3fc5b3cc-9500-42a6-8f63-47276ab408a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.817246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-86607ad9-d623-4518-b3ac-eec9c7281156 req-3fc5b3cc-9500-42a6-8f63-47276ab408a8 service nova] Creating event network-changed:f68364fe-308b-47e5-b6fa-d75a66d8d8d5 for instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca on n-h1-836830-13 Aug 29 15:45:29.833726 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-86607ad9-d623-4518-b3ac-eec9c7281156 req-3fc5b3cc-9500-42a6-8f63-47276ab408a8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055605 Aug 29 15:45:29.835114 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1070/2123] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:29.842966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.844092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.852656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.853160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.853605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.854312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.854773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.855246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.923913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.933806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.935352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:29.937167 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1a83655-3890-49b1-9b52-66636d90ebba tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.695187 Aug 29 15:45:29.938848 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1054/2124] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:29.956244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:29.956942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:29.963976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.964860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.966511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:29.967955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:29.968853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:29.969545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.099392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.110510 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-961b434d-00fb-4dab-b48a-18d2680aa745 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.273781 Aug 29 15:45:30.111416 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1071/2125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:30.248158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.260765 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-151fd2f0-09a9-4041-ad4d-12ab046a48bf tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.320472 Aug 29 15:45:30.262225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1055/2126] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:29 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:30.419687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.420245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.426976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.427725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.428359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.429269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.429975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.430566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.665119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.674509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.677192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.678561 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-139b3ef8-77dc-4cba-bed7-353cdb92b52e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.263215 Aug 29 15:45:30.696691 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1072/2127] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:30.704718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.705358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.718846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.719538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.719985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.720705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.721166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.721591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.800280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.800776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.810504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.816066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.816760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.817691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.818323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.818944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.931804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:30.944110 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cec41591-fef6-4d6a-a8fb-e4db30345a0c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1273 microversion: 2.1 time: 0.147559 Aug 29 15:45:30.957179 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1073/2128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:30.964749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:30.965653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:30.973635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.974380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.975014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:30.975951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:30.976625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:30.977647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.241519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.255540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.259701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.262885 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-96eae7f1-cd78-481a-831a-e2bb677a896f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.304340 Aug 29 15:45:31.265378 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1074/2129] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:31.274137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.278277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.293472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.298955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.299847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.301177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.302132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.302774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.402210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.420993 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a7ef5e5-f0e2-4673-b496-1898030c771b tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.718092 Aug 29 15:45:31.423844 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1056/2130] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:30 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:31.437224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.437868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.455011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.455188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.455770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.459109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.459898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.460376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.615590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.628412 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4788f257-f6f2-4806-967f-a65705dd443f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1316 microversion: 2.1 time: 0.361449 Aug 29 15:45:31.644975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1075/2131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:31.709865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.710766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.724079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.724584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.725026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.735260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.735910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.736367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.901529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:31.913040 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ebe2d509-64b6-43a1-a723-a22da5f7f735 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.485785 Aug 29 15:45:31.915332 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1057/2132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:31.968931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:31.970381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:31.982503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.985596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.986246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:31.988211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:31.992255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:31.992946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.112926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.130616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.137218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.138678 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7caca091-2ce5-4521-9a60-1a63849c7d6d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.434907 Aug 29 15:45:32.142132 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1076/2133] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:32.261673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.269405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:32.276865 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7359428d-a22b-4f31-bbdb-367200e543eb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1273 microversion: 2.1 time: 0.312390 Aug 29 15:45:32.291168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1058/2134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:31 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1273 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:32.299349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.300287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.315983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.318216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.318672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.320893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.321439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.321879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.445003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.446198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.459131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.465092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.465899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.469219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.469962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.470651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.797792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.813224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.814833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:32.816047 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb1b31ca-e6d9-4f5d-8b47-a67810836008 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.523794 Aug 29 15:45:32.832464 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1077/2135] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:32.833736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:32.837792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:32.851303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.851832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.856359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:32.857377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:32.858909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:32.859550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.030651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.050111 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcd3249c-8ac6-4afb-bf4e-15cdbfa9fc53 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.608791 Aug 29 15:45:33.052609 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1059/2136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:33.069213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.070356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.078677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.080304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.080957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.082120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.082809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.083445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.178445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.188562 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-130e3052-7234-48ab-b78c-3f069b2512ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1466 microversion: 2.1 time: 0.363992 Aug 29 15:45:33.189760 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1078/2137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:32 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1466 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:33.195732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.196654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.204806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.205620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.206910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.207928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.209187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.210011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.492704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.505810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.507478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.509841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed5b3f28-820e-4940-8710-5a571547b089 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.318900 Aug 29 15:45:33.510685 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1079/2138] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:33.516925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.517881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.526896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.527855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.528544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.530978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.532236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.533158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.646763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:33.712895 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d3d71bdf-a34a-4886-813b-135ef2194361 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1619 microversion: 2.1 time: 0.200593 Aug 29 15:45:33.713533 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1080/2139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1619 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:33.721449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.722081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.729834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.730337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.730853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.735896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.736488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.737151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.963958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:33.972807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b5a3141-9a4f-4126-93e6-19c6ec88cecb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.256857 Aug 29 15:45:33.973946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1081/2140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:33.978565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:33.979209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:33.986296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.986994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.987626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:33.988554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:33.989177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:33.989770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.036083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.047963 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f2caeaa5-b685-4dbf-9afc-597fea116656 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.992462 Aug 29 15:45:34.051350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1060/2141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:34.056015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-687533761", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "47f1aebf-dfb9-406c-b132-1081aacd03ef"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:34.183328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:34.256897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.271805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.273378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.274908 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ea63f3e-741b-437f-a855-d8d27a2d3f1b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.299650 Aug 29 15:45:34.276093 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1082/2142] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:33 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:34.282382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.283204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:34.292383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.292877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.293378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.294082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.294536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.295772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.490054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.502905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9623b331-1702-4297-a4ff-2c6dc28012af tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.225619 Aug 29 15:45:34.519415 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1083/2143] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:34.541228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:34.542494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:34.553559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.554526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.556356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.557409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:34.558208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:34.559467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:34.769142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.781690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.782633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:34.783903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cccd1e7b-f1a5-4fe2-8c61-84c665678c4e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.249429 Aug 29 15:45:34.784677 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1084/2144] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:35.002216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.004529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.011604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.012794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.013396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.014259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.014829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.015390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.034404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:35.179776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.190014 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a79f8dd-483f-4468-bf5b-58e959f40e8b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.199497 Aug 29 15:45:35.190845 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1085/2145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:34 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:35.209068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.210314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.216826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.217694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.218510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.219649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.220278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.220864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.431765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.442387 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b84072a5-d702-4955-b6fa-510a3f5f9cf3 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.237744 Aug 29 15:45:35.443790 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1086/2146] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:35.454064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.454736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.461118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.461941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.462754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.463786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.464659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.465830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.522977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:35.529069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:35.530423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:35.531398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:35.532627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:35.574448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.575769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.578715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.580647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.581853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.584364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.623047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:35.632022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Getting quotas for user efd373f4dbd944aa82c96a42545c7479 and project 3da73abe36a64bde9e9fc9315f1a87b4. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:35.662913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:35.665207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:35.706350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:35.727511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:35.787185 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49062705-17d8-48bf-a86d-e9c402645b1b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734439 Aug 29 15:45:35.790610 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1061/2147] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:35.800544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.803649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:35.815436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.817575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.820126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.822806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:35.823750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:35.825859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:35.848896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.859535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.870190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:35.874164 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef1a21e5-586c-44cf-9476-282155a0aa50 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.427073 Aug 29 15:45:35.877066 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1087/2148] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:35.885541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea97f608-7d34-4136-ae4d-b2896246db29 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:35.888791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea97f608-7d34-4136-ae4d-b2896246db29 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.020825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ea97f608-7d34-4136-ae4d-b2896246db29 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.040574 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea97f608-7d34-4136-ae4d-b2896246db29 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1216 microversion: 2.1 time: 0.161506 Aug 29 15:45:36.045735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1088/2149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.055949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.067711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.088183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.088683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.089188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.090486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.092907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.094224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.400406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.413955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.417790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.429073 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d252c9b-ee27-4494-97ad-f931ea26dfb6 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.380471 Aug 29 15:45:36.430235 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1089/2150] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:36.437089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.437899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.445323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.446090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.447698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.448624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.449265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.449949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.682215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.695410 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b1ca06b1-2690-4b5d-b409-2ad0e06f09b1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.263328 Aug 29 15:45:36.696499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1090/2151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.702670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.703827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.711719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.713251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.714099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.715376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.715891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.716462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.885746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:36.895840 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ac23ca2-c5b2-4065-8d1e-2d0b329195f1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 1.103432 Aug 29 15:45:36.896838 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1062/2152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:35 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:36.902207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:36.903204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:36.928403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.928751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.929198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:36.929930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:36.930396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:36.930844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.084679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.094418 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e5c948c-cda8-4463-9d5e-905ff4687892 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.396431 Aug 29 15:45:37.112192 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1091/2153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:37.119866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.120499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.143327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.143871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.144327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.145067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.145780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.146203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.256181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.267742 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-786d222f-d84b-492a-80b6-7398d9183e73 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1212 microversion: 2.1 time: 0.154428 Aug 29 15:45:37.268328 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1092/2154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1212 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:37.273235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.290501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.292464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.296562 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d700ce34-984b-4e5a-ad8c-860ee47b6c6e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.398435 Aug 29 15:45:37.309257 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1063/2155] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:36 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:37.457530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.458512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.490354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.493993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.494783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.498009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.499435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.500052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.644220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6e984d6c-3338-4279-a604-7b8e5088b486 req-4c9ecb4d-e7a0-4955-92eb-fc11a292a226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d3ca4c-bcb4-444d-a316-0ba73c73182d", "tag": "c3a5ec6c-d281-4b8b-99c8-5931934e075f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:37.662083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e984d6c-3338-4279-a604-7b8e5088b486 req-4c9ecb4d-e7a0-4955-92eb-fc11a292a226 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.664072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e984d6c-3338-4279-a604-7b8e5088b486 req-4c9ecb4d-e7a0-4955-92eb-fc11a292a226 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.667330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e984d6c-3338-4279-a604-7b8e5088b486 req-4c9ecb4d-e7a0-4955-92eb-fc11a292a226 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.697143 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6e984d6c-3338-4279-a604-7b8e5088b486 req-4c9ecb4d-e7a0-4955-92eb-fc11a292a226 service nova] Creating event network-changed:c3a5ec6c-d281-4b8b-99c8-5931934e075f for instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d on n-h2-836830-13 Aug 29 15:45:37.710553 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6e984d6c-3338-4279-a604-7b8e5088b486 req-4c9ecb4d-e7a0-4955-92eb-fc11a292a226 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071035 Aug 29 15:45:37.716635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1064/2156] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:37.725459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.736361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.746734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.747670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.749005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.750081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.752510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.753541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:37.937782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.960767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.966922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:37.972550 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c7139dc-1f13-4b74-a662-81f035ed1c46 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.517396 Aug 29 15:45:37.973738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1093/2157] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:37.981150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:37.982035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:37.990869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:37.991740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:37.995865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.004822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.005317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.006650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.169766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.182976 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73b8992e-d160-44b7-8b7e-562ab2d52207 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.462983 Aug 29 15:45:38.200791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1065/2158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:38.206669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.207276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:38.232650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.234004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.234662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.235639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.236830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.240235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.474271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.486661 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc986ac9-39fa-41f5-b098-4aa5b3b31ea3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.511560 Aug 29 15:45:38.487915 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1094/2159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:37 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:38.493802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.494656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:38.504924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.508877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.512158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.512992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.513515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.514173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.602693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.616459 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f47eedb-5e39-44ec-a051-1783000d9e71 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.414016 Aug 29 15:45:38.636890 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1066/2160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:38 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:38.659939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.661725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:38.673513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.674004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.674439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.675282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:38.676397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:38.677507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:38.712173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:38.727538 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-16d08960-70b1-4ab2-88f0-c1a841869bb9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1268 microversion: 2.1 time: 0.238101 Aug 29 15:45:38.731584 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1095/2161] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:38 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1268 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:38.999066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:38.999833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.014417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.015240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.015918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.019533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.020029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.025542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.361838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.378869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.383215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.384712 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe03e389-4560-451d-bf32-4e358ca74def tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.745776 Aug 29 15:45:39.385465 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1067/2162] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:38 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:39.393964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.396896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.405787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.406713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.407363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.408501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.409835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.410450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.738972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.747233 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ab39cd8-04ed-4e4e-984b-62e142378d92 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.360270 Aug 29 15:45:39.750878 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1068/2163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:39.762648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.763326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.774497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.775059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.775791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.777192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.777839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.778305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.851630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.862427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.869144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:39.874381 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba9865ff-b924-4d3b-9c36-ac8703fc1a6c tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1487 microversion: 2.25 time: 0.879037 Aug 29 15:45:39.876190 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1096/2164] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:38 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1487 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:39.885065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:39.885688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:39.912763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.913261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.913698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:39.914403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:39.914853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:39.915299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.384952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.402879 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1db12368-1762-4b92-9e28-c53e84a57535 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1475 microversion: 2.1 time: 0.650166 Aug 29 15:45:40.407501 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1069/2165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1475 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.420029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.421527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.422666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.430356 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c498800-dcb5-4d4b-9710-01e8c1fc0b7c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.552322 Aug 29 15:45:40.434953 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1097/2166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:39 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.437377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.439459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.440163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.442666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.444174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.445501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.625725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-245643769", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "de1443b1-39f5-4061-a39a-7893400b1341"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:40.714204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] validate_networks() for [('de1443b1-39f5-4061-a39a-7893400b1341', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:40.759325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:40.789304 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5592eac1-e819-4f36-9145-4b28ef6ec7ee tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1274 microversion: 2.1 time: 0.379978 Aug 29 15:45:40.797064 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1070/2167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1274 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:40.806410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:40.814167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:40.837011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.837916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.838530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:40.841810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:40.842723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:40.844030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.719077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.734270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.738902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:41.750461 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-357c7110-a957-459f-a5b0-9dbad3d329c9 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.952085 Aug 29 15:45:41.751570 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1071/2168] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:40 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:41.761234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:41.762132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:41.778047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.789886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.790711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:41.791507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:41.791973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:41.792398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.232554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:42.260867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:42.261442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:42.261967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:42.262381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:42.262934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:42.277520 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8769e6fc-85b5-40ad-b57c-43661d8ce393 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.519292 Aug 29 15:45:42.292934 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1072/2169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:41 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:42.293887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.294611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.296058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.297056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.297756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.298408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.306314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.307321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.315113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.315885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.316574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.317904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:42.318438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.319129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.319810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.324105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Getting quotas for project c649ecccd1a4487aa9e1a282d631be1a. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:42.345260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Getting quotas for user 5c9cc007c0504400b414c395570e98ca and project c649ecccd1a4487aa9e1a282d631be1a. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:42.381045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:42.384857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:42.497373 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-793fe72f-9082-4470-b9d4-611705f544a3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059472 Aug 29 15:45:42.499823 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1098/2170] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:42.506042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:42.507372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:42.516402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.517515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.518765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:42.519895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:42.521949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:42.522585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.044032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.074916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.083931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.088077 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aeec36e5-d084-4886-8e8d-22ccdbd745cd tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1477 microversion: 2.25 time: 0.792495 Aug 29 15:45:43.090686 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1073/2171] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1477 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:43.097449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:43.098644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:43.117991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.119188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.119833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.124133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.125273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.126441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.592494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.607440 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bde6ecb2-d000-405f-9843-c44387f360d6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.514289 Aug 29 15:45:43.609325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1074/2172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:43 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:43.620956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:43.622874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:43.639830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.640352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.640806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.641544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:43.644767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:43.645481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:43.973906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:43.991522 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94476505-ae5b-4fcf-87f7-452f3a50982e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.378366 Aug 29 15:45:43.996676 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1075/2173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:43 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:44.006101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.007564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.029309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.031099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.032218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.043163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.043841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.044296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.065366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.087152 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-927c9e79-b669-4d3c-bc74-c320940be174 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1474 microversion: 2.1 time: 1.584713 Aug 29 15:45:44.088379 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1099/2174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:42 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1474 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:44.095138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.096367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.104227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.105138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.105741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.107158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.108317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.109328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.167568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.172883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:44.177946 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28ef81ef-2ec7-4631-91d3-8b6de989a5b0 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1220 microversion: 2.1 time: 0.179852 Aug 29 15:45:44.178992 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1076/2175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:43 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:44.195937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f593192f-7604-4bbd-a88d-a6d40888a8b3 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '.version_select at 0x7f32eef0ff70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.202751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f593192f-7604-4bbd-a88d-a6d40888a8b3 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.203629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f593192f-7604-4bbd-a88d-a6d40888a8b3 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.204270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f593192f-7604-4bbd-a88d-a6d40888a8b3 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.221138 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f593192f-7604-4bbd-a88d-a6d40888a8b3 tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 3666 microversion: 2.25 time: 0.040652 Aug 29 15:45:44.223330 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1077/2176] 10.222.0.83 () {60 vars in 1184 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/os-migrations => generated 3666 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:44.228009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2d028a52-aab8-4c68-b1b6-588252e3f8a8 req-da39fe67-6878-43f6-be61-c555a2fb4c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "name": "network-vif-unplugged", "status": "completed", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:44.244946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d028a52-aab8-4c68-b1b6-588252e3f8a8 req-da39fe67-6878-43f6-be61-c555a2fb4c5f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.246275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d028a52-aab8-4c68-b1b6-588252e3f8a8 req-da39fe67-6878-43f6-be61-c555a2fb4c5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.246870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d028a52-aab8-4c68-b1b6-588252e3f8a8 req-da39fe67-6878-43f6-be61-c555a2fb4c5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.265785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2d028a52-aab8-4c68-b1b6-588252e3f8a8 req-da39fe67-6878-43f6-be61-c555a2fb4c5f service nova] Creating event network-vif-unplugged:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h1-836830-13 Aug 29 15:45:44.275203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-2d028a52-aab8-4c68-b1b6-588252e3f8a8 req-da39fe67-6878-43f6-be61-c555a2fb4c5f service nova] Instance c1c48488-7ccd-47b0-afaf-00706b074dea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:45:44.289036 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2d028a52-aab8-4c68-b1b6-588252e3f8a8 req-da39fe67-6878-43f6-be61-c555a2fb4c5f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064305 Aug 29 15:45:44.289837 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1078/2177] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:44.296282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.296997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.303298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.303783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.304234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.304940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.305392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.305816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.494240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.503442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d0cedf88-971d-4d69-953b-5fe16d6ac249 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.212124 Aug 29 15:45:44.503994 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1079/2178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:44.508954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.509833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.519926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.520768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.521230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.522074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.522526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.522949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.668226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] Lazy-loading 'services' on Instance uuid 2c69654a-6a13-4653-9c37-04df93393b26 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:44.669829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.683440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.685008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:44.687213 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e50441a-2056-4a98-8bd1-5127a492d02c tempest-LiveAutoBlockMigrationV225Test-1190807314 tempest-LiveAutoBlockMigrationV225Test-1190807314-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1971 microversion: 2.25 time: 0.180317 Aug 29 15:45:44.687368 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4330dfd-0f47-47b9-a947-480f84bc45ee tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.597402 Aug 29 15:45:44.688024 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1100/2179] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:44.692969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a48b3c30-19b4-4863-a46f-5eb19a8fd082 req-4c3167e1-67f6-439a-8d37-73a4e394f12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97fbcb39-0ebf-43f6-95ab-ffc8cf599146", "tag": "4355e20c-05c7-4c4c-a2a6-06aece1a8216"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:44.703016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a48b3c30-19b4-4863-a46f-5eb19a8fd082 req-4c3167e1-67f6-439a-8d37-73a4e394f12f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.703873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a48b3c30-19b4-4863-a46f-5eb19a8fd082 req-4c3167e1-67f6-439a-8d37-73a4e394f12f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.704001 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1080/2180] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1971 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:44.704585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a48b3c30-19b4-4863-a46f-5eb19a8fd082 req-4c3167e1-67f6-439a-8d37-73a4e394f12f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.718032 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a48b3c30-19b4-4863-a46f-5eb19a8fd082 req-4c3167e1-67f6-439a-8d37-73a4e394f12f service nova] Creating event network-changed:4355e20c-05c7-4c4c-a2a6-06aece1a8216 for instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 on n-h1-836830-13 Aug 29 15:45:44.723969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a48b3c30-19b4-4863-a46f-5eb19a8fd082 req-4c3167e1-67f6-439a-8d37-73a4e394f12f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034431 Aug 29 15:45:44.734574 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1101/2181] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:44.735807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.736940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.756738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.757451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.764039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.764814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.765417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.766605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.772245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.773552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.783343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.783940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.784740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.785832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.786474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.787126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.821493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:45:44.914118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:44.951947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-743170af-c0ee-45ab-b2ef-69c9e31f2fa5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 204 len: 0 microversion: 2.25 time: 0.198083 Aug 29 15:45:44.954325 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1102/2182] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:45:44 2022] DELETE /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:45:44.967427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:44.970093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:44.982783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.985113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.986454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.988521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:44.989239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:44.989924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:44.994450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.007107 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ae3b583-d326-4a55-96a3-bff7e03ac67c tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.301570 Aug 29 15:45:45.016064 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1081/2183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.027483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.027483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.043458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.045337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.046810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.049717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.050505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.051565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.302220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.318251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.327854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-89d796aa-a59a-4db2-8636-b07a62555116 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.309380 Aug 29 15:45:45.328870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.332814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.333357 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1082/2184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.335776 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-279fba8d-5db7-445d-939d-bca8c759a067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1483 microversion: 2.25 time: 0.376660 Aug 29 15:45:45.337700 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1103/2185] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:44 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1483 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:45.343889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.344815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.349350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.350580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.364748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.367542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.371241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.372436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.375389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.375814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.377338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.379250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.380432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.381607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.384527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.385218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.501521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.518698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5da2c02e-fcd9-400e-85bb-513bc68b7440 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1220 microversion: 2.1 time: 0.178245 Aug 29 15:45:45.522643 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1104/2186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1220 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.528786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.530067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.545455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.546380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.547354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.548174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.548640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.549513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.612363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:45.644861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.653864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:45.656513 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b4645e83-e065-4f27-8553-1f36ca2384bc tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1474 microversion: 2.1 time: 0.321645 Aug 29 15:45:45.660626 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1083/2187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1474 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.727711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:45.728333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:45.749751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.750564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.751212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.752090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.752705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.753311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.793224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:45.806418 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-95d53e0e-c1fc-46d3-96a6-7b2a000cae70 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.281770 Aug 29 15:45:45.820482 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1105/2188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:45.841835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ac231d41-0828-48c9-92e0-3ba75a6e8695 req-8e7b9aef-0ce5-4e3f-a3b0-cff18a6f6c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-plugged", "status": "completed", "tag": "e65b0349-4179-4165-9636-d17fd8a0a033"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:45.866706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ac231d41-0828-48c9-92e0-3ba75a6e8695 req-8e7b9aef-0ce5-4e3f-a3b0-cff18a6f6c65 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:45.867652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ac231d41-0828-48c9-92e0-3ba75a6e8695 req-8e7b9aef-0ce5-4e3f-a3b0-cff18a6f6c65 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:45.868348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ac231d41-0828-48c9-92e0-3ba75a6e8695 req-8e7b9aef-0ce5-4e3f-a3b0-cff18a6f6c65 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:45.891822 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ac231d41-0828-48c9-92e0-3ba75a6e8695 req-8e7b9aef-0ce5-4e3f-a3b0-cff18a6f6c65 service nova] Creating event network-vif-plugged:e65b0349-4179-4165-9636-d17fd8a0a033 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:45.898890 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ac231d41-0828-48c9-92e0-3ba75a6e8695 req-8e7b9aef-0ce5-4e3f-a3b0-cff18a6f6c65 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062683 Aug 29 15:45:45.900170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1106/2189] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:46.038259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.040089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.051812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.053223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.055946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.057200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.058127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.058823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.140308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.150787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.153337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.154913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5de7543-8f05-4176-a133-64105d8b781d tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.431084 Aug 29 15:45:46.156789 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1084/2190] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:45 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:46.265672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.275839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5665f8ba-7e69-418a-9afd-91077e2e1a33 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.244089 Aug 29 15:45:46.276582 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1107/2191] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:46.322480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-aa7acf21-516d-4df4-bae9-25060fbb8e97 req-fba4fbe0-c109-49a7-84ee-1161b1fc55ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:46.339899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-aa7acf21-516d-4df4-bae9-25060fbb8e97 req-fba4fbe0-c109-49a7-84ee-1161b1fc55ef service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.340376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-aa7acf21-516d-4df4-bae9-25060fbb8e97 req-fba4fbe0-c109-49a7-84ee-1161b1fc55ef service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.348883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-aa7acf21-516d-4df4-bae9-25060fbb8e97 req-fba4fbe0-c109-49a7-84ee-1161b1fc55ef service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.353832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.355055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.364186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.365754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.366441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.367648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.369210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.370144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.375429 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-aa7acf21-516d-4df4-bae9-25060fbb8e97 req-fba4fbe0-c109-49a7-84ee-1161b1fc55ef service nova] Creating event network-changed:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h1-836830-13 Aug 29 15:45:46.393730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-aa7acf21-516d-4df4-bae9-25060fbb8e97 req-fba4fbe0-c109-49a7-84ee-1161b1fc55ef service nova] Instance c1c48488-7ccd-47b0-afaf-00706b074dea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:45:46.421881 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-aa7acf21-516d-4df4-bae9-25060fbb8e97 req-fba4fbe0-c109-49a7-84ee-1161b1fc55ef service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103019 Aug 29 15:45:46.428313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1085/2192] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:46.438320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.443463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.482046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.483160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.486460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.487480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.488320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.491690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.599879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.614115 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4114b51-6a1b-4ed3-a634-8ef031852afe tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.264192 Aug 29 15:45:46.615266 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1108/2193] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:46.621241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.622704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.630105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.631101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.632817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.633964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.634765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.635624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.787403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:46.804087 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4af2c4e7-5b90-4c56-835b-8edd2ef49783 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1268 microversion: 2.1 time: 0.187309 Aug 29 15:45:46.804962 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1109/2194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:46.812050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:46.813210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:46.827386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.829579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.830875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:46.833111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:46.834738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:46.836159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.483416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.497598 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f68502ba-99f4-4bca-a3a0-be1676123db8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1474 microversion: 2.1 time: 0.691222 Aug 29 15:45:47.499433 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1110/2195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1474 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:47.505912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.506906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.519658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.520825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.522944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.524021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.525274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.526764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.665046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.683084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.686241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.689144 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8df016fa-02ac-43ec-aa5d-c77ca7624067 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1483 microversion: 2.25 time: 1.258355 Aug 29 15:45:47.691205 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1086/2196] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:46 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1483 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:47.699002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:47.702391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:47.710532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.711526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.712515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.713538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:47.714226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:47.714898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:47.985418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:47.994741 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01b691a2-b1c7-4983-a2fd-bc0a0cd19455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.493795 Aug 29 15:45:48.011945 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1111/2197] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.017965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.019136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.031476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.035706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.036262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.039205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.039752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.041801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.357021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.367865 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bba4c65a-edde-49c8-b1f4-80ee9ba484ba tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.354314 Aug 29 15:45:48.368992 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1112/2198] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.379639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.382582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.390630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.391308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.391755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.392598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.393065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.393495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.596677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.608709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.611653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.613790 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-baa3e376-f4fb-4185-a71c-0d9794cc15f5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.920811 Aug 29 15:45:48.615085 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1087/2199] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:47 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:48.621509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.622361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.630024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.630790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.631438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.632522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.633151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.633595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.722478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.731873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f909fb1a-7192-477c-8470-3e899bcf5809 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.361237 Aug 29 15:45:48.768363 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1113/2200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.775376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4e5c74ed-fd3d-4cf7-aea7-cc059f55d33a req-a2fc1628-962b-4037-8906-0dea36ffdb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-plugged", "status": "completed", "tag": "19608bdd-c953-4f2d-93c6-86f485a25fc3"}, {"server_uuid": "84901dc8-b1fb-4b33-ba18-4f5ac98666ca", "name": "network-vif-plugged", "status": "completed", "tag": "f68364fe-308b-47e5-b6fa-d75a66d8d8d5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:48.821141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e5c74ed-fd3d-4cf7-aea7-cc059f55d33a req-a2fc1628-962b-4037-8906-0dea36ffdb25 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.824264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e5c74ed-fd3d-4cf7-aea7-cc059f55d33a req-a2fc1628-962b-4037-8906-0dea36ffdb25 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.825190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e5c74ed-fd3d-4cf7-aea7-cc059f55d33a req-a2fc1628-962b-4037-8906-0dea36ffdb25 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.857939 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4e5c74ed-fd3d-4cf7-aea7-cc059f55d33a req-a2fc1628-962b-4037-8906-0dea36ffdb25 service nova] Creating event network-vif-plugged:19608bdd-c953-4f2d-93c6-86f485a25fc3 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:48.858483 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4e5c74ed-fd3d-4cf7-aea7-cc059f55d33a req-a2fc1628-962b-4037-8906-0dea36ffdb25 service nova] Creating event network-vif-plugged:f68364fe-308b-47e5-b6fa-d75a66d8d8d5 for instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca on n-h1-836830-13 Aug 29 15:45:48.867355 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4e5c74ed-fd3d-4cf7-aea7-cc059f55d33a req-a2fc1628-962b-4037-8906-0dea36ffdb25 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097174 Aug 29 15:45:48.868307 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1114/2201] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:48.874499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.875883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.883430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.883935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.884382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.885350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.885820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.886248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.900315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:48.917036 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b06c922-a857-4d51-97f9-57357c83b81d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1274 microversion: 2.1 time: 0.299774 Aug 29 15:45:48.931332 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1088/2202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1274 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:48.938252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:48.941144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:48.948025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.948801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.949447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:48.950343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:48.950976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:48.952145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.136683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.152547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8389cc4-fa5d-468a-8427-f12611857b9d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1472 microversion: 2.1 time: 0.282326 Aug 29 15:45:49.153274 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1115/2203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:49.159488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.160117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.170457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.171308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.171990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.173294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.174320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.175038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.352524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.365911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11aa9a1b-b29d-48fe-b670-c28e4d7a10ff tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.211498 Aug 29 15:45:49.366705 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1116/2204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:49.391786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.391786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.398373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.398977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.403774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.405068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.405903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.406501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.533662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.545886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.547733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.549299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-999a6369-7ceb-412d-9931-989f569bc757 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1483 microversion: 2.25 time: 0.616618 Aug 29 15:45:49.550069 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1089/2205] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:48 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1483 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:49.641755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.642380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.648931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.649431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.649870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.650588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.651061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.651688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.753297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:49.761912 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-338896c3-b567-4519-b438-3d155807955d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.375938 Aug 29 15:45:49.762504 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1117/2206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:49.774415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:49.775229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:49.782071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.782664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.783209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:49.784016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:49.784546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:49.785083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.047518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.062105 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3e04d9d-0a3c-444a-8595-78a761f08ba1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.291827 Aug 29 15:45:50.062714 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1118/2207] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:50.075585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:50.081201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.089631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.093617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.094381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.095330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.098293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.098739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.204904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.226194 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d41a901e-ad30-4e8c-b4c7-c4593cc1d0be tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1274 microversion: 2.1 time: 0.152196 Aug 29 15:45:50.229141 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1119/2208] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:50 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:50.236460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:50.237389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.244457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.245543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.246425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.247531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.248398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.249118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.553059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.555706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:50.564719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a1b3530-3280-4020-b937-da497b1dd234 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1469 microversion: 2.1 time: 0.334061 Aug 29 15:45:50.565322 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1120/2209] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:50 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1469 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:50.570506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:50.571288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.581447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.582052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.582443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.583171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.583626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.584055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.760312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.771128 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f16d84f8-5ef1-4413-bb20-5414ccefdd55 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.203967 Aug 29 15:45:50.772034 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1121/2210] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:50 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:50.776821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:50.777438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.784575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.785078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.785511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.786280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.786732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.787178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.867191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.886853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.888383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.889674 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d549b2ee-8c2c-401c-ad07-3afe92ab26e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 1.252344 Aug 29 15:45:50.890786 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1090/2211] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:49 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:50.892527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.899556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:50.902802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.918547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.919274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.919788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.920812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.921540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.921998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.922616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.923759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:50.925250 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02e0ca56-2b78-4557-ac06-0991924190bb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1441 microversion: 2.25 time: 0.152256 Aug 29 15:45:50.926359 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1122/2212] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:50 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1441 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:50.931724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:50.933407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:50.940569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.941485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.943014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:50.945025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:50.945752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:50.946495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.171978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a675d2d0-9546-4f69-87d0-62bbf9856f7d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "POST /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea/action" status: 202 len: 0 microversion: 2.1 time: 0.278585 Aug 29 15:45:51.173442 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1091/2213] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:50 2022] POST /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:51.206837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ba856c54-4ad1-4244-a4a7-8320f3f8e183 req-6ad8c5c4-49b1-4a89-9ebd-bf05235a0c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c69654a-6a13-4653-9c37-04df93393b26", "name": "network-vif-deleted", "tag": "b976629e-c63c-432c-89e0-f9d9bfd35a55"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:51.230274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba856c54-4ad1-4244-a4a7-8320f3f8e183 req-6ad8c5c4-49b1-4a89-9ebd-bf05235a0c11 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.231250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba856c54-4ad1-4244-a4a7-8320f3f8e183 req-6ad8c5c4-49b1-4a89-9ebd-bf05235a0c11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.231936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba856c54-4ad1-4244-a4a7-8320f3f8e183 req-6ad8c5c4-49b1-4a89-9ebd-bf05235a0c11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.253993 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ba856c54-4ad1-4244-a4a7-8320f3f8e183 req-6ad8c5c4-49b1-4a89-9ebd-bf05235a0c11 service nova] Creating event network-vif-deleted:b976629e-c63c-432c-89e0-f9d9bfd35a55 for instance 2c69654a-6a13-4653-9c37-04df93393b26 on n-h1-836830-13 Aug 29 15:45:51.283967 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ba856c54-4ad1-4244-a4a7-8320f3f8e183 req-6ad8c5c4-49b1-4a89-9ebd-bf05235a0c11 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107126 Aug 29 15:45:51.285796 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1092/2214] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:51.294158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-plugged", "status": "completed", "tag": "d1de827f-efc1-4f79-bef5-1c199a88d94d"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-plugged", "status": "completed", "tag": "ecd0e964-9c43-41f4-b26c-045a5a86c754"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-plugged", "status": "completed", "tag": "c9522880-8b9a-466b-815f-947dc37f0279"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-plugged", "status": "completed", "tag": "1ff5da3d-8e87-4515-81d9-3b8ba6e95e80"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:51.312695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.313562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.314171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.341433 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Creating event network-vif-plugged:d1de827f-efc1-4f79-bef5-1c199a88d94d for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:51.342720 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Creating event network-vif-plugged:ecd0e964-9c43-41f4-b26c-045a5a86c754 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:51.343791 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Creating event network-vif-plugged:c9522880-8b9a-466b-815f-947dc37f0279 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:51.344680 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] Creating event network-vif-plugged:1ff5da3d-8e87-4515-81d9-3b8ba6e95e80 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:51.354778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7dbce548-440e-442a-a90a-094da656dc52 req-51cef21f-d365-43ca-80ba-2a95689c5ade service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.067347 Aug 29 15:45:51.356459 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1093/2215] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:51.365805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.367648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:51.379417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.380235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.380953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.382036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.382662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.383296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.420968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:51.617229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:51.628024 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5337cb31-3507-427b-8a5b-7cd35db8e362 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1315 microversion: 2.1 time: 0.700245 Aug 29 15:45:51.642400 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1123/2216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:50 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:51.643938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.644674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:51.652374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.653018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.653559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.654546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.655386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.656041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.882299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:51.894373 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-35f7fa2f-f5c1-408e-930a-2da1a1a6c769 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.254489 Aug 29 15:45:51.895095 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1124/2217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:51.899945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.900569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:51.921971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.922482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.923456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.923685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:51.934735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:51.935228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:51.963932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:51.973885 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bff0d4d-a3c2-4035-b448-ff88412b1a37 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.616009 Aug 29 15:45:51.980085 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1094/2218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:51.985301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:51.997812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.017335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.018019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.021088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.033727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.039548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.043771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.261576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.273534 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-836fd9d4-1430-4b3f-ad12-3d2f862b2a84 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.376677 Aug 29 15:45:52.274719 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1125/2219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:52.280543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.281597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.288806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.289392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.290239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.291148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.291716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.292276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.312433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:52.364539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:52.551986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.565320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.567519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.569541 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28d2e354-2958-4aed-95ef-d188d9fb3d3b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.293531 Aug 29 15:45:52.570647 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1126/2220] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:52.577364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.578924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.587014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.587864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.588579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.589519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.590325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.591228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.682789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.694095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.696074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.697831 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7433c8a-a56b-42a0-9555-688ec71867d3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1265 microversion: 2.25 time: 0.125594 Aug 29 15:45:52.698963 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1127/2221] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:52.723897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:52.740894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73b279f7-ab95-41d6-ab25-eb7556f1a7c1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.759231 Aug 29 15:45:52.755033 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1095/2222] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:51 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:52.759992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:52.760619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:52.770862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:52.783506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.784054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.784498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.794346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:52.795506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:52.796000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:52.828948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1525824021", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "45e4fff8-ac31-41e5-89a5-4960938cd66b"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:52.928861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] validate_networks() for [('45e4fff8-ac31-41e5-89a5-4960938cd66b', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:45:53.276030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.288325 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-846df6c9-8b2c-47ed-928b-613023a1ec58 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1503 microversion: 2.1 time: 0.529908 Aug 29 15:45:53.291168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1096/2223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:52 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1503 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:53.299006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.299666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.318329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.346136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.346710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.349679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.350630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.356933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.648912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:53.657902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d57b3b9-56e9-4315-9b0e-4f69e4dc922e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.365479 Aug 29 15:45:53.667306 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1097/2224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:53.674636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.675361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.676016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:45:53.676445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:45:53.677327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:45:53.678449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:45:53.679118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:45:53.693519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.694021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.694466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.695318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.695974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.696411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.697107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.698893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.700891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.702719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.706773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.707723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.756767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Getting quotas for project a25ad3634e624e9394ac4e588d773383. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:45:53.775962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Getting quotas for user 7058c725d25749af95e6a5fc806e27ef and project a25ad3634e624e9394ac4e588d773383. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:45:53.813926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:45:53.816658 n-d-836830-13 devstack@n-api.service[129133]: WARNING nova.utils [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1525824021 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-152582402 Aug 29 15:45:53.822670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:45:53.931963 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5029d850-8609-4e83-8760-c694c07b3fe8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231203 Aug 29 15:45:53.933646 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1128/2225] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:45:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:45:53.939117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:53.939706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:53.958293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.958798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.959441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:53.960151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:53.960814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:53.961241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.206500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.236370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-193b7096-8f5e-4d89-bf42-7eb03d7329f2 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.567806 Aug 29 15:45:54.247216 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1098/2226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:54.260252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-359302689"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:54.261045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.269185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.269892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.270847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.271971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.273301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.274644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.335361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.345765 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31c73a20-a996-4724-8799-acf392ac9edd tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.410849 Aug 29 15:45:54.346356 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1129/2227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:53 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:54.363520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a7a180e1-79ec-41ad-b7e9-69facb6b0a30 req-62b8a1dd-afc9-4908-8420-edca715f1b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-plugged", "status": "completed", "tag": "3d078389-4765-402b-87e7-e088b9a2e62a"}, {"server_uuid": "f2d3ca4c-bcb4-444d-a316-0ba73c73182d", "name": "network-vif-plugged", "status": "completed", "tag": "c3a5ec6c-d281-4b8b-99c8-5931934e075f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:54.383786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a7a180e1-79ec-41ad-b7e9-69facb6b0a30 req-62b8a1dd-afc9-4908-8420-edca715f1b46 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.387203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a7a180e1-79ec-41ad-b7e9-69facb6b0a30 req-62b8a1dd-afc9-4908-8420-edca715f1b46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.388557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a7a180e1-79ec-41ad-b7e9-69facb6b0a30 req-62b8a1dd-afc9-4908-8420-edca715f1b46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.416676 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a7a180e1-79ec-41ad-b7e9-69facb6b0a30 req-62b8a1dd-afc9-4908-8420-edca715f1b46 service nova] Creating event network-vif-plugged:3d078389-4765-402b-87e7-e088b9a2e62a for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:45:54.417497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a7a180e1-79ec-41ad-b7e9-69facb6b0a30 req-62b8a1dd-afc9-4908-8420-edca715f1b46 service nova] Creating event network-vif-plugged:c3a5ec6c-d281-4b8b-99c8-5931934e075f for instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d on n-h2-836830-13 Aug 29 15:45:54.432927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a7a180e1-79ec-41ad-b7e9-69facb6b0a30 req-62b8a1dd-afc9-4908-8420-edca715f1b46 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082808 Aug 29 15:45:54.434479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1130/2228] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:54.449084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.450203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.466532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.468230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.468944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.469942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.470807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.471415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.682749 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.network.security_group_api [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Adding security group 83a26228-3800-44b3-8187-7ae1eccf1463 to port f68364fe-308b-47e5-b6fa-d75a66d8d8d5 Aug 29 15:45:54.798210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.813345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.815192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.817705 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e538bfba-615e-46a7-9e39-978a32597c4b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.380835 Aug 29 15:45:54.835248 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1131/2229] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:54.843641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:54.844720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:54.852608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.853851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.854505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.856072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:54.856832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:54.858404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:54.980705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.995715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.997626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:54.999931 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bbd9f68e-8168-45c1-9e3b-e4ea2bc09ac1 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1265 microversion: 2.25 time: 0.163317 Aug 29 15:45:55.002162 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1132/2230] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:54 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:55.016451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.018091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.026888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:55.028957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.030505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.031491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.032527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.033389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.034764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.325054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:55.348428 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-682bf2c2-e084-4948-9f35-c19e32dd1345 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.344708 Aug 29 15:45:55.349255 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1133/2231] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:55.362256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.364251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.382410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.384283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.384743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.386555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.389281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.389967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.520005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:55.529691 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-58e0740c-e7c1-4b20-bbf5-21ee29e8c8b3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1228 microversion: 2.1 time: 0.177136 Aug 29 15:45:55.530383 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1134/2232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1228 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:55.535257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:55.535860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:55.542183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.542683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.543162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.545550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.546033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.546470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.832468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:55.853031 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f70fb87b-22ac-490f-9cab-86a1643dba52 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.320272 Aug 29 15:45:55.870281 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1135/2233] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:55.907975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-cab6c8fd-122c-4b05-8134-eb2ad1d50fb5 req-59439a1b-eeb3-41c1-8e40-8cd5a7529024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad4ca47-791b-4aee-8049-546871c1c595", "tag": "6654d464-4236-42a1-9054-da7e6f46eeb4"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:55.935243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cab6c8fd-122c-4b05-8134-eb2ad1d50fb5 req-59439a1b-eeb3-41c1-8e40-8cd5a7529024 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:55.936706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cab6c8fd-122c-4b05-8134-eb2ad1d50fb5 req-59439a1b-eeb3-41c1-8e40-8cd5a7529024 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:55.937499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cab6c8fd-122c-4b05-8134-eb2ad1d50fb5 req-59439a1b-eeb3-41c1-8e40-8cd5a7529024 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:55.977715 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-cab6c8fd-122c-4b05-8134-eb2ad1d50fb5 req-59439a1b-eeb3-41c1-8e40-8cd5a7529024 service nova] Creating event network-changed:6654d464-4236-42a1-9054-da7e6f46eeb4 for instance aad4ca47-791b-4aee-8049-546871c1c595 on n-h2-836830-13 Aug 29 15:45:55.988374 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-cab6c8fd-122c-4b05-8134-eb2ad1d50fb5 req-59439a1b-eeb3-41c1-8e40-8cd5a7529024 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115778 Aug 29 15:45:55.989859 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1136/2234] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:55.999524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.000918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.009185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.010002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.012306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.013407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.018747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.022743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.246810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.260512 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9db25376-148a-4f03-b2a8-58028a5ef9d6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.267454 Aug 29 15:45:56.267437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1137/2235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:55 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.273284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.273949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.282090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.282591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.283071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.284662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.285123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.285552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.320938 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-91c07013-244d-498c-b6b2-9990272cd40e tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca/action" status: 202 len: 0 microversion: 2.1 time: 2.072539 Aug 29 15:45:56.322787 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1099/2236] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:54 2022] POST /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca/action => generated 0 bytes in 2075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:56.329104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.330840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.339734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.341037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.341590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.342345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.342871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.343350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.510883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.521287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff8ba975-9a77-4a0d-b22e-5c005188e687 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.251705 Aug 29 15:45:56.535630 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1138/2237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:56 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.541056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.541682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.556415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.556836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.557304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.558182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.558648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.559146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.589316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:56.636927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.647220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.649104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.650284 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ccb767ee-de61-48e1-a846-08f4c48da9de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1265 microversion: 2.25 time: 0.113610 Aug 29 15:45:56.651833 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1139/2238] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:56 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:56.657087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-143ead8f-3041-4527-84cd-e67b433737a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edc089d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.671865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.690444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.692738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.694147 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3193889a-f6a7-478f-a679-bf7515c63d79 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.370146 Aug 29 15:45:56.695290 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1100/2239] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:56 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:56.702017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.703005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.714534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.715067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.715517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.717326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.717998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.718438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.814743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-143ead8f-3041-4527-84cd-e67b433737a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use.", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:45:56.815475 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-143ead8f-3041-4527-84cd-e67b433737a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use. Aug 29 15:45:56.815475 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-96999914-136f-4320-b30a-d81c89dbe4a2'] Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-143ead8f-3041-4527-84cd-e67b433737a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463 HTTP/1.1 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: exception: Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use. Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-96999914-136f-4320-b30a-d81c89dbe4a2'] Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '83a26228-3800-44b3-8187-7ae1eccf1463'} Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:45:56.817454 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use. Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96999914-136f-4320-b30a-d81c89dbe4a2'] Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use. Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96999914-136f-4320-b30a-d81c89dbe4a2'] Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use. Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96999914-136f-4320-b30a-d81c89dbe4a2'] Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use. Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96999914-136f-4320-b30a-d81c89dbe4a2'] Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-143ead8f-3041-4527-84cd-e67b433737a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 400 to user: Security Group 83a26228-3800-44b3-8187-7ae1eccf1463 in use. Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-96999914-136f-4320-b30a-d81c89dbe4a2'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-143ead8f-3041-4527-84cd-e67b433737a7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463" status: 400 len: 185 microversion: 2.1 time: 0.166065 Aug 29 15:45:56.823196 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1140/2240] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:45:56 2022] DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463 => generated 185 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:45:56.834715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:56.835754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.845118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.845908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.846599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.847518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.848653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.849277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.940290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.942368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:56.951969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6415e4dc-e007-41f6-9732-790fa882ab4c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1284 microversion: 2.1 time: 0.127011 Aug 29 15:45:56.953096 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4262dc5-896f-4277-8d0b-78ec1c5eb063 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1315 microversion: 2.1 time: 0.255859 Aug 29 15:45:56.954460 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1101/2241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:56 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.954591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1141/2242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:56 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:56.959468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-abd2b384-ffc5-49f6-bdcc-b42411f55ff0 req-a8e7e407-b4c3-46bc-be2b-b744d8e23b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fbcb39-0ebf-43f6-95ab-ffc8cf599146", "name": "network-vif-plugged", "status": "completed", "tag": "4355e20c-05c7-4c4c-a2a6-06aece1a8216"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:56.960236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:56.962973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:56.971195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-abd2b384-ffc5-49f6-bdcc-b42411f55ff0 req-a8e7e407-b4c3-46bc-be2b-b744d8e23b82 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.971784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.971984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-abd2b384-ffc5-49f6-bdcc-b42411f55ff0 req-a8e7e407-b4c3-46bc-be2b-b744d8e23b82 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.972445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-abd2b384-ffc5-49f6-bdcc-b42411f55ff0 req-a8e7e407-b4c3-46bc-be2b-b744d8e23b82 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.972621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.973423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.974295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:56.975632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:56.976240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:56.987298 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-abd2b384-ffc5-49f6-bdcc-b42411f55ff0 req-a8e7e407-b4c3-46bc-be2b-b744d8e23b82 service nova] Creating event network-vif-plugged:4355e20c-05c7-4c4c-a2a6-06aece1a8216 for instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 on n-h1-836830-13 Aug 29 15:45:56.992856 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-abd2b384-ffc5-49f6-bdcc-b42411f55ff0 req-a8e7e407-b4c3-46bc-be2b-b744d8e23b82 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036983 Aug 29 15:45:56.995295 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1142/2243] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:57.002128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.003122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.011396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.012114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.012791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.015268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.015934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.016539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.080421 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6301c034-b876-4adf-9936-e28bd7348339 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca/action" status: 202 len: 0 microversion: 2.1 time: 0.124243 Aug 29 15:45:57.081665 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1102/2244] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:56 2022] POST /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:57.090859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.092607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.101866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.103488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.104205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.106212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.106948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.108287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.208620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.220091 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa7cde50-0836-447d-975b-ce1759a9fec7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.223387 Aug 29 15:45:57.221489 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1143/2245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:56 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:57.282341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.283875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.293579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.300837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.301639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.302607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.303471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.304112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.385865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.394627 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b11c3e31-339b-4468-856d-a1a08718dc02 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1573 microversion: 2.1 time: 0.308520 Aug 29 15:45:57.415718 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1103/2246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1573 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:57.541752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.542428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.552421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.560086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.561445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.565623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.566220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.575384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.627320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.636228 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0977505b-9074-4518-9488-a3d3c05365df tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.358209 Aug 29 15:45:57.641147 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1144/2247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:57.675399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.676048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.689238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.689790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.690075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.690737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.691259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.691754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.776192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.786500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.788163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:57.789642 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97da244f-3dc6-48c2-a31a-a6938a03fa0d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1265 microversion: 2.25 time: 0.118910 Aug 29 15:45:57.791086 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1145/2248] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:45:57.796897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:57.797583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:57.803707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.804497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.805036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:57.805824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:57.806445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:57.807336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.028558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.041239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.043751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.045523 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-85496747-54a3-47bd-9dd4-4eae38353c7a tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1874 microversion: 2.42 time: 0.253548 Aug 29 15:45:58.055346 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1146/2249] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1874 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:58.055346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.055346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.061629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.074778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78ce7f5e-67ca-4294-b815-0b9e5775b7e8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.536767 Aug 29 15:45:58.075411 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1104/2250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:57 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:45:58.087890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.087890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.087890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.087890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.087890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.087890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.103574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.104810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.112325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.113087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.113660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.115529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.116134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.116673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.296654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.308420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4368a0e-b55a-40c5-82e8-8a45b35e01a8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1284 microversion: 2.1 time: 0.212585 Aug 29 15:45:58.315680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1105/2251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:58.327093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5f7b636b-2d28-48c5-82f4-9c5661d1dd29 req-28ecab54-7878-4959-8606-e9c884fad1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84901dc8-b1fb-4b33-ba18-4f5ac98666ca", "tag": "f68364fe-308b-47e5-b6fa-d75a66d8d8d5"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:58.350644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5f7b636b-2d28-48c5-82f4-9c5661d1dd29 req-28ecab54-7878-4959-8606-e9c884fad1c4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.351442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5f7b636b-2d28-48c5-82f4-9c5661d1dd29 req-28ecab54-7878-4959-8606-e9c884fad1c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.352383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5f7b636b-2d28-48c5-82f4-9c5661d1dd29 req-28ecab54-7878-4959-8606-e9c884fad1c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.369461 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-5f7b636b-2d28-48c5-82f4-9c5661d1dd29 req-28ecab54-7878-4959-8606-e9c884fad1c4 service nova] Creating event network-changed:f68364fe-308b-47e5-b6fa-d75a66d8d8d5 for instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca on n-h1-836830-13 Aug 29 15:45:58.375765 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5f7b636b-2d28-48c5-82f4-9c5661d1dd29 req-28ecab54-7878-4959-8606-e9c884fad1c4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056935 Aug 29 15:45:58.377007 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1106/2252] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:45:58.382882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.384554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.385477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.392206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.393440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.393642 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e120fff3-f38e-4f33-8a90-b429c6dddd09 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1503 microversion: 2.1 time: 0.345943 Aug 29 15:45:58.393875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.408041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1147/2253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:58.408155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.408155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.408155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.416781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:45:58.418991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.426887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.427567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.428159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.428888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.429508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.429948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.477670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'flavor' on Instance uuid f2d3ca4c-bcb4-444d-a316-0ba73c73182d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:58.631931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.642240 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e0c3cc1d-6e0d-4bc2-b6cb-76a68690b884 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.263524 Aug 29 15:45:58.643209 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1107/2254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:58.651635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.652821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.660762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.661487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.662089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.663112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.663723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.664260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.707936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6667750a-8ca1-46ae-bc7c-542999c89129 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d/action" status: 202 len: 0 microversion: 2.1 time: 0.295581 Aug 29 15:45:58.708932 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1148/2255] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:45:58 2022] POST /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:45:58.714230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.715050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.725973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.725973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.725973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.725973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.725973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.726594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.855709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.866983 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c8640e0-2f83-4818-8b49-be072c183e83 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1573 microversion: 2.1 time: 0.222259 Aug 29 15:45:58.871180 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1108/2256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1573 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:58.873068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.874154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.882741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.883349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.883853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.884637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.885162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.885654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.886906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:58.902220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4185cae3-d816-4eb0-b7b4-53ccf3f9f441 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1316 microversion: 2.1 time: 0.192083 Aug 29 15:45:58.902925 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1149/2257] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:58.909144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:58.910104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:58.917286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.918031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.918739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.919981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.920980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.921629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.968664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:58.969619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:58.970679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:58.972321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'fault' on Instance uuid 2c69654a-6a13-4653-9c37-04df93393b26 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:45:59.035539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.061556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.067366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.071291 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8fa202d-7a9e-4980-8f56-2ea17f88cdd0 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 200 len: 1270 microversion: 2.25 time: 0.166593 Aug 29 15:45:59.074644 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1150/2258] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:59.096202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.098057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.129870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.131612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.132796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.137491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.138783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.139885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.288460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.298844 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2af455a9-64d6-4897-ae90-a571764e714a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.429881 Aug 29 15:45:59.299698 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1109/2259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:58 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:59.304634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.305424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.321997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.322499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.323167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.324080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.324846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.325445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.390758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.405267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.407184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.410170 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89defb3e-f9eb-4dcc-9373-7685f79e2f9c tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2829 microversion: 2.42 time: 0.321415 Aug 29 15:45:59.423541 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1151/2260] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2829 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:59.440625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.441520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.449662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.450312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.450995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.451851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.452451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.452979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.533375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.542528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-769aad29-2e61-4b58-b4ea-71fcf69acdda tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1284 microversion: 2.1 time: 0.117654 Aug 29 15:45:59.551615 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1152/2261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:59.552232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.553435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.559807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.560324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.560763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.561527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.561977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.562397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.580955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:45:59.583304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:45:59.598049 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ba41290-e3fc-4b95-b77b-dead8662d69e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.296572 Aug 29 15:45:59.599349 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1110/2262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:45:59.664464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.665087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.676201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.677123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.677573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.678449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.679056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.679511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.697052 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-effd3360-6b72-45b9-bb9e-97393e72ecf4 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.152458 Aug 29 15:45:59.699140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1153/2263] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55/os-interface => generated 1829 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:45:59.891332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:45:59.892713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:45:59.903663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.907468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.908134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:45:59.909032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:45:59.909639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:45:59.913392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.050737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:00.059496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9023d1a9-392d-4cd6-9db4-a59a32133499 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.398989 Aug 29 15:46:00.072214 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1111/2264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:00.080025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.080426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.088287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.088782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.089218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.089924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.090405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.092500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.255245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:00.269538 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3896bc25-75c0-49e8-a90b-948d5a11e1c9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1578 microversion: 2.1 time: 0.383050 Aug 29 15:46:00.285890 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1154/2265] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:45:59 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1578 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:00.285890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.285890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 2c69654a-6a13-4653-9c37-04df93393b26] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.295317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.296424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.297380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.298326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.298983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.299852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.324672 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] HTTP exception thrown: Instance 2c69654a-6a13-4653-9c37-04df93393b26 could not be found. Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Request method failure captured: Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 HTTP/1.1 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN14P6wNxA5wsg6uVjuAvqegPxyfXqGi48qgzzIKPdufPolF8AWBac2zZL7X5ops9MBZFj93vYHRDITeCxjuqIpTmzlmAsFDe3y60wkADNqJX-Xd7I4SOx6RHE6_8KJNpRCJGodorNF52MFAQ55VcombAGL7SqFUZlU20LzvlywZW2U Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_70d66d1258d14a39b174734f9865c070", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/70d66d1258d14a39b174734f9865c070"}]}] Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f12698b45a114720af9c98b163077f59 Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 2c69654a-6a13-4653-9c37-04df93393b26 could not be found. Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '2c69654a-6a13-4653-9c37-04df93393b26'} Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c69654a-6a13-4653-9c37-04df93393b26 could not be found. Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c69654a-6a13-4653-9c37-04df93393b26 could not be found. Aug 29 15:46:00.327180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c69654a-6a13-4653-9c37-04df93393b26 could not be found. Aug 29 15:46:00.335627 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:00.338083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Returning 404 to user: Instance 2c69654a-6a13-4653-9c37-04df93393b26 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:00.341381 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2405cae-0e3e-4d33-b835-c78956a46e5e tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26" status: 404 len: 111 microversion: 2.25 time: 0.067188 Aug 29 15:46:00.342031 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1155/2266] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/2c69654a-6a13-4653-9c37-04df93393b26 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:46:00.349561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.350507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.373943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.374457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.374952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.375715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.376184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.376619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.389397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:00.398522 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-af3d481a-54ee-4d87-ae01-66805dff9059 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1466 microversion: 2.1 time: 0.324841 Aug 29 15:46:00.399117 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1112/2267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1466 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:00.425602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.426626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.433735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.434756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.436149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.437887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.438834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.439611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.443877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:00.674579 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e13de7e4-fe84-4194-9423-74b3048fded1 tempest-ServersOnMultiNodesTest-452822611 tempest-ServersOnMultiNodesTest-452822611-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1619 microversion: 2.1 time: 0.254591 Aug 29 15:46:00.687052 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1113/2268] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1619 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:00.687052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.687052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.704262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.708760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.713241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.714467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.714971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.715607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.840980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:00.844642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:00.853616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-830320c1-b9db-4dab-80f5-bbdc0e6d1903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.509753 Aug 29 15:46:00.854239 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ab24389-fdaa-4b62-977f-de6c9a45ebb5 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1284 microversion: 2.1 time: 0.175942 Aug 29 15:46:00.855537 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1156/2269] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:00.863088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.868129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.869169 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1114/2270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:00.874473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:00.874971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:00.883302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.883801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.884558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.885288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.885895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.886332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.887362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.887957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.888536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.889352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:00.889965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:00.890489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:00.928461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:01.037195 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e72b3aae-f3e6-4ac5-9de1-5846795dbabc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 204 len: 0 microversion: 2.1 time: 0.166661 Aug 29 15:46:01.037793 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1115/2271] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:00 2022] DELETE /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:01.054581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.056989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.064986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.065645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.067541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.068429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.069045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.069599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.121763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:01.131824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4859d87-8212-40bf-b958-fbea2f0e60f5 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.275113 Aug 29 15:46:01.145136 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1157/2272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:00 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:01.150637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.151529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.158537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.159333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.159928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.160813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.161429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.162013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.267085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:01.276627 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac6c08dd-26e4-4855-abd4-9abd7079999e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1472 microversion: 2.1 time: 0.228050 Aug 29 15:46:01.277555 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1116/2273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:01.296765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.297503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.304668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.305260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.305779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.306560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.307196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.307669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.530790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:01.542897 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98cfb16c-f0dc-45aa-b5b3-27b4e8de7a24 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.396296 Aug 29 15:46:01.543527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1158/2274] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:01.555464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:01.555825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e3dfd2e4-4d39-4237-9f82-59b99bdd271e req-dfed7485-9e0d-4602-97e6-d9a27bafa71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "tag": "1ff5da3d-8e87-4515-81d9-3b8ba6e95e80"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:01.567755 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f072e08-ce05-4c5e-a9ac-1e6eda6cace8 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1571 microversion: 2.1 time: 0.275850 Aug 29 15:46:01.582050 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1117/2275] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1571 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:01.586153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e3dfd2e4-4d39-4237-9f82-59b99bdd271e req-dfed7485-9e0d-4602-97e6-d9a27bafa71d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.586677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e3dfd2e4-4d39-4237-9f82-59b99bdd271e req-dfed7485-9e0d-4602-97e6-d9a27bafa71d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.587130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e3dfd2e4-4d39-4237-9f82-59b99bdd271e req-dfed7485-9e0d-4602-97e6-d9a27bafa71d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.592830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-309043066"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:01.593568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.600553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.601602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.602250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.603825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.603962 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e3dfd2e4-4d39-4237-9f82-59b99bdd271e req-dfed7485-9e0d-4602-97e6-d9a27bafa71d service nova] Creating event network-changed:1ff5da3d-8e87-4515-81d9-3b8ba6e95e80 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:46:01.604482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.605016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.616944 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e3dfd2e4-4d39-4237-9f82-59b99bdd271e req-dfed7485-9e0d-4602-97e6-d9a27bafa71d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066009 Aug 29 15:46:01.617566 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1159/2276] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:01.876374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:01.877116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:01.885980 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.network.security_group_api [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Adding security group a5321592-c7c4-4186-a6ef-2f152f865fea to port f68364fe-308b-47e5-b6fa-d75a66d8d8d5 Aug 29 15:46:01.888235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.889661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.890764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:01.891922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:01.892736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:01.893371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.078531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:02.089573 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-38c45109-9741-490a-b805-7a6ae0b9ea3f tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.218518 Aug 29 15:46:02.103964 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1160/2277] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:01 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:02.109730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.110362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.126659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.127661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.128128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.128876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.129340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.129772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.270701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:02.280370 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0ce53fa-6986-43f5-9446-8a37df28e0c3 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1284 microversion: 2.1 time: 0.175166 Aug 29 15:46:02.280976 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1161/2278] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:02.290018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.296064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.308301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.308830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.310085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.311846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.312457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.312963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.581127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:02.591159 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-848d5653-4ff1-4317-bfe0-ec0203051c64 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.304394 Aug 29 15:46:02.592956 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1162/2279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:02.598230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.599263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.606072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.606705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.608133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.609206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.609886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.610423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.933009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:02.945771 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9262099-14a9-41ca-a8bd-f8487c201960 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1472 microversion: 2.1 time: 0.351040 Aug 29 15:46:02.947499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1163/2280] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:02.956215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:02.957621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:02.968387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.969708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.970357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:02.971669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:02.972362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:02.973509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.223673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.241904 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-80490f51-ba0d-42c9-8a44-8065330bfee6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.291778 Aug 29 15:46:03.255055 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1164/2281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:02 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:03.255055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.255055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:03.276143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.277663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.278426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.279899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.285019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.286529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.593180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.610771 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b458165e-e9ca-4e74-8f63-d2a6a62607dd tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.365429 Aug 29 15:46:03.611609 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1165/2282] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:03.624978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.625651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:03.633975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.634477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.634919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.639932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.640431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.640881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.733904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:03.783059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:03.792528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:03.799613 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b0f2d21-3678-4319-8638-08d8b90828c0 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1290 microversion: 2.1 time: 0.186729 Aug 29 15:46:03.811064 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1166/2283] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1290 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:03.811064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:03.811064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:03.819271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.819271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.819271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:03.819271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:03.819271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:03.819271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.041147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.054855 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-43fbff98-3be4-4e5d-991f-9119ebc6ea31 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.253142 Aug 29 15:46:04.056409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1167/2284] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:03 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:04.063482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.064542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.075050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.075849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.077000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.078196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.079012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.079761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.168360 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1dcdc17-1a92-4904-9c95-8055fdebbe36 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca/action" status: 202 len: 0 microversion: 2.1 time: 2.581601 Aug 29 15:46:04.169151 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1118/2285] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:46:01 2022] POST /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca/action => generated 0 bytes in 2583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:46:04.179981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2fac3930-c4b2-4a02-9eec-3722c2455eea tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32f06481f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.284860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.297334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da8858a2-5646-420a-b00a-15ef8e3c9a84 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1472 microversion: 2.1 time: 0.239304 Aug 29 15:46:04.298146 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1168/2286] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:04.303990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6b736396-ddce-4fc6-b45e-8dbe9f62bbc1 req-fbdec3fc-5520-4d9f-98a6-94a206bd160b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84901dc8-b1fb-4b33-ba18-4f5ac98666ca", "tag": "f68364fe-308b-47e5-b6fa-d75a66d8d8d5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:04.314585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6b736396-ddce-4fc6-b45e-8dbe9f62bbc1 req-fbdec3fc-5520-4d9f-98a6-94a206bd160b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.315163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6b736396-ddce-4fc6-b45e-8dbe9f62bbc1 req-fbdec3fc-5520-4d9f-98a6-94a206bd160b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.315615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6b736396-ddce-4fc6-b45e-8dbe9f62bbc1 req-fbdec3fc-5520-4d9f-98a6-94a206bd160b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.329747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6b736396-ddce-4fc6-b45e-8dbe9f62bbc1 req-fbdec3fc-5520-4d9f-98a6-94a206bd160b service nova] Creating event network-changed:f68364fe-308b-47e5-b6fa-d75a66d8d8d5 for instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca on n-h1-836830-13 Aug 29 15:46:04.335806 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6b736396-ddce-4fc6-b45e-8dbe9f62bbc1 req-fbdec3fc-5520-4d9f-98a6-94a206bd160b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036368 Aug 29 15:46:04.336806 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1169/2287] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:04.342840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.344262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.351776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.352275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.352715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.353424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.353964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.354305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.660757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:04.670405 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3cd66b1f-1658-4496-8f2c-f89c6095358c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.331674 Aug 29 15:46:04.674451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1170/2288] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:04.680000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:04.680623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:04.692711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.693219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.693659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:04.702844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:04.703389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:04.703934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.014142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.023596 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5d0a46b-effb-4852-ba9b-a40c7336a267 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.347933 Aug 29 15:46:05.043230 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1171/2289] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:04 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:05.043230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.043230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.050512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.051682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.052774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.053744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.054384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.054989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.238430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.247133 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88aac71c-30f3-4f2c-aa58-ce804d86a888 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1290 microversion: 2.1 time: 0.213089 Aug 29 15:46:05.248100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1172/2290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1290 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:05.253046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.253763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.260220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.260898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.261823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.262768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.263706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.264390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.295393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:05.308632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-2fac3930-c4b2-4a02-9eec-3722c2455eea tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use.", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:05.309389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-2fac3930-c4b2-4a02-9eec-3722c2455eea tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use. Aug 29 15:46:05.309389 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-f1c34fd7-ad72-4814-9c2c-691e4c23d8a8'] Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2fac3930-c4b2-4a02-9eec-3722c2455eea tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea HTTP/1.1 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: exception: Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use. Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-f1c34fd7-ad72-4814-9c2c-691e4c23d8a8'] Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a5321592-c7c4-4186-a6ef-2f152f865fea'} Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:05.315835 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use. Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1c34fd7-ad72-4814-9c2c-691e4c23d8a8'] Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use. Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1c34fd7-ad72-4814-9c2c-691e4c23d8a8'] Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use. Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1c34fd7-ad72-4814-9c2c-691e4c23d8a8'] Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use. Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1c34fd7-ad72-4814-9c2c-691e4c23d8a8'] Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2fac3930-c4b2-4a02-9eec-3722c2455eea tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 400 to user: Security Group a5321592-c7c4-4186-a6ef-2f152f865fea in use. Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-f1c34fd7-ad72-4814-9c2c-691e4c23d8a8'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2fac3930-c4b2-4a02-9eec-3722c2455eea tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea" status: 400 len: 185 microversion: 2.1 time: 1.142327 Aug 29 15:46:05.321057 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1119/2291] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:04 2022] DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea => generated 185 bytes in 1144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:46:05.337329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.337949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.341940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:05.359103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.359628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.360069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.360787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.361239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.361660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.441462 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd2d28a3-e5b4-4fb2-958f-3b8793f936b3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "DELETE /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 204 len: 0 microversion: 2.25 time: 0.189812 Aug 29 15:46:05.444431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1173/2292] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:46:05 2022] DELETE /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:46:05.450194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.451952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.458923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.459600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.460590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.460940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.461493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.462132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.607851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.617309 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-efbdadd7-72c2-4bc0-b800-fd5d8d473b50 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1472 microversion: 2.1 time: 0.171508 Aug 29 15:46:05.618258 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1174/2293] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:05.636424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.637322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.645333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.646192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.646733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.647586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.648214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.648739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.678737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:05.781621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c893d968-587a-4958-b4a5-97bc0bae2257 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 204 len: 0 microversion: 2.1 time: 0.149158 Aug 29 15:46:05.782463 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1175/2294] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:05 2022] DELETE /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:05.787983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.788861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.795248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.795746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.796184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.796912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:05.797371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:05.797801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:05.955397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.968509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.970479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:05.972831 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-de3dee39-f04d-48b9-8e58-49c8af91c0c9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1732 microversion: 2.25 time: 0.189478 Aug 29 15:46:05.974282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1176/2295] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:05.979740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:05.980683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:05.983469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:06.002426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.003940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.004581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.005474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.006289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.007012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.177523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.186429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ffe740be-77c6-4361-8b03-0ec30fd63c18 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.210582 Aug 29 15:46:06.194359 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1177/2296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:06.203094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.203729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.210690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.211407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.212263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.213425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.214247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.214981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.378737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.386873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6562073-6aab-44e2-9e3e-a2d318e9cc41 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1645 microversion: 2.1 time: 0.191290 Aug 29 15:46:06.387628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1178/2297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1645 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:06.393298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.394018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.400844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.401578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.402403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.403316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.404025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.405085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.439734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.454125 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d2f44613-98ea-409c-82cb-a9aa97f97ae6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 1.133485 Aug 29 15:46:06.455452 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1120/2298] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:05 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:06.463410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-cc17a17f-561a-4c86-a480-d67932fcbf88 req-6d2e8618-0cad-4ebb-b811-06d5be7abcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fbcb39-0ebf-43f6-95ab-ffc8cf599146", "name": "network-vif-unplugged", "status": "completed", "tag": "4355e20c-05c7-4c4c-a2a6-06aece1a8216"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:06.481255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cc17a17f-561a-4c86-a480-d67932fcbf88 req-6d2e8618-0cad-4ebb-b811-06d5be7abcb1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.482465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cc17a17f-561a-4c86-a480-d67932fcbf88 req-6d2e8618-0cad-4ebb-b811-06d5be7abcb1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.483522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cc17a17f-561a-4c86-a480-d67932fcbf88 req-6d2e8618-0cad-4ebb-b811-06d5be7abcb1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.505420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-cc17a17f-561a-4c86-a480-d67932fcbf88 req-6d2e8618-0cad-4ebb-b811-06d5be7abcb1 service nova] Creating event network-vif-unplugged:4355e20c-05c7-4c4c-a2a6-06aece1a8216 for instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 on n-h1-836830-13 Aug 29 15:46:06.515258 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-cc17a17f-561a-4c86-a480-d67932fcbf88 req-6d2e8618-0cad-4ebb-b811-06d5be7abcb1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057462 Aug 29 15:46:06.517350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1121/2299] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:06.526365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.527689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.539822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.541955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.542907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.544542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.546079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.547604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.569623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.580360 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a0607a1-38fc-40ff-9f6a-a68be6ea531b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.190635 Aug 29 15:46:06.597753 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1179/2300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:06.639055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:06.639986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:06.648732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.650213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.650562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.651329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.652024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.652429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.754491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.763896 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf561805-594f-4b29-a59f-0a5b492671bc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1430 microversion: 2.1 time: 0.129867 Aug 29 15:46:06.765190 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1180/2301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1430 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:06.887519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2f61006d-86a2-42e6-8cb9-b46e3a9f4ab3 req-19b31988-b319-4d5f-93b9-63ba8bdd9cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97fbcb39-0ebf-43f6-95ab-ffc8cf599146", "name": "network-vif-deleted", "tag": "4355e20c-05c7-4c4c-a2a6-06aece1a8216"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:06.904754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2f61006d-86a2-42e6-8cb9-b46e3a9f4ab3 req-19b31988-b319-4d5f-93b9-63ba8bdd9cfe service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:06.905713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2f61006d-86a2-42e6-8cb9-b46e3a9f4ab3 req-19b31988-b319-4d5f-93b9-63ba8bdd9cfe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:06.906707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2f61006d-86a2-42e6-8cb9-b46e3a9f4ab3 req-19b31988-b319-4d5f-93b9-63ba8bdd9cfe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:06.926963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:06.940909 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75217f50-e0e8-46ff-ab1e-6e8c5ece47fc tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.421663 Aug 29 15:46:06.948607 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1122/2302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:06.962190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2f61006d-86a2-42e6-8cb9-b46e3a9f4ab3 req-19b31988-b319-4d5f-93b9-63ba8bdd9cfe service nova] Creating event network-vif-deleted:4355e20c-05c7-4c4c-a2a6-06aece1a8216 for instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 on n-h1-836830-13 Aug 29 15:46:06.968282 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2f61006d-86a2-42e6-8cb9-b46e3a9f4ab3 req-19b31988-b319-4d5f-93b9-63ba8bdd9cfe service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091164 Aug 29 15:46:06.969158 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1181/2303] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:07.006995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.008106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.027849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.035304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.036122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.039354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.044365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.045624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.209699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.211016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.220591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.221401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.222230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.223239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.223927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.224614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.430309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.443926 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca2693b2-36b1-48ea-baa7-7c5ff3c4642e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.239081 Aug 29 15:46:07.444523 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1182/2304] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:07.464670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.465303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.474711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.475601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.476272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.477425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.478089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.478906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.697577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.707265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76ea321e-8508-47e6-87bf-98cc59998603 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1645 microversion: 2.1 time: 0.261546 Aug 29 15:46:07.719308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1183/2305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1645 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:07.719308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.719308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.727849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.728348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.728781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.729485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.729937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.730361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.876171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.884902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73728d70-0c73-430d-aefc-9aeab44a7ec1 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.175365 Aug 29 15:46:07.899066 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1184/2306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:07.899066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.899066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.900055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.900187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.900602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.901380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.901835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.902377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.948351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.959554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.961513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:07.963161 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5878ed1e-730c-4ab4-bab4-e54e3ededd87 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1732 microversion: 2.25 time: 0.966080 Aug 29 15:46:07.964431 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1123/2307] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:06 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1732 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:07.970149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:07.970829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:07.977953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.978580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.979150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:07.980462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:07.981042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:07.981632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.033898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.034978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.035434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.035891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lazy-loading 'fault' on Instance uuid 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:08.099391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.109471 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c98429b-d4cc-47fa-932e-85e254de8c46 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.222217 Aug 29 15:46:08.110222 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1185/2308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:08.129837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.130906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.137828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.139251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.139689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.140500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.140958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.141378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.171318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.179491 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d96ffb35-2a7b-4357-a418-3f07710028b0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 200 len: 1306 microversion: 2.1 time: 0.213730 Aug 29 15:46:08.194305 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1124/2309] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:07 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 1306 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:08.292148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.300894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-189f35f0-42e4-4a0e-992b-14dea1abcc1c tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.176203 Aug 29 15:46:08.301479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1186/2310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:08.467068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.468252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.474647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.475298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.475997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.477402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.477924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.478449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.546538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ab2dd326-4823-40e3-8c5d-f10f0b64eeed req-aedc6385-9606-49f4-aa6d-f703ed4deb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad4ca47-791b-4aee-8049-546871c1c595", "name": "network-vif-plugged", "status": "completed", "tag": "6654d464-4236-42a1-9054-da7e6f46eeb4"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:08.557105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ab2dd326-4823-40e3-8c5d-f10f0b64eeed req-aedc6385-9606-49f4-aa6d-f703ed4deb95 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.557749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ab2dd326-4823-40e3-8c5d-f10f0b64eeed req-aedc6385-9606-49f4-aa6d-f703ed4deb95 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.558393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ab2dd326-4823-40e3-8c5d-f10f0b64eeed req-aedc6385-9606-49f4-aa6d-f703ed4deb95 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.571305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ab2dd326-4823-40e3-8c5d-f10f0b64eeed req-aedc6385-9606-49f4-aa6d-f703ed4deb95 service nova] Creating event network-vif-plugged:6654d464-4236-42a1-9054-da7e6f46eeb4 for instance aad4ca47-791b-4aee-8049-546871c1c595 on n-h2-836830-13 Aug 29 15:46:08.578037 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ab2dd326-4823-40e3-8c5d-f10f0b64eeed req-aedc6385-9606-49f4-aa6d-f703ed4deb95 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035864 Aug 29 15:46:08.578653 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1187/2311] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:08.733679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.734455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.741678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.742261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.742790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.743583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.744101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.744592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.974002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:08.982950 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ecba86f9-86e9-49e0-865a-d12fb767e263 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1645 microversion: 2.1 time: 0.253183 Aug 29 15:46:08.986383 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1188/2312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1645 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:08.988411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:08.989025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:08.995108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.995598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.996033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:08.996723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:08.997179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:08.997604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.000385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:09.070832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.081090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1c41736a-d730-4768-8807-973cf7f9cc76 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.618727 Aug 29 15:46:09.081834 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1125/2313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:09.087886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.089054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.097992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.099475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.100018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.101205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.102004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.102617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.146405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.154790 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8bf82038-894c-4486-9ee9-49c3688bddd9 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.169757 Aug 29 15:46:09.155574 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1189/2314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:08 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:09.164411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e3eaddd2-a1d9-47ab-92f7-b3afc87f276f req-6095039f-b76d-4a0b-8623-253c369ff61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:09.174849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e3eaddd2-a1d9-47ab-92f7-b3afc87f276f req-6095039f-b76d-4a0b-8623-253c369ff61f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.175477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e3eaddd2-a1d9-47ab-92f7-b3afc87f276f req-6095039f-b76d-4a0b-8623-253c369ff61f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.175980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e3eaddd2-a1d9-47ab-92f7-b3afc87f276f req-6095039f-b76d-4a0b-8623-253c369ff61f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.189717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e3eaddd2-a1d9-47ab-92f7-b3afc87f276f req-6095039f-b76d-4a0b-8623-253c369ff61f service nova] Creating event network-changed:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h2-836830-13 Aug 29 15:46:09.195743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-e3eaddd2-a1d9-47ab-92f7-b3afc87f276f req-6095039f-b76d-4a0b-8623-253c369ff61f service nova] Instance c1c48488-7ccd-47b0-afaf-00706b074dea is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 15:46:09.208452 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e3eaddd2-a1d9-47ab-92f7-b3afc87f276f req-6095039f-b76d-4a0b-8623-253c369ff61f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047665 Aug 29 15:46:09.209188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1190/2315] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:09.214945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.215722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.222673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.223203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.224063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.224358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.224813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.225438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.373744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.381982 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7604d0a5-886b-4ef5-8999-01cf116e951c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.171564 Aug 29 15:46:09.382741 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1191/2316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:09.388397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.389017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 97fbcb39-0ebf-43f6-95ab-ffc8cf599146] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.395854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.396660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.397283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.397997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.398564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.399292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.413884 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 could not be found. Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 HTTP/1.1 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 could not be found. Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '97fbcb39-0ebf-43f6-95ab-ffc8cf599146'} Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 could not be found. Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 could not be found. Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:09.415613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 could not be found. Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance 97fbcb39-0ebf-43f6-95ab-ffc8cf599146 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bb242f22-88b8-4773-85cf-225abd3e5bf3 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146" status: 404 len: 111 microversion: 2.1 time: 0.032857 Aug 29 15:46:09.422052 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1192/2317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/97fbcb39-0ebf-43f6-95ab-ffc8cf599146 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:09.423654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.424172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.430351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.430764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.431235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.431938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.432407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.432930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.573037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.582279 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4fe92d8e-3d07-4029-96c8-23d58b08ba23 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.163680 Aug 29 15:46:09.583015 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1193/2318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:09.588231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.588965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.597893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.598508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.599105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.599918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.600478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.601004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.629864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:09.688853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.713972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.718312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:09.724717 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49b1b004-13a1-44b8-90f8-099f5dc6b4a7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1732 microversion: 2.25 time: 0.639957 Aug 29 15:46:09.738623 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1126/2319] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1732 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:09.753576 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-791aab1b-de13-468b-bc62-a3fe8d488a24 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 204 len: 0 microversion: 2.1 time: 0.168890 Aug 29 15:46:09.755138 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1194/2320] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:09 2022] DELETE /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:09.765852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:09.766989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:09.776051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.776666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.777115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.778127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:09.778613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:09.779896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:09.807981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:10.007384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.008123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.016458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.017007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.017442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.018150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.018608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.019322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.057924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.058444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.059103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.059818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lazy-loading 'fault' on Instance uuid 84901dc8-b1fb-4b33-ba18-4f5ac98666ca {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:10.117829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.128637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7d007935-47e8-4a5d-a04f-5ce0904ab46f tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 200 len: 1305 microversion: 2.1 time: 0.125921 Aug 29 15:46:10.130908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1195/2321] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:10.136269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.137134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.155481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.156183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.156917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.159861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.160619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.161086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.392598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.407335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8dfa8967-00fe-4e1e-ae86-b477ab17e53c tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.274381 Aug 29 15:46:10.408922 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1196/2322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:10.415595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.416348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.424217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.424895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.425494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.426890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.427625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.428401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.579807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.589433 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-618d13c5-c733-4727-ba35-eb41733b7e39 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.179026 Aug 29 15:46:10.590023 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1197/2323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:10.596633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.597420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.610237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.611287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.611440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.613528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.613697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.614180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.731136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.752924 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eb544ef7-d6b6-4ff9-9c38-4cc91542595e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1472 microversion: 2.1 time: 0.992311 Aug 29 15:46:10.753847 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1127/2324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:09 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1472 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:10.781239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.781434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.795344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.796452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.797091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.798047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.798722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.799193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.844887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.855457 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f59fd7d1-2aa8-40c9-be16-8a4dccfd7109 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.264332 Aug 29 15:46:10.856639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1198/2325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:10.867702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:10.868925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:10.877892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.878788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.879350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.880392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:10.881031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:10.881548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:10.956414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.965408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.967396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:10.968729 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae738bfe-f8a7-4bf3-94a7-f06df54084cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1664 microversion: 2.25 time: 0.109845 Aug 29 15:46:10.969419 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1199/2326] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1664 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:11.152735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.153397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.160716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.161207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.161641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.162395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.162850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.163296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.178621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca HTTP/1.1 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '84901dc8-b1fb-4b33-ba18-4f5ac98666ca'} Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:11.180334 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0eb08145-785b-4d50-badf-57b6e2b6ef64 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 404 len: 111 microversion: 2.1 time: 0.033272 Aug 29 15:46:11.184954 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1200/2327] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:46:11.190837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-695c4819-1c2e-4ccf-a3c4-ef0253160674 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32f2944d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.384163 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-695c4819-1c2e-4ccf-a3c4-ef0253160674 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463" status: 202 len: 0 microversion: 2.1 time: 0.196928 Aug 29 15:46:11.384961 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1201/2328] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:11 2022] DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:46:11.390036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-59a2ed60-edb5-4699-aece-56d4542e14a2 req-e59fdd09-e2dd-4e14-a145-ba154b8c6b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84901dc8-b1fb-4b33-ba18-4f5ac98666ca", "name": "network-vif-deleted", "tag": "f68364fe-308b-47e5-b6fa-d75a66d8d8d5"}, {"name": "network-changed", "server_uuid": "bf3ea860-8924-4b41-a76a-5f15ce543ba4", "tag": "ac54ca12-72b9-4ec9-b799-8738e3c401d3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:11.404294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-59a2ed60-edb5-4699-aece-56d4542e14a2 req-e59fdd09-e2dd-4e14-a145-ba154b8c6b47 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.405060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-59a2ed60-edb5-4699-aece-56d4542e14a2 req-e59fdd09-e2dd-4e14-a145-ba154b8c6b47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.405666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-59a2ed60-edb5-4699-aece-56d4542e14a2 req-e59fdd09-e2dd-4e14-a145-ba154b8c6b47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.430331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-59a2ed60-edb5-4699-aece-56d4542e14a2 req-e59fdd09-e2dd-4e14-a145-ba154b8c6b47 service nova] Creating event network-vif-deleted:f68364fe-308b-47e5-b6fa-d75a66d8d8d5 for instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca on n-h1-836830-13 Aug 29 15:46:11.431510 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-59a2ed60-edb5-4699-aece-56d4542e14a2 req-e59fdd09-e2dd-4e14-a145-ba154b8c6b47 service nova] Creating event network-changed:ac54ca12-72b9-4ec9-b799-8738e3c401d3 for instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 on n-h2-836830-13 Aug 29 15:46:11.442426 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-59a2ed60-edb5-4699-aece-56d4542e14a2 req-e59fdd09-e2dd-4e14-a145-ba154b8c6b47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056024 Aug 29 15:46:11.443374 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1202/2329] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:11.448685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8702012-df78-4ce1-9071-38ada8e87ed0 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32f2a5d430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.514378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.527671 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b291abdc-34de-49c6-bf8c-406fd0df8bea tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.760503 Aug 29 15:46:11.528716 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1128/2330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:10 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:11.539449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.546751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.557389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.558270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.559088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.561243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.562380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.563214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.693532 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8702012-df78-4ce1-9071-38ada8e87ed0 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea" status: 202 len: 0 microversion: 2.1 time: 0.247851 Aug 29 15:46:11.704727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1203/2331] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:11 2022] DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:11.711832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.713717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.723586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.724404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.725235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.726212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.726882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.727515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.742728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.752208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b23b246-02de-4b22-b8e0-e95b18ef18e6 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.221559 Aug 29 15:46:11.753146 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1129/2332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:11.758404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-50b76ee3-deee-43b9-9a07-3349905924b7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'create', calling method: .version_select at 0x7f32ee8e49d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-341408926", "description": "tempest-description-1955591666"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:11.919229 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-50b76ee3-deee-43b9-9a07-3349905924b7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.163110 Aug 29 15:46:11.923259 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1130/2333] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:46:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:11.941294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.942572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.948256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:11.957187 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d6901893-3570-4702-ae83-e99df5c14014 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1316 microversion: 2.1 time: 0.250845 Aug 29 15:46:11.970520 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1204/2334] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:11.970680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.970680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.970877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:11.970877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:11.971106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.971106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.971106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.971106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.973725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.974504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.974811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:11.975538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:11.976111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:11.976539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.141226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.150208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-538d5446-2841-4ad1-9e77-44cd47bbd5e6 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1472 microversion: 2.1 time: 0.224148 Aug 29 15:46:12.150450 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1131/2335] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:12.156215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b3072e1-138c-4ad9-80ae-e41932d80493 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Action: 'update', calling method: .version_select at 0x7f32edc1bca0>, body: {"security_group": {"name": "tempest-sg-hth-254570212", "description": "tempest-description-hth-273060717"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:12.176887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.186380 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-178bb59a-8d22-49d1-ae23-7ffcbad33bb9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.226536 Aug 29 15:46:12.187901 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1205/2336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:11 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:12.192950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.193659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.200120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.201029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.201846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.202925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.203490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.204102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.283985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.304447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.306924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.308328 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18007f31-c589-4e85-bd0c-f645e03af5de tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1664 microversion: 2.25 time: 0.119216 Aug 29 15:46:12.309084 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1206/2337] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1664 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:12.329218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b3072e1-138c-4ad9-80ae-e41932d80493 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "PUT /compute/v2.1/os-security-groups/d68faea4-93eb-4aa6-beb9-95478ad4a3b7" status: 200 len: 216 microversion: 2.1 time: 0.177692 Aug 29 15:46:12.337639 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1132/2338] 10.222.0.83 () {60 vars in 1290 bytes} [Mon Aug 29 15:46:12 2022] PUT /compute/v2.1/os-security-groups/d68faea4-93eb-4aa6-beb9-95478ad4a3b7 => generated 216 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:12.343331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-550033ed-e5f2-423f-a670-14d65bfb60ed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32f2ab09d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.397717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-550033ed-e5f2-423f-a670-14d65bfb60ed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/d68faea4-93eb-4aa6-beb9-95478ad4a3b7" status: 200 len: 216 microversion: 2.1 time: 0.059361 Aug 29 15:46:12.398340 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1207/2339] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/os-security-groups/d68faea4-93eb-4aa6-beb9-95478ad4a3b7 => generated 216 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:12.411450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba998dca-332c-4517-ae80-a390a745035a tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32eef1fa60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.548799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.549625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.557068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.557560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.558164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.558884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.559349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.559775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.617090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba998dca-332c-4517-ae80-a390a745035a tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/d68faea4-93eb-4aa6-beb9-95478ad4a3b7" status: 202 len: 0 microversion: 2.1 time: 0.209203 Aug 29 15:46:12.622141 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1133/2340] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:12 2022] DELETE /compute/v2.1/os-security-groups/d68faea4-93eb-4aa6-beb9-95478ad4a3b7 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:12.630919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.652563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.662798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.663580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.664243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.665377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.666208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.666854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.683255 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca HTTP/1.1 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '84901dc8-b1fb-4b33-ba18-4f5ac98666ca'} Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:12.685833 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:12.691190 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6a97fa3c-1fcb-47de-8b60-4e0779d2e04b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 404 len: 111 microversion: 2.1 time: 0.064755 Aug 29 15:46:12.693587 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1134/2341] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:12 2022] DELETE /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:12.699179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.699835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 84901dc8-b1fb-4b33-ba18-4f5ac98666ca] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.707618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.708193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.708643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.709365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.709829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.710262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.728384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:12.728889 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca HTTP/1.1 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '84901dc8-b1fb-4b33-ba18-4f5ac98666ca'} Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.730459 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Instance 84901dc8-b1fb-4b33-ba18-4f5ac98666ca could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-43481bac-b8ce-4090-8e95-a82c6b2941da tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca" status: 404 len: 111 microversion: 2.1 time: 0.036768 Aug 29 15:46:12.736862 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1135/2342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/84901dc8-b1fb-4b33-ba18-4f5ac98666ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:46:12.741472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df8f2c74-67c4-48fb-a23d-d0b63bff42c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32ee4ad430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.745482 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-025409c0-c933-46fb-b3b1-74f88400582e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.200714 Aug 29 15:46:12.746319 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1208/2343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:12.765390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-df8f2c74-67c4-48fb-a23d-d0b63bff42c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:12.767308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.security_group_api [None req-df8f2c74-67c4-48fb-a23d-d0b63bff42c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group a5321592-c7c4-4186-a6ef-2f152f865fea not found {{(pid=129132) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:12.767840 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-df8f2c74-67c4-48fb-a23d-d0b63bff42c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist Aug 29 15:46:12.767840 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-9cedc879-041b-48fb-8a1d-8e812a17df7b'] Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df8f2c74-67c4-48fb-a23d-d0b63bff42c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea HTTP/1.1 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: exception: Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-9cedc879-041b-48fb-8a1d-8e812a17df7b'] Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a5321592-c7c4-4186-a6ef-2f152f865fea'} Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:12.769716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cedc879-041b-48fb-8a1d-8e812a17df7b'] Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cedc879-041b-48fb-8a1d-8e812a17df7b'] Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cedc879-041b-48fb-8a1d-8e812a17df7b'] Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cedc879-041b-48fb-8a1d-8e812a17df7b'] Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df8f2c74-67c4-48fb-a23d-d0b63bff42c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group a5321592-c7c4-4186-a6ef-2f152f865fea does not exist Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-9cedc879-041b-48fb-8a1d-8e812a17df7b'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-df8f2c74-67c4-48fb-a23d-d0b63bff42c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea" status: 404 len: 194 microversion: 2.1 time: 0.034057 Aug 29 15:46:12.775207 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1136/2344] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:12 2022] DELETE /compute/v2.1/os-security-groups/a5321592-c7c4-4186-a6ef-2f152f865fea => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:12.781923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4618ef76-fecb-4324-a667-bfee531ca950 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edbf88b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.784941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.785686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:12.804138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.805398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.806242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.807852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:12.811599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:12.812781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:12.817872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:12.825932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-4618ef76-fecb-4324-a667-bfee531ca950 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:12.827231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.security_group_api [None req-4618ef76-fecb-4324-a667-bfee531ca950 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 83a26228-3800-44b3-8187-7ae1eccf1463 not found {{(pid=129132) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:12.827815 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4618ef76-fecb-4324-a667-bfee531ca950 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist Aug 29 15:46:12.827815 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-885a841b-3fc7-498e-8873-7cc8467a50c5'] Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4618ef76-fecb-4324-a667-bfee531ca950 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463 HTTP/1.1 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: exception: Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-885a841b-3fc7-498e-8873-7cc8467a50c5'] Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '83a26228-3800-44b3-8187-7ae1eccf1463'} Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:12.829776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885a841b-3fc7-498e-8873-7cc8467a50c5'] Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885a841b-3fc7-498e-8873-7cc8467a50c5'] Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885a841b-3fc7-498e-8873-7cc8467a50c5'] Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-885a841b-3fc7-498e-8873-7cc8467a50c5'] Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4618ef76-fecb-4324-a667-bfee531ca950 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 83a26228-3800-44b3-8187-7ae1eccf1463 does not exist Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-885a841b-3fc7-498e-8873-7cc8467a50c5'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4618ef76-fecb-4324-a667-bfee531ca950 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463" status: 404 len: 194 microversion: 2.1 time: 0.053928 Aug 29 15:46:12.834537 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1137/2345] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:12 2022] DELETE /compute/v2.1/os-security-groups/83a26228-3800-44b3-8187-7ae1eccf1463 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:12.844704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0bc5191-0227-415e-833e-c0786553735d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32ef248700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.914842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-c0bc5191-0227-415e-833e-c0786553735d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:12.915494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.security_group_api [None req-c0bc5191-0227-415e-833e-c0786553735d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 00f3c891-f006-4c20-92bc-f27acf7288f4 not found {{(pid=129132) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:12.916225 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c0bc5191-0227-415e-833e-c0786553735d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:46:12.916225 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-2893bd05-245e-4c02-a5e9-2bb4c013595f'] Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0bc5191-0227-415e-833e-c0786553735d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4 HTTP/1.1 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: exception: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-2893bd05-245e-4c02-a5e9-2bb4c013595f'] Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '00f3c891-f006-4c20-92bc-f27acf7288f4'} Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:12.918352 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2893bd05-245e-4c02-a5e9-2bb4c013595f'] Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2893bd05-245e-4c02-a5e9-2bb4c013595f'] Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2893bd05-245e-4c02-a5e9-2bb4c013595f'] Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2893bd05-245e-4c02-a5e9-2bb4c013595f'] Aug 29 15:46:12.925501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:12.931505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0bc5191-0227-415e-833e-c0786553735d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 00f3c891-f006-4c20-92bc-f27acf7288f4 does not exist Aug 29 15:46:12.931505 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-2893bd05-245e-4c02-a5e9-2bb4c013595f'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:12.931505 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0bc5191-0227-415e-833e-c0786553735d tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4" status: 404 len: 194 microversion: 2.1 time: 0.094674 Aug 29 15:46:12.932323 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1138/2346] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:12 2022] DELETE /compute/v2.1/os-security-groups/00f3c891-f006-4c20-92bc-f27acf7288f4 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:12.964728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-feb41354-e9f3-4e38-a3db-4180601fb5c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32edbf88b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:12.996491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG neutronclient.v2_0.client [None req-feb41354-e9f3-4e38-a3db-4180601fb5c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist", "detail": ""}} {{(pid=129132) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:12.997199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.security_group_api [None req-feb41354-e9f3-4e38-a3db-4180601fb5c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 not found {{(pid=129132) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:12.998420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-feb41354-e9f3-4e38-a3db-4180601fb5c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:46:12.998420 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-528f5bdd-d76a-4e8e-ad77-6256729c8c6c'] Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-feb41354-e9f3-4e38-a3db-4180601fb5c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433 HTTP/1.1 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: exception: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-528f5bdd-d76a-4e8e-ad77-6256729c8c6c'] Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '16bc40f5-392b-4cc0-808a-ea27d8c27433'} Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:13.000711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-528f5bdd-d76a-4e8e-ad77-6256729c8c6c'] Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-528f5bdd-d76a-4e8e-ad77-6256729c8c6c'] Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-528f5bdd-d76a-4e8e-ad77-6256729c8c6c'] Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-528f5bdd-d76a-4e8e-ad77-6256729c8c6c'] Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-feb41354-e9f3-4e38-a3db-4180601fb5c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 16bc40f5-392b-4cc0-808a-ea27d8c27433 does not exist Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: Neutron server returns request_ids: ['req-528f5bdd-d76a-4e8e-ad77-6256729c8c6c'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:13.006735 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-feb41354-e9f3-4e38-a3db-4180601fb5c7 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433" status: 404 len: 194 microversion: 2.1 time: 0.067391 Aug 29 15:46:13.015456 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1139/2347] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:12 2022] DELETE /compute/v2.1/os-security-groups/16bc40f5-392b-4cc0-808a-ea27d8c27433 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:13.018297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.018919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.027780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.028277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.028746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.030252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.030715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.031161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.045507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.054392 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30c7ffb8-80e9-445a-a94b-c9f5f1a24b41 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.280342 Aug 29 15:46:13.055370 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1209/2348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:12 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:13.060464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0744b11-65b6-44f9-a101-df9a3f23c3a9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32f285b0d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.096490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-b0744b11-65b6-44f9-a101-df9a3f23c3a9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:13.097019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-b0744b11-65b6-44f9-a101-df9a3f23c3a9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 91f45970-bb74-44e1-8094-8512b4fbaa11 not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:13.097539 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b0744b11-65b6-44f9-a101-df9a3f23c3a9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:46:13.097539 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-170e7d0a-7a1d-4c04-b8b0-8d803567043f'] Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0744b11-65b6-44f9-a101-df9a3f23c3a9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11 HTTP/1.1 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-170e7d0a-7a1d-4c04-b8b0-8d803567043f'] Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '91f45970-bb74-44e1-8094-8512b4fbaa11'} Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:13.099598 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-170e7d0a-7a1d-4c04-b8b0-8d803567043f'] Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-170e7d0a-7a1d-4c04-b8b0-8d803567043f'] Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-170e7d0a-7a1d-4c04-b8b0-8d803567043f'] Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-170e7d0a-7a1d-4c04-b8b0-8d803567043f'] Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0744b11-65b6-44f9-a101-df9a3f23c3a9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 91f45970-bb74-44e1-8094-8512b4fbaa11 does not exist Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-170e7d0a-7a1d-4c04-b8b0-8d803567043f'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0744b11-65b6-44f9-a101-df9a3f23c3a9 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11" status: 404 len: 194 microversion: 2.1 time: 0.044705 Aug 29 15:46:13.104106 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1210/2349] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:13 2022] DELETE /compute/v2.1/os-security-groups/91f45970-bb74-44e1-8094-8512b4fbaa11 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:13.111398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea4f2134-ee88-4f37-9908-340d5a5a90f4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32f2ab9430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.133170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-ea4f2134-ee88-4f37-9908-340d5a5a90f4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:13.133866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-ea4f2134-ee88-4f37-9908-340d5a5a90f4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Neutron security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:13.134492 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ea4f2134-ee88-4f37-9908-340d5a5a90f4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:46:13.134492 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-88418c4e-3d2a-4fc8-aeee-a4187f6230cc'] Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea4f2134-ee88-4f37-9908-340d5a5a90f4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 HTTP/1.1 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-88418c4e-3d2a-4fc8-aeee-a4187f6230cc'] Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158'} Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:13.137219 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88418c4e-3d2a-4fc8-aeee-a4187f6230cc'] Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88418c4e-3d2a-4fc8-aeee-a4187f6230cc'] Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88418c4e-3d2a-4fc8-aeee-a4187f6230cc'] Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88418c4e-3d2a-4fc8-aeee-a4187f6230cc'] Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea4f2134-ee88-4f37-9908-340d5a5a90f4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Security group 7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 does not exist Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-88418c4e-3d2a-4fc8-aeee-a4187f6230cc'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea4f2134-ee88-4f37-9908-340d5a5a90f4 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158" status: 404 len: 194 microversion: 2.1 time: 0.032815 Aug 29 15:46:13.143173 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1211/2350] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:13 2022] DELETE /compute/v2.1/os-security-groups/7ccb6ae2-f304-4e7d-9d15-5d8ff84f4158 => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:46:13.147977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.148481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.155350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.155844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.156311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.157017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.157474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.157907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.185156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:13.191649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.199527 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14a1be99-e65a-44fc-8e5f-718a58f4ae4e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1505 microversion: 2.1 time: 0.188622 Aug 29 15:46:13.200422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1140/2351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:13.207604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.208585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.215488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.216872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.218124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.219227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.219938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.220540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.291832 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d1128332-9e45-46c8-884a-bdff4641c8f6 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 204 len: 0 microversion: 2.1 time: 0.147322 Aug 29 15:46:13.292744 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1212/2352] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:13 2022] DELETE /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:13.300333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.301037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.307351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.307841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.308281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.308990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.309448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.309984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.390620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.399583 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-98a0624a-4389-4ab9-9404-69f60e7dc7a8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1472 microversion: 2.1 time: 0.195652 Aug 29 15:46:13.400170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1141/2353] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:13.405850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.406644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.412802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.413291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.413925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.414632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.415127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.415595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.449644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.450720 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5437be0f-e41d-4043-b481-95399a91028e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595/os-instance-actions/req-793fe72f-9082-4470-b9d4-611705f544a3" status: 200 len: 313 microversion: 2.1 time: 0.049547 Aug 29 15:46:13.452303 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1142/2354] 10.222.0.83 () {58 vars in 1419 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595/os-instance-actions/req-793fe72f-9082-4470-b9d4-611705f544a3 => generated 313 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:13.456971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.457597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.457867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.465678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.466107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.466587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.467323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.467783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.467909 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b68134c4-3e69-4665-affe-74b8ef7c5e1e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.173691 Aug 29 15:46:13.468211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.475057 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1213/2355] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:13.475057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.475057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.483773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.484277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.484720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.485525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.485978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.486468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.521626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.522111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.522549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.522998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'fault' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:13.566970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.577162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.578706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.579961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9052c806-eb99-45d2-bd89-97203fcfb06f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1375 microversion: 2.25 time: 0.110295 Aug 29 15:46:13.580675 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1214/2356] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1375 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:13.586005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:13.588350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.595616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.596198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.596710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.597498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.597960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.598433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.635194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.643297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-547cbf23-005c-454f-84c7-fab6ee181342 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1646 microversion: 2.1 time: 0.189896 Aug 29 15:46:13.643875 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1143/2357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1646 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:13.648516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-77d04ee7-8718-49d5-bc06-549d87fc6c9e req-54dfdd52-ffbb-49f1-a155-fafae6ad87ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36742e72-c374-4c67-82eb-e6dd5a601e99", "name": "network-vif-deleted", "tag": "15a54a03-347a-46bd-bbe5-7a555d14444e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:13.661916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-77d04ee7-8718-49d5-bc06-549d87fc6c9e req-54dfdd52-ffbb-49f1-a155-fafae6ad87ce service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.662399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-77d04ee7-8718-49d5-bc06-549d87fc6c9e req-54dfdd52-ffbb-49f1-a155-fafae6ad87ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.662903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-77d04ee7-8718-49d5-bc06-549d87fc6c9e req-54dfdd52-ffbb-49f1-a155-fafae6ad87ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.679308 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-77d04ee7-8718-49d5-bc06-549d87fc6c9e req-54dfdd52-ffbb-49f1-a155-fafae6ad87ce service nova] Creating event network-vif-deleted:15a54a03-347a-46bd-bbe5-7a555d14444e for instance 36742e72-c374-4c67-82eb-e6dd5a601e99 on n-h2-836830-13 Aug 29 15:46:13.684281 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-77d04ee7-8718-49d5-bc06-549d87fc6c9e req-54dfdd52-ffbb-49f1-a155-fafae6ad87ce service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039262 Aug 29 15:46:13.685464 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1144/2358] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:13.685668 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ed58abe-a81b-4d28-af38-737f87275444 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "POST /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595/action" status: 202 len: 0 microversion: 2.1 time: 0.103163 Aug 29 15:46:13.686746 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1215/2359] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:46:13 2022] POST /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:13.694995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.695740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.702614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.703403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.703849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.704538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.704990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.705412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.770692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:13.771349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:13.777555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.778049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.778489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.779240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:13.779749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:13.780194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:13.847096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.855920 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f4236039-9473-417e-b1c2-1e22df5eb85e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1507 microversion: 2.1 time: 0.164910 Aug 29 15:46:13.856496 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1145/2360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:13.924427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:13.932330 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d104443f-4ccb-4103-a013-a19a8ac4c34a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.166417 Aug 29 15:46:13.932897 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1216/2361] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:13 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:14.076943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.077463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.083513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.083996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.084428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.085115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.085560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.085978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.220412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.228665 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7757e82-818c-4be8-acb1-631dbd8fada7 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.156095 Aug 29 15:46:14.229269 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1146/2362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:14.421983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.422555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.429489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.429966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.430396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.431096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.431544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.431964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.489335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.489950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.496032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.496521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.496956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.497650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.498104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.498527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.566020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.574187 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aba37724-ef0b-4a5e-a87d-cba84bd999e0 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1472 microversion: 2.1 time: 0.157068 Aug 29 15:46:14.574773 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1217/2363] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:14.604906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.605544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.612451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.612946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.613372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.614060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.614508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.614923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.644259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.648653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.649133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.649563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.650009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'fault' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:14.652847 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bef2d860-3b9b-4685-9f1a-4b79d36d80d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.167370 Aug 29 15:46:14.653735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1147/2364] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:14.667276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.668391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.676194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.676963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.677395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.678113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.678559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.678976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.697718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.708078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.709563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.710796 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57f4db41-4ed2-404f-aa95-3413d2cafbf4 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1375 microversion: 2.25 time: 0.109912 Aug 29 15:46:14.711394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1218/2365] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1375 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:14.878237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.878945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:14.885434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.885899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.886333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.887042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:14.887495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:14.887917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:14.976021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:14.984917 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c028444c-65eb-4186-a25c-3cf17752bb08 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1646 microversion: 2.1 time: 0.321795 Aug 29 15:46:14.986115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1148/2366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1646 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:14.991893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:14.993054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.000244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.000859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.001412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.002216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.003090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.003828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.045820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.054389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d3cd8d1-61cf-48ab-adad-8fa3a809fe13 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1507 microversion: 2.1 time: 0.180285 Aug 29 15:46:15.054973 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1219/2367] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:15.223104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.230916 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2439224e-3e56-4d88-804f-4909d7cf5770 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.243066 Aug 29 15:46:15.231497 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1149/2368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:14 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:15.250771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:15.251428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.257680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.258170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.258611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.259340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.259799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.260228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.411203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.442820 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f9a709ac-4f0c-4b7a-995b-b126ed900736 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.176664 Aug 29 15:46:15.442820 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1220/2369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:15 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:15.595340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:15.596055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.599200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:15.603007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.604890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.605339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.606045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.606499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.607040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.675338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:15.676112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.683175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.684031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.684765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.686310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.686899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.687797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.776172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.785318 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e7f30f3-5432-4059-8665-e152968151c4 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1472 microversion: 2.1 time: 0.194650 Aug 29 15:46:15.794823 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1150/2370] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:15 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:15.802702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e93de6aa-69fc-4cc4-8ac5-12343332e09d req-752fcbd6-b3da-43a9-88bc-55787744ec73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c38b478-d0f1-43a7-9258-2e2f07800774", "name": "network-vif-deleted", "tag": "a053a1d8-5fcb-4d22-ab96-a10b16caa325"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:15.814048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e93de6aa-69fc-4cc4-8ac5-12343332e09d req-752fcbd6-b3da-43a9-88bc-55787744ec73 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.814764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e93de6aa-69fc-4cc4-8ac5-12343332e09d req-752fcbd6-b3da-43a9-88bc-55787744ec73 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.815267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e93de6aa-69fc-4cc4-8ac5-12343332e09d req-752fcbd6-b3da-43a9-88bc-55787744ec73 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.828007 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e93de6aa-69fc-4cc4-8ac5-12343332e09d req-752fcbd6-b3da-43a9-88bc-55787744ec73 service nova] Creating event network-vif-deleted:a053a1d8-5fcb-4d22-ab96-a10b16caa325 for instance 9c38b478-d0f1-43a7-9258-2e2f07800774 on n-h1-836830-13 Aug 29 15:46:15.833727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e93de6aa-69fc-4cc4-8ac5-12343332e09d req-752fcbd6-b3da-43a9-88bc-55787744ec73 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037126 Aug 29 15:46:15.834345 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1151/2371] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:15.840459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:15.842931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:15.849460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.849960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.850398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.851136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.851772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.852199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.852847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.863580 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b28aea4a-d4bb-4788-984a-83ecccd5c709 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.192592 Aug 29 15:46:15.869353 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1221/2372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:15 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:15.885961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:15.886459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:15.886919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:15.887381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'fault' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:15.930017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.938694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.940181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:15.941344 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3abc1e73-3da6-4a0c-b618-04c93985e237 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1375 microversion: 2.25 time: 0.105729 Aug 29 15:46:15.941901 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1152/2373] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:15 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1375 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:16.011666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.012275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.018387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.018867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.019333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.020152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.021352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.022137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.062275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:16.066794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.067376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.067814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.068265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lazy-loading 'fault' on Instance uuid 9c38b478-d0f1-43a7-9258-2e2f07800774 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:16.077826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.079439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.087007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.087687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.088252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.089305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.089929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.090481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.108501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:16.126193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fcf93e985b4a09a67b719508d8f812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a27922448d754caea1e19340b11bfd64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:16.135083 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe6fa685-4629-43aa-9e70-55c090491a44 tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 200 len: 1305 microversion: 2.1 time: 0.127450 Aug 29 15:46:16.135677 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1222/2374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:16.233382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:16.241209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f81a7b3-b7c7-452b-8d3a-ecb6c0a214a2 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1507 microversion: 2.1 time: 0.168914 Aug 29 15:46:16.241783 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1153/2375] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:16.252067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.252684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.258904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.259423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.259885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.260575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.261032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.261458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.394734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:16.402671 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-34977ab0-92a7-4e87-bc6a-a0fa939a9ee4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.154696 Aug 29 15:46:16.403275 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1223/2376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:16.446485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.447135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.453892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.454377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.454813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.455533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.455988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.456411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.591946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:16.599914 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7312954d-5c3e-4811-9a66-7a6bc69d21d5 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.157382 Aug 29 15:46:16.600479 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1154/2377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:16.805727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.806339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.813872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.814352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.814784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.815497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.815947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.816371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.819240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:16.884807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:16.885427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:16.892445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.892940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.893381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.894087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.894542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.894965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:16.959984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:16.969724 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c9f1c6e4-d341-41d6-9a72-84e4421f321f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1472 microversion: 2.1 time: 0.167807 Aug 29 15:46:16.984008 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1224/2378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:16.984008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a930ec01-a7dd-4447-b115-0797eb157a25 req-9d03c80a-4b55-4cdf-8dab-2a59e52501b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a59b56d-57a1-4efa-876c-9eb4ffe3caf7", "name": "network-vif-unplugged", "status": "completed", "tag": "c6c851cd-bc07-4beb-8aa2-14e69e41d52d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:16.989272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a930ec01-a7dd-4447-b115-0797eb157a25 req-9d03c80a-4b55-4cdf-8dab-2a59e52501b4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:16.989931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a930ec01-a7dd-4447-b115-0797eb157a25 req-9d03c80a-4b55-4cdf-8dab-2a59e52501b4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:16.990260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a930ec01-a7dd-4447-b115-0797eb157a25 req-9d03c80a-4b55-4cdf-8dab-2a59e52501b4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.004269 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a930ec01-a7dd-4447-b115-0797eb157a25 req-9d03c80a-4b55-4cdf-8dab-2a59e52501b4 service nova] Creating event network-vif-unplugged:c6c851cd-bc07-4beb-8aa2-14e69e41d52d for instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 on n-h2-836830-13 Aug 29 15:46:17.009772 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a930ec01-a7dd-4447-b115-0797eb157a25 req-9d03c80a-4b55-4cdf-8dab-2a59e52501b4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037349 Aug 29 15:46:17.010459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1225/2379] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:17.015894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.016945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.023760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.024248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.024687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.025390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.025949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.026291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.050248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.058178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47ec8bad-f573-478f-984d-c2530783b455 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.177505 Aug 29 15:46:17.058762 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1155/2380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:16 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:17.063444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.063929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.064526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.064972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'fault' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:17.106173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.115048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.116496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.117657 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a320e6bd-f453-47eb-9db2-57d1c3a0958b tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1375 microversion: 2.25 time: 0.106079 Aug 29 15:46:17.118220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1226/2381] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1375 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:17.158456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.159108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] [instance: 9c38b478-d0f1-43a7-9258-2e2f07800774] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.165385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.165873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.166317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.167008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.167491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.167920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.182718 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] HTTP exception thrown: Instance 9c38b478-d0f1-43a7-9258-2e2f07800774 could not be found. Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Request method failure captured: Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 HTTP/1.1 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN7qt9h6FYQ92UAA5V3qaM5z9EmddtH4w-nys67VnbQxFAlAom0EhL3Y77kHjYBAFRAvszqN0kFbQ0njmmzHo54N9W_LSM1Qj76D6nhBso7kSQzwd31HCVVGlJzKsP8xB8gxjBLzIRCnBwyeQUfw07Vy-l0NNfSgRBsHmDl3P8-O4oI Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a27922448d754caea1e19340b11bfd64", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a27922448d754caea1e19340b11bfd64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a27922448d754caea1e19340b11bfd64"}]}] Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a27922448d754caea1e19340b11bfd64 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1287229231 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a9fcf93e985b4a09a67b719508d8f812 Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupsTestJSON-1287229231-project Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 9c38b478-d0f1-43a7-9258-2e2f07800774 could not be found. Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9c38b478-d0f1-43a7-9258-2e2f07800774'} Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c38b478-d0f1-43a7-9258-2e2f07800774 could not be found. Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c38b478-d0f1-43a7-9258-2e2f07800774 could not be found. Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:17.184398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c38b478-d0f1-43a7-9258-2e2f07800774 could not be found. Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Returning 404 to user: Instance 9c38b478-d0f1-43a7-9258-2e2f07800774 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-68bffd31-9fe4-4ee8-8f55-f50809581fed tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774" status: 404 len: 111 microversion: 2.1 time: 0.031902 Aug 29 15:46:17.188892 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1156/2382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/9c38b478-d0f1-43a7-9258-2e2f07800774 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:17.195192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-361877d9-a930-48ab-8f3b-f926bb47551b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32ee2449d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.261718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.262335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.271162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.271669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.272110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.272815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.273311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.273736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.386405 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-361877d9-a930-48ab-8f3b-f926bb47551b tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/4d12c280-62d2-4311-bf18-bbf8e0d24a57" status: 202 len: 0 microversion: 2.1 time: 0.194901 Aug 29 15:46:17.387493 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1227/2383] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:17 2022] DELETE /compute/v2.1/os-security-groups/4d12c280-62d2-4311-bf18-bbf8e0d24a57 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:17.397469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f18ca576-b405-467d-8dd8-4de1baaa99ee tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] Calling method '.version_select at 0x7f32f2ab9280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.424186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.432490 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-512b9821-56c0-4cde-b579-9aaf77c155cc tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1507 microversion: 2.1 time: 0.174668 Aug 29 15:46:17.433052 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1157/2384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:17.438035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.438648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.444749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.445424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.446010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.446898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.447389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.447974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.621651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f18ca576-b405-467d-8dd8-4de1baaa99ee tempest-SecurityGroupsTestJSON-1287229231 tempest-SecurityGroupsTestJSON-1287229231-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/1f6da4c6-ed29-493b-8da2-32ade760088e" status: 202 len: 0 microversion: 2.1 time: 0.229353 Aug 29 15:46:17.622507 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1228/2385] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:17 2022] DELETE /compute/v2.1/os-security-groups/1f6da4c6-ed29-493b-8da2-32ade760088e => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:17.627220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.627846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:17.634602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.635126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.635570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.636665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:17.636818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:17.637193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:17.679659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:17.694106 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-560fe111-d617-4be6-85b6-4415ee0a5a29 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.259676 Aug 29 15:46:17.694846 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1158/2386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:17.995699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:17.996779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.005642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.006298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.006835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.007662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.008212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.008732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.262217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.283457 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9daff6e6-320c-4a88-b1ba-58fc54e6a7bf tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1468 microversion: 2.1 time: 0.659949 Aug 29 15:46:18.286589 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1229/2387] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1468 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:18.291906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:18.292805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.300632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.302381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.303282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.304278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.305082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.305879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.381344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.398941 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-897b84f1-e880-4757-95d2-efa851777551 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1472 microversion: 2.1 time: 0.411099 Aug 29 15:46:18.400021 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1159/2388] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:17 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:18.415536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:18.416637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.430664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.431413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.431991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.433597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.434694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.436232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.537440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.538219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.539096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.540230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'fault' on Instance uuid 36742e72-c374-4c67-82eb-e6dd5a601e99 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:18.677519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.689299 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3305a70e-aa9e-4bdc-aeab-fe40e3c055a9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.401026 Aug 29 15:46:18.706856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1230/2389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:18 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:18.713200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:18.714854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:18.724705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.728089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.729325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.730190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:18.730949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:18.731525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:18.987947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.997226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:18.999951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.001420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d51a0fa-201b-47e8-a0fb-22a9bc0d68d9 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 200 len: 1375 microversion: 2.25 time: 0.600019 Aug 29 15:46:19.002192 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1160/2390] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:18 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 1375 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:19.007095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.007953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:19.014573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.015406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.016047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.016971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.017621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.018703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.043598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.057274 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7d91b775-aad4-4623-a7d0-8b813d184526 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1507 microversion: 2.1 time: 0.348013 Aug 29 15:46:19.060347 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1231/2391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:18 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:19.284134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6c5adf5a-5681-40b6-94df-dfa8a23f7f95 req-fa94c610-3971-4852-9140-9e101516dcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a59b56d-57a1-4efa-876c-9eb4ffe3caf7", "name": "network-vif-deleted", "tag": "c6c851cd-bc07-4beb-8aa2-14e69e41d52d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:19.294946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.308617 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9faf1658-d37d-4876-9449-a29f27fa7dc6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.304975 Aug 29 15:46:19.309847 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1161/2392] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:19.311011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6c5adf5a-5681-40b6-94df-dfa8a23f7f95 req-fa94c610-3971-4852-9140-9e101516dcd7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.311563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6c5adf5a-5681-40b6-94df-dfa8a23f7f95 req-fa94c610-3971-4852-9140-9e101516dcd7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.312006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6c5adf5a-5681-40b6-94df-dfa8a23f7f95 req-fa94c610-3971-4852-9140-9e101516dcd7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.323730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.324582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:19.335354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.335843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.337012 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6c5adf5a-5681-40b6-94df-dfa8a23f7f95 req-fa94c610-3971-4852-9140-9e101516dcd7 service nova] Creating event network-vif-deleted:c6c851cd-bc07-4beb-8aa2-14e69e41d52d for instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 on n-h2-836830-13 Aug 29 15:46:19.342656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.345305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.345791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.346223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.354344 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6c5adf5a-5681-40b6-94df-dfa8a23f7f95 req-fa94c610-3971-4852-9140-9e101516dcd7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074958 Aug 29 15:46:19.361337 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1232/2393] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:19.421954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.422581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:19.439760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.440320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.443479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.444288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.444776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.446631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.592196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.597503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:19.609529 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53110bfb-a360-46be-9071-6282064be58b tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1301 microversion: 2.1 time: 0.192838 Aug 29 15:46:19.611748 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2626994c-48ae-46a3-9e63-d05293011f68 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1461 microversion: 2.1 time: 0.294858 Aug 29 15:46:19.612658 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1233/2394] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1301 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:19.620771 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1162/2395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1461 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:19.712747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.713464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:19.729278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.730131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.730842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.731842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.732975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.733672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.861919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:19.863310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:19.876624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.877132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.877581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:19.878641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:19.879043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:19.879468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.130799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:20.139751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f030a4ef-28b1-4e3c-a230-213f2c880cda tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.431388 Aug 29 15:46:20.151836 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1163/2396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:20.167819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.168814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 36742e72-c374-4c67-82eb-e6dd5a601e99] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.186913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.187689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.188348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.189514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.190036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.190444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.229992 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] HTTP exception thrown: Instance 36742e72-c374-4c67-82eb-e6dd5a601e99 could not be found. Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Request method failure captured: Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 HTTP/1.1 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN14P6wNxA5wsg6uVjuAvqegPxyfXqGi48qgzzIKPdufPolF8AWBac2zZL7X5ops9MBZFj93vYHRDITeCxjuqIpTmzlmAsFDe3y60wkADNqJX-Xd7I4SOx6RHE6_8KJNpRCJGodorNF52MFAQ55VcombAGL7SqFUZlU20LzvlywZW2U Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_70d66d1258d14a39b174734f9865c070", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/70d66d1258d14a39b174734f9865c070"}]}] Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f12698b45a114720af9c98b163077f59 Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 36742e72-c374-4c67-82eb-e6dd5a601e99 could not be found. Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '36742e72-c374-4c67-82eb-e6dd5a601e99'} Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36742e72-c374-4c67-82eb-e6dd5a601e99 could not be found. Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36742e72-c374-4c67-82eb-e6dd5a601e99 could not be found. Aug 29 15:46:20.231809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36742e72-c374-4c67-82eb-e6dd5a601e99 could not be found. Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Returning 404 to user: Instance 36742e72-c374-4c67-82eb-e6dd5a601e99 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-974788ad-e4e3-4af0-ab4d-cd65629d22b5 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99" status: 404 len: 111 microversion: 2.25 time: 0.080679 Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1164/2397] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/36742e72-c374-4c67-82eb-e6dd5a601e99 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:46:20.242316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.245207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.256149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.256677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.257130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.257863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.258326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.258757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.410483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:20.418687 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1abbf0ed-c9a2-41ea-9711-ca1ff16c7cbf tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1507 microversion: 2.1 time: 0.180226 Aug 29 15:46:20.420481 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1165/2398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:20.425398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-55de43e3-4e9d-4d20-a638-48c260689c9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '.version_select at 0x7f32ee8c5dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.428875 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc89f16f-6310-4f26-a9af-36e7d7a11064 tempest-MigrationsAdminTest-1671626282 tempest-MigrationsAdminTest-1671626282-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1614 microversion: 2.1 time: 0.797230 Aug 29 15:46:20.430942 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1234/2399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:19 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1614 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:20.435770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.436364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.443119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.444221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.445439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.446361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.446966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.447611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.463227 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-55de43e3-4e9d-4d20-a638-48c260689c9f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132406724" status: 204 len: 0 microversion: 2.25 time: 0.041438 Aug 29 15:46:20.468034 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1166/2400] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132406724 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:46:20.474308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.475670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.481806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.483289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.484141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.485108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.485772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.486384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.515324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:20.614318 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36d06489-6cb4-4168-b7b8-5031aebf2af2 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 204 len: 0 microversion: 2.1 time: 0.144316 Aug 29 15:46:20.615904 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1167/2401] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:20 2022] DELETE /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:20.626485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.627235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.636514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.637557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.638293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.638884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.639415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.639855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.730970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:20.748811 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9f1ad32c-7d2f-4822-a30a-44c49450d822 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.313947 Aug 29 15:46:20.751799 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1235/2402] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:20.757987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:20.758369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:20.779475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.780887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.781447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.784771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.785364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.786373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.902003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:20.902822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:20.903672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:20.904988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lazy-loading 'fault' on Instance uuid 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:20.995293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.005854 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b034efd9-45d1-4d4f-95db-cd96453e4c63 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1306 microversion: 2.1 time: 0.254455 Aug 29 15:46:21.006511 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1236/2403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1306 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:21.177668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:21.177853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:21.185607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.186398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.186867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.188013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.188486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.188930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.235320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.254498 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d4d122e-83c2-4b8b-9baf-da74abeb6d25 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.630948 Aug 29 15:46:21.255168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1168/2404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:20 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:21.362126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.370733 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-956bca4b-e19d-48e8-bce5-3b801fcfa537 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.197598 Aug 29 15:46:21.372106 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1237/2405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:21 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:21.442600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:21.443580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:21.450566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.451118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.451717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.452514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.452956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.453537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.698140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.710708 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc4ca76b-d005-4b08-bfa4-6969ab900b16 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1512 microversion: 2.1 time: 0.272216 Aug 29 15:46:21.711621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1169/2406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:21 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:21.779598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:21.780450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:21.789138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.789915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.790413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.791854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.791854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.792501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.890221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:21.890953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:21.898196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.898800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.899493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.900470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:21.901116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:21.901790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:21.922587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:21.945148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:21.990644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:21.999522 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8482270-6548-4860-85fa-8d84b6f19ca1 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.226956 Aug 29 15:46:22.000211 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1238/2407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:21 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:22.029281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.030364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.037342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.037897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.038541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.039467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.040440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.041040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.055776 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-23bf3214-129f-418e-8493-bb86597b3a37 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 204 len: 0 microversion: 2.25 time: 0.169547 Aug 29 15:46:22.060098 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1170/2408] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:46:21 2022] DELETE /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:46:22.067423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.068328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.074803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.075475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.076038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.077578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.077578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.078138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.088225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.088765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.089508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.090148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lazy-loading 'fault' on Instance uuid 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:22.138299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.146943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-396f16d1-66e8-49bc-bbae-d8655f2ba3fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 200 len: 1306 microversion: 2.1 time: 0.121975 Aug 29 15:46:22.147552 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1239/2409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 1306 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:22.275877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.276528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.286669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.287201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.287645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.288381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.288868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.289298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.393619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.403763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.405313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.406492 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-41057ca2-a0e1-443b-b06c-38ac9a5f33ab tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1548 microversion: 2.25 time: 0.344167 Aug 29 15:46:22.407567 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1171/2410] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1548 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:22.412563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.413353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.425660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.426168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.427416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.429004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.429864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.430523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.493866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.503857 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f8c12d5-20dd-4b19-8e6c-3e7c5610d5bd tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.231885 Aug 29 15:46:22.504451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1240/2411] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:22.733968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:22.735208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:22.745101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.745674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.746321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.747070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:22.751086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.754876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:22.755409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:22.760306 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-67ba8ab7-9fa9-4c81-807f-174b0305ab2e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.351289 Aug 29 15:46:22.764163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1172/2412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:22.918414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:22.927970 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dcac8dc6-d85a-45af-a7a6-6d84baf23b12 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1512 microversion: 2.1 time: 0.198191 Aug 29 15:46:22.928779 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1241/2413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:22 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:23.053332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.054573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.070210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.071112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.072070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.073158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.081049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.081685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.168163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.169150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.181293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.185237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.188307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.189926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.197428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.198480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.231490 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 could not be found. Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 HTTP/1.1 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 could not be found. Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '1a59b56d-57a1-4efa-876c-9eb4ffe3caf7'} Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 could not be found. Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 could not be found. Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:23.233939 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:23.237067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:23.237067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:23.237067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:23.237067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:23.237067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:23.237067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 could not be found. Aug 29 15:46:23.237067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:23.239485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance 1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:23.242654 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3a8cfdb-59a8-46d7-8581-96583a6ffc1d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7" status: 404 len: 111 microversion: 2.1 time: 0.078664 Aug 29 15:46:23.250308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1242/2414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/1a59b56d-57a1-4efa-876c-9eb4ffe3caf7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:23.256254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.257258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.271072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.271787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.272453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.273304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.273722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.274300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.334527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:23.341592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:23.437308 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1bf2aaf5-064c-40a8-adf7-29add687776f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 204 len: 0 microversion: 2.1 time: 0.185345 Aug 29 15:46:23.440902 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1243/2415] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:23 2022] DELETE /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:23.443977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.444940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.451655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.452270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.452775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.453575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.454105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.454774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.543629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.564979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.566884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.569585 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b3257ab-1375-4149-82df-1f86fc851be7 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1506 microversion: 2.25 time: 0.129841 Aug 29 15:46:23.571320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1244/2416] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1506 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:23.578241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.579115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.588523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.590520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.592265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.593429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.594055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.594633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.604167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:23.613037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8e565e3-76a2-48a5-a9ef-f2166b5c1c45 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.579826 Aug 29 15:46:23.623199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1173/2417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:23.628941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:23.629460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:23.664509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.665238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.665692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:23.666460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:23.672072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:23.673021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.002276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.032832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dc7b59d1-bf55-40b3-940c-79588ce46119 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.413712 Aug 29 15:46:24.039724 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1174/2418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:24.053648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-cf69fb60-f578-485d-b67a-748d26ca62f0 req-fc459622-257b-429f-8b92-2b50bf37b659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be7a738-71fb-4b02-90d4-497b04cb438c", "name": "network-vif-deleted", "tag": "497ace04-4c82-46cf-ba04-0cba678d10fe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:24.069675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cf69fb60-f578-485d-b67a-748d26ca62f0 req-fc459622-257b-429f-8b92-2b50bf37b659 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.070360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cf69fb60-f578-485d-b67a-748d26ca62f0 req-fc459622-257b-429f-8b92-2b50bf37b659 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.071137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cf69fb60-f578-485d-b67a-748d26ca62f0 req-fc459622-257b-429f-8b92-2b50bf37b659 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.085184 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-cf69fb60-f578-485d-b67a-748d26ca62f0 req-fc459622-257b-429f-8b92-2b50bf37b659 service nova] Creating event network-vif-deleted:497ace04-4c82-46cf-ba04-0cba678d10fe for instance 5be7a738-71fb-4b02-90d4-497b04cb438c on n-h1-836830-13 Aug 29 15:46:24.093297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-cf69fb60-f578-485d-b67a-748d26ca62f0 req-fc459622-257b-429f-8b92-2b50bf37b659 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052018 Aug 29 15:46:24.094367 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1175/2419] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:24.102918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.104136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.109366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.116141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.117017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.117647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.118664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.119474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.120127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.122169 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b445d14-c2d5-477f-98b9-c66b2856b4b8 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1471 microversion: 2.1 time: 0.549450 Aug 29 15:46:24.128398 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1245/2420] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:23 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:24.134932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.134932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.154720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.155664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.156201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.157643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.163195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.163733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.397231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.414636 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-499d4ecd-e2dc-4379-a064-494c072f12f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.318076 Aug 29 15:46:24.417821 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1176/2421] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:24.547893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.567109 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6aad75b0-93bb-42ab-8894-2003bc2a62bb tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1505 microversion: 2.1 time: 0.436672 Aug 29 15:46:24.568220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1246/2422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:24.589516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '.version_select at 0x7f32ee7475e0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.590418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.598329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.599258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.599366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.600365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.601152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.601681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.602360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.603004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.610404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.612551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.613841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.616451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.617694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.618774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.677169 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe9714d0-3c19-44f4-8e13-17427df096ee tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.091689 Aug 29 15:46:24.687473 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1177/2423] 10.222.0.83 () {58 vars in 1296 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595/os-instance-actions => generated 611 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:24.696311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-720bdc29-a5c8-4144-a333-1c3f7ba74790 req-b6640335-5440-40ed-8c6b-104c29655217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "name": "network-vif-plugged", "status": "completed", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:24.709778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.710978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.712058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.712802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lazy-loading 'fault' on Instance uuid 5be7a738-71fb-4b02-90d4-497b04cb438c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:24.715651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-720bdc29-a5c8-4144-a333-1c3f7ba74790 req-b6640335-5440-40ed-8c6b-104c29655217 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.716339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-720bdc29-a5c8-4144-a333-1c3f7ba74790 req-b6640335-5440-40ed-8c6b-104c29655217 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.716820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-720bdc29-a5c8-4144-a333-1c3f7ba74790 req-b6640335-5440-40ed-8c6b-104c29655217 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.758324 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-720bdc29-a5c8-4144-a333-1c3f7ba74790 req-b6640335-5440-40ed-8c6b-104c29655217 service nova] Creating event network-vif-plugged:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h2-836830-13 Aug 29 15:46:24.766051 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-720bdc29-a5c8-4144-a333-1c3f7ba74790 req-b6640335-5440-40ed-8c6b-104c29655217 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076100 Aug 29 15:46:24.766966 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1178/2424] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:24.773449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.774204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.781577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.782185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.782809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.783728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.784257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.784390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.785006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.797792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.799795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.803200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6420484-9702-4dcd-af26-17057f98831d tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 200 len: 1351 microversion: 2.25 time: 0.212336 Aug 29 15:46:24.805522 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1247/2425] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 1351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:24.820753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:24.821494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:24.832224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.834189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.835446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.836576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:24.837856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:24.838347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:24.877548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:24.984627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:24.996181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed9f404f-0f51-40f5-a928-9c90467878a9 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.227909 Aug 29 15:46:24.996937 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1179/2426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:24 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:25.004178 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-064bbfd8-5292-4909-a7aa-20dc8a39fe8b tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "DELETE /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 204 len: 0 microversion: 2.1 time: 0.197274 Aug 29 15:46:25.007824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1248/2427] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:24 2022] DELETE /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:25.016597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.018003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.024368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.024854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.025314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.025987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.026431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.027014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.058101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.058962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.067454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.068040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.068546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.069316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.069842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.070333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.193118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.206690 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d355987-fb72-4f82-ac2a-26adff25b84f tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1511 microversion: 2.1 time: 0.192223 Aug 29 15:46:25.206690 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1180/2428] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:25 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:25.211524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.212261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.222015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.223732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.224516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.225421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.225979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.226827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.258545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.270518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-afcea966-2be5-4f18-9c78-31e612f167eb tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.217252 Aug 29 15:46:25.272164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1249/2429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:25 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:25.406653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.418632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19d419f2-9d2a-428f-8db3-1b54e32291fc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1471 microversion: 2.1 time: 0.212371 Aug 29 15:46:25.419635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1181/2430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:25 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:25.440532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.441153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.447628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.448115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.448833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.449556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.450014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.451103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.601856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:25.612459 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18a8582e-5e9b-45d1-be8a-1db95f85cafb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.175868 Aug 29 15:46:25.613264 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1250/2431] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:25 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:25.830757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.831412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 5be7a738-71fb-4b02-90d4-497b04cb438c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.837752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.838261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.838718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.839466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.839985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.840356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.855153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] HTTP exception thrown: Instance 5be7a738-71fb-4b02-90d4-497b04cb438c could not be found. Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Request method failure captured: Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c HTTP/1.1 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN14P6wNxA5wsg6uVjuAvqegPxyfXqGi48qgzzIKPdufPolF8AWBac2zZL7X5ops9MBZFj93vYHRDITeCxjuqIpTmzlmAsFDe3y60wkADNqJX-Xd7I4SOx6RHE6_8KJNpRCJGodorNF52MFAQ55VcombAGL7SqFUZlU20LzvlywZW2U Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_70d66d1258d14a39b174734f9865c070", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/70d66d1258d14a39b174734f9865c070"}]}] Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f12698b45a114720af9c98b163077f59 Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 5be7a738-71fb-4b02-90d4-497b04cb438c could not be found. Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '5be7a738-71fb-4b02-90d4-497b04cb438c'} Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be7a738-71fb-4b02-90d4-497b04cb438c could not be found. Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be7a738-71fb-4b02-90d4-497b04cb438c could not be found. Aug 29 15:46:25.858025 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be7a738-71fb-4b02-90d4-497b04cb438c could not be found. Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Returning 404 to user: Instance 5be7a738-71fb-4b02-90d4-497b04cb438c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:25.862121 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c6a68a84-941e-4724-83da-405a28661cec tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c" status: 404 len: 111 microversion: 2.25 time: 0.033287 Aug 29 15:46:25.863699 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1182/2432] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:25 2022] GET /compute/v2.1/servers/5be7a738-71fb-4b02-90d4-497b04cb438c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:46:25.869178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:25.869748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:25.877699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.878299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.878659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.879432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:25.879888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:25.880689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:25.920681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:26.019761 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f99b6f36-814e-44a0-8f4e-693e0fa7b5c3 tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "DELETE /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 204 len: 0 microversion: 2.25 time: 0.154233 Aug 29 15:46:26.020974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.021948 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1251/2433] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:46:25 2022] DELETE /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:46:26.024980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.034357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.034548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.035527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.035690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.035978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.036709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.037198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.037673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.045729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.046264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.046763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.047578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.048045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.048479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.207937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.220776 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-680e6638-ae5a-4984-aeb2-11577dd20c20 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.204493 Aug 29 15:46:26.221540 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1183/2434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:26.228180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.228916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.237099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.237936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.238976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.240043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.240839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.241475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.298075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.316112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.318207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.320485 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b59a9f8-80b4-43ec-9e55-86d8ecd1f8cb tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1563 microversion: 2.25 time: 0.293548 Aug 29 15:46:26.321220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1252/2435] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1563 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:26.326877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.327908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.335467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.336328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.337154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.338292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.338983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.339511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.493616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.502319 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b367a528-b66f-4c92-8ee2-963624e2513e tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1511 microversion: 2.1 time: 0.278958 Aug 29 15:46:26.503590 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1184/2436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:26.521115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.522739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.531112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.532036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.532788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.534397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.535114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.535893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.601146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:26.613832 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a978db8-2b19-43b6-ab33-fed5ce4775ab tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.291219 Aug 29 15:46:26.615002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1253/2437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:26.634986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:26.636182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:26.644498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.645490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.646447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:26.651164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:26.652380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:26.653052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.174870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.195554 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f1a6da4a-afb4-4996-a20b-740e474073cf tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1471 microversion: 2.1 time: 0.689612 Aug 29 15:46:27.198112 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1185/2438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1471 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:27.245800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.246425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.254670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.255528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.256244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.257212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.257884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.258513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.310791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.324749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-41e34278-0bd0-4aa0-a786-cc798c487ef6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.693699 Aug 29 15:46:27.326863 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1254/2439] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:26 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:27.344950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.345848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.352190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.352948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.353574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.354459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.355122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.355876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.361579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:27.492219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.507178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6c8a4768-4a5c-4f5a-b383-cef6f4f994bb tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.264940 Aug 29 15:46:27.508900 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1186/2440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:27.526810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.527536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.545378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.545938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.546383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.549514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.550027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.551356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.578612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:27.649297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.663797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.668358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f12698b45a114720af9c98b163077f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d66d1258d14a39b174734f9865c070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.672178 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a38942a-59dd-40d5-a022-1c66b2cd7d3a tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 200 len: 1563 microversion: 2.25 time: 0.331588 Aug 29 15:46:27.674052 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1255/2441] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 1563 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:46:27.686664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-11d01dfd-c48c-4bd2-bdbb-b5575debfd64 req-c7fa8e49-a7d8-4d91-aa5d-90e8b5d4204f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d99101-0823-46e5-9f79-d44dfabf604c", "name": "network-vif-deleted", "tag": "e9d2f9a1-50b7-4d78-8fe3-09622b410585"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:27.708766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-11d01dfd-c48c-4bd2-bdbb-b5575debfd64 req-c7fa8e49-a7d8-4d91-aa5d-90e8b5d4204f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.709287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-11d01dfd-c48c-4bd2-bdbb-b5575debfd64 req-c7fa8e49-a7d8-4d91-aa5d-90e8b5d4204f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.709800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-11d01dfd-c48c-4bd2-bdbb-b5575debfd64 req-c7fa8e49-a7d8-4d91-aa5d-90e8b5d4204f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.730436 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-11d01dfd-c48c-4bd2-bdbb-b5575debfd64 req-c7fa8e49-a7d8-4d91-aa5d-90e8b5d4204f service nova] Creating event network-vif-deleted:e9d2f9a1-50b7-4d78-8fe3-09622b410585 for instance 64d99101-0823-46e5-9f79-d44dfabf604c on n-h1-836830-13 Aug 29 15:46:27.736490 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-11d01dfd-c48c-4bd2-bdbb-b5575debfd64 req-c7fa8e49-a7d8-4d91-aa5d-90e8b5d4204f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061241 Aug 29 15:46:27.737286 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1256/2442] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:27.742696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:27.743627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:27.750435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.750934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.751402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.752110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:27.752571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:27.753001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:27.819153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.832943 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32fb65d4-2d06-4d7d-b7cc-c019b0e7d3d3 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1511 microversion: 2.1 time: 0.310155 Aug 29 15:46:27.833729 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1187/2443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1511 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:27.948702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:27.966792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-106d5a00-37f6-4205-bf04-221dad81ac2e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.228093 Aug 29 15:46:27.967815 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1257/2444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:27 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:28.222283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:28.223073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.232038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.232638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.233314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.234212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.234738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.235252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.348857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:28.349499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.383186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.383891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.384430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.391477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.392164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.392855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.478768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.490177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b7e216d6-e6be-420c-9d21-f2bebde8eb7a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1471 microversion: 2.1 time: 0.274268 Aug 29 15:46:28.490779 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1188/2445] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:28 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:28.530546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:28.531283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.549783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.550277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.550718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.551451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.551903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.552328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.642668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.652538 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ffba2a5e-068d-40e4-b03f-9c3dc077d050 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.309558 Aug 29 15:46:28.654631 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1258/2446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:28 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:28.702708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:28.703928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] [instance: 64d99101-0823-46e5-9f79-d44dfabf604c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.720662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.721172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.721805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.723188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.723659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.725359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.748765 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] HTTP exception thrown: Instance 64d99101-0823-46e5-9f79-d44dfabf604c could not be found. Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Request method failure captured: Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c HTTP/1.1 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN14P6wNxA5wsg6uVjuAvqegPxyfXqGi48qgzzIKPdufPolF8AWBac2zZL7X5ops9MBZFj93vYHRDITeCxjuqIpTmzlmAsFDe3y60wkADNqJX-Xd7I4SOx6RHE6_8KJNpRCJGodorNF52MFAQ55VcombAGL7SqFUZlU20LzvlywZW2U Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.25 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_70d66d1258d14a39b174734f9865c070", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/70d66d1258d14a39b174734f9865c070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/70d66d1258d14a39b174734f9865c070"}]}] Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 70d66d1258d14a39b174734f9865c070 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-402833300 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f12698b45a114720af9c98b163077f59 Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-402833300-project Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 64d99101-0823-46e5-9f79-d44dfabf604c could not be found. Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '64d99101-0823-46e5-9f79-d44dfabf604c'} Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d99101-0823-46e5-9f79-d44dfabf604c could not be found. Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d99101-0823-46e5-9f79-d44dfabf604c could not be found. Aug 29 15:46:28.750638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d99101-0823-46e5-9f79-d44dfabf604c could not be found. Aug 29 15:46:28.753897 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:28.756581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] Returning 404 to user: Instance 64d99101-0823-46e5-9f79-d44dfabf604c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:28.757461 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b97c2938-dca3-4811-a99c-d4d51d77c39f tempest-LiveAutoBlockMigrationV225Test-402833300 tempest-LiveAutoBlockMigrationV225Test-402833300-project] 10.222.0.83 "GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c" status: 404 len: 111 microversion: 2.25 time: 0.060016 Aug 29 15:46:28.759111 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1259/2447] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:28 2022] GET /compute/v2.1/servers/64d99101-0823-46e5-9f79-d44dfabf604c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:46:28.858634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:28.859496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:28.873666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.876989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.877668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.882301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.883440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.884095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:28.896698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:28.908477 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d514c807-8fa7-4e03-9f09-c0d652dbd5fd tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.383615 Aug 29 15:46:28.912330 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1189/2448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:28 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:28.969587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3a20e5ed-b2a3-4a3f-9c12-2be52748365e req-c15c7a7d-33db-46a8-911e-961868897796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "name": "network-vif-unplugged", "status": "completed", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:28.987856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3a20e5ed-b2a3-4a3f-9c12-2be52748365e req-c15c7a7d-33db-46a8-911e-961868897796 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:28.988730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3a20e5ed-b2a3-4a3f-9c12-2be52748365e req-c15c7a7d-33db-46a8-911e-961868897796 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:28.989323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3a20e5ed-b2a3-4a3f-9c12-2be52748365e req-c15c7a7d-33db-46a8-911e-961868897796 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.011279 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3a20e5ed-b2a3-4a3f-9c12-2be52748365e req-c15c7a7d-33db-46a8-911e-961868897796 service nova] Creating event network-vif-unplugged:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h2-836830-13 Aug 29 15:46:29.019989 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3a20e5ed-b2a3-4a3f-9c12-2be52748365e req-c15c7a7d-33db-46a8-911e-961868897796 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056067 Aug 29 15:46:29.021533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1190/2449] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:46:29.027547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.033779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.040014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:29.047256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.047997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.048919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.050578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.051270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.052075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.245080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:29.253414 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-daff590e-a865-433f-b2d4-c0d9f0488f88 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1511 microversion: 2.1 time: 0.401064 Aug 29 15:46:29.254000 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1260/2450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:28 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:29.367878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:29.377834 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a62e98f-c0cd-4bf8-b48f-74b60b777d61 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.354700 Aug 29 15:46:29.378884 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1191/2451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:29.514018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.514646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.517300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:29.524055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.524767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.525353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.526204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.526812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.527416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.679331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.680200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.687282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.688007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.688616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.689491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.690315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.690886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.878313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:29.887699 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d92aeb9-00bd-4313-bc73-f6241cfb6228 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.212202 Aug 29 15:46:29.889546 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1192/2452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:29.910286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:29.921126 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-41047a16-50dc-436f-9bc0-dc5a6a45b9f1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1471 microversion: 2.1 time: 0.411159 Aug 29 15:46:29.922482 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1261/2453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:29.933627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:29.934451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:29.942010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.942681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.943355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:29.944925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:29.945723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:29.946623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.212115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.222257 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13bcc005-9833-4257-ace3-039f8cde15f8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.292557 Aug 29 15:46:30.222857 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1193/2454] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:29 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:30.277110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:30.277754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:30.302077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.302562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.310638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.310638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.311046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.312462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.407423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:30.408287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:30.424265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.424777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.425225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.426088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.428625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.429100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.653132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.663306 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-00b1371d-866d-4895-a624-84d39ed6e249 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1511 microversion: 2.1 time: 0.392424 Aug 29 15:46:30.664227 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1262/2455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:30 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:30.783947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:30.794732 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0121e6d-f2e8-4b09-9c69-1ef415891572 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.396674 Aug 29 15:46:30.809063 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1194/2456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:30 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:30.909798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:30.910567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:30.926052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.926375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.926819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.927654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.928055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.928489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.947708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:30.948484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:30.961112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.962017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.963416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:30.977456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:30.980569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:30.981729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.259152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:31.268197 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f505a36-1aba-45c3-9d03-474ca62337cf tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.362258 Aug 29 15:46:31.283143 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1263/2457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:30 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:31.289431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:31.290222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:31.297710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.298403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.299039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.299897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.300505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.301082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.355983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:31.374054 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77b8ad9f-a219-4d99-be25-090023ddc0ad tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1471 microversion: 2.1 time: 0.433944 Aug 29 15:46:31.374658 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1195/2458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:30 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:31.574647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:31.587906 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-127356d4-1406-49aa-b259-581c3ce86d7e tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.303344 Aug 29 15:46:31.588959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1264/2459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:31 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:31.686145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:31.687533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:31.700118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.701803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.703823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.706603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.710298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.712027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.818593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:31.820003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:31.832742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.833452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.836136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:31.842209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:31.843778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:31.844418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.145270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:32.174732 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e35f6302-8504-4f31-a337-8f1251646bad tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.361981 Aug 29 15:46:32.175330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1265/2460] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:31 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:32.175819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:32.203452 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5b24be9-26ac-48d5-a9bf-a5e67dea2eb8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1511 microversion: 2.1 time: 0.522089 Aug 29 15:46:32.210463 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1196/2461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:31 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1511 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:32.293904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:32.296731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:32.313611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.314114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.314555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.315296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.318036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.320697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.396986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:32.397814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:32.410673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.411604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.426417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.429289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.430791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.431351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.818121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:32.831608 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c579cd0-d2a5-4657-9365-5212b7cd2089 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1509 microversion: 2.1 time: 0.545231 Aug 29 15:46:32.833045 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1266/2462] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:32 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1509 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:32.856172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fbff8101-d5cb-4d9d-97ca-cab74215aea6 req-75a31982-6122-4e7d-b2f2-78322b8023be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3ea860-8924-4b41-a76a-5f15ce543ba4", "name": "network-vif-plugged", "status": "completed", "tag": "ac54ca12-72b9-4ec9-b799-8738e3c401d3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:32.895214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbff8101-d5cb-4d9d-97ca-cab74215aea6 req-75a31982-6122-4e7d-b2f2-78322b8023be service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.899509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbff8101-d5cb-4d9d-97ca-cab74215aea6 req-75a31982-6122-4e7d-b2f2-78322b8023be service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.900220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbff8101-d5cb-4d9d-97ca-cab74215aea6 req-75a31982-6122-4e7d-b2f2-78322b8023be service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:32.921215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fbff8101-d5cb-4d9d-97ca-cab74215aea6 req-75a31982-6122-4e7d-b2f2-78322b8023be service nova] Creating event network-vif-plugged:ac54ca12-72b9-4ec9-b799-8738e3c401d3 for instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 on n-h2-836830-13 Aug 29 15:46:32.936365 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fbff8101-d5cb-4d9d-97ca-cab74215aea6 req-75a31982-6122-4e7d-b2f2-78322b8023be service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101811 Aug 29 15:46:32.940920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1267/2463] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:32.961580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:32.962664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:32.996944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:32.998207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:32.998826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.001087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.003373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.006086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.393408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:33.404590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ac3d443b-9e11-4f78-be52-0f91caa74325 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.461226 Aug 29 15:46:33.405439 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1268/2464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:32 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:33.410787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:33.411763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:33.420119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.420963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.421624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.422641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.423300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.423873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.457071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:33.473337 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0a06f8b-a9b0-4eb6-bc8f-b00eac596f3a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1471 microversion: 2.1 time: 1.080796 Aug 29 15:46:33.476400 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1197/2465] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:32 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1471 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:33.488922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:33.489619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:33.496313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.497317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.498002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.498975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.500112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.500694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.797608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:33.812959 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9edb67e-13eb-4df1-94d7-504ab7dd8a6f tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.405958 Aug 29 15:46:33.822513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1269/2466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:33 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:33.859291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:33.859974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:33.879303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.879803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.880249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:33.881013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:33.881405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:33.881926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.245080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:34.270901 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-86e49a65-4210-40f5-a781-021b40b5cc47 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1530 microversion: 2.1 time: 0.415413 Aug 29 15:46:34.272257 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1270/2467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:33 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1530 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:34.282152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-250a12e8-24f6-422c-bee4-5a0fd685aac1 req-77bac6c7-faf3-4cf0-940c-f4fddd469c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "742dab4b-1817-4408-b02f-3aa64ab6440e", "name": "network-vif-deleted", "tag": "4a22f332-ddc6-4cbb-89f0-4cc50b419e63"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:34.337664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-250a12e8-24f6-422c-bee4-5a0fd685aac1 req-77bac6c7-faf3-4cf0-940c-f4fddd469c80 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.338333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-250a12e8-24f6-422c-bee4-5a0fd685aac1 req-77bac6c7-faf3-4cf0-940c-f4fddd469c80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.339780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-250a12e8-24f6-422c-bee4-5a0fd685aac1 req-77bac6c7-faf3-4cf0-940c-f4fddd469c80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.356117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:34.365922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec737085-b91d-4945-a8e5-37d01b869ee8 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1511 microversion: 2.1 time: 0.888073 Aug 29 15:46:34.366833 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1198/2468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:33 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1511 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:34.389837 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-250a12e8-24f6-422c-bee4-5a0fd685aac1 req-77bac6c7-faf3-4cf0-940c-f4fddd469c80 service nova] Creating event network-vif-deleted:4a22f332-ddc6-4cbb-89f0-4cc50b419e63 for instance 742dab4b-1817-4408-b02f-3aa64ab6440e on n-h2-836830-13 Aug 29 15:46:34.408769 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-250a12e8-24f6-422c-bee4-5a0fd685aac1 req-77bac6c7-faf3-4cf0-940c-f4fddd469c80 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133442 Aug 29 15:46:34.409795 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1271/2469] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:34.428837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:34.429937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:34.449800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.451072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.451998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.455429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.458048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.462231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.499796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:34.500770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:34.522016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.522835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.523498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.524836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.525456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.526055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.682967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:34.696260 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-239f268a-8fb9-4669-9b87-c61cad9d00ca tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1429 microversion: 2.1 time: 0.203463 Aug 29 15:46:34.719268 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1272/2470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:34 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1429 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:34.734598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-645bd10d-61b3-4359-8b3e-a86b63c0de9a req-d994edd2-d3c3-4b71-a138-2cbf8cd63cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad4ca47-791b-4aee-8049-546871c1c595", "name": "network-vif-deleted", "tag": "6654d464-4236-42a1-9054-da7e6f46eeb4"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:34.760284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-645bd10d-61b3-4359-8b3e-a86b63c0de9a req-d994edd2-d3c3-4b71-a138-2cbf8cd63cf4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.760810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-645bd10d-61b3-4359-8b3e-a86b63c0de9a req-d994edd2-d3c3-4b71-a138-2cbf8cd63cf4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.761499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-645bd10d-61b3-4359-8b3e-a86b63c0de9a req-d994edd2-d3c3-4b71-a138-2cbf8cd63cf4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.784101 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-645bd10d-61b3-4359-8b3e-a86b63c0de9a req-d994edd2-d3c3-4b71-a138-2cbf8cd63cf4 service nova] Creating event network-vif-deleted:6654d464-4236-42a1-9054-da7e6f46eeb4 for instance aad4ca47-791b-4aee-8049-546871c1c595 on n-h2-836830-13 Aug 29 15:46:34.790065 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-645bd10d-61b3-4359-8b3e-a86b63c0de9a req-d994edd2-d3c3-4b71-a138-2cbf8cd63cf4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065384 Aug 29 15:46:34.791376 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1273/2471] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:34.844675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:34.846351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:34.860070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.861398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.861846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:34.862923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:34.863672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:34.864248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.084701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.095892 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bdd3bc27-ddff-450d-8b38-6eef6f4d957e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1467 microversion: 2.1 time: 0.255808 Aug 29 15:46:35.096797 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1274/2472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:34 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1467 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:35.109280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.120214 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30075dc9-f03e-4399-9211-4fde7eb2917b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 0.697435 Aug 29 15:46:35.121596 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1199/2473] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:34 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:35.301190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:35.302088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:35.308614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.309339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.309922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.310918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.311554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.312328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.342208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:35.389500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:35.390248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:35.403034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.405572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.406193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.418317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.419178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.419819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.591476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.600599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:35.610834 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d556e1b-4d62-468b-9a01-1c00c4d1aa3d tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1301 microversion: 2.1 time: 0.226174 Aug 29 15:46:35.615245 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c1d67c60-e3d7-46f4-be1b-574e910ff68b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1530 microversion: 2.1 time: 0.312731 Aug 29 15:46:35.617040 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1275/2474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:35 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1530 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:35.617413 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1200/2475] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:35 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1301 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:35.736940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:35.739507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:35.752958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.754296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.754957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.757215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.757954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.758604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.871917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:35.874979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:35.880070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:35.881859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lazy-loading 'fault' on Instance uuid 742dab4b-1817-4408-b02f-3aa64ab6440e {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:36.138863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85cbe5ef-61cc-4db4-b02d-dc6bc398a174 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Calling method '.version_select at 0x7f32ee242820>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.187331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:36.204951 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96716718-e544-422d-b6dd-a8b22928fcf7 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1306 microversion: 2.1 time: 0.472789 Aug 29 15:46:36.206893 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1201/2476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:35 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1306 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:36.222576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.225489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:36.230709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-85cbe5ef-61cc-4db4-b02d-dc6bc398a174 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:36.231487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-85cbe5ef-61cc-4db4-b02d-dc6bc398a174 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Neutron security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:36.233248 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-85cbe5ef-61cc-4db4-b02d-dc6bc398a174 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] HTTP exception thrown: Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist Aug 29 15:46:36.233248 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-bb418f76-f4e5-45e6-b366-7b82547a25c5'] Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85cbe5ef-61cc-4db4-b02d-dc6bc398a174 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Request method failure captured: Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-security-groups/ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b HTTP/1.1 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN9bKsGLMhceve3dUzwWlzUuQOQiJIaN3RUvFHB2UD5nIGUqXU_v5XargEfVJkl769D-Jo5ZImuums5a9j5Vub-4-vCb5A-kXB93OrMwve0kFqYi1GqAP23Wbbhp8UK9TV-tCROL-LMynrDMJfkgiv8iiJtuSe89VSi93ERVe4QzNqc Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0a221479f5ac41ddbf38ca7b8551f0d3", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0a221479f5ac41ddbf38ca7b8551f0d3"}]}] Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: acaa8c9ad876400b9878b6378b7bcdad Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-bb418f76-f4e5-45e6-b366-7b82547a25c5'] Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b'} Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:36.236431 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb418f76-f4e5-45e6-b366-7b82547a25c5'] Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb418f76-f4e5-45e6-b366-7b82547a25c5'] Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb418f76-f4e5-45e6-b366-7b82547a25c5'] Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb418f76-f4e5-45e6-b366-7b82547a25c5'] Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85cbe5ef-61cc-4db4-b02d-dc6bc398a174 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Returning 404 to user: Security group ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b does not exist Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-bb418f76-f4e5-45e6-b366-7b82547a25c5'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-85cbe5ef-61cc-4db4-b02d-dc6bc398a174 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b" status: 404 len: 194 microversion: 2.1 time: 0.416707 Aug 29 15:46:36.247156 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1276/2477] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:35 2022] DELETE /compute/v2.1/os-security-groups/ef3aba4a-6bdd-46bc-8682-5584d1ad2d9b => generated 194 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:36.258999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.258999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.258999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.258999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.258999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.258999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.275766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.282728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:36.338301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.338810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.339271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.339985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.340445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.341530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.409672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.410597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.411217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.411835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lazy-loading 'fault' on Instance uuid c1c48488-7ccd-47b0-afaf-00706b074dea {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:36.541692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:36.560153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4561a486-669f-47c1-8768-f4890c9f1125 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 200 len: 1302 microversion: 2.1 time: 0.350055 Aug 29 15:46:36.562621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1202/2478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 1302 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:36.571109 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d64016c-d8a4-4461-aceb-4124e8a3e854 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004499 Aug 29 15:46:36.571836 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1203/2479] 10.222.0.83 () {58 vars in 1164 bytes} [Mon Aug 29 15:46:36 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:46:36.585971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b63cd08c-fcca-4dc9-944b-74d14301aefd tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Calling method '.version_select at 0x7f32ee4fe3a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.908210 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b63cd08c-fcca-4dc9-944b-74d14301aefd tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.329706 Aug 29 15:46:36.909528 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1204/2480] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:36.921402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:36.923497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:36.940723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.941344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.943053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:36.943957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:36.944833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:36.945342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.009693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.010449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.011459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.012114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lazy-loading 'fault' on Instance uuid aad4ca47-791b-4aee-8049-546871c1c595 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:37.067072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c9cc007c0504400b414c395570e98ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c649ecccd1a4487aa9e1a282d631be1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.077432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:37.081252 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d799b34-a894-4f52-a8b1-88c8003a4b72 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 200 len: 1306 microversion: 2.1 time: 0.168691 Aug 29 15:46:37.082188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1205/2481] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:37.088577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.089662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.097866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.098986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.099788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.100663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.101267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.101988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.303400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.310869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.315310 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f13b406b-4fad-4864-b0b3-0bc0f24d9c22 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1530 microversion: 2.1 time: 0.231278 Aug 29 15:46:37.316489 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1206/2482] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1530 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:37.321970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8a656610-59af-4b02-8b9b-f43dcd7d1c86 req-9b1e6816-8733-403a-bc47-a74cf57d1efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c48488-7ccd-47b0-afaf-00706b074dea", "name": "network-vif-deleted", "tag": "145711a5-172d-4521-9ea8-6e083ab1ab1c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:37.324764 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d1388b63-31e4-4d1e-a584-239687f5cd70 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1332 microversion: 2.1 time: 1.080287 Aug 29 15:46:37.325743 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1277/2483] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:36 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1332 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:37.333151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8a656610-59af-4b02-8b9b-f43dcd7d1c86 req-9b1e6816-8733-403a-bc47-a74cf57d1efe service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.333488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5ba5514-2f9a-460d-a0ad-f2613eb15782 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Calling method '.version_select at 0x7f32ee37aa60>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.334154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8a656610-59af-4b02-8b9b-f43dcd7d1c86 req-9b1e6816-8733-403a-bc47-a74cf57d1efe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.334950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8a656610-59af-4b02-8b9b-f43dcd7d1c86 req-9b1e6816-8733-403a-bc47-a74cf57d1efe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.362847 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8a656610-59af-4b02-8b9b-f43dcd7d1c86 req-9b1e6816-8733-403a-bc47-a74cf57d1efe service nova] Creating event network-vif-deleted:145711a5-172d-4521-9ea8-6e083ab1ab1c for instance c1c48488-7ccd-47b0-afaf-00706b074dea on n-h2-836830-13 Aug 29 15:46:37.370256 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8a656610-59af-4b02-8b9b-f43dcd7d1c86 req-9b1e6816-8733-403a-bc47-a74cf57d1efe service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051683 Aug 29 15:46:37.371218 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1207/2484] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:37.378364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.379340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.387270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.388652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.389323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.390469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.391179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.391815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.431775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.432470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.433189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.433758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lazy-loading 'fault' on Instance uuid 742dab4b-1817-4408-b02f-3aa64ab6440e {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:37.508403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:37.517853 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0be84453-a690-4232-a548-bda8922da454 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 200 len: 1306 microversion: 2.1 time: 0.144556 Aug 29 15:46:37.529420 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1208/2485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:37.592771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.593420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: c1c48488-7ccd-47b0-afaf-00706b074dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.606691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.607713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.615891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.617085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.617809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.618469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.627396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-e5ba5514-2f9a-460d-a0ad-f2613eb15782 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:37.628185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e5ba5514-2f9a-460d-a0ad-f2613eb15782 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 29 15:46:37.628185 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-3d94b140-90c9-47a9-bbd0-15bd4d3ecb07'] Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5ba5514-2f9a-460d-a0ad-f2613eb15782 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Request method failure captured: Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-security-groups/1a41073e-df22-468c-821b-f08fe544d4f8 HTTP/1.1 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN9bKsGLMhceve3dUzwWlzUuQOQiJIaN3RUvFHB2UD5nIGUqXU_v5XargEfVJkl769D-Jo5ZImuums5a9j5Vub-4-vCb5A-kXB93OrMwve0kFqYi1GqAP23Wbbhp8UK9TV-tCROL-LMynrDMJfkgiv8iiJtuSe89VSi93ERVe4QzNqc Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0a221479f5ac41ddbf38ca7b8551f0d3", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0a221479f5ac41ddbf38ca7b8551f0d3"}]}] Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: acaa8c9ad876400b9878b6378b7bcdad Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: exception: Insufficient rights for removing default security group. Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-3d94b140-90c9-47a9-bbd0-15bd4d3ecb07'] Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '1a41073e-df22-468c-821b-f08fe544d4f8'} Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:37.631504 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d94b140-90c9-47a9-bbd0-15bd4d3ecb07'] Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d94b140-90c9-47a9-bbd0-15bd4d3ecb07'] Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d94b140-90c9-47a9-bbd0-15bd4d3ecb07'] Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d94b140-90c9-47a9-bbd0-15bd4d3ecb07'] Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5ba5514-2f9a-460d-a0ad-f2613eb15782 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-3d94b140-90c9-47a9-bbd0-15bd4d3ecb07'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e5ba5514-2f9a-460d-a0ad-f2613eb15782 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/1a41073e-df22-468c-821b-f08fe544d4f8" status: 400 len: 182 microversion: 2.1 time: 0.306637 Aug 29 15:46:37.635727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1278/2486] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:46:37 2022] DELETE /compute/v2.1/os-security-groups/1a41073e-df22-468c-821b-f08fe544d4f8 => generated 182 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:46:37.648444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60cdd0a7-6f9b-4c01-9aae-2b561bd49688 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Calling method '.version_select at 0x7f32ee240040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.656378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] HTTP exception thrown: Instance c1c48488-7ccd-47b0-afaf-00706b074dea could not be found. Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Request method failure captured: Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea HTTP/1.1 Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2zYd7aFBlRP6bINxvOMHfQHRGA18qz_4KV0-6h8RWlrBPSo8tbUxYqbt-NnNFWXJKeLdKU2vhNoONPpGy-YFddxO2H0wZcboWOzUdESRTpg1EW3eMdE8AXk1NmSMvzz2zlnYa_WC8jXoc7ei0IwMYKSXC9H4c1cUaCieuntL_zshc Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_95b8e2179e1f4fa6bf596a8dd85f761c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/95b8e2179e1f4fa6bf596a8dd85f761c"}]}] Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: cc90d88d1e574a94858bbe2523855caa Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance c1c48488-7ccd-47b0-afaf-00706b074dea could not be found. Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'c1c48488-7ccd-47b0-afaf-00706b074dea'} Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c48488-7ccd-47b0-afaf-00706b074dea could not be found. Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c48488-7ccd-47b0-afaf-00706b074dea could not be found. Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.659786 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.665127 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.665127 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.665127 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.665127 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:37.665127 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:37.665127 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c48488-7ccd-47b0-afaf-00706b074dea could not be found. Aug 29 15:46:37.665127 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.667472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Returning 404 to user: Instance c1c48488-7ccd-47b0-afaf-00706b074dea could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:37.668573 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6083e2b4-52c9-41b6-93f6-dbe201b5dbb3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea" status: 404 len: 111 microversion: 2.1 time: 0.082305 Aug 29 15:46:37.670458 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1209/2487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/servers/c1c48488-7ccd-47b0-afaf-00706b074dea => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:46:37.687913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.688472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.703135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.703873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.706930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.707904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.712080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.712689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.717854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-60cdd0a7-6f9b-4c01-9aae-2b561bd49688 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:37.718561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-60cdd0a7-6f9b-4c01-9aae-2b561bd49688 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Neutron security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:37.719410 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-60cdd0a7-6f9b-4c01-9aae-2b561bd49688 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] HTTP exception thrown: Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist Aug 29 15:46:37.719410 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-4e4990b2-a3c7-42bb-bf06-7e8546afaad9'] Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60cdd0a7-6f9b-4c01-9aae-2b561bd49688 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Request method failure captured: Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-security-groups/d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 HTTP/1.1 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN9bKsGLMhceve3dUzwWlzUuQOQiJIaN3RUvFHB2UD5nIGUqXU_v5XargEfVJkl769D-Jo5ZImuums5a9j5Vub-4-vCb5A-kXB93OrMwve0kFqYi1GqAP23Wbbhp8UK9TV-tCROL-LMynrDMJfkgiv8iiJtuSe89VSi93ERVe4QzNqc Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0a221479f5ac41ddbf38ca7b8551f0d3", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0a221479f5ac41ddbf38ca7b8551f0d3"}]}] Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: acaa8c9ad876400b9878b6378b7bcdad Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-4e4990b2-a3c7-42bb-bf06-7e8546afaad9'] Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2'} Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:37.723461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4990b2-a3c7-42bb-bf06-7e8546afaad9'] Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4990b2-a3c7-42bb-bf06-7e8546afaad9'] Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4990b2-a3c7-42bb-bf06-7e8546afaad9'] Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e4990b2-a3c7-42bb-bf06-7e8546afaad9'] Aug 29 15:46:37.729181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.737146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60cdd0a7-6f9b-4c01-9aae-2b561bd49688 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Returning 404 to user: Security group d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 does not exist Aug 29 15:46:37.737146 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-4e4990b2-a3c7-42bb-bf06-7e8546afaad9'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:37.737146 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60cdd0a7-6f9b-4c01-9aae-2b561bd49688 tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] 10.222.0.83 "GET /compute/v2.1/os-security-groups/d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2" status: 404 len: 194 microversion: 2.1 time: 0.092525 Aug 29 15:46:37.743138 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1279/2488] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/os-security-groups/d0d8f1b2-a786-4658-9e8d-c2d2f9a6f0b2 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:37.753211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91bc47f9-b9f1-4c40-8dbb-e7dc277b182f tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Action: 'update', calling method: .version_select at 0x7f32ee37a790>, body: {"security_group": {"name": "tempest-sg-1829623848", "description": "tempest-description-2004486353"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:37.787292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:37.831361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-91bc47f9-b9f1-4c40-8dbb-e7dc277b182f tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:46:37.831966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-91bc47f9-b9f1-4c40-8dbb-e7dc277b182f tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Neutron security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:46:37.832518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-91bc47f9-b9f1-4c40-8dbb-e7dc277b182f tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] HTTP exception thrown: Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist Aug 29 15:46:37.832518 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-793afaa5-66f5-4896-9314-aa9531a449bb'] Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91bc47f9-b9f1-4c40-8dbb-e7dc277b182f tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Request method failure captured: Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/os-security-groups/6f965e94-7dad-4dc7-9de4-6916cf2effe3 HTTP/1.1 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 102 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN9bKsGLMhceve3dUzwWlzUuQOQiJIaN3RUvFHB2UD5nIGUqXU_v5XargEfVJkl769D-Jo5ZImuums5a9j5Vub-4-vCb5A-kXB93OrMwve0kFqYi1GqAP23Wbbhp8UK9TV-tCROL-LMynrDMJfkgiv8iiJtuSe89VSi93ERVe4QzNqc Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0a221479f5ac41ddbf38ca7b8551f0d3", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0a221479f5ac41ddbf38ca7b8551f0d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0a221479f5ac41ddbf38ca7b8551f0d3"}]}] Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0a221479f5ac41ddbf38ca7b8551f0d3 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568 Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: acaa8c9ad876400b9878b6378b7bcdad Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1019750568-project Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: {"security_group": {"name": "tempest-sg-1829623848", "description": "tempest-description-2004486353"}} Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-793afaa5-66f5-4896-9314-aa9531a449bb'] Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '6f965e94-7dad-4dc7-9de4-6916cf2effe3', 'body': {'security_group': {'name': 'tempest-sg-1829623848', 'description': 'tempest-description-2004486353'}}} Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:46:37.834413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793afaa5-66f5-4896-9314-aa9531a449bb'] Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793afaa5-66f5-4896-9314-aa9531a449bb'] Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793afaa5-66f5-4896-9314-aa9531a449bb'] Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793afaa5-66f5-4896-9314-aa9531a449bb'] Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91bc47f9-b9f1-4c40-8dbb-e7dc277b182f tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] Returning 404 to user: Security group 6f965e94-7dad-4dc7-9de4-6916cf2effe3 does not exist Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-793afaa5-66f5-4896-9314-aa9531a449bb'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:37.837962 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91bc47f9-b9f1-4c40-8dbb-e7dc277b182f tempest-SecurityGroupsNegativeTestJSON-1019750568 tempest-SecurityGroupsNegativeTestJSON-1019750568-project] 10.222.0.83 "PUT /compute/v2.1/os-security-groups/6f965e94-7dad-4dc7-9de4-6916cf2effe3" status: 404 len: 194 microversion: 2.1 time: 0.092178 Aug 29 15:46:37.842719 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1280/2489] 10.222.0.83 () {60 vars in 1290 bytes} [Mon Aug 29 15:46:37 2022] PUT /compute/v2.1/os-security-groups/6f965e94-7dad-4dc7-9de4-6916cf2effe3 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:37.950564 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-579ddc7f-252d-4020-82c9-35eb13237c31 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "DELETE /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 204 len: 0 microversion: 2.1 time: 0.274266 Aug 29 15:46:37.953203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1210/2490] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:37 2022] DELETE /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:37.962617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:37.963271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:37.972504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.973223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.973960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:37.974881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:37.975635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:37.976302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.113349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:38.115627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] [instance: aad4ca47-791b-4aee-8049-546871c1c595] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:38.130206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.132067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.132639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.134845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.135460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.137132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.159576 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] HTTP exception thrown: Instance aad4ca47-791b-4aee-8049-546871c1c595 could not be found. Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Request method failure captured: Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 HTTP/1.1 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN8jliUzCruJqqkXHWINbj17tzqpkGD5ndET8E2nqiL5_rR9aF3_tav8GSnVoUMOVggOJNHfsA8h4JQRg_Hwx5bnR1bnDvHVfBtaSF0D4Omlpyt4sz4tWfeaHKjYXfEC-b19Ed7ZMEpvJyrBqyjt2-GcjoFXOvhccKtHmL-1yMSDjW0 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: c649ecccd1a4487aa9e1a282d631be1a Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-InstanceActionsTestJSON-1730032923 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c649ecccd1a4487aa9e1a282d631be1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c649ecccd1a4487aa9e1a282d631be1a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c649ecccd1a4487aa9e1a282d631be1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c649ecccd1a4487aa9e1a282d631be1a"}]}] Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-InstanceActionsTestJSON-1730032923 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: c649ecccd1a4487aa9e1a282d631be1a Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1730032923 Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-InstanceActionsTestJSON-1730032923-project Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 5c9cc007c0504400b414c395570e98ca Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-InstanceActionsTestJSON-1730032923-project Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance aad4ca47-791b-4aee-8049-546871c1c595 could not be found. Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'aad4ca47-791b-4aee-8049-546871c1c595'} Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad4ca47-791b-4aee-8049-546871c1c595 could not be found. Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad4ca47-791b-4aee-8049-546871c1c595 could not be found. Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:38.162212 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.166018 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:38.166018 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:38.166018 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:38.166018 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:38.166018 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:38.166018 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad4ca47-791b-4aee-8049-546871c1c595 could not be found. Aug 29 15:46:38.166018 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.167110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] Returning 404 to user: Instance aad4ca47-791b-4aee-8049-546871c1c595 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:38.168505 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-460780e7-5ab4-4c7e-8fb4-c4e131bcdde6 tempest-InstanceActionsTestJSON-1730032923 tempest-InstanceActionsTestJSON-1730032923-project] 10.222.0.83 "GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595" status: 404 len: 111 microversion: 2.1 time: 0.064512 Aug 29 15:46:38.173750 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1211/2491] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:38 2022] GET /compute/v2.1/servers/aad4ca47-791b-4aee-8049-546871c1c595 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:38.262797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:38.285061 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-392a0ec3-6be1-4329-a417-eb38d646dec1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1532 microversion: 2.1 time: 0.327803 Aug 29 15:46:38.286571 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1281/2492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:37 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1532 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:38.339311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:38.339949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:38.351746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.352243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.354342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:38.355005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.355769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:38.356197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.357499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.358084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.370696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.374298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.374970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.379258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.380051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.387666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.711651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:38.722241 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24cfc924-56fe-4cd9-8e77-44bf1079c6c2 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1537 microversion: 2.1 time: 0.372916 Aug 29 15:46:38.723679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1282/2493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:38 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1537 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:38.730005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:38.730800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 742dab4b-1817-4408-b02f-3aa64ab6440e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:38.751461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.751950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.752473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.753176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.766101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.766729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.784281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance 742dab4b-1817-4408-b02f-3aa64ab6440e could not be found. Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e HTTP/1.1 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 742dab4b-1817-4408-b02f-3aa64ab6440e could not be found. Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '742dab4b-1817-4408-b02f-3aa64ab6440e'} Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 742dab4b-1817-4408-b02f-3aa64ab6440e could not be found. Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 742dab4b-1817-4408-b02f-3aa64ab6440e could not be found. Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:38.791693 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.795875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:38.795875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:38.795875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:38.795875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:38.795875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:38.795875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 742dab4b-1817-4408-b02f-3aa64ab6440e could not be found. Aug 29 15:46:38.795875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:38.797251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance 742dab4b-1817-4408-b02f-3aa64ab6440e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:38.803606 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a9ac8ed-ed30-4bf9-81e1-6dc66e977cdc tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e" status: 404 len: 111 microversion: 2.1 time: 0.073446 Aug 29 15:46:38.804764 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1283/2494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:38 2022] GET /compute/v2.1/servers/742dab4b-1817-4408-b02f-3aa64ab6440e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:38.810620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-811bd2c9-4759-4a18-8104-ebd2da5e0e17 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'create', calling method: .version_select at 0x7f32ee4ee670>, body: {"pool": "b651865a-1c0e-419b-b2e5-5ce156b625c8"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:38.849246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:38.861204 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f230cdb-2009-43aa-9b52-e137a7187576 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1530 microversion: 2.1 time: 0.527110 Aug 29 15:46:38.861820 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1212/2495] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:38 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1530 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:38.870645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:38.873968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:38.886481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.886968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.891669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.894686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:38.896747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:38.900540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:38.983935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:39.210362 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8fb25024-8001-46c7-a62d-10117a44408a tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 204 len: 0 microversion: 2.1 time: 0.347265 Aug 29 15:46:39.211756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1213/2496] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:38 2022] DELETE /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:39.220426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-65d173b8-a174-461c-b7f2-7498f8ea082b req-8b77641a-0832-4ba2-bcf7-d3e331c046c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d3ca4c-bcb4-444d-a316-0ba73c73182d", "name": "network-vif-plugged", "status": "completed", "tag": "c3a5ec6c-d281-4b8b-99c8-5931934e075f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:39.234175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-65d173b8-a174-461c-b7f2-7498f8ea082b req-8b77641a-0832-4ba2-bcf7-d3e331c046c9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.234973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-65d173b8-a174-461c-b7f2-7498f8ea082b req-8b77641a-0832-4ba2-bcf7-d3e331c046c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.235686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-65d173b8-a174-461c-b7f2-7498f8ea082b req-8b77641a-0832-4ba2-bcf7-d3e331c046c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.252035 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-65d173b8-a174-461c-b7f2-7498f8ea082b req-8b77641a-0832-4ba2-bcf7-d3e331c046c9 service nova] Creating event network-vif-plugged:c3a5ec6c-d281-4b8b-99c8-5931934e075f for instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d on n-h2-836830-13 Aug 29 15:46:39.257890 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-65d173b8-a174-461c-b7f2-7498f8ea082b req-8b77641a-0832-4ba2-bcf7-d3e331c046c9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044522 Aug 29 15:46:39.259395 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1214/2497] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:39.265587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:39.266535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:39.274046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.274884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.275618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.277189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.277906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.279116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.353371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:39.514896 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aee5f427-7198-429c-97b5-26438a2cd891 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 204 len: 0 microversion: 2.1 time: 0.251601 Aug 29 15:46:39.515594 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1215/2498] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:39 2022] DELETE /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:39.538625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:39.539396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:39.555840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.559470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.560046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.565158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.565462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.568785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.885312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:39.894090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2456b737-fe31-499f-979b-017365e37a2d tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1532 microversion: 2.1 time: 0.371313 Aug 29 15:46:39.894822 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1216/2499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:39 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1532 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:39.901709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:39.902347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:39.922616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.923359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.923816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:39.924570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:39.925023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:39.925447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:40.222250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:40.232770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3acbf861-7cc2-4b53-82b1-3c4e3bdce26e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 200 len: 1473 microversion: 2.1 time: 0.336613 Aug 29 15:46:40.247638 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1217/2500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:39 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 1473 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:40.257204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:40.258279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:40.266151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:40.266940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:40.267933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:40.268814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:40.269427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:40.270013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:40.520987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:40.530223 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c21f2b2-a7d6-4e48-971b-bb6964091953 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.280954 Aug 29 15:46:40.531595 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1218/2501] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:40 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:40.917433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:40.918065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:40.929100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:40.930506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:40.931075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:40.932402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:40.933134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:40.933977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.354702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:41.363515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:41.365915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a16f852-68fc-430c-ad07-41ac45d09308 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1532 microversion: 2.1 time: 0.452466 Aug 29 15:46:41.371296 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1219/2502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:40 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1532 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:41.389688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:41.391396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:41.410279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.420745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.422719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.423730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.424400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.425024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.827055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:41.846227 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-129e8eab-faa9-483e-8202-2a28374f64ec tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 200 len: 1473 microversion: 2.1 time: 0.470466 Aug 29 15:46:41.859440 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1220/2503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:41 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:41.867226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:41.867860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:41.875121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.875624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.876063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:41.876773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:41.877229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:41.877671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.366175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.384337 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46deea46-889c-4aa6-86b4-02de1919c63a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 2.519485 Aug 29 15:46:44.385240 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1221/2504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:41 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 2525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:44.436622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:44.437974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:44.478991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.484280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.484744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.485489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.492448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.493901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.651119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.651631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.652076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.660541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lazy-loading 'fault' on Instance uuid 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:44.807425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:44.823866 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-da77c46e-751b-4f30-9ef7-24c47bce01b3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 200 len: 1366 microversion: 2.1 time: 0.437307 Aug 29 15:46:44.841983 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1222/2505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:44 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:44.865915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:44.867280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:44.893555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.893965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.895476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:44.899578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:44.900417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:44.901055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.015687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.022967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.027532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.033643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lazy-loading 'fault' on Instance uuid a91019f2-48d5-4ac8-b793-5f2a1ae48274 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:46:45.532777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:45.557012 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33d9bd4e-2b82-4101-8aed-dc203e4fdf9d tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 200 len: 1308 microversion: 2.1 time: 0.711306 Aug 29 15:46:45.559931 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1223/2506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:44 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 1308 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:45.569360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f81a1f1f-2ce6-45c6-80b3-a7b5152d4e0f req-dfc555f7-62e6-4015-9838-2eb0403ee4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68bde7f9-b4bb-4d3e-96ee-0fb709fbc236", "name": "network-vif-deleted", "tag": "5e6078e9-14a7-45a5-9f89-74ca83fe9d56"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:45.614404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f81a1f1f-2ce6-45c6-80b3-a7b5152d4e0f req-dfc555f7-62e6-4015-9838-2eb0403ee4e0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.617578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f81a1f1f-2ce6-45c6-80b3-a7b5152d4e0f req-dfc555f7-62e6-4015-9838-2eb0403ee4e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.620764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f81a1f1f-2ce6-45c6-80b3-a7b5152d4e0f req-dfc555f7-62e6-4015-9838-2eb0403ee4e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.660471 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f81a1f1f-2ce6-45c6-80b3-a7b5152d4e0f req-dfc555f7-62e6-4015-9838-2eb0403ee4e0 service nova] Creating event network-vif-deleted:5e6078e9-14a7-45a5-9f89-74ca83fe9d56 for instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 on n-h1-836830-13 Aug 29 15:46:45.673237 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f81a1f1f-2ce6-45c6-80b3-a7b5152d4e0f req-dfc555f7-62e6-4015-9838-2eb0403ee4e0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108025 Aug 29 15:46:45.689088 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1224/2507] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:45.715339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:45.716887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:45.731906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.745997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.745997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.748589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.750036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.752519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.883293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-811bd2c9-4759-4a18-8104-ebd2da5e0e17 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.076435 Aug 29 15:46:45.891792 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1284/2508] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:46:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:45.891792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:45.891792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:45.922880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.926456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.928652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.929715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:45.933052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:45.936646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:45.988346 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] HTTP exception thrown: Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 could not be found. Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Request method failure captured: Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 HTTP/1.1 Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2zYd7aFBlRP6bINxvOMHfQHRGA18qz_4KV0-6h8RWlrBPSo8tbUxYqbt-NnNFWXJKeLdKU2vhNoONPpGy-YFddxO2H0wZcboWOzUdESRTpg1EW3eMdE8AXk1NmSMvzz2zlnYa_WC8jXoc7ei0IwMYKSXC9H4c1cUaCieuntL_zshc Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_95b8e2179e1f4fa6bf596a8dd85f761c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/95b8e2179e1f4fa6bf596a8dd85f761c"}]}] Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: cc90d88d1e574a94858bbe2523855caa Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 could not be found. Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '68bde7f9-b4bb-4d3e-96ee-0fb709fbc236'} Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 could not be found. Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 could not be found. Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:45.990516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:45.994188 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:45.994188 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:45.994188 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:45.994188 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:45.994188 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:45.994188 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 could not be found. Aug 29 15:46:45.994188 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:45.995806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Returning 404 to user: Instance 68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:45.996943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c543b24-547b-4abc-8419-af82a923300e tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236" status: 404 len: 111 microversion: 2.1 time: 0.110995 Aug 29 15:46:46.001784 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1285/2509] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:45 2022] GET /compute/v2.1/servers/68bde7f9-b4bb-4d3e-96ee-0fb709fbc236 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:46.007765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.222"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:46.010760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:46.017665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.018609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.019083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:46.019897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.020446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.023192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:46.071084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:46:46.072985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquired lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:46:46.374043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:46.400634 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d41202ef-7367-4254-83c7-b26b35c13fee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.708735 Aug 29 15:46:46.402491 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1225/2510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:45 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:46.420758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-10d654cb-cd50-4aef-bde5-3a74079bbbd0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '.version_select at 0x7f32eea87160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:46.473694 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-10d654cb-cd50-4aef-bde5-3a74079bbbd0 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436511461" status: 202 len: 0 microversion: 2.1 time: 0.068484 Aug 29 15:46:46.488170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1226/2511] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:46:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436511461 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:46:46.494385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:46.495823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:46.502265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:46.529203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.530549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.531188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:46.533004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:46.534308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:46.535312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.195863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:47.206968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:47.220846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:47.222188 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-db4fffed-51cf-480b-8141-d0e2bcaaa085 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2946 microversion: 2.42 time: 0.732756 Aug 29 15:46:47.235484 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1227/2512] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:46:46 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2946 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:47.250504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.251436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: a91019f2-48d5-4ac8-b793-5f2a1ae48274] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:47.258318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.258823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.259300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.260022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.260479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.265457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.304177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 could not be found. Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 HTTP/1.1 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 could not be found. Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a91019f2-48d5-4ac8-b793-5f2a1ae48274'} Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 could not be found. Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 could not be found. Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:47.307925 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 could not be found. Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.315405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:47.316416 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8dbe769-b84a-499c-ba8b-f61aa67a9837 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274" status: 404 len: 111 microversion: 2.1 time: 0.079236 Aug 29 15:46:47.318872 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1228/2513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/servers/a91019f2-48d5-4ac8-b793-5f2a1ae48274 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:47.336043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.339080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:47.358305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.358807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.358993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.359974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.360437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.360891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.631559 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95c609c2-8e2b-4ca3-9792-694eeed70230 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.307118 Aug 29 15:46:47.632533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1229/2514] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55/os-interface => generated 1829 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:46:47.655592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.661036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: e3685c60-cfca-4c4f-b754-960d478aa207] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:47.676304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.677358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.678477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.682142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.682867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.683418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.717841 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance e3685c60-cfca-4c4f-b754-960d478aa207 could not be found. Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 HTTP/1.1 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance e3685c60-cfca-4c4f-b754-960d478aa207 could not be found. Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e3685c60-cfca-4c4f-b754-960d478aa207'} Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3685c60-cfca-4c4f-b754-960d478aa207 could not be found. Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3685c60-cfca-4c4f-b754-960d478aa207 could not be found. Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:47.723889 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3685c60-cfca-4c4f-b754-960d478aa207 could not be found. Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance e3685c60-cfca-4c4f-b754-960d478aa207 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:47.728117 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0517b09-5a3e-4889-902a-b1de4020cc53 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207" status: 404 len: 111 microversion: 2.1 time: 0.081058 Aug 29 15:46:47.731748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1230/2515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/servers/e3685c60-cfca-4c4f-b754-960d478aa207 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:47.745649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:47.748505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:47.769490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.772124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.777655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:47.782477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:47.783107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:47.783504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:48.526872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:48.536670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15976d5d-5522-4c95-a69a-df69c96cfc65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.802394 Aug 29 15:46:48.558217 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1231/2516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:47 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:48.565015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4c2673fb-92ed-4e09-97bc-e8da263e04e9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:48.679822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4c2673fb-92ed-4e09-97bc-e8da263e04e9 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/ef25c095-969b-4641-b2fb-b56d46aeb61f" status: 204 len: 0 microversion: 2.1 time: 0.119542 Aug 29 15:46:48.681545 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1232/2517] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:46:48 2022] DELETE /compute/v2.1/os-server-groups/ef25c095-969b-4641-b2fb-b56d46aeb61f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:48.692278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2394b6b4-cb9a-4f70-ac0e-01ad4f7bd83d req-de39cb9d-8d0e-4ba7-88c5-678ce699b4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91019f2-48d5-4ac8-b793-5f2a1ae48274", "name": "network-vif-deleted", "tag": "92a35708-d0a7-4eb6-8e3c-0c967ab3663d"}, {"server_uuid": "e3685c60-cfca-4c4f-b754-960d478aa207", "name": "network-vif-deleted", "tag": "5919f625-39ab-4106-a5fe-021441163394"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:48.714040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2394b6b4-cb9a-4f70-ac0e-01ad4f7bd83d req-de39cb9d-8d0e-4ba7-88c5-678ce699b4db service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:48.719629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2394b6b4-cb9a-4f70-ac0e-01ad4f7bd83d req-de39cb9d-8d0e-4ba7-88c5-678ce699b4db service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:48.720494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2394b6b4-cb9a-4f70-ac0e-01ad4f7bd83d req-de39cb9d-8d0e-4ba7-88c5-678ce699b4db service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:48.751801 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2394b6b4-cb9a-4f70-ac0e-01ad4f7bd83d req-de39cb9d-8d0e-4ba7-88c5-678ce699b4db service nova] Creating event network-vif-deleted:92a35708-d0a7-4eb6-8e3c-0c967ab3663d for instance a91019f2-48d5-4ac8-b793-5f2a1ae48274 on n-h2-836830-13 Aug 29 15:46:48.752552 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2394b6b4-cb9a-4f70-ac0e-01ad4f7bd83d req-de39cb9d-8d0e-4ba7-88c5-678ce699b4db service nova] Creating event network-vif-deleted:5919f625-39ab-4106-a5fe-021441163394 for instance e3685c60-cfca-4c4f-b754-960d478aa207 on n-h1-836830-13 Aug 29 15:46:48.773879 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2394b6b4-cb9a-4f70-ac0e-01ad4f7bd83d req-de39cb9d-8d0e-4ba7-88c5-678ce699b4db service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089081 Aug 29 15:46:48.775800 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1233/2518] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:48.796313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:48.797293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:48.807748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:48.809365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:48.810653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:48.820426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:48.821826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:48.822495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:48.895010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:49.093414 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5ae5cd3-b35f-43d0-ba17-9a0323a04e65 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 204 len: 0 microversion: 2.1 time: 0.310287 Aug 29 15:46:49.100325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1234/2519] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:48 2022] DELETE /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:49.126914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:49.127496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:49.156523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.157570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.158783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.160329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.161582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.162217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.322258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:49.603877 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2c83c93d-516d-40c7-a3c6-c871bfc00688 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 204 len: 0 microversion: 2.1 time: 0.497723 Aug 29 15:46:49.604778 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1235/2520] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:49 2022] DELETE /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:49.619575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:49.628119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:49.662931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.668505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.671855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.675950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:49.676553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:49.677024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:49.755520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:49.850148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:50.007726 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77c67549-6fc7-4ae1-8004-9e4c469e83c4 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 204 len: 0 microversion: 2.1 time: 0.401204 Aug 29 15:46:50.009521 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1236/2521] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:49 2022] DELETE /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:50.017326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:50.019294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.027861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.028823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.030117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.031144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.031823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.032773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.354427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:50.366417 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0c35dc2-2364-49af-a775-129871cb58c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.355141 Aug 29 15:46:50.366767 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1237/2522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:50 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:50.380707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:50.381338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.398642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.399183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.399629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.400505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.400975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.401411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.680176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:50.697334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9f9354e-d356-46ec-874a-0f1e7bbb5566 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 200 len: 1474 microversion: 2.1 time: 0.327135 Aug 29 15:46:50.708045 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1238/2523] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:50 2022] GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:50.733132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:50.735835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Building network info cache for instance {{(pid=129133) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:46:50.737581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:50.764840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.766811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.771965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:50.775287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:50.776705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:50.792301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.138701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.147908 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2af02c14-a30b-4912-aaef-1b0f027c45a3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1467 microversion: 2.1 time: 0.430693 Aug 29 15:46:51.168055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1239/2524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:50 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1467 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:51.179591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6ce8bffb-6d48-4a86-8b8b-4f1f9abb1c58 req-8c269a9c-5bd2-4ec1-b82b-3dc6519fe2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3ea860-8924-4b41-a76a-5f15ce543ba4", "tag": "ac54ca12-72b9-4ec9-b799-8738e3c401d3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:51.205820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6ce8bffb-6d48-4a86-8b8b-4f1f9abb1c58 req-8c269a9c-5bd2-4ec1-b82b-3dc6519fe2dd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.206216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6ce8bffb-6d48-4a86-8b8b-4f1f9abb1c58 req-8c269a9c-5bd2-4ec1-b82b-3dc6519fe2dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.206655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6ce8bffb-6d48-4a86-8b8b-4f1f9abb1c58 req-8c269a9c-5bd2-4ec1-b82b-3dc6519fe2dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.243701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6ce8bffb-6d48-4a86-8b8b-4f1f9abb1c58 req-8c269a9c-5bd2-4ec1-b82b-3dc6519fe2dd service nova] Creating event network-changed:ac54ca12-72b9-4ec9-b799-8738e3c401d3 for instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 on n-h2-836830-13 Aug 29 15:46:51.277610 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6ce8bffb-6d48-4a86-8b8b-4f1f9abb1c58 req-8c269a9c-5bd2-4ec1-b82b-3dc6519fe2dd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107467 Aug 29 15:46:51.281875 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1240/2525] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:51.390291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:51.391486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:51.405972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.406844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.407531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.409084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.411612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.412332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.945725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:51.959067 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7084491-d371-4475-9ed1-df52893019c2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.574001 Aug 29 15:46:51.960892 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1241/2526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:51 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:51.976331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:51.977853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:51.995351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:51.996140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:51.996772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:51.998492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.001365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.001988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.408501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.423579 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e2c6f36-ca07-4c93-9a0b-566a6f02af79 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 200 len: 1474 microversion: 2.1 time: 0.459320 Aug 29 15:46:52.424882 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1242/2527] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:51 2022] GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 1474 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:52.437547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:52.439757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:52.458367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.459265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.461306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.462299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.463589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.465241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.762007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:52.789324 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73ff5d10-eead-425f-b250-3c4351cb7ae3 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 200 len: 1425 microversion: 2.1 time: 0.363071 Aug 29 15:46:52.790162 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1243/2528] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:52 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 1425 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:52.815840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ecc4ea95-08fa-40de-9d5a-f7bae2af6205 req-e95d0c11-6e2f-450b-84f0-18bcb40e9cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4655c40-ac22-4aff-b255-ade7df5360e4", "name": "network-vif-deleted", "tag": "637658fb-18e7-4845-b4a4-d6913e7b26a6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:52.833939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ecc4ea95-08fa-40de-9d5a-f7bae2af6205 req-e95d0c11-6e2f-450b-84f0-18bcb40e9cac service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:52.834730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ecc4ea95-08fa-40de-9d5a-f7bae2af6205 req-e95d0c11-6e2f-450b-84f0-18bcb40e9cac service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:52.835522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ecc4ea95-08fa-40de-9d5a-f7bae2af6205 req-e95d0c11-6e2f-450b-84f0-18bcb40e9cac service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:52.859586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ecc4ea95-08fa-40de-9d5a-f7bae2af6205 req-e95d0c11-6e2f-450b-84f0-18bcb40e9cac service nova] Creating event network-vif-deleted:637658fb-18e7-4845-b4a4-d6913e7b26a6 for instance b4655c40-ac22-4aff-b255-ade7df5360e4 on n-h1-836830-13 Aug 29 15:46:52.886173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ecc4ea95-08fa-40de-9d5a-f7bae2af6205 req-e95d0c11-6e2f-450b-84f0-18bcb40e9cac service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078644 Aug 29 15:46:52.887099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1244/2529] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:52.983483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:52.985011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:53.001479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.003203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.005548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.006588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.009006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.009722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.527140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:53.539170 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38f7c26a-f1c9-4f0e-8de3-19dcf8cbd4e1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.561738 Aug 29 15:46:53.560153 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1245/2530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:52 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:46:53.572244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:53.578002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:53.592039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.596754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.599213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:53.604526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:53.605385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:53.606036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.012820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Updating instance_info_cache with network_info: [{"id": "ac54ca12-72b9-4ec9-b799-8738e3c401d3", "address": "fa:16:3e:2a:71:63", "network": {"id": "45e4fff8-ac31-41e5-89a5-4960938cd66b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1766412748-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a25ad3634e624e9394ac4e588d773383", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapac54ca12-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129133) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:46:54.045619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Releasing lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:46:54.046412 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-197cf190-450f-43dc-86bf-56c289eb151a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action" status: 202 len: 0 microversion: 2.1 time: 8.043318 Aug 29 15:46:54.050627 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1286/2531] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:46:46 2022] POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action => generated 0 bytes in 8048 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:46:54.055516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.058735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: b4655c40-ac22-4aff-b255-ade7df5360e4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:54.066353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.067153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.067759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.068621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.069311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.069876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.085985 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] HTTP exception thrown: Instance b4655c40-ac22-4aff-b255-ade7df5360e4 could not be found. Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Request method failure captured: Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 HTTP/1.1 Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN2zYd7aFBlRP6bINxvOMHfQHRGA18qz_4KV0-6h8RWlrBPSo8tbUxYqbt-NnNFWXJKeLdKU2vhNoONPpGy-YFddxO2H0wZcboWOzUdESRTpg1EW3eMdE8AXk1NmSMvzz2zlnYa_WC8jXoc7ei0IwMYKSXC9H4c1cUaCieuntL_zshc Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_95b8e2179e1f4fa6bf596a8dd85f761c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/95b8e2179e1f4fa6bf596a8dd85f761c"}]}] Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: cc90d88d1e574a94858bbe2523855caa Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b4655c40-ac22-4aff-b255-ade7df5360e4 could not be found. Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b4655c40-ac22-4aff-b255-ade7df5360e4'} Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4655c40-ac22-4aff-b255-ade7df5360e4 could not be found. Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4655c40-ac22-4aff-b255-ade7df5360e4 could not be found. Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:54.089631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:54.094166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:54.094166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:54.094166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:54.094166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:54.094166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:54.094166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4655c40-ac22-4aff-b255-ade7df5360e4 could not be found. Aug 29 15:46:54.094166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:46:54.095396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Returning 404 to user: Instance b4655c40-ac22-4aff-b255-ade7df5360e4 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:54.096429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a66c85a4-7b18-4e6a-b7c7-e32382e90766 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4" status: 404 len: 111 microversion: 2.1 time: 0.044793 Aug 29 15:46:54.101652 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1287/2532] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:54 2022] GET /compute/v2.1/servers/b4655c40-ac22-4aff-b255-ade7df5360e4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:54.107876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b38cad6d-73f0-4f0e-b728-5fe7317fbd62 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'create', calling method: .version_select at 0x7f32ee4eeaf0>, body: {"pool": "b651865a-1c0e-419b-b2e5-5ce156b625c8"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:54.541813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:54.592463 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-726ca1d9-385e-4d37-b279-e6ed7c6ccf51 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 200 len: 1474 microversion: 2.1 time: 1.029836 Aug 29 15:46:54.601087 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1246/2533] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:53 2022] GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 1474 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:54.638334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.640968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:54.664326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.667627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.671523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.673493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.675868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.679194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.724774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:54.943085 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-928a764a-c412-4e3e-8cb6-38c3439666ec tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 204 len: 0 microversion: 2.1 time: 0.337080 Aug 29 15:46:54.944166 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1247/2534] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:54 2022] DELETE /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:54.957893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:54.961199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:54.983845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.987792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.988638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:54.990272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:54.990758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:54.994225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.596275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:55.622746 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbcd193f-c154-40ec-8078-952b5cb40238 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.676200 Aug 29 15:46:55.640967 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1248/2535] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:54 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:55.654958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:55.657237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:55.685571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.686346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.687546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:55.689620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:55.690872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:55.692530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.217776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc90d88d1e574a94858bbe2523855caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95b8e2179e1f4fa6bf596a8dd85f761c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:56.238933 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff5f2ee7-7cb5-49f5-aeee-669c36356be1 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 200 len: 1467 microversion: 2.1 time: 0.596380 Aug 29 15:46:56.240737 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1249/2536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:55 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 1467 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:56.259623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ba9d2830-1f73-4907-95f6-430566773d8a req-40259b4d-5829-4b0e-a19d-49c70a06139d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb436cc-a387-48b8-8883-7308ff1103de", "name": "network-vif-unplugged", "status": "completed", "tag": "d12af6c1-2acd-4fae-ba3e-a07a9dd19696"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:56.295951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba9d2830-1f73-4907-95f6-430566773d8a req-40259b4d-5829-4b0e-a19d-49c70a06139d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.299347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba9d2830-1f73-4907-95f6-430566773d8a req-40259b4d-5829-4b0e-a19d-49c70a06139d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.299972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba9d2830-1f73-4907-95f6-430566773d8a req-40259b4d-5829-4b0e-a19d-49c70a06139d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.331483 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ba9d2830-1f73-4907-95f6-430566773d8a req-40259b4d-5829-4b0e-a19d-49c70a06139d service nova] Creating event network-vif-unplugged:d12af6c1-2acd-4fae-ba3e-a07a9dd19696 for instance eeb436cc-a387-48b8-8883-7308ff1103de on n-h2-836830-13 Aug 29 15:46:56.355804 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ba9d2830-1f73-4907-95f6-430566773d8a req-40259b4d-5829-4b0e-a19d-49c70a06139d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112223 Aug 29 15:46:56.358306 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1250/2537] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:56.376180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4297ca52-784a-409a-aa6f-64afb3e1e71e req-40a1a6e2-8f27-43be-8421-383f17e101c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0", "name": "network-vif-deleted", "tag": "455f92df-2866-44da-8e9c-bdfab88822ef"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:56.417979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4297ca52-784a-409a-aa6f-64afb3e1e71e req-40a1a6e2-8f27-43be-8421-383f17e101c9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.418508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4297ca52-784a-409a-aa6f-64afb3e1e71e req-40a1a6e2-8f27-43be-8421-383f17e101c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.419256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4297ca52-784a-409a-aa6f-64afb3e1e71e req-40a1a6e2-8f27-43be-8421-383f17e101c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.444313 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4297ca52-784a-409a-aa6f-64afb3e1e71e req-40a1a6e2-8f27-43be-8421-383f17e101c9 service nova] Creating event network-vif-deleted:455f92df-2866-44da-8e9c-bdfab88822ef for instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 on n-h2-836830-13 Aug 29 15:46:56.455437 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4297ca52-784a-409a-aa6f-64afb3e1e71e req-40a1a6e2-8f27-43be-8421-383f17e101c9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092512 Aug 29 15:46:56.456587 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1251/2538] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:56.479757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:56.480498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:56.508309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.508823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.509304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:56.510053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:56.510526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:56.510966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.534266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:57.557912 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57a7037d-4ab1-4a03-9f76-99dd406562e1 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 200 len: 1474 microversion: 2.1 time: 1.097774 Aug 29 15:46:57.571403 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1252/2539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:56 2022] GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 1474 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:57.578775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:57.579492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:57.601596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.604822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.605349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.609811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:57.610775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:57.611272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:57.680832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:58.307818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:46:58.341541 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0f3239c-bed4-4915-ac91-f21c5898eaba tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.776711 Aug 29 15:46:58.346220 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1253/2540] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:57 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:46:58.404119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c6b489bd-c269-4bb5-8261-4d066a8d4b4f req-6f1b91a1-3960-42c2-abf3-328a3dfab659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb436cc-a387-48b8-8883-7308ff1103de", "name": "network-vif-deleted", "tag": "d12af6c1-2acd-4fae-ba3e-a07a9dd19696"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:58.478583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c6b489bd-c269-4bb5-8261-4d066a8d4b4f req-6f1b91a1-3960-42c2-abf3-328a3dfab659 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.482292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c6b489bd-c269-4bb5-8261-4d066a8d4b4f req-6f1b91a1-3960-42c2-abf3-328a3dfab659 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.483241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c6b489bd-c269-4bb5-8261-4d066a8d4b4f req-6f1b91a1-3960-42c2-abf3-328a3dfab659 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.545532 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c6b489bd-c269-4bb5-8261-4d066a8d4b4f req-6f1b91a1-3960-42c2-abf3-328a3dfab659 service nova] Creating event network-vif-deleted:d12af6c1-2acd-4fae-ba3e-a07a9dd19696 for instance eeb436cc-a387-48b8-8883-7308ff1103de on n-h2-836830-13 Aug 29 15:46:58.564778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c6b489bd-c269-4bb5-8261-4d066a8d4b4f req-6f1b91a1-3960-42c2-abf3-328a3dfab659 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193426 Aug 29 15:46:58.568527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1254/2541] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:58.592122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:58.594142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] [instance: 9e266eab-6b47-440b-bb3b-cd7801c3d859] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:58.618536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.619052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.631666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.635750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.636275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.636747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.678335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] HTTP exception thrown: Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 could not be found. Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Request method failure captured: Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 HTTP/1.1 Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN2zYd7aFBlRP6bINxvOMHfQHRGA18qz_4KV0-6h8RWlrBPSo8tbUxYqbt-NnNFWXJKeLdKU2vhNoONPpGy-YFddxO2H0wZcboWOzUdESRTpg1EW3eMdE8AXk1NmSMvzz2zlnYa_WC8jXoc7ei0IwMYKSXC9H4c1cUaCieuntL_zshc Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_95b8e2179e1f4fa6bf596a8dd85f761c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/95b8e2179e1f4fa6bf596a8dd85f761c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/95b8e2179e1f4fa6bf596a8dd85f761c"}]}] Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 95b8e2179e1f4fa6bf596a8dd85f761c Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-MigrationsAdminTest-664702707 Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: cc90d88d1e574a94858bbe2523855caa Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-MigrationsAdminTest-664702707-project Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 could not be found. Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9e266eab-6b47-440b-bb3b-cd7801c3d859'} Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 could not be found. Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 could not be found. Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:58.682249 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 could not be found. Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.686516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] Returning 404 to user: Instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:58.689857 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b914f21f-bd75-4d19-af66-9ac12f0a23a8 tempest-MigrationsAdminTest-664702707 tempest-MigrationsAdminTest-664702707-project] 10.222.0.83 "GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859" status: 404 len: 111 microversion: 2.1 time: 0.116971 Aug 29 15:46:58.692489 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1255/2542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:58 2022] GET /compute/v2.1/servers/9e266eab-6b47-440b-bb3b-cd7801c3d859 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:58.708260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:58.721360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: eeb436cc-a387-48b8-8883-7308ff1103de] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:58.739937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.740452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.740904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.745091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.746951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.747884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.790480 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance eeb436cc-a387-48b8-8883-7308ff1103de could not be found. Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de HTTP/1.1 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance eeb436cc-a387-48b8-8883-7308ff1103de could not be found. Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'eeb436cc-a387-48b8-8883-7308ff1103de'} Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb436cc-a387-48b8-8883-7308ff1103de could not be found. Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb436cc-a387-48b8-8883-7308ff1103de could not be found. Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:58.801737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb436cc-a387-48b8-8883-7308ff1103de could not be found. Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.806083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance eeb436cc-a387-48b8-8883-7308ff1103de could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:58.809393 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-05cc6adc-35cf-4495-8cde-0beeed7bba88 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de" status: 404 len: 111 microversion: 2.1 time: 0.113466 Aug 29 15:46:58.814046 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1256/2543] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:58 2022] GET /compute/v2.1/servers/eeb436cc-a387-48b8-8883-7308ff1103de => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:58.829415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-314593db-d836-434b-aca6-cb6b609b5439 req-3a588cb3-7e58-4881-9eec-a012a09e4264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e266eab-6b47-440b-bb3b-cd7801c3d859", "name": "network-vif-deleted", "tag": "88188c6a-a8cf-4565-990b-5ba98a2ea997"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:46:58.861937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-314593db-d836-434b-aca6-cb6b609b5439 req-3a588cb3-7e58-4881-9eec-a012a09e4264 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.864176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-314593db-d836-434b-aca6-cb6b609b5439 req-3a588cb3-7e58-4881-9eec-a012a09e4264 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.864866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-314593db-d836-434b-aca6-cb6b609b5439 req-3a588cb3-7e58-4881-9eec-a012a09e4264 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.897643 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-314593db-d836-434b-aca6-cb6b609b5439 req-3a588cb3-7e58-4881-9eec-a012a09e4264 service nova] Creating event network-vif-deleted:88188c6a-a8cf-4565-990b-5ba98a2ea997 for instance 9e266eab-6b47-440b-bb3b-cd7801c3d859 on n-h1-836830-13 Aug 29 15:46:58.907178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-314593db-d836-434b-aca6-cb6b609b5439 req-3a588cb3-7e58-4881-9eec-a012a09e4264 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091366 Aug 29 15:46:58.908390 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1257/2544] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:58.914639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:58.915585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:58.925759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.926728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.927990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.930293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:58.930962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:58.931739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:58.956306 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 could not be found. Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 HTTP/1.1 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 could not be found. Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0'} Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 could not be found. Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 could not be found. Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:46:58.958882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.962551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:46:58.962551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:46:58.962551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:46:58.962551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:46:58.962551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:46:58.962551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 could not be found. Aug 29 15:46:58.962551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:46:58.970942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance 3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:46:58.972197 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc058125-c93c-41b4-98ff-5979a985f49c tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0" status: 404 len: 111 microversion: 2.1 time: 0.062528 Aug 29 15:46:58.975012 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1258/2545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:58 2022] GET /compute/v2.1/servers/3536e1b7-d2f4-45f8-ad8b-6c7aaa7983b0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:46:58.990619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2a337ea0-e38c-4d08-89ac-9fbb1e4363eb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:59.051903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:UPDATE=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:59.066512 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2a337ea0-e38c-4d08-89ac-9fbb1e4363eb tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/1478d0e9-432e-48f3-beab-fd90e1b1a6eb" status: 204 len: 0 microversion: 2.1 time: 0.089131 Aug 29 15:46:59.069625 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1259/2546] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:46:58 2022] DELETE /compute/v2.1/os-server-groups/1478d0e9-432e-48f3-beab-fd90e1b1a6eb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:59.091983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:59.098190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:59.116914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.117953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.118456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.119220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.119686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.120110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.237640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:46:59.513558 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19b7e3b5-4b67-434b-ba72-6767c51b622e tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 204 len: 0 microversion: 2.1 time: 0.436789 Aug 29 15:46:59.514683 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1260/2547] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:46:59 2022] DELETE /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:46:59.522062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:59.522875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:59.532334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.533148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.533874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.535056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.535756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.536631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.813249 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b38cad6d-73f0-4f0e-b728-5fe7317fbd62 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.710081 Aug 29 15:46:59.821522 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1288/2548] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:46:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:46:59.827430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:46:59.828182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:46:59.836982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=44 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:46:59.838976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.839811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.841380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:46:59.846179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:46:59.846179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:46:59.846179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.117269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:00.145436 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b3548ba-c89b-47bb-b0fa-8157fa0d6c92 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1473 microversion: 2.1 time: 0.327889 Aug 29 15:47:00.166355 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1289/2549] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:59 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1473 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:00.172439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.83"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:00.182527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:00.199681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.200858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.201365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.202147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:00.203793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:00.214112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:00.266884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:47:00.271972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquired lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:47:00.630462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:00.643598 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b52a191b-225a-4225-96b4-b45c97ef1fc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 1.127257 Aug 29 15:47:00.646333 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1261/2550] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:46:59 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:01.174730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:01.175429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:01.199435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.200071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.200588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:01.201834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:01.202297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:01.202796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.042613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:02.054414 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6e90f78-0cb8-4a2b-a62e-9dd49ba6cd5f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1473 microversion: 2.1 time: 0.883716 Aug 29 15:47:02.057083 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1262/2551] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:01 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1473 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:02.058147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8.", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:47:02.059790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Releasing lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:47:02.060878 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8. Aug 29 15:47:02.060878 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-ad6037ec-e827-4f31-b89a-21afb66e30e2'] Aug 29 15:47:02.062043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:02.062828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Request method failure captured: Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action HTTP/1.1 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 45 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN8v7RIUSq41UWSNxQdM5BLno_Nus26iBTF-CuDI4RvaNUI75KK_xeC5VAErx_fhhS6cHo5017rnkX4pmBb4kaaEE8ONOwMxI3ubFKIW4dJ9JIDWEhNfhMsKh4xTBO8ZkzXuU2uO991k5DnksNIS3PhAlda-8zlFAa8KPbdQtg0II9M Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a25ad3634e624e9394ac4e588d773383", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a25ad3634e624e9394ac4e588d773383"}]}] Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 7058c725d25749af95e6a5fc806e27ef Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: {"addFloatingIp": {"address": "172.25.0.83"}} Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: exception: Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8. Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-ad6037ec-e827-4f31-b89a-21afb66e30e2'] Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bf3ea860-8924-4b41-a76a-5f15ce543ba4', 'body': {'addFloatingIp': {'address': '172.25.0.83'}}} Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:47:02.064358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8. Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6037ec-e827-4f31-b89a-21afb66e30e2'] Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8. Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6037ec-e827-4f31-b89a-21afb66e30e2'] Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8. Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6037ec-e827-4f31-b89a-21afb66e30e2'] Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8. Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad6037ec-e827-4f31-b89a-21afb66e30e2'] Aug 29 15:47:02.067541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:02.073261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Returning 400 to user: Cannot associate floating IP 172.25.0.83 (98130440-794d-49e5-bcdd-d20c645b89dc) with port ac54ca12-72b9-4ec9-b799-8738e3c401d3 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network b651865a-1c0e-419b-b2e5-5ce156b625c8. Aug 29 15:47:02.073261 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-ad6037ec-e827-4f31-b89a-21afb66e30e2'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:02.077706 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e020bd10-0dc7-4ef3-ad10-abfddf8fd8be tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action" status: 400 len: 381 microversion: 2.1 time: 1.917376 Aug 29 15:47:02.079293 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1290/2552] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:00 2022] POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action => generated 381 bytes in 1919 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:02.085848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.086349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.086810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.089860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ab369a34-e479-47a7-a5bb-f4315b1913a6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '.version_select at 0x7f32ee96e9d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:02.109898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:02.110402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:02.111285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:02.650254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:02.707009 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0fd52fbe-cd59-4df5-9837-27e755e5e7f7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.648637 Aug 29 15:47:02.715348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1263/2553] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:02 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:03.079944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:03.080608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:03.097249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.102461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.106032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.109305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.117995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.119177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.334606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd373f4dbd944aa82c96a42545c7479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da73abe36a64bde9e9fc9315f1a87b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:03.357787 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca42f8f9-726a-498c-947f-af63a9a4796f tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 200 len: 1431 microversion: 2.1 time: 0.282049 Aug 29 15:47:03.361263 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1264/2554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:03 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 1431 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:03.390091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-15fd73f0-403c-47d0-8f42-514e50d8ccdf req-344b7847-c73d-4c3e-ac71-d5110010fc29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f1aebf-dfb9-406c-b132-1081aacd03ef", "name": "network-vif-deleted", "tag": "265b876b-61d8-4605-ae5a-385b99f6c59b"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:03.442886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-15fd73f0-403c-47d0-8f42-514e50d8ccdf req-344b7847-c73d-4c3e-ac71-d5110010fc29 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.443563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-15fd73f0-403c-47d0-8f42-514e50d8ccdf req-344b7847-c73d-4c3e-ac71-d5110010fc29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.444103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-15fd73f0-403c-47d0-8f42-514e50d8ccdf req-344b7847-c73d-4c3e-ac71-d5110010fc29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.504447 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-15fd73f0-403c-47d0-8f42-514e50d8ccdf req-344b7847-c73d-4c3e-ac71-d5110010fc29 service nova] Creating event network-vif-deleted:265b876b-61d8-4605-ae5a-385b99f6c59b for instance 47f1aebf-dfb9-406c-b132-1081aacd03ef on n-h1-836830-13 Aug 29 15:47:03.517850 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-15fd73f0-403c-47d0-8f42-514e50d8ccdf req-344b7847-c73d-4c3e-ac71-d5110010fc29 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153047 Aug 29 15:47:03.524056 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1265/2555] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:03.759228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:03.760957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:03.775245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.779165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.779896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:03.780833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:03.789951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:03.790660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.717619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:04.729996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a1104335-56be-4f89-841c-e355b1e4b59e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.994229 Aug 29 15:47:04.734955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1266/2556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:03 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:04.758019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:04.759108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] [instance: 47f1aebf-dfb9-406c-b132-1081aacd03ef] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:04.766421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.780220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.780799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.781899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:04.782385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:04.784426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:04.832770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] HTTP exception thrown: Instance 47f1aebf-dfb9-406c-b132-1081aacd03ef could not be found. Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Request method failure captured: Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef HTTP/1.1 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5jp_FyL8Ehykj3BJmohj8bF7iEdY0PAD4x20facSxhOkky-PzUGOZXmSnH9qh0m5Pj2NSkm3awk-tDhjKaObf_Uinn50mrSVi6fxJEZKhaxYVfkHEJaOpKCP_Ns2fJA0jdzhe0SNw6GaPAqFoLdlciiZeLiOtBZpzZUSfFbvZWbrQ Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3da73abe36a64bde9e9fc9315f1a87b4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3da73abe36a64bde9e9fc9315f1a87b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3da73abe36a64bde9e9fc9315f1a87b4"}]}] Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3da73abe36a64bde9e9fc9315f1a87b4 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1227384055 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: efd373f4dbd944aa82c96a42545c7479 Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersOnMultiNodesTest-1227384055-project Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 47f1aebf-dfb9-406c-b132-1081aacd03ef could not be found. Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '47f1aebf-dfb9-406c-b132-1081aacd03ef'} Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f1aebf-dfb9-406c-b132-1081aacd03ef could not be found. Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f1aebf-dfb9-406c-b132-1081aacd03ef could not be found. Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:04.837059 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f1aebf-dfb9-406c-b132-1081aacd03ef could not be found. Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:04.841535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] Returning 404 to user: Instance 47f1aebf-dfb9-406c-b132-1081aacd03ef could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:04.842669 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62419812-af64-4dc2-8a1d-76300fb96196 tempest-ServersOnMultiNodesTest-1227384055 tempest-ServersOnMultiNodesTest-1227384055-project] 10.222.0.83 "GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef" status: 404 len: 111 microversion: 2.1 time: 0.102358 Aug 29 15:47:04.846833 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1267/2557] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:04 2022] GET /compute/v2.1/servers/47f1aebf-dfb9-406c-b132-1081aacd03ef => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:05.079717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ab369a34-e479-47a7-a5bb-f4315b1913a6 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/98130440-794d-49e5-bcdd-d20c645b89dc" status: 202 len: 0 microversion: 2.1 time: 2.994136 Aug 29 15:47:05.085382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1291/2558] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:47:02 2022] DELETE /compute/v2.1/os-floating-ips/98130440-794d-49e5-bcdd-d20c645b89dc => generated 0 bytes in 3000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:05.091846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.222"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:05.229239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d78008d4-3dc5-4e2d-a1b1-6338ed6a3213 tempest-ListImageFiltersNegativeTestJSON-1666625090 tempest-ListImageFiltersNegativeTestJSON-1666625090-project] Calling method '.version_select at 0x7f32eea871f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.297357 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d78008d4-3dc5-4e2d-a1b1-6338ed6a3213 tempest-ListImageFiltersNegativeTestJSON-1666625090 tempest-ListImageFiltersNegativeTestJSON-1666625090-project] HTTP exception thrown: Image not found. Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d78008d4-3dc5-4e2d-a1b1-6338ed6a3213 tempest-ListImageFiltersNegativeTestJSON-1666625090 tempest-ListImageFiltersNegativeTestJSON-1666625090-project] Request method failure captured: Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/images/42e6d92b-9e45-40d1-9e30-8eb55307405f HTTP/1.1 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN94aLPMEYU9TGwq7TLMeNSA_M6KPezjtApOWQmcqJIWdZxGuXy3B-Op7_iG8m495LDpGxk7PsbkaeLPIawh37GbO2Q4DyqfbgFuqI1zTo9ua41581TIiyx0vVmlcj5zorggGJ0ojocO3Mjqo891p4Vfiv9iZmnCUMtMMa7GTcC2W6w Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ba5b90786abe449f83a54f3c96334bdd Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1666625090 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ba5b90786abe449f83a54f3c96334bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ba5b90786abe449f83a54f3c96334bdd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ba5b90786abe449f83a54f3c96334bdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ba5b90786abe449f83a54f3c96334bdd"}]}] Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1666625090 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ba5b90786abe449f83a54f3c96334bdd Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1666625090 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ListImageFiltersNegativeTestJSON-1666625090-project Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: aed6c4b8b7c04a6b95b51a18d7077d09 Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1666625090-project Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '42e6d92b-9e45-40d1-9e30-8eb55307405f'} Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 42e6d92b-9e45-40d1-9e30-8eb55307405f Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:47:05.299869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42e6d92b-9e45-40d1-9e30-8eb55307405f could not be found. Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:47:05.303626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:05.308576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d78008d4-3dc5-4e2d-a1b1-6338ed6a3213 tempest-ListImageFiltersNegativeTestJSON-1666625090 tempest-ListImageFiltersNegativeTestJSON-1666625090-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:05.311355 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d78008d4-3dc5-4e2d-a1b1-6338ed6a3213 tempest-ListImageFiltersNegativeTestJSON-1666625090 tempest-ListImageFiltersNegativeTestJSON-1666625090-project] 10.222.0.83 "GET /compute/v2.1/images/42e6d92b-9e45-40d1-9e30-8eb55307405f" status: 404 len: 62 microversion: 2.1 time: 0.463412 Aug 29 15:47:05.312842 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1268/2559] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:47:04 2022] GET /compute/v2.1/images/42e6d92b-9e45-40d1-9e30-8eb55307405f => generated 62 bytes in 465 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:47:05.368690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:05.376540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.377299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.377938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.379652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.383525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.384741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.388580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=48,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:05.760398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:05.761492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:05.777024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.780101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.781621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:05.783313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:05.784444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:05.785620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:06.195977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:47:06.196468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquired lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:47:06.334993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:06.349494 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-66b3068b-bfa1-498b-bd5b-f025285f566d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1525 microversion: 2.1 time: 0.594151 Aug 29 15:47:06.363727 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1269/2560] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:05 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1525 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:07.385850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:07.386477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:07.394883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.395727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.396600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.407425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:07.408878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:07.409513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:07.875885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:07.894228 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-16fe8bf6-08e8-4910-b749-02b8726a434d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1507 microversion: 2.1 time: 0.509498 Aug 29 15:47:07.896673 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1270/2561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:07 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:08.917370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:08.918032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:08.929648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.932916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.933544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:08.935012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:08.941298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:08.942425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.580297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:09.604927 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cb0ca57-4c94-4e68-9471-63f52bf0a01c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1507 microversion: 2.1 time: 0.691245 Aug 29 15:47:09.627725 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1271/2562] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:08 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1507 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:09.642198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Building network info cache for instance {{(pid=129133) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 15:47:09.751345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6e005902-0edf-4923-af4a-dfffdc6e98bc req-1c4621b8-b314-4942-867d-69042cbb3ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3ea860-8924-4b41-a76a-5f15ce543ba4", "tag": "ac54ca12-72b9-4ec9-b799-8738e3c401d3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:09.772304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e005902-0edf-4923-af4a-dfffdc6e98bc req-1c4621b8-b314-4942-867d-69042cbb3ac1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:09.793858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e005902-0edf-4923-af4a-dfffdc6e98bc req-1c4621b8-b314-4942-867d-69042cbb3ac1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:09.796473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e005902-0edf-4923-af4a-dfffdc6e98bc req-1c4621b8-b314-4942-867d-69042cbb3ac1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:09.845005 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6e005902-0edf-4923-af4a-dfffdc6e98bc req-1c4621b8-b314-4942-867d-69042cbb3ac1 service nova] Creating event network-changed:ac54ca12-72b9-4ec9-b799-8738e3c401d3 for instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 on n-h2-836830-13 Aug 29 15:47:09.875994 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6e005902-0edf-4923-af4a-dfffdc6e98bc req-1c4621b8-b314-4942-867d-69042cbb3ac1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128685 Aug 29 15:47:09.879337 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1272/2563] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:10.969635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1259006688", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "a0bec00e-10bc-4cbd-9756-ac3ed3e82a16"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:11.063243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] validate_networks() for [('a0bec00e-10bc-4cbd-9756-ac3ed3e82a16', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:11.872169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Updating instance_info_cache with network_info: [{"id": "ac54ca12-72b9-4ec9-b799-8738e3c401d3", "address": "fa:16:3e:2a:71:63", "network": {"id": "45e4fff8-ac31-41e5-89a5-4960938cd66b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1766412748-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a25ad3634e624e9394ac4e588d773383", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapac54ca12-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129133) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:47:11.897011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Releasing lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:47:11.898255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8b4fd07-80c9-425e-a009-4f1eae36e545 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action" status: 202 len: 0 microversion: 2.1 time: 6.811703 Aug 29 15:47:11.899093 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1292/2564] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:05 2022] POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action => generated 0 bytes in 6813 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 15:47:11.905760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:11.906710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:11.916285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.917267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.918660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:11.919886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:11.921396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:11.922132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.265560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:12.282263 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4bf7ed2-89b0-4458-9311-b8f849145b4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 200 len: 1510 microversion: 2.1 time: 0.378160 Aug 29 15:47:12.304202 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1293/2565] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:11 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:12.310715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9bed819e-8d49-43da-86af-c28db216fc58 req-41614a23-88b1-487a-a7df-fc9af9ac8955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d3ca4c-bcb4-444d-a316-0ba73c73182d", "name": "network-vif-unplugged", "status": "completed", "tag": "c3a5ec6c-d281-4b8b-99c8-5931934e075f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:12.331926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9bed819e-8d49-43da-86af-c28db216fc58 req-41614a23-88b1-487a-a7df-fc9af9ac8955 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:12.336239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9bed819e-8d49-43da-86af-c28db216fc58 req-41614a23-88b1-487a-a7df-fc9af9ac8955 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:12.339926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9bed819e-8d49-43da-86af-c28db216fc58 req-41614a23-88b1-487a-a7df-fc9af9ac8955 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:12.361471 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9bed819e-8d49-43da-86af-c28db216fc58 req-41614a23-88b1-487a-a7df-fc9af9ac8955 service nova] Creating event network-vif-unplugged:c3a5ec6c-d281-4b8b-99c8-5931934e075f for instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d on n-h2-836830-13 Aug 29 15:47:12.373648 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9bed819e-8d49-43da-86af-c28db216fc58 req-41614a23-88b1-487a-a7df-fc9af9ac8955 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064646 Aug 29 15:47:12.377890 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1294/2566] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:12.698041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71b01b33-e0c9-4b45-b8d4-b179e53c010f tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:12.723561 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71b01b33-e0c9-4b45-b8d4-b179e53c010f tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.333869 Aug 29 15:47:12.728393 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1295/2567] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:47:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:12.736091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b4184c1-8c4c-4a2f-b1cb-39f17afbac7d tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '.version_select at 0x7f32ee99dca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.169004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:13.169724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:13.170292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:13.170839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:13.171334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:13.208481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.212984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.220113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.222992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.228776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.229489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.305948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Getting quotas for project 5cbb49e2c7b44bfc88daa86ad4a568c5. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:13.330593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Getting quotas for user e77747aef70040c98167ea7daddf25c6 and project 5cbb49e2c7b44bfc88daa86ad4a568c5. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:13.374669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:13.383212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:13.532930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d47b9ee-d5ae-4825-b367-32e88e8f0757 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.261628 Aug 29 15:47:13.538433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1273/2568] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:47:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3268 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:47:13.551910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:13.553510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:13.597572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.598432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.598575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.599262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:13.599720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:13.600563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:13.666999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:13.682536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.compute.api [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Working on deleting snapshot 347e3892-e03e-48f2-8125-c1d3674169b0 from shelved instance... Aug 29 15:47:14.935180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Doing local delete in cell 28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=129132) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 15:47:14.936841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:14.938512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:14.941532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:14.942260 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.compute.api [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 15:47:14.951741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] deallocate_for_instance() {{(pid=129132) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 29 15:47:16.393457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Updating instance_info_cache with network_info: [] {{(pid=129132) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 15:47:16.398504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:17.111267 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f657175-58df-431f-b63b-280c175dc7a2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 204 len: 0 microversion: 2.1 time: 3.571496 Aug 29 15:47:17.115907 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1274/2569] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:13 2022] DELETE /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 0 bytes in 3574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:17.120903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:17.122438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:17.130418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.131836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.132510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.133500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:17.134429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:17.135055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:17.302526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.319975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.323698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:17.326472 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5da19fb-6e4d-41e0-a262-84a8d482b25f tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1317 microversion: 2.21 time: 0.212073 Aug 29 15:47:17.327707 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1275/2570] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:17 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:17.332882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e296980-70f6-44c3-a804-03b7264a1bb4 tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2100383306", "imageRef": "450eca7c-8668-4159-8cc9-afdbc424c78b", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:17.408072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-6e296980-70f6-44c3-a804-03b7264a1bb4 tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:18.501087 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b4184c1-8c4c-4a2f-b1cb-39f17afbac7d tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/2824f5b3-bc15-4a89-b228-96b609f0a2a9" status: 202 len: 0 microversion: 2.1 time: 5.771276 Aug 29 15:47:18.502846 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1296/2571] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:47:12 2022] DELETE /compute/v2.1/os-floating-ips/2824f5b3-bc15-4a89-b228-96b609f0a2a9 => generated 0 bytes in 5774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:18.508751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d749eee8-2359-4218-b83f-92a175ea122f req-3a6ef87a-3f9d-4717-a4a9-3d6660199faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d3ca4c-bcb4-444d-a316-0ba73c73182d", "name": "network-vif-deleted", "tag": "c3a5ec6c-d281-4b8b-99c8-5931934e075f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:18.540890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d749eee8-2359-4218-b83f-92a175ea122f req-3a6ef87a-3f9d-4717-a4a9-3d6660199faf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.541738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d749eee8-2359-4218-b83f-92a175ea122f req-3a6ef87a-3f9d-4717-a4a9-3d6660199faf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.542368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d749eee8-2359-4218-b83f-92a175ea122f req-3a6ef87a-3f9d-4717-a4a9-3d6660199faf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.552851 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6e296980-70f6-44c3-a804-03b7264a1bb4 tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e296980-70f6-44c3-a804-03b7264a1bb4 tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] Request method failure captured: Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 143 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN9_mVKhSdnVBgQw65656tztzeikuTFWTIS1tFiwu1jWsjTj5OLGJsaNA01uf6IJJWKxIQc8ho-ZgNielGJcWDEu-XuoI-S97l16eCKhons72gteioNU-ikWkHg1peCTJk_8y8rWcpK6v4hy3W-BjiEOA5_2eOpNqpY-JN218SpHNJQ Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b4f05a49416c463084643b9c6bd91df7 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FlavorsV2NegativeTest-1466008435 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4f05a49416c463084643b9c6bd91df7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b4f05a49416c463084643b9c6bd91df7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b4f05a49416c463084643b9c6bd91df7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b4f05a49416c463084643b9c6bd91df7"}]}] Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FlavorsV2NegativeTest-1466008435 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b4f05a49416c463084643b9c6bd91df7 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1466008435 Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FlavorsV2NegativeTest-1466008435-project Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 36c57640941540989f44f908b4f87e4b Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FlavorsV2NegativeTest-1466008435-project Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2100383306", "imageRef": "450eca7c-8668-4159-8cc9-afdbc424c78b", "flavorRef": "452"}} Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: exception: Flavor's memory is too small for requested image. Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2100383306', 'imageRef': '450eca7c-8668-4159-8cc9-afdbc424c78b', 'flavorRef': '452'}}} Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:18.555600 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 29 15:47:18.560898 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.563655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e296980-70f6-44c3-a804-03b7264a1bb4 tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:18.564703 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e296980-70f6-44c3-a804-03b7264a1bb4 tempest-FlavorsV2NegativeTest-1466008435 tempest-FlavorsV2NegativeTest-1466008435-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.235525 Aug 29 15:47:18.565755 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1276/2572] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:17 2022] POST /compute/v2.1/servers => generated 93 bytes in 1237 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:18.566350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.server_external_events [req-d749eee8-2359-4218-b83f-92a175ea122f req-3a6ef87a-3f9d-4717-a4a9-3d6660199faf service nova] Unable to find a host for instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d. Dropping event network-vif-deleted {{(pid=129133) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:47:18.567488 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d749eee8-2359-4218-b83f-92a175ea122f req-3a6ef87a-3f9d-4717-a4a9-3d6660199faf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.063409 Aug 29 15:47:18.568442 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1297/2573] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:47:18.588064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.591003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:18.593585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:18.595836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:18.618442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.620604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.621946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.623778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.625130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.626191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.628123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.639071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.643665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.644617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.646361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.647939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.695626 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d HTTP/1.1 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'f2d3ca4c-bcb4-444d-a316-0ba73c73182d'} Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:18.698282 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.704096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.704096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:18.704096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:18.704096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:18.704096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:18.704096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:47:18.704096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.707291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:18.708597 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8311a660-0cbf-4d19-a4f2-d17097b6b3b7 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 404 len: 111 microversion: 2.1 time: 0.141270 Aug 29 15:47:18.709807 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1277/2574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:18 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:18.760721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-143ac873-e7c3-4c4f-87ad-cada84532e4b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-143ac873-e7c3-4c4f-87ad-cada84532e4b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Request method failure captured: Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action HTTP/1.1 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 34 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN8v7RIUSq41UWSNxQdM5BLno_Nus26iBTF-CuDI4RvaNUI75KK_xeC5VAErx_fhhS6cHo5017rnkX4pmBb4kaaEE8ONOwMxI3ubFKIW4dJ9JIDWEhNfhMsKh4xTBO8ZkzXuU2uO991k5DnksNIS3PhAlda-8zlFAa8KPbdQtg0II9M Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a25ad3634e624e9394ac4e588d773383", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a25ad3634e624e9394ac4e588d773383"}]}] Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 7058c725d25749af95e6a5fc806e27ef Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: {"addFloatingIp": {"address": ""}} Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bf3ea860-8924-4b41-a76a-5f15ce543ba4', 'body': {'addFloatingIp': {'address': ''}}} Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '' Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:47:18.780012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-143ac873-e7c3-4c4f-87ad-cada84532e4b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:18.783644 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-143ac873-e7c3-4c4f-87ad-cada84532e4b tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action" status: 400 len: 142 microversion: 2.1 time: 0.071846 Aug 29 15:47:18.785037 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1278/2575] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:18 2022] POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action => generated 142 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:18.799904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:18.820926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:18.852572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.853557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.854376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.863295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:18.864000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:18.864393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:18.909094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 15:47:18.909387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquired lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 15:47:19.347844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Releasing lock "refresh_cache-bf3ea860-8924-4b41-a76a-5f15ce543ba4" {{(pid=129132) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 15:47:19.348515 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] HTTP exception thrown: floating IP not found Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Request method failure captured: Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action HTTP/1.1 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 41 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN8v7RIUSq41UWSNxQdM5BLno_Nus26iBTF-CuDI4RvaNUI75KK_xeC5VAErx_fhhS6cHo5017rnkX4pmBb4kaaEE8ONOwMxI3ubFKIW4dJ9JIDWEhNfhMsKh4xTBO8ZkzXuU2uO991k5DnksNIS3PhAlda-8zlFAa8KPbdQtg0II9M Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a25ad3634e624e9394ac4e588d773383", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a25ad3634e624e9394ac4e588d773383"}]}] Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 7058c725d25749af95e6a5fc806e27ef Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: exception: floating IP not found Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bf3ea860-8924-4b41-a76a-5f15ce543ba4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 29 15:47:19.350283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Returning 404 to user: floating IP not found {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9bf6c493-6e32-40ad-a399-6b0b8cceeace tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action" status: 404 len: 67 microversion: 2.1 time: 0.559923 Aug 29 15:47:19.354374 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1279/2576] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:18 2022] POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action => generated 67 bytes in 561 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:47:19.359776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1872657063", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9bbf042d-13bc-4426-83e8-c7e73123f015"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:19.383722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.393818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.399696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:19.408684 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42c71672-f680-42a8-bd67-a3c9c2f3df08 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.822660 Aug 29 15:47:19.435118 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1298/2577] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:18 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:19.447167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5983080-9c30-4954-8f1b-ece94e40ac37 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:19.539083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] validate_networks() for [('9bbf042d-13bc-4426-83e8-c7e73123f015', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:19.640651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d5983080-9c30-4954-8f1b-ece94e40ac37 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5983080-9c30-4954-8f1b-ece94e40ac37 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Request method failure captured: Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action HTTP/1.1 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 44 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN8v7RIUSq41UWSNxQdM5BLno_Nus26iBTF-CuDI4RvaNUI75KK_xeC5VAErx_fhhS6cHo5017rnkX4pmBb4kaaEE8ONOwMxI3ubFKIW4dJ9JIDWEhNfhMsKh4xTBO8ZkzXuU2uO991k5DnksNIS3PhAlda-8zlFAa8KPbdQtg0II9M Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a25ad3634e624e9394ac4e588d773383", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a25ad3634e624e9394ac4e588d773383"}]}] Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 7058c725d25749af95e6a5fc806e27ef Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: exception: Floating IP not found for address 0.0.0.0. Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bf3ea860-8924-4b41-a76a-5f15ce543ba4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 29 15:47:19.642770 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5983080-9c30-4954-8f1b-ece94e40ac37 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5983080-9c30-4954-8f1b-ece94e40ac37 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action" status: 404 len: 88 microversion: 2.1 time: 0.208101 Aug 29 15:47:19.647182 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1299/2578] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:19 2022] POST /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4/action => generated 88 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:47:19.658346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:19.658856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:19.688238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.688734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.689175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.706819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:19.707475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:19.707933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:19.787310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:19.986955 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7f56632-c04c-486a-b46f-0e3d0672ebd8 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 204 len: 0 microversion: 2.1 time: 0.335622 Aug 29 15:47:19.992746 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1300/2579] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:19 2022] DELETE /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:20.383271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-129444447", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b1c5c2dc-a8ed-42b9-8ea6-87c597165b4a"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:20.529038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] validate_networks() for [('b1c5c2dc-a8ed-42b9-8ea6-87c597165b4a', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:21.678207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:21.678874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:21.679172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:21.679593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:21.680015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:21.721715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.722243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.722694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.725181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.729154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.729833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.792254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Getting quotas for project 99a31c64e992417d8862b3443fa8c105. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:21.810579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Getting quotas for user 085145c4942d4c889c291a99eb1d009a and project 99a31c64e992417d8862b3443fa8c105. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:21.848576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Going to run 2 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:21.853641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 00613584-4178-4f30-acdb-ee7d93bf4bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:21.865433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:21.866076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:21.866559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:21.867265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:21.867902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:21.885846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.888382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.890997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.892165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:21.893535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:21.894847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:21.920646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:21.929074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for user 853f8300f9bb403b9cea4834c5a1edcb and project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:21.954812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:21.957590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:21.961141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=00613584-4178-4f30-acdb-ee7d93bf4bd3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:22.024468 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2be4575d-035f-4802-9136-9c2de1f18371 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.670553 Aug 29 15:47:22.032978 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1280/2580] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:22.039716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:22.040935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:22.049020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.050325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.051008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.052224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.053184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.053796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.223141 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b3d868a9-2307-41ba-8d61-db101b46aad6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.228493 Aug 29 15:47:22.238619 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1301/2581] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:22.266711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:22.268313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:22.299773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.300567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.301196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.302790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.304532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.306159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.534030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.544352 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-efce7681-7b64-450c-9130-66ff85636dc4 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1543 microversion: 2.1 time: 0.508782 Aug 29 15:47:22.549045 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1281/2582] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:22 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1543 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:22.562461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e87df7f8-85a8-4fc4-8ca6-7d28b2dfd7f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:22.563122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e87df7f8-85a8-4fc4-8ca6-7d28b2dfd7f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:22.785474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e87df7f8-85a8-4fc4-8ca6-7d28b2dfd7f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.793606 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e87df7f8-85a8-4fc4-8ca6-7d28b2dfd7f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1215 microversion: 2.1 time: 0.243383 Aug 29 15:47:22.811878 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1282/2583] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:22 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:22.828256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:22.844517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:22.853057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Searching by: {'deleted': False, 'project_id': '99a31c64e992417d8862b3443fa8c105'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:47:22.931447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.932032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.934779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.937981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:22.939344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:22.939987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:22.990032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.006822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.012778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.018089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c74e9f3b-257a-4bc9-843f-1d5dd4f70149 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.774254 Aug 29 15:47:23.021963 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1302/2584] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:22 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:23.038807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8a6e79a5-00be-4ff5-8f86-17c4430bd99d req-b41ce25c-5042-4225-bf4d-39e83563abc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c09e1cf-9be0-4dac-ba57-91da4a620bbc", "tag": "64780ad7-4410-40e0-ba19-a3babe5b1ffe"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:23.055227 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c03342c6-31ed-43c7-9360-b3f9a7a16492 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.230947 Aug 29 15:47:23.059373 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1283/2585] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:47:22 2022] GET /compute/v2.1/servers => generated 675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:23.060390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8a6e79a5-00be-4ff5-8f86-17c4430bd99d req-b41ce25c-5042-4225-bf4d-39e83563abc7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.060889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8a6e79a5-00be-4ff5-8f86-17c4430bd99d req-b41ce25c-5042-4225-bf4d-39e83563abc7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.061320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8a6e79a5-00be-4ff5-8f86-17c4430bd99d req-b41ce25c-5042-4225-bf4d-39e83563abc7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.070735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-516a8979-9727-4c59-aad8-2c58d34e4ea6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:23.084856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-516a8979-9727-4c59-aad8-2c58d34e4ea6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:23.093588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8a6e79a5-00be-4ff5-8f86-17c4430bd99d req-b41ce25c-5042-4225-bf4d-39e83563abc7 service nova] Creating event network-changed:64780ad7-4410-40e0-ba19-a3babe5b1ffe for instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc on n-h2-836830-13 Aug 29 15:47:23.109153 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8a6e79a5-00be-4ff5-8f86-17c4430bd99d req-b41ce25c-5042-4225-bf4d-39e83563abc7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080398 Aug 29 15:47:23.112710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1303/2586] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:23.349136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-516a8979-9727-4c59-aad8-2c58d34e4ea6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.375704 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-516a8979-9727-4c59-aad8-2c58d34e4ea6 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1219 microversion: 2.1 time: 0.291640 Aug 29 15:47:23.383371 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1284/2587] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:23 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1219 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:23.574835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:23.575876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:23.601334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.602436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.603791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.606624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.607552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.609395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.814772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:23.815467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:23.838791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.839364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.839854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.856456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:23.858265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:23.862014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:23.947292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:23.962376 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fef8170a-20b4-4462-9de1-9b46bfe81137 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1543 microversion: 2.1 time: 0.392010 Aug 29 15:47:23.978997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1304/2588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:23 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1543 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:24.045130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.046074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:24.060485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.063717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.064378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.067230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.069632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.071761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.298737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.325703 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0046d64-7d5c-4302-acaa-13942431f2c6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1267 microversion: 2.1 time: 0.514756 Aug 29 15:47:24.328228 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1285/2589] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:23 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1267 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:24.406814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.407472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:24.421639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.423784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.426343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.427135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:24.427643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:24.428081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:24.503607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.514743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.516572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.518283 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2998818d-f4e8-4589-a5ec-2c0ae46761eb tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.480215 Aug 29 15:47:24.519225 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1305/2590] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:24.733019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:24.756680 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8926f24e-38cf-45a9-af29-7e0aa0cf79db tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1223 microversion: 2.1 time: 0.355603 Aug 29 15:47:24.760064 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1286/2591] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1223 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:24.894470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-febc9fec-29df-42f6-ae32-1d9f8ded4ff4 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Calling method '.version_select at 0x7f32efd33310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.943934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-febc9fec-29df-42f6-ae32-1d9f8ded4ff4 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] HTTP exception thrown: Image not found. Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-febc9fec-29df-42f6-ae32-1d9f8ded4ff4 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Request method failure captured: Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/images/e94ecb78-ce5e-4e9a-983f-2ca3de7f012b/metadata/os_distro HTTP/1.1 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-MPIPUpU1AswEDpQPxP4wG5k8T_299o9aup3ap1PPK67rqnssvrkQitJLEU0Aq_huIrzyzGX3tsJVuSyZshC9wtbwf5r0Jc6r_KywCvB18wYo24sXZGEuZavHx0h4wN60y3Hu_1kzClzXynDilqUHVIPHvcOm3UdfQ1wooJKS5ml4 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9b2c1f9e69b64705adce1bfa7230e8bd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9b2c1f9e69b64705adce1bfa7230e8bd"}]}] Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 90cf62e411444153b2f238fb2d2c31be Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: exception: Image not found. Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'image_id': 'e94ecb78-ce5e-4e9a-983f-2ca3de7f012b', 'id': 'os_distro'} Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e94ecb78-ce5e-4e9a-983f-2ca3de7f012b Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:47:24.953260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e94ecb78-ce5e-4e9a-983f-2ca3de7f012b could not be found. Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:24.957984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-febc9fec-29df-42f6-ae32-1d9f8ded4ff4 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Returning 404 to user: Image not found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:24.962388 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-febc9fec-29df-42f6-ae32-1d9f8ded4ff4 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] 10.222.0.83 "DELETE /compute/v2.1/images/e94ecb78-ce5e-4e9a-983f-2ca3de7f012b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.435423 Aug 29 15:47:24.962585 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1306/2592] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:47:24 2022] DELETE /compute/v2.1/images/e94ecb78-ce5e-4e9a-983f-2ca3de7f012b/metadata/os_distro => generated 62 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:47:24.972806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25752567-e1bc-453e-85ea-3f08ee7acf2e tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Calling method '.version_select at 0x7f32f2a88f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.986041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:24.986811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:25.003666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.006285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.009282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.014515 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-25752567-e1bc-453e-85ea-3f08ee7acf2e tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] HTTP exception thrown: Image not found. Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25752567-e1bc-453e-85ea-3f08ee7acf2e tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Request method failure captured: Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/images/40fbdec5-80ad-48ae-81d5-eeba2175b2db/metadata/os_version HTTP/1.1 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-MPIPUpU1AswEDpQPxP4wG5k8T_299o9aup3ap1PPK67rqnssvrkQitJLEU0Aq_huIrzyzGX3tsJVuSyZshC9wtbwf5r0Jc6r_KywCvB18wYo24sXZGEuZavHx0h4wN60y3Hu_1kzClzXynDilqUHVIPHvcOm3UdfQ1wooJKS5ml4 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9b2c1f9e69b64705adce1bfa7230e8bd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9b2c1f9e69b64705adce1bfa7230e8bd"}]}] Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 90cf62e411444153b2f238fb2d2c31be Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'image_id': '40fbdec5-80ad-48ae-81d5-eeba2175b2db', 'id': 'os_version'} Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 40fbdec5-80ad-48ae-81d5-eeba2175b2db Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:47:25.016595 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 40fbdec5-80ad-48ae-81d5-eeba2175b2db could not be found. Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.021618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25752567-e1bc-453e-85ea-3f08ee7acf2e tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:25.026420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25752567-e1bc-453e-85ea-3f08ee7acf2e tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] 10.222.0.83 "GET /compute/v2.1/images/40fbdec5-80ad-48ae-81d5-eeba2175b2db/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.058059 Aug 29 15:47:25.026672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.027824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.033051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.033524 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1287/2593] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/images/40fbdec5-80ad-48ae-81d5-eeba2175b2db/metadata/os_version => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:47:25.042392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-720138b0-82d4-431e-9e2b-13af129eb502 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Calling method '.version_select at 0x7f32edca5160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.099534 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-720138b0-82d4-431e-9e2b-13af129eb502 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] HTTP exception thrown: Image not found. Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-720138b0-82d4-431e-9e2b-13af129eb502 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Request method failure captured: Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/images/59023b72-7092-4b09-8e98-f0194a9054ca/metadata HTTP/1.1 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-MPIPUpU1AswEDpQPxP4wG5k8T_299o9aup3ap1PPK67rqnssvrkQitJLEU0Aq_huIrzyzGX3tsJVuSyZshC9wtbwf5r0Jc6r_KywCvB18wYo24sXZGEuZavHx0h4wN60y3Hu_1kzClzXynDilqUHVIPHvcOm3UdfQ1wooJKS5ml4 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9b2c1f9e69b64705adce1bfa7230e8bd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9b2c1f9e69b64705adce1bfa7230e8bd"}]}] Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 90cf62e411444153b2f238fb2d2c31be Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'image_id': '59023b72-7092-4b09-8e98-f0194a9054ca'} Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 59023b72-7092-4b09-8e98-f0194a9054ca Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:47:25.101956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 59023b72-7092-4b09-8e98-f0194a9054ca could not be found. Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-720138b0-82d4-431e-9e2b-13af129eb502 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-720138b0-82d4-431e-9e2b-13af129eb502 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] 10.222.0.83 "GET /compute/v2.1/images/59023b72-7092-4b09-8e98-f0194a9054ca/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065815 Aug 29 15:47:25.107081 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1288/2594] 10.222.0.83 () {58 vars in 1260 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/images/59023b72-7092-4b09-8e98-f0194a9054ca/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:47:25.119662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bed2b454-6e43-4b3e-ae68-0edb6c1f74b9 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Action: 'update_all', calling method: .version_select at 0x7f32ee7f6700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:25.174508 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-bed2b454-6e43-4b3e-ae68-0edb6c1f74b9 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] HTTP exception thrown: Image not found. Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bed2b454-6e43-4b3e-ae68-0edb6c1f74b9 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Request method failure captured: Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/images/7db03b7d-875d-45fe-8b02-8a35a51394aa/metadata HTTP/1.1 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 57 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-MPIPUpU1AswEDpQPxP4wG5k8T_299o9aup3ap1PPK67rqnssvrkQitJLEU0Aq_huIrzyzGX3tsJVuSyZshC9wtbwf5r0Jc6r_KywCvB18wYo24sXZGEuZavHx0h4wN60y3Hu_1kzClzXynDilqUHVIPHvcOm3UdfQ1wooJKS5ml4 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9b2c1f9e69b64705adce1bfa7230e8bd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9b2c1f9e69b64705adce1bfa7230e8bd"}]}] Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 90cf62e411444153b2f238fb2d2c31be Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'image_id': '7db03b7d-875d-45fe-8b02-8a35a51394aa', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7db03b7d-875d-45fe-8b02-8a35a51394aa Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:47:25.177240 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7db03b7d-875d-45fe-8b02-8a35a51394aa could not be found. Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:47:25.181518 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.194091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bed2b454-6e43-4b3e-ae68-0edb6c1f74b9 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:25.194091 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bed2b454-6e43-4b3e-ae68-0edb6c1f74b9 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] 10.222.0.83 "PUT /compute/v2.1/images/7db03b7d-875d-45fe-8b02-8a35a51394aa/metadata" status: 404 len: 62 microversion: 2.1 time: 0.072789 Aug 29 15:47:25.194091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1289/2595] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:47:25 2022] PUT /compute/v2.1/images/7db03b7d-875d-45fe-8b02-8a35a51394aa/metadata => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:47:25.217907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-60664823-a97a-42d4-9ebe-006e79030c2d tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Action: 'update', calling method: .version_select at 0x7f32ef5aa700>, body: {"meta": {"os_distro": "alt"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:25.305736 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-60664823-a97a-42d4-9ebe-006e79030c2d tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] HTTP exception thrown: Image not found. Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-60664823-a97a-42d4-9ebe-006e79030c2d tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Request method failure captured: Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/images/ddb6ae31-edd9-4708-9c5d-48898fa97b62/metadata/os_distro HTTP/1.1 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 30 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-MPIPUpU1AswEDpQPxP4wG5k8T_299o9aup3ap1PPK67rqnssvrkQitJLEU0Aq_huIrzyzGX3tsJVuSyZshC9wtbwf5r0Jc6r_KywCvB18wYo24sXZGEuZavHx0h4wN60y3Hu_1kzClzXynDilqUHVIPHvcOm3UdfQ1wooJKS5ml4 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9b2c1f9e69b64705adce1bfa7230e8bd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9b2c1f9e69b64705adce1bfa7230e8bd"}]}] Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 90cf62e411444153b2f238fb2d2c31be Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: {"meta": {"os_distro": "alt"}} Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'image_id': 'ddb6ae31-edd9-4708-9c5d-48898fa97b62', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ddb6ae31-edd9-4708-9c5d-48898fa97b62 Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:47:25.311106 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ddb6ae31-edd9-4708-9c5d-48898fa97b62 could not be found. Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-60664823-a97a-42d4-9ebe-006e79030c2d tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:25.315381 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-60664823-a97a-42d4-9ebe-006e79030c2d tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] 10.222.0.83 "PUT /compute/v2.1/images/ddb6ae31-edd9-4708-9c5d-48898fa97b62/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.113227 Aug 29 15:47:25.318959 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1290/2596] 10.222.0.83 () {60 vars in 1310 bytes} [Mon Aug 29 15:47:25 2022] PUT /compute/v2.1/images/ddb6ae31-edd9-4708-9c5d-48898fa97b62/metadata/os_distro => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:47:25.346049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f2d2abe6-865f-4dc3-8831-4852df5c1c43 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Action: 'create', calling method: .version_select at 0x7f32ee8c5430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:25.422831 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f2d2abe6-865f-4dc3-8831-4852df5c1c43 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] HTTP exception thrown: Image not found. Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f2d2abe6-865f-4dc3-8831-4852df5c1c43 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Request method failure captured: Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/images/9cfc20d4-3337-44f0-b607-be3bb8a94925/metadata HTTP/1.1 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 57 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-MPIPUpU1AswEDpQPxP4wG5k8T_299o9aup3ap1PPK67rqnssvrkQitJLEU0Aq_huIrzyzGX3tsJVuSyZshC9wtbwf5r0Jc6r_KywCvB18wYo24sXZGEuZavHx0h4wN60y3Hu_1kzClzXynDilqUHVIPHvcOm3UdfQ1wooJKS5ml4 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_9b2c1f9e69b64705adce1bfa7230e8bd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/9b2c1f9e69b64705adce1bfa7230e8bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/9b2c1f9e69b64705adce1bfa7230e8bd"}]}] Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 9b2c1f9e69b64705adce1bfa7230e8bd Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 90cf62e411444153b2f238fb2d2c31be Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2071293226-project Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'image_id': '9cfc20d4-3337-44f0-b607-be3bb8a94925', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9cfc20d4-3337-44f0-b607-be3bb8a94925 Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:47:25.428465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9cfc20d4-3337-44f0-b607-be3bb8a94925 could not be found. Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f2d2abe6-865f-4dc3-8831-4852df5c1c43 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:25.432809 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f2d2abe6-865f-4dc3-8831-4852df5c1c43 tempest-ImagesMetadataNegativeTestJSON-2071293226 tempest-ImagesMetadataNegativeTestJSON-2071293226-project] 10.222.0.83 "POST /compute/v2.1/images/9cfc20d4-3337-44f0-b607-be3bb8a94925/metadata" status: 404 len: 62 microversion: 2.1 time: 0.110388 Aug 29 15:47:25.437486 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1291/2597] 10.222.0.83 () {60 vars in 1281 bytes} [Mon Aug 29 15:47:25 2022] POST /compute/v2.1/images/9cfc20d4-3337-44f0-b607-be3bb8a94925/metadata => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:47:25.501427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.508984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:25.543461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.543976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.551762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.552798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.555957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.556580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.689978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:25.707991 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb3b02c0-14e4-432f-982c-336c395bab85 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1273 microversion: 2.1 time: 0.269204 Aug 29 15:47:25.710853 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1292/2598] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1273 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:25.725506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:25.726411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:25.737329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:25.739777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.744745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.745436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.747285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.747991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.748636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:25.877892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:25.901892 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb67a7a6-9517-4946-9196-f97e9b360951 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1501 microversion: 2.1 time: 0.917744 Aug 29 15:47:25.905403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1307/2599] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:24 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1501 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:25.939940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-66b251a6-e2fa-4636-9158-6877664e1fe5 req-4e01f0d0-2825-4823-8f32-a89a77d7e2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3ea860-8924-4b41-a76a-5f15ce543ba4", "name": "network-vif-deleted", "tag": "ac54ca12-72b9-4ec9-b799-8738e3c401d3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:25.972308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66b251a6-e2fa-4636-9158-6877664e1fe5 req-4e01f0d0-2825-4823-8f32-a89a77d7e2f2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:25.984983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66b251a6-e2fa-4636-9158-6877664e1fe5 req-4e01f0d0-2825-4823-8f32-a89a77d7e2f2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:25.985436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66b251a6-e2fa-4636-9158-6877664e1fe5 req-4e01f0d0-2825-4823-8f32-a89a77d7e2f2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.038547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-66b251a6-e2fa-4636-9158-6877664e1fe5 req-4e01f0d0-2825-4823-8f32-a89a77d7e2f2 service nova] Creating event network-vif-deleted:ac54ca12-72b9-4ec9-b799-8738e3c401d3 for instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 on n-h2-836830-13 Aug 29 15:47:26.050603 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-66b251a6-e2fa-4636-9158-6877664e1fe5 req-4e01f0d0-2825-4823-8f32-a89a77d7e2f2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142171 Aug 29 15:47:26.052847 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1308/2600] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:26.075597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:26.077827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:26.116220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.116963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.119263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.122095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.122986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.125418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.479281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:26.489401 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2debf47-e75c-4b9c-ae2b-90e152843f38 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1271 microversion: 2.1 time: 0.434669 Aug 29 15:47:26.495485 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1309/2601] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:26 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1271 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:26.736629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:26.737416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:26.750545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.752149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.753783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:26.758179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:26.762808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:26.765889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.155292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.176238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.177969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.179004 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3c73e665-b207-4a68-9bdd-78660a99d8db tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 1.466873 Aug 29 15:47:27.179680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1293/2602] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:25 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:27.188680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:27.189625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:27.197069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.198023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.200059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.201892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.202561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.203198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.571207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:27.585627 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-85d97e61-e02c-4975-95b5-ffd0ac00e711 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.851764 Aug 29 15:47:27.588458 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1310/2603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:26 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:27.604139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:27.607171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:27.631783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.632807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.633420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:27.637180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:27.637726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:27.638324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.009576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7058c725d25749af95e6a5fc806e27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25ad3634e624e9394ac4e588d773383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.021836 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3cb84662-e1b0-466f-a629-5d631d7f2a0a tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 200 len: 1501 microversion: 2.1 time: 0.840573 Aug 29 15:47:28.054188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1294/2604] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:27 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 1501 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:28.071774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:28.085969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a74db8a-d08b-47f3-b79e-a873a238491e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1271 microversion: 2.1 time: 0.496037 Aug 29 15:47:28.092138 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1311/2605] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:27 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1271 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:28.209415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:28.211491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:28.239736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.241420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.244930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.245933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.249462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.250129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.607769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:28.608381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:28.628357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.628959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.633059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:28.634134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:28.640220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:28.643871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.142846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:29.161291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:29.163464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:29.165453 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-70652627-3c4e-495f-bce5-3d76c6fa1ed6 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.963310 Aug 29 15:47:29.168572 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1295/2606] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:28 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:29.177000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.178332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] [instance: bf3ea860-8924-4b41-a76a-5f15ce543ba4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.188029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.188784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.190330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.191265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.192381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.192980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.219605 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] HTTP exception thrown: Instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 could not be found. Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Request method failure captured: Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 HTTP/1.1 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN8v7RIUSq41UWSNxQdM5BLno_Nus26iBTF-CuDI4RvaNUI75KK_xeC5VAErx_fhhS6cHo5017rnkX4pmBb4kaaEE8ONOwMxI3ubFKIW4dJ9JIDWEhNfhMsKh4xTBO8ZkzXuU2uO991k5DnksNIS3PhAlda-8zlFAa8KPbdQtg0II9M Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a25ad3634e624e9394ac4e588d773383", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a25ad3634e624e9394ac4e588d773383"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a25ad3634e624e9394ac4e588d773383"}]}] Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a25ad3634e624e9394ac4e588d773383 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 7058c725d25749af95e6a5fc806e27ef Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 could not be found. Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bf3ea860-8924-4b41-a76a-5f15ce543ba4'} Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 could not be found. Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 could not be found. Aug 29 15:47:29.222552 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 could not be found. Aug 29 15:47:29.226735 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:29.235644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] Returning 404 to user: Instance bf3ea860-8924-4b41-a76a-5f15ce543ba4 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:29.237277 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8dbac9b-ff08-4bf5-9f2f-a736438f5961 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451 tempest-FloatingIPsAssociationNegativeTestJSON-1390996451-project] 10.222.0.83 "GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4" status: 404 len: 111 microversion: 2.1 time: 0.066795 Aug 29 15:47:29.239058 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1296/2607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/bf3ea860-8924-4b41-a76a-5f15ce543ba4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:29.248316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:29.250170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:29.261303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.262477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.263127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.263995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:29.264601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:29.265329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:29.400166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:29.419104 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e5bd254-9030-4697-86e0-3da085fb4b65 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.814599 Aug 29 15:47:29.420510 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1312/2608] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:28 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:29.436201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:29.444606 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78d668c9-9a03-4bc9-a26e-8a2db1cfd0c1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1277 microversion: 2.1 time: 0.204152 Aug 29 15:47:29.445827 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1297/2609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:29 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:30.195584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.196964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:30.205958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:30.225153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.226182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.226832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.229366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.230758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.231993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.309225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:30.444048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:30.444836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:30.459772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.460715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.461453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:30.462396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:30.463154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:30.464137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.252964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.261850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.263521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.264689 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-517baf3c-dbd9-4208-906c-28598543d47b tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 1.078234 Aug 29 15:47:31.275407 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1313/2610] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:30 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:31.280634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:31.286295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:31.296445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.307966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.309222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.310146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:31.310791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:31.311417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:31.769245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:31.835596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:31.897159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:31.934219 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60a94067-0b28-46d2-80d0-d07eacf8b5bb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.657497 Aug 29 15:47:31.937490 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1314/2611] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:31 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:32.162804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.172668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=82,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=14,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:32.200670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c286b931-9c0b-48ae-9469-ad22465a369b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 1.762839 Aug 29 15:47:32.202657 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1298/2612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:30 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:32.296333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:32.297726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:32.314510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.315013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.315479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.316179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.316635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.317062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.424588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-415601b1-4983-4cfa-8e5f-b529cd7b8111 req-8a592033-5183-4172-a03f-67407e01c60b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00613584-4178-4f30-acdb-ee7d93bf4bd3", "tag": "bc967f67-9062-4cc7-b2f3-4f005cd1a44a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:32.443337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-415601b1-4983-4cfa-8e5f-b529cd7b8111 req-8a592033-5183-4172-a03f-67407e01c60b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.444054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-415601b1-4983-4cfa-8e5f-b529cd7b8111 req-8a592033-5183-4172-a03f-67407e01c60b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.444734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-415601b1-4983-4cfa-8e5f-b529cd7b8111 req-8a592033-5183-4172-a03f-67407e01c60b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.458734 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-415601b1-4983-4cfa-8e5f-b529cd7b8111 req-8a592033-5183-4172-a03f-67407e01c60b service nova] Creating event network-changed:bc967f67-9062-4cc7-b2f3-4f005cd1a44a for instance 00613584-4178-4f30-acdb-ee7d93bf4bd3 on n-h1-836830-13 Aug 29 15:47:32.465892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-415601b1-4983-4cfa-8e5f-b529cd7b8111 req-8a592033-5183-4172-a03f-67407e01c60b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044416 Aug 29 15:47:32.467291 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1299/2613] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:32.748542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.757526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.759525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:32.760903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ba53544-a8b4-4cdd-9640-656ca25a225e tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.475033 Aug 29 15:47:32.775868 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1315/2614] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:32 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:32.829181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1b555c6d-a79b-416c-a34e-036df6036220 req-7553a326-582e-4699-bd31-995fd4f3af47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2847ea65-8be6-4458-9d02-aab8b85011b2", "tag": "6766b945-4112-49a8-8486-809660723e2f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:32.851504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1b555c6d-a79b-416c-a34e-036df6036220 req-7553a326-582e-4699-bd31-995fd4f3af47 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.856063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1b555c6d-a79b-416c-a34e-036df6036220 req-7553a326-582e-4699-bd31-995fd4f3af47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.857062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1b555c6d-a79b-416c-a34e-036df6036220 req-7553a326-582e-4699-bd31-995fd4f3af47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.877626 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1b555c6d-a79b-416c-a34e-036df6036220 req-7553a326-582e-4699-bd31-995fd4f3af47 service nova] Creating event network-changed:6766b945-4112-49a8-8486-809660723e2f for instance 2847ea65-8be6-4458-9d02-aab8b85011b2 on n-h1-836830-13 Aug 29 15:47:32.883888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1b555c6d-a79b-416c-a34e-036df6036220 req-7553a326-582e-4699-bd31-995fd4f3af47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061447 Aug 29 15:47:32.885835 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1300/2615] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:32.958021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:32.959622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:32.972218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.973454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.974362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:32.975294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:32.975935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:32.976540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.223376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.227749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.237215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:33.239978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.242900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.244391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.245591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.247316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.248718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.354879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:33.428530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:33.439223 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-13c4ba44-2a57-4a25-a7eb-6fe19fb5df61 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.485465 Aug 29 15:47:33.451786 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1316/2616] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:32 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:33.459445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ea0484c8-bfb0-41e1-b193-3bee807e87c1 req-a91c1970-10a6-42ba-8429-84bb51db48f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c09e1cf-9be0-4dac-ba57-91da4a620bbc", "name": "network-vif-plugged", "status": "completed", "tag": "64780ad7-4410-40e0-ba19-a3babe5b1ffe"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:33.488723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ea0484c8-bfb0-41e1-b193-3bee807e87c1 req-a91c1970-10a6-42ba-8429-84bb51db48f3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.489635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ea0484c8-bfb0-41e1-b193-3bee807e87c1 req-a91c1970-10a6-42ba-8429-84bb51db48f3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.490557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ea0484c8-bfb0-41e1-b193-3bee807e87c1 req-a91c1970-10a6-42ba-8429-84bb51db48f3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.559838 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ea0484c8-bfb0-41e1-b193-3bee807e87c1 req-a91c1970-10a6-42ba-8429-84bb51db48f3 service nova] Creating event network-vif-plugged:64780ad7-4410-40e0-ba19-a3babe5b1ffe for instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc on n-h2-836830-13 Aug 29 15:47:33.571716 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ea0484c8-bfb0-41e1-b193-3bee807e87c1 req-a91c1970-10a6-42ba-8429-84bb51db48f3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117640 Aug 29 15:47:33.572911 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1317/2617] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:33.796520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:33.798323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:33.805614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.807202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.807925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:33.809052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:33.809817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:33.810451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.080612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.089148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.091536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.092855 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c656a030-89ab-4c17-849e-0dba6b673d76 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.310613 Aug 29 15:47:34.093413 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1318/2618] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:34.197109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:34.212920 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc91dfef-04e0-4566-9263-2e12235ba72e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.993104 Aug 29 15:47:34.224535 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1301/2619] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:33 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:34.471570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:34.473754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:34.499537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.501518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.502250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-115fee31-6d66-49d2-b326-833ddad6a501 req-572588e1-ac7b-40bd-aae1-ea5c91b0ae20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ce36de-706f-4255-bd0c-429d6c2f5bdc", "tag": "119ba675-9625-4083-83fa-b5913246a089"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:34.507718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.512444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.513095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.515184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.531201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-115fee31-6d66-49d2-b326-833ddad6a501 req-572588e1-ac7b-40bd-aae1-ea5c91b0ae20 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:34.531728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-115fee31-6d66-49d2-b326-833ddad6a501 req-572588e1-ac7b-40bd-aae1-ea5c91b0ae20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:34.533266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-115fee31-6d66-49d2-b326-833ddad6a501 req-572588e1-ac7b-40bd-aae1-ea5c91b0ae20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:34.567017 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-115fee31-6d66-49d2-b326-833ddad6a501 req-572588e1-ac7b-40bd-aae1-ea5c91b0ae20 service nova] Creating event network-changed:119ba675-9625-4083-83fa-b5913246a089 for instance 54ce36de-706f-4255-bd0c-429d6c2f5bdc on n-h2-836830-13 Aug 29 15:47:34.580700 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-115fee31-6d66-49d2-b326-833ddad6a501 req-572588e1-ac7b-40bd-aae1-ea5c91b0ae20 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083140 Aug 29 15:47:34.582244 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1302/2620] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:35.036270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-583ffb98-7a3b-45d8-b76b-3e96fd86888f tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32ee8ee4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1660168793", "description": "tempest-description-303207163"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:35.140274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:35.148343 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f2a5f37f-1327-473f-8fcf-2134d3c0bfae tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.682156 Aug 29 15:47:35.148787 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1319/2621] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:34 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:35.162116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:35.167118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:35.189578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.190416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.191155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.192434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.193225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.194195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.852529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-583ffb98-7a3b-45d8-b76b-3e96fd86888f tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.074805 Aug 29 15:47:35.862323 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1303/2622] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:47:34 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:35.867932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:35.868706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:35.887063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.889957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.890451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:35.892532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:35.895154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:35.895829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.020856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:36.094865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:36.099916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:36.114267 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e5e71f7-b8c4-469a-90f5-66cca06bca60 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.955652 Aug 29 15:47:36.115569 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1320/2623] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:35 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:36.141558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-61130f97-218b-4782-b4c1-b5edb24ea081 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32ee4f8d30>, body: {"security_group_rule": {"parent_group_id": "cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:36.612371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:36.627586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9937c72-895d-4ae1-8248-14b7f1aa2f8d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.758550 Aug 29 15:47:36.628250 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1304/2624] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:35 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:36.633103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:36.644017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:36.650762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.651474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.652117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.653676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:36.659134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:36.660081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:36.901992 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-61130f97-218b-4782-b4c1-b5edb24ea081 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.782933 Aug 29 15:47:36.903017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1321/2625] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:36.914510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-419d4d6e-b1b3-4f6c-8462-313ce91540a6 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32ee99d310>, body: {"security_group_rule": {"parent_group_id": "cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:37.079481 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-419d4d6e-b1b3-4f6c-8462-313ce91540a6 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: This rule already exists in group cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-419d4d6e-b1b3-4f6c-8462-313ce91540a6 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 138 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: {"security_group_rule": {"parent_group_id": "cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: exception: This rule already exists in group cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95 Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:37.081862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:37.085921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:37.085921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:37.085921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95 Aug 29 15:47:37.085921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:37.085921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-419d4d6e-b1b3-4f6c-8462-313ce91540a6 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 400 to user: This rule already exists in group cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:37.085921 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-419d4d6e-b1b3-4f6c-8462-313ce91540a6 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.174742 Aug 29 15:47:37.091807 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1322/2626] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:36 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:37.108435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd3f97e2-b15e-4861-b3bf-4a55030b560d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Calling method '.version_select at 0x7f32f286b8b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.541549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:37.571803 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b4c69611-b82b-4e6d-9ac3-9d39b844990d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.942175 Aug 29 15:47:37.572454 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1305/2627] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:36 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:37.592377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:37.592627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:37.631191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.631700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.632137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:37.632852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:37.633298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:37.633718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.065215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd3f97e2-b15e-4861-b3bf-4a55030b560d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-group-rules/c0ad310c-e86c-4b16-a0c7-a941a162ccef" status: 202 len: 0 microversion: 2.1 time: 0.968961 Aug 29 15:47:38.067583 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1323/2628] 10.222.0.83 () {58 vars in 1287 bytes} [Mon Aug 29 15:47:37 2022] DELETE /compute/v2.1/os-security-group-rules/c0ad310c-e86c-4b16-a0c7-a941a162ccef => generated 0 bytes in 972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:47:38.073017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.073553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.088701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.091674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.093568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.095661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.097824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.099709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.518281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.527978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.533080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.536764 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a50bb314-8d51-4cb7-97a8-a0b91789a951 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1359 microversion: 2.21 time: 0.949869 Aug 29 15:47:38.541542 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1306/2629] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:37 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1359 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:38.549750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2d7f833-bc49-471f-9586-50de1e0a09b0 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32edc1d9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1144592990", "description": "tempest-description-1530445063"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:38.651840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:38.665535 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73848160-3987-4a86-8618-3525df63c08d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.596773 Aug 29 15:47:38.666370 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1324/2630] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:38.688673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:38.690605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:38.708166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.709317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.709905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:38.710965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:38.711600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:38.712631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.302772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:39.315964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-249387b8-8300-4e38-9e00-4685f9a5cd6c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.648263 Aug 29 15:47:39.321308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1325/2631] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:38 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:39.565366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:39.565959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:39.584058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.584638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.585115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.586977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.592999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.593710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.839336 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2d7f833-bc49-471f-9586-50de1e0a09b0 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.295474 Aug 29 15:47:39.841037 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1307/2632] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:47:38 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:39.850982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:39.852256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:39.884526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.887603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.888237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:39.894441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:39.899608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:39.900266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.297827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.313678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.317244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.322365 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8fc06876-7b1a-44be-806e-ffbeae7f7d46 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1552 microversion: 2.21 time: 0.757246 Aug 29 15:47:40.323142 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1326/2633] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:39 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1552 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:47:40.334525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04ce9f34-4c63-43f0-bfe2-d0c40bd41f62 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32edab85e0>, body: {"security_group_rule": {"parent_group_id": "d4b35982-7f5f-46fa-b5d5-7aa8c73d1486", "ip_protocol": "tcp", "from_port": 2052199250, "to_port": 22}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:40.469458 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-04ce9f34-4c63-43f0-bfe2-d0c40bd41f62 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: Invalid port range 2052199250:22. Former value cannot be greater than the later Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04ce9f34-4c63-43f0-bfe2-d0c40bd41f62 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 146 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: {"security_group_rule": {"parent_group_id": "d4b35982-7f5f-46fa-b5d5-7aa8c73d1486", "ip_protocol": "tcp", "from_port": 2052199250, "to_port": 22}} Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid port range 2052199250:22. Former value cannot be greater than the later Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd4b35982-7f5f-46fa-b5d5-7aa8c73d1486', 'ip_protocol': 'tcp', 'from_port': 2052199250, 'to_port': 22}}} Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2052199250:22. Former value cannot be greater than the later Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2052199250:22. Former value cannot be greater than the later Aug 29 15:47:40.470995 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2052199250:22. Former value cannot be greater than the later Aug 29 15:47:40.474994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:40.476813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04ce9f34-4c63-43f0-bfe2-d0c40bd41f62 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 400 to user: Invalid port range 2052199250:22. Former value cannot be greater than the later {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:40.478295 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04ce9f34-4c63-43f0-bfe2-d0c40bd41f62 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.154038 Aug 29 15:47:40.478862 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1327/2634] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:40 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:40.490919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-25f9007a-1b17-433e-9692-fdfc5dfa5352 req-89031cbf-40d3-49ca-8a2b-b81ec087e738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00613584-4178-4f30-acdb-ee7d93bf4bd3", "name": "network-vif-plugged", "status": "completed", "tag": "bc967f67-9062-4cc7-b2f3-4f005cd1a44a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:40.516029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-25f9007a-1b17-433e-9692-fdfc5dfa5352 req-89031cbf-40d3-49ca-8a2b-b81ec087e738 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.516756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-25f9007a-1b17-433e-9692-fdfc5dfa5352 req-89031cbf-40d3-49ca-8a2b-b81ec087e738 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.518283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-25f9007a-1b17-433e-9692-fdfc5dfa5352 req-89031cbf-40d3-49ca-8a2b-b81ec087e738 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.550889 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-25f9007a-1b17-433e-9692-fdfc5dfa5352 req-89031cbf-40d3-49ca-8a2b-b81ec087e738 service nova] Creating event network-vif-plugged:bc967f67-9062-4cc7-b2f3-4f005cd1a44a for instance 00613584-4178-4f30-acdb-ee7d93bf4bd3 on n-h1-836830-13 Aug 29 15:47:40.559713 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-25f9007a-1b17-433e-9692-fdfc5dfa5352 req-89031cbf-40d3-49ca-8a2b-b81ec087e738 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078547 Aug 29 15:47:40.560924 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1328/2635] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:40.568907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:40.577104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:40.591828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.595196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.595945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.597166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.600432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.601122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.729459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:40.753146 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47ad6c76-9a6f-4c38-b194-fdaa1fa7601e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.910227 Aug 29 15:47:40.754269 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1308/2636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:39 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:40.760476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:40.761223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:40.768298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.771896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.772552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.773816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:40.774424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:40.776266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:40.900371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:41.106202 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e330bed-bbd5-45f9-9e19-ebd51e062e27 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 204 len: 0 microversion: 2.21 time: 0.347517 Aug 29 15:47:41.109390 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1309/2637] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:47:40 2022] DELETE /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:47:41.123847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cc7ad5b-074f-4283-9d5c-dac3490d3d9d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32edc1d5e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1345515085", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:41.128244 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-8cc7ad5b-074f-4283-9d5c-dac3490d3d9d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: Security group id should be uuid Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cc7ad5b-074f-4283-9d5c-dac3490d3d9d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 131 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1345515085", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: exception: Security group id should be uuid Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1345515085', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:41.132767 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:41.136315 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 29 15:47:41.136315 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:41.140627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cc7ad5b-074f-4283-9d5c-dac3490d3d9d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 400 to user: Security group id should be uuid {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:41.141762 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cc7ad5b-074f-4283-9d5c-dac3490d3d9d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.030832 Aug 29 15:47:41.146181 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1310/2638] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:41 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:41.160000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:41.161050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:41.175672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.184532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.185102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.186034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.186566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.189320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.292687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.312303 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f052813d-26a9-424d-8437-24df3390261e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.749956 Aug 29 15:47:41.312939 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1329/2639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:40 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:41.317917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b53aebda-7554-4674-ba13-d825e69bb6e7 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32edab8f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1078640868", "description": "tempest-description-400584175"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:41.525915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.541632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.548688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:41.550867 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62d971e3-f1d6-4af3-a80a-97e48b1ba49c tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1558 microversion: 2.21 time: 0.402619 Aug 29 15:47:41.553680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1311/2640] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:41 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1558 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:41.774859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:41.775898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:41.783826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.785293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.786160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.787201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:41.787913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:41.788516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:41.811635 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b53aebda-7554-4674-ba13-d825e69bb6e7 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.497279 Aug 29 15:47:41.813080 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1330/2641] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:47:41 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:41.827694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9812f3c0-8274-4eaf-b24b-7f8008295e9f tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32edad6ca0>, body: {"security_group_rule": {"parent_group_id": "e5ddcecd-2d83-4ddd-8f4a-ada448468f58", "ip_protocol": "tempest-999-1282544467", "from_port": 22, "to_port": 22}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:42.001496 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-9812f3c0-8274-4eaf-b24b-7f8008295e9f tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: Invalid IP protocol tempest-999-1282544467. Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9812f3c0-8274-4eaf-b24b-7f8008295e9f tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 157 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: {"security_group_rule": {"parent_group_id": "e5ddcecd-2d83-4ddd-8f4a-ada448468f58", "ip_protocol": "tempest-999-1282544467", "from_port": 22, "to_port": 22}} Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid IP protocol tempest-999-1282544467. Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e5ddcecd-2d83-4ddd-8f4a-ada448468f58', 'ip_protocol': 'tempest-999-1282544467', 'from_port': 22, 'to_port': 22}}} Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1282544467. Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1282544467. Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.003472 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1282544467. Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9812f3c0-8274-4eaf-b24b-7f8008295e9f tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 400 to user: Invalid IP protocol tempest-999-1282544467. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9812f3c0-8274-4eaf-b24b-7f8008295e9f tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.183293 Aug 29 15:47:42.008026 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1331/2642] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:41 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:47:42.017446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0822d367-8ab4-491e-b284-bb54fcec9597 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32ee99d310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1927197093", "description": "tempest-description-1101356278"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:42.182867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.202721 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e4366c6-e894-45fc-bdcb-49ddb3daf237 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.432258 Aug 29 15:47:42.209249 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1312/2643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:41 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:42.335179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.336185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:42.375060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.384930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.385427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.394870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.399720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.400483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.883719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:42.898854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed921b4a-0bed-4908-960b-d2fae4d56615 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.568636 Aug 29 15:47:42.901254 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1313/2644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:42 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:42.911842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:42.914384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:42.939881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.940713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.942095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:42.943100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:42.943772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:42.944405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.107395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0822d367-8ab4-491e-b284-bb54fcec9597 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.096574 Aug 29 15:47:43.109928 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1332/2645] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:47:42 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:43.117105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b1f47e45-451a-4d4e-983f-fcdf11cfb621 req-d1bd2dd1-0799-4efe-b1ba-83426a7a8f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ce36de-706f-4255-bd0c-429d6c2f5bdc", "name": "network-vif-plugged", "status": "completed", "tag": "119ba675-9625-4083-83fa-b5913246a089"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:43.153076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1f47e45-451a-4d4e-983f-fcdf11cfb621 req-d1bd2dd1-0799-4efe-b1ba-83426a7a8f0c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.153668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1f47e45-451a-4d4e-983f-fcdf11cfb621 req-d1bd2dd1-0799-4efe-b1ba-83426a7a8f0c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.154212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1f47e45-451a-4d4e-983f-fcdf11cfb621 req-d1bd2dd1-0799-4efe-b1ba-83426a7a8f0c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.169729 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b1f47e45-451a-4d4e-983f-fcdf11cfb621 req-d1bd2dd1-0799-4efe-b1ba-83426a7a8f0c service nova] Creating event network-vif-plugged:119ba675-9625-4083-83fa-b5913246a089 for instance 54ce36de-706f-4255-bd0c-429d6c2f5bdc on n-h2-836830-13 Aug 29 15:47:43.195243 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b1f47e45-451a-4d4e-983f-fcdf11cfb621 req-d1bd2dd1-0799-4efe-b1ba-83426a7a8f0c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083646 Aug 29 15:47:43.196437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1333/2646] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:43.202259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-36099f0b-de3d-4a64-9560-b148d2256d03 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32edab8160>, body: {"security_group_rule": {"parent_group_id": "56be61aa-950a-4e26-be8d-8d6443d8f15c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:43.396274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.407455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.409542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.411169 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15a87ab3-8ebd-4bd7-ad46-37aa9af9f986 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1558 microversion: 2.21 time: 0.508022 Aug 29 15:47:43.442886 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1314/2647] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:42 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1558 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:43.456068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:43.458014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:43.469551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.470755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.472416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.476806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.477690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.478285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.646258 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-36099f0b-de3d-4a64-9560-b148d2256d03 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-36099f0b-de3d-4a64-9560-b148d2256d03 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 138 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: {"security_group_rule": {"parent_group_id": "56be61aa-950a-4e26-be8d-8d6443d8f15c", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'security_group_rule': {'parent_group_id': '56be61aa-950a-4e26-be8d-8d6443d8f15c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:47:43.656729 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 29 15:47:43.661285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:43.664046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-36099f0b-de3d-4a64-9560-b148d2256d03 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:43.665012 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-36099f0b-de3d-4a64-9560-b148d2256d03 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.467434 Aug 29 15:47:43.666056 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1334/2648] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:43 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 469 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:43.675536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a9aca44-c7bb-45ba-aa2d-90a85bef9194 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32edc30b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1652353931", "description": "tempest-description-116734004"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:43.923976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:43.947997 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe048d6a-6a6f-49d1-a296-6dcc8797bbaa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.501518 Aug 29 15:47:43.951419 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1315/2649] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:43 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:43.957021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:43.957876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:43.964664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.965879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.966476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:43.968196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:43.968832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:43.969507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.331428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.344350 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-216578ef-24dd-4111-9590-6c6f375096ea tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1319 microversion: 2.1 time: 0.391593 Aug 29 15:47:44.345520 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1316/2650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:43 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:44.427216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-39307e67-d4f2-4ed4-b1b5-9629d487233e req-9bda43b2-7ac7-4a7d-965a-4d46ef2e1d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c09e1cf-9be0-4dac-ba57-91da4a620bbc", "name": "network-vif-deleted", "tag": "64780ad7-4410-40e0-ba19-a3babe5b1ffe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:44.452991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-39307e67-d4f2-4ed4-b1b5-9629d487233e req-9bda43b2-7ac7-4a7d-965a-4d46ef2e1d99 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.453747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-39307e67-d4f2-4ed4-b1b5-9629d487233e req-9bda43b2-7ac7-4a7d-965a-4d46ef2e1d99 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.454544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-39307e67-d4f2-4ed4-b1b5-9629d487233e req-9bda43b2-7ac7-4a7d-965a-4d46ef2e1d99 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.476769 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-39307e67-d4f2-4ed4-b1b5-9629d487233e req-9bda43b2-7ac7-4a7d-965a-4d46ef2e1d99 service nova] Creating event network-vif-deleted:64780ad7-4410-40e0-ba19-a3babe5b1ffe for instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc on n-h2-836830-13 Aug 29 15:47:44.487811 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-39307e67-d4f2-4ed4-b1b5-9629d487233e req-9bda43b2-7ac7-4a7d-965a-4d46ef2e1d99 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064045 Aug 29 15:47:44.491837 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1317/2651] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:44.508664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.509392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.520512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.521280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.523629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.524614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.525909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.526583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.598536 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a9aca44-c7bb-45ba-aa2d-90a85bef9194 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.926886 Aug 29 15:47:44.600108 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1335/2652] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 15:47:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:47:44.625481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23d7a1b7-2e00-4899-b9e1-f9231d346ebc tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32ee5e5790>, body: {"security_group_rule": {"parent_group_id": "19320f60-6143-41f2-bfad-f65246f30bb6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1169736624}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:44.652156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.669764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.676771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77747aef70040c98167ea7daddf25c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbb49e2c7b44bfc88daa86ad4a568c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:44.678266 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c7064cb2-98d6-460b-934d-d4cd014cecbf tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 200 len: 1516 microversion: 2.21 time: 0.183914 Aug 29 15:47:44.681244 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1318/2653] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:47:44.973782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:44.975532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:44.986884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.988931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.991782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:44.992733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:44.993371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:44.997948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.032452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:45.078327 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-23d7a1b7-2e00-4899-b9e1-f9231d346ebc tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: Invalid port range 22:1169736624. Valid TCP ports should be between 1-65535 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23d7a1b7-2e00-4899-b9e1-f9231d346ebc tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 146 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: {"security_group_rule": {"parent_group_id": "19320f60-6143-41f2-bfad-f65246f30bb6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1169736624}} Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid port range 22:1169736624. Valid TCP ports should be between 1-65535 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'security_group_rule': {'parent_group_id': '19320f60-6143-41f2-bfad-f65246f30bb6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1169736624}}} Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1169736624. Valid TCP ports should be between 1-65535 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1169736624. Valid TCP ports should be between 1-65535 Aug 29 15:47:45.080367 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1169736624. Valid TCP ports should be between 1-65535 Aug 29 15:47:45.084839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.087175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23d7a1b7-2e00-4899-b9e1-f9231d346ebc tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 400 to user: Invalid port range 22:1169736624. Valid TCP ports should be between 1-65535 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:45.091188 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23d7a1b7-2e00-4899-b9e1-f9231d346ebc tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.474525 Aug 29 15:47:45.099570 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1336/2654] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:44 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 488 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:47:45.119131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c24217b-6fc1-44fb-9226-f2b859c10a9c tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Action: 'create', calling method: .version_select at 0x7f32ee7f2d30>, body: {"security_group_rule": {"parent_group_id": "25cc4a96-3744-4630-8a9b-9fda788f9bc8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:45.215003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-6c24217b-6fc1-44fb-9226-f2b859c10a9c tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:47:45.216364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-6c24217b-6fc1-44fb-9226-f2b859c10a9c tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Neutron security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 not found {{(pid=129133) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 29 15:47:45.216897 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-6c24217b-6fc1-44fb-9226-f2b859c10a9c tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist Aug 29 15:47:45.216897 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-3d77a239-c03f-48ce-b86d-6a1b6df1fce9'] Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c24217b-6fc1-44fb-9226-f2b859c10a9c tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 138 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: {"security_group_rule": {"parent_group_id": "25cc4a96-3744-4630-8a9b-9fda788f9bc8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-3d77a239-c03f-48ce-b86d-6a1b6df1fce9'] Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'security_group_rule': {'parent_group_id': '25cc4a96-3744-4630-8a9b-9fda788f9bc8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:47:45.224394 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d77a239-c03f-48ce-b86d-6a1b6df1fce9'] Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d77a239-c03f-48ce-b86d-6a1b6df1fce9'] Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d77a239-c03f-48ce-b86d-6a1b6df1fce9'] Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d77a239-c03f-48ce-b86d-6a1b6df1fce9'] Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c24217b-6fc1-44fb-9226-f2b859c10a9c tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 404 to user: Security group 25cc4a96-3744-4630-8a9b-9fda788f9bc8 does not exist Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-3d77a239-c03f-48ce-b86d-6a1b6df1fce9'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c24217b-6fc1-44fb-9226-f2b859c10a9c tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.125191 Aug 29 15:47:45.228257 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1337/2655] 10.222.0.83 () {60 vars in 1195 bytes} [Mon Aug 29 15:47:45 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:45.242462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1f45040d-4ca6-406d-b909-51ef381a6762 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Calling method '.version_select at 0x7f32efd913a0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.407593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-1f45040d-4ca6-406d-b909-51ef381a6762 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:47:45.408542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.security_group_api [None req-1f45040d-4ca6-406d-b909-51ef381a6762 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Neutron security group rule 609ac962-f946-4bea-b081-529d9242e460 not found {{(pid=129133) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 29 15:47:45.409171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-1f45040d-4ca6-406d-b909-51ef381a6762 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] HTTP exception thrown: Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist Aug 29 15:47:45.409171 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-1faca0ab-4575-419e-9c80-3c626dfa504d'] Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1f45040d-4ca6-406d-b909-51ef381a6762 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Request method failure captured: Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-security-group-rules/609ac962-f946-4bea-b081-529d9242e460 HTTP/1.1 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-WCeGWsS4o5Zu1zW6iyb0_Pj6L-b32opLn7XHD_qTvPd4CBBJ2J9o5i0vTvAUPs37h22A-op_aksByn4TcsqyQun8LB2DZOLIunLOnxV0sH1EJ9adSeCPLdEChlihXh72TW53marqVYqfJ4fu5tXoa88Vm97l3OHZnng2QoO5Nn4A Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dfb01eb303394c63b10e95487f67aa5d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dfb01eb303394c63b10e95487f67aa5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dfb01eb303394c63b10e95487f67aa5d"}]}] Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dfb01eb303394c63b10e95487f67aa5d Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3b926292fcc044389a38c8de0d293722 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: exception: Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-1faca0ab-4575-419e-9c80-3c626dfa504d'] Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '609ac962-f946-4bea-b081-529d9242e460'} Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:47:45.413142 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1faca0ab-4575-419e-9c80-3c626dfa504d'] Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1faca0ab-4575-419e-9c80-3c626dfa504d'] Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1faca0ab-4575-419e-9c80-3c626dfa504d'] Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1faca0ab-4575-419e-9c80-3c626dfa504d'] Aug 29 15:47:45.416365 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:45.422671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1f45040d-4ca6-406d-b909-51ef381a6762 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Returning 404 to user: Security group rule 609ac962-f946-4bea-b081-529d9242e460 does not exist Aug 29 15:47:45.422671 n-d-836830-13 devstack@n-api.service[129133]: Neutron server returns request_ids: ['req-1faca0ab-4575-419e-9c80-3c626dfa504d'] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:45.423838 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1f45040d-4ca6-406d-b909-51ef381a6762 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-group-rules/609ac962-f946-4bea-b081-529d9242e460" status: 404 len: 199 microversion: 2.1 time: 0.190627 Aug 29 15:47:45.425020 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1338/2656] 10.222.0.83 () {58 vars in 1287 bytes} [Mon Aug 29 15:47:45 2022] DELETE /compute/v2.1/os-security-group-rules/609ac962-f946-4bea-b081-529d9242e460 => generated 199 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:47:45.434625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e0f3a3c3-4ef0-48f8-8d00-bdbacde59eb9 req-8d4ba0b0-f3da-490a-83ec-41ec39346e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2847ea65-8be6-4458-9d02-aab8b85011b2", "name": "network-vif-plugged", "status": "completed", "tag": "6766b945-4112-49a8-8486-809660723e2f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:45.459471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e0f3a3c3-4ef0-48f8-8d00-bdbacde59eb9 req-8d4ba0b0-f3da-490a-83ec-41ec39346e3d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.459957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e0f3a3c3-4ef0-48f8-8d00-bdbacde59eb9 req-8d4ba0b0-f3da-490a-83ec-41ec39346e3d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.460390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e0f3a3c3-4ef0-48f8-8d00-bdbacde59eb9 req-8d4ba0b0-f3da-490a-83ec-41ec39346e3d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.495236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:45.508541 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-68356290-307a-4416-a3d4-308abd6fe614 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.538524 Aug 29 15:47:45.509558 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1319/2657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:44 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:45.528152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:45.528837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:45.531985 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e0f3a3c3-4ef0-48f8-8d00-bdbacde59eb9 req-8d4ba0b0-f3da-490a-83ec-41ec39346e3d service nova] Creating event network-vif-plugged:6766b945-4112-49a8-8486-809660723e2f for instance 2847ea65-8be6-4458-9d02-aab8b85011b2 on n-h1-836830-13 Aug 29 15:47:45.538132 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e0f3a3c3-4ef0-48f8-8d00-bdbacde59eb9 req-8d4ba0b0-f3da-490a-83ec-41ec39346e3d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111523 Aug 29 15:47:45.543495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.547320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1339/2658] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:45.547745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.550294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.552498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:45.554845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:45.555497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:45.556153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f0bbe60-270c-4e85-b55b-37a0fbd9cc8d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Calling method '.version_select at 0x7f32ee55bca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.210391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.230087 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ca9c038-333c-407f-8388-bdfed9068ede tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 200 len: 1506 microversion: 2.1 time: 0.719462 Aug 29 15:47:46.230855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1320/2659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:45 2022] GET /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 1506 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:46.252789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.253635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.261324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.262669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.263539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.264435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.265053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.265653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.284396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] HTTP exception thrown: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Request method failure captured: Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc HTTP/1.1 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN9978_GuNB9wDx4OF1sLeeEUauS9kANlBX5TIDTRs3xwNWSwQoZAG5cxO6T12AbqZ5KMayZc8AriHs6gXN59DRB14ghikjl6MZBRaQk4LzXTcaaxGgQQ87U-IUZ1zMqlsnTFsW8fG2h2ZCW45DHO_pW0n6yje9FDnVZdq7i-T1n0J4 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 5cbb49e2c7b44bfc88daa86ad4a568c5 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5cbb49e2c7b44bfc88daa86ad4a568c5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}] Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 5cbb49e2c7b44bfc88daa86ad4a568c5 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-InstanceActionsV221TestJSON-1761599055-project Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e77747aef70040c98167ea7daddf25c6 Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-InstanceActionsV221TestJSON-1761599055-project Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '0c09e1cf-9be0-4dac-ba57-91da4a620bbc'} Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:46.286330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:46.290353 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:46.291715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Returning 404 to user: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:46.293309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e9ecf05b-1e12-4ac4-8c3b-baad54c1fc65 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 404 len: 111 microversion: 2.21 time: 0.044217 Aug 29 15:47:46.295844 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1321/2660] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:46.310268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.311093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 00613584-4178-4f30-acdb-ee7d93bf4bd3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.327462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.340160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.340934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.341828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.344233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.346708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.414585 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f0bbe60-270c-4e85-b55b-37a0fbd9cc8d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/19320f60-6143-41f2-bfad-f65246f30bb6" status: 202 len: 0 microversion: 2.1 time: 0.862586 Aug 29 15:47:46.417527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1340/2661] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:47:45 2022] DELETE /compute/v2.1/os-security-groups/19320f60-6143-41f2-bfad-f65246f30bb6 => generated 0 bytes in 866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:46.423359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '.version_select at 0x7f32ee2acee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.424062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.443789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.444293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.444741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.445457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.457405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.457890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.666569 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d5e0516-5b86-4d7e-8add-cc89049b0282 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.247340 Aug 29 15:47:46.672659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1341/2662] 10.222.0.83 () {60 vars in 1337 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc/os-instance-actions => generated 611 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:47:46.686991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2180edc6-e5d4-48a1-9feb-ad22fc1f5f5d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Calling method '.version_select at 0x7f32eff4e160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.690394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:46.706167 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-45ce0c1d-67e3-4419-8365-7c721d488a0d tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/00613584-4178-4f30-acdb-ee7d93bf4bd3" status: 200 len: 1506 microversion: 2.1 time: 0.403123 Aug 29 15:47:46.724922 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1322/2663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/00613584-4178-4f30-acdb-ee7d93bf4bd3 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:46.744777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:46.744777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:46.758371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.758917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.759394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:46.765947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:46.766708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:46.767370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.122446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:47.145135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8420cd2e-60c7-49c8-ae65-a36536815410 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1315 microversion: 2.1 time: 0.418093 Aug 29 15:47:47.153331 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1323/2664] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:46 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:47.166262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:47.167176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:47.178650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.179422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.180179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.181201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.181815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.182588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.185926 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2180edc6-e5d4-48a1-9feb-ad22fc1f5f5d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/56be61aa-950a-4e26-be8d-8d6443d8f15c" status: 202 len: 0 microversion: 2.1 time: 0.511724 Aug 29 15:47:47.186544 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1342/2665] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:47:46 2022] DELETE /compute/v2.1/os-security-groups/56be61aa-950a-4e26-be8d-8d6443d8f15c => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:47.191655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:47.192166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 00613584-4178-4f30-acdb-ee7d93bf4bd3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:47.211581 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] HTTP exception thrown: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Request method failure captured: Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc HTTP/1.1 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN9978_GuNB9wDx4OF1sLeeEUauS9kANlBX5TIDTRs3xwNWSwQoZAG5cxO6T12AbqZ5KMayZc8AriHs6gXN59DRB14ghikjl6MZBRaQk4LzXTcaaxGgQQ87U-IUZ1zMqlsnTFsW8fG2h2ZCW45DHO_pW0n6yje9FDnVZdq7i-T1n0J4 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 5cbb49e2c7b44bfc88daa86ad4a568c5 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5cbb49e2c7b44bfc88daa86ad4a568c5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}] Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 5cbb49e2c7b44bfc88daa86ad4a568c5 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-InstanceActionsV221TestJSON-1761599055-project Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e77747aef70040c98167ea7daddf25c6 Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-InstanceActionsV221TestJSON-1761599055-project Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '0c09e1cf-9be0-4dac-ba57-91da4a620bbc'} Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:47.213795 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:47.221428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:47:47.222446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.222446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.223791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.223791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:47.224198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:47.224291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:47.224595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Returning 404 to user: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:47.227642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bfe3abff-ebf2-4d8f-b9d6-b3895acc3724 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 404 len: 111 microversion: 2.21 time: 0.072868 Aug 29 15:47:47.228604 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1324/2666] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:47:47 2022] DELETE /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:47.280186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 00613584-4178-4f30-acdb-ee7d93bf4bd3] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:47.430320 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15506c98-1880-4f9c-b9fd-524781d72bd8 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "DELETE /compute/v2.1/servers/00613584-4178-4f30-acdb-ee7d93bf4bd3" status: 204 len: 0 microversion: 2.1 time: 0.242286 Aug 29 15:47:47.435919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1343/2667] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:47 2022] DELETE /compute/v2.1/servers/00613584-4178-4f30-acdb-ee7d93bf4bd3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:47.444730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc5888ae-748c-429d-81f9-47c715451508 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Calling method '.version_select at 0x7f32eda47160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:47.568842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1581791142", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "5c5d881c-0bfc-43c0-bfab-44566705c02e"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:47.719643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] validate_networks() for [('5c5d881c-0bfc-43c0-bfab-44566705c02e', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:48.013242 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc5888ae-748c-429d-81f9-47c715451508 tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/e5ddcecd-2d83-4ddd-8f4a-ada448468f58" status: 202 len: 0 microversion: 2.1 time: 0.577368 Aug 29 15:47:48.013819 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1344/2668] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:47:47 2022] DELETE /compute/v2.1/os-security-groups/e5ddcecd-2d83-4ddd-8f4a-ada448468f58 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:48.019084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.020042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] [instance: 0c09e1cf-9be0-4dac-ba57-91da4a620bbc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:48.039926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.040637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.041238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.042153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.043408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.044009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.066396 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] HTTP exception thrown: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Request method failure captured: Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc HTTP/1.1 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN9978_GuNB9wDx4OF1sLeeEUauS9kANlBX5TIDTRs3xwNWSwQoZAG5cxO6T12AbqZ5KMayZc8AriHs6gXN59DRB14ghikjl6MZBRaQk4LzXTcaaxGgQQ87U-IUZ1zMqlsnTFsW8fG2h2ZCW45DHO_pW0n6yje9FDnVZdq7i-T1n0J4 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.21 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 5cbb49e2c7b44bfc88daa86ad4a568c5 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5cbb49e2c7b44bfc88daa86ad4a568c5", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5cbb49e2c7b44bfc88daa86ad4a568c5"}]}] Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 5cbb49e2c7b44bfc88daa86ad4a568c5 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1761599055 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-InstanceActionsV221TestJSON-1761599055-project Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e77747aef70040c98167ea7daddf25c6 Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-InstanceActionsV221TestJSON-1761599055-project Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '0c09e1cf-9be0-4dac-ba57-91da4a620bbc'} Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:48.068410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. Aug 29 15:47:48.072410 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:47:48.075233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] Returning 404 to user: Instance 0c09e1cf-9be0-4dac-ba57-91da4a620bbc could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:47:48.076288 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7eb838d-1764-4b18-868a-d389a828feb7 tempest-InstanceActionsV221TestJSON-1761599055 tempest-InstanceActionsV221TestJSON-1761599055-project] 10.222.0.83 "GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc" status: 404 len: 111 microversion: 2.21 time: 0.061383 Aug 29 15:47:48.085041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1345/2669] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:47:48 2022] GET /compute/v2.1/servers/0c09e1cf-9be0-4dac-ba57-91da4a620bbc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:47:48.090946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.091820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:48.100282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.101025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.101634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.103271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.104399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.105209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.165212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 54ce36de-706f-4255-bd0c-429d6c2f5bdc] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:47:48.173275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:48.381734 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-748318b2-1930-4a7e-8c93-8aca701e0295 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "DELETE /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc" status: 204 len: 0 microversion: 2.1 time: 0.294823 Aug 29 15:47:48.382819 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1346/2670] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:47:48 2022] DELETE /compute/v2.1/servers/54ce36de-706f-4255-bd0c-429d6c2f5bdc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:47:48.395444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-198b96ac-134e-47f8-969e-777164ccb8ad tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Calling method '.version_select at 0x7f32ee2bf550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.938122 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-198b96ac-134e-47f8-969e-777164ccb8ad tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/d4b35982-7f5f-46fa-b5d5-7aa8c73d1486" status: 202 len: 0 microversion: 2.1 time: 0.553793 Aug 29 15:47:48.943325 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1347/2671] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:47:48 2022] DELETE /compute/v2.1/os-security-groups/d4b35982-7f5f-46fa-b5d5-7aa8c73d1486 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:48.951904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:48.952795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:48.976097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.976713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.977413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:48.979156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:48.983565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:48.986077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.146348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:49.147133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:49.147522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:49.147933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:49.148352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:49.170064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.170559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.171005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.171758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:49.172216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:49.172645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:49.207591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for project 062ee746b4614e629a9d853a6d84a368. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:49.215878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for user 215e000f15f44b41aa38a41a941c16da and project 062ee746b4614e629a9d853a6d84a368. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:49.263356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:49.269455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:49.349211 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-87122675-e63c-4f43-8e07-91090ef107be tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.119215 Aug 29 15:47:49.350533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1325/2672] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:47:49.357570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-60363620", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b1c5c2dc-a8ed-42b9-8ea6-87c597165b4a"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:49.468162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] validate_networks() for [('b1c5c2dc-a8ed-42b9-8ea6-87c597165b4a', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:47:50.388114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:50.407093 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a87b92f-4623-4179-876d-2f2ef8355d2c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1502 microversion: 2.1 time: 1.459975 Aug 29 15:47:50.408305 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1348/2673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:48 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1502 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:50.417026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59825fa8-2f86-4762-87d8-e640691b8c4d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] Calling method '.version_select at 0x7f32ee2bf0d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:50.717576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:47:50.718594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:47:50.719254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:47:50.719817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:47:50.720415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:47:50.750286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.750988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.751625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.753655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:50.754400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:50.754976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:50.825670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Getting quotas for project 99a31c64e992417d8862b3443fa8c105. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:47:50.835708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Getting quotas for user 085145c4942d4c889c291a99eb1d009a and project 99a31c64e992417d8862b3443fa8c105. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:47:50.852217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Going to run 2 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:47:50.854746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:50.901792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=a74ba016-abd0-4f53-9116-cd86687ec625,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:47:50.982975 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02c880eb-c73c-49dc-b01c-3eee67613464 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.629889 Aug 29 15:47:50.984325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1326/2674] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:47:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 1632 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:47:50.991527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:50.993053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:51.006372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:47:51.010349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.012637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.013380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.014391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.015129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.015768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.468839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59825fa8-2f86-4762-87d8-e640691b8c4d tempest-SecurityGroupRulesNegativeTestJSON-1761432424 tempest-SecurityGroupRulesNegativeTestJSON-1761432424-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95" status: 202 len: 0 microversion: 2.1 time: 1.059145 Aug 29 15:47:51.470010 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1349/2675] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 15:47:50 2022] DELETE /compute/v2.1/os-security-groups/cda6985c-e4a4-4bc5-ae5b-1934dc3ffc95 => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:51.476135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-499e5a5e-00b6-45e3-b015-11dd702daf4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:51.516219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-499e5a5e-00b6-45e3-b015-11dd702daf4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:51.518171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-499e5a5e-00b6-45e3-b015-11dd702daf4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:51.518827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-499e5a5e-00b6-45e3-b015-11dd702daf4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:51.584698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-499e5a5e-00b6-45e3-b015-11dd702daf4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Going to try to stop instance {{(pid=129133) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:47:51.859993 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-499e5a5e-00b6-45e3-b015-11dd702daf4e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2/action" status: 202 len: 0 microversion: 2.1 time: 0.387976 Aug 29 15:47:51.861040 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1350/2676] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:47:51 2022] POST /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:47:51.875966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:51.904228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:51.911406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Searching by: {'deleted': False, 'project_id': '99a31c64e992417d8862b3443fa8c105'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:47:52.000792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.001690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.017656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.034871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.035854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.037341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.160343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:47:52.288477 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c52a433-0b96-493c-9a37-0ae6cfd95ced tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.424799 Aug 29 15:47:52.293727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.294623 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1351/2677] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:47:51 2022] GET /compute/v2.1/servers => generated 1331 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:52.302553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b1c044c7-b995-42f1-a7da-97901190617f req-3f4c2048-41c5-4e56-86f0-a0a6aba8b003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00613584-4178-4f30-acdb-ee7d93bf4bd3", "name": "network-vif-deleted", "tag": "bc967f67-9062-4cc7-b2f3-4f005cd1a44a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:52.333349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1c044c7-b995-42f1-a7da-97901190617f req-3f4c2048-41c5-4e56-86f0-a0a6aba8b003 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.334188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1c044c7-b995-42f1-a7da-97901190617f req-3f4c2048-41c5-4e56-86f0-a0a6aba8b003 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.334848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1c044c7-b995-42f1-a7da-97901190617f req-3f4c2048-41c5-4e56-86f0-a0a6aba8b003 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.354240 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb7609e3-af7c-4aa4-8f70-caaf9375c6c9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1277 microversion: 2.1 time: 1.365832 Aug 29 15:47:52.368145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1327/2678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:50 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1277 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:52.373151 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b1c044c7-b995-42f1-a7da-97901190617f req-3f4c2048-41c5-4e56-86f0-a0a6aba8b003 service nova] Creating event network-vif-deleted:bc967f67-9062-4cc7-b2f3-4f005cd1a44a for instance 00613584-4178-4f30-acdb-ee7d93bf4bd3 on n-h1-836830-13 Aug 29 15:47:52.378755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:52.383774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:52.386810 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b1c044c7-b995-42f1-a7da-97901190617f req-3f4c2048-41c5-4e56-86f0-a0a6aba8b003 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089818 Aug 29 15:47:52.387720 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1352/2679] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:52.403346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8773bf3c-ce23-4c42-9325-c1e5d4b5a60e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:52.404284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8773bf3c-ce23-4c42-9325-c1e5d4b5a60e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:52.418503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.420643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.421101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.421841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:52.427539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:52.428083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:52.816682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8773bf3c-ce23-4c42-9325-c1e5d4b5a60e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:52.824670 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8773bf3c-ce23-4c42-9325-c1e5d4b5a60e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1216 microversion: 2.1 time: 0.434847 Aug 29 15:47:52.846953 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1353/2680] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:52 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1216 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:53.379897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:53.380519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:53.399551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.400054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.400493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.407363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.407903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.408356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.778131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.794677 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-92501961-c00b-4d94-ae54-ec5160edd811 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 1.431902 Aug 29 15:47:53.803697 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1328/2681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:52 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:53.813341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:53.831467 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-903a688e-178b-468f-93e5-1359ea0f2a32 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1283 microversion: 2.1 time: 0.454322 Aug 29 15:47:53.834542 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1354/2682] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:53 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1283 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:53.854514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:53.855276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:53.868446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.869056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.869547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:53.870257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:53.870715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:53.871181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.147362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:54.163722 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b080d0d-2654-4340-bb7a-bdd577fcb9ed tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1268 microversion: 2.1 time: 0.313499 Aug 29 15:47:54.164886 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1329/2683] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:53 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1268 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:54.608571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3195c380-aaef-4a59-a1e2-7742b4c09c2d req-53832f11-2174-49fa-b818-802e7eac9091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ce36de-706f-4255-bd0c-429d6c2f5bdc", "name": "network-vif-deleted", "tag": "119ba675-9625-4083-83fa-b5913246a089"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:54.629956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3195c380-aaef-4a59-a1e2-7742b4c09c2d req-53832f11-2174-49fa-b818-802e7eac9091 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.635528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3195c380-aaef-4a59-a1e2-7742b4c09c2d req-53832f11-2174-49fa-b818-802e7eac9091 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.637393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3195c380-aaef-4a59-a1e2-7742b4c09c2d req-53832f11-2174-49fa-b818-802e7eac9091 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.697986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3195c380-aaef-4a59-a1e2-7742b4c09c2d req-53832f11-2174-49fa-b818-802e7eac9091 service nova] Creating event network-vif-deleted:119ba675-9625-4083-83fa-b5913246a089 for instance 54ce36de-706f-4255-bd0c-429d6c2f5bdc on n-h2-836830-13 Aug 29 15:47:54.707715 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3195c380-aaef-4a59-a1e2-7742b4c09c2d req-53832f11-2174-49fa-b818-802e7eac9091 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104252 Aug 29 15:47:54.711244 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1355/2684] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:54.829294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.830506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.849370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.850059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.850754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.851660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.852340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.852989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.857217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:54.858155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:54.869859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.870363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.875757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:54.876481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:54.877134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:54.877648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.329717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.348481 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-88e55d37-6a8e-4838-9451-32d3217e97dc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.521178 Aug 29 15:47:55.350367 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1330/2685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:55.360776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:55.365373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:55.368370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.381412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:55.382751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:55.383794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.386556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:55.387637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:55.387978 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7612001a-aca8-4a41-9a63-95c4697013d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1283 microversion: 2.1 time: 0.536933 Aug 29 15:47:55.389195 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1356/2686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:54 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1283 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:55.389897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:55.493217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:55.505566 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-803e1270-a592-46bb-ae1e-fd0de11012a1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1274 microversion: 2.1 time: 0.152622 Aug 29 15:47:55.508308 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1331/2687] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:55 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:56.372014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.373356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.385487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.386438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.388520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.389497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.390172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.404868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.422349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.423763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.448817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.450224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.455621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.459833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.469108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.469896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.881156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:56.894728 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef4f6c93-5c69-4fbe-ac1b-ef1f7d2d96a8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.484126 Aug 29 15:47:56.895372 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1332/2688] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:56.913260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:56.913904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:56.926183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.926990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.927613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:56.928644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:56.929268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:56.929860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:57.093563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.104592 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96af34d6-c477-4a3f-a78b-43567a00cc77 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1274 microversion: 2.1 time: 0.205681 Aug 29 15:47:57.106373 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1333/2689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:57.615520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:57.629105 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f75da803-4887-4267-a6a5-798496ee6418 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 1.261409 Aug 29 15:47:57.641719 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1357/2690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:56 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:57.920046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:57.920668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:57.927586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.928089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.928531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:57.929242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:57.929699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:57.930128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.125679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:58.126556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:58.135578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.138887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.139623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.140542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.141157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.152480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.237353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:58.252543 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08b76b57-cc85-4a60-8f3a-a225b75a351d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.336146 Aug 29 15:47:58.254060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1334/2691] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:57 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:47:58.658302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:58.658929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:58.672607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.673213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.683769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:58.691444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:58.691969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:58.692421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.035959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:59.050557 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a29bd601-ba76-44ed-b5fe-4e9d3b979fdc tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.397265 Aug 29 15:47:59.053573 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1335/2692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:58 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:59.250733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9029e0ab-e300-4521-aec8-72045675e1d9 req-c30e5952-6ff5-4b9e-95b7-fc06f5d8dd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74ba016-abd0-4f53-9116-cd86687ec625", "tag": "a5a81870-30a7-47e0-93e6-255202bb7745"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:47:59.287103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9029e0ab-e300-4521-aec8-72045675e1d9 req-c30e5952-6ff5-4b9e-95b7-fc06f5d8dd29 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.288452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9029e0ab-e300-4521-aec8-72045675e1d9 req-c30e5952-6ff5-4b9e-95b7-fc06f5d8dd29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.293496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9029e0ab-e300-4521-aec8-72045675e1d9 req-c30e5952-6ff5-4b9e-95b7-fc06f5d8dd29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.332141 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9029e0ab-e300-4521-aec8-72045675e1d9 req-c30e5952-6ff5-4b9e-95b7-fc06f5d8dd29 service nova] Creating event network-changed:a5a81870-30a7-47e0-93e6-255202bb7745 for instance a74ba016-abd0-4f53-9116-cd86687ec625 on n-h2-836830-13 Aug 29 15:47:59.347123 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9029e0ab-e300-4521-aec8-72045675e1d9 req-c30e5952-6ff5-4b9e-95b7-fc06f5d8dd29 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124161 Aug 29 15:47:59.349863 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1336/2693] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:47:59.363700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:47:59.365247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:47:59.383459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.384885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.385917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.387609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:47:59.388662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:47:59.389643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:47:59.499737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:59.514359 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0c00fde-7733-42e1-8c64-e9710bf382e2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 1.390684 Aug 29 15:47:59.516634 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1358/2694] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:58 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:47:59.791930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:47:59.813294 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1cf30415-978f-4ac4-b554-296c2105169e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.459943 Aug 29 15:47:59.814595 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1337/2695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:47:59 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:00.081575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:00.082334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:00.100680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.101509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.102214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.105401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.106073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.107074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.309705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1499342471", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": "none"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:00.377587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:00.378323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:00.380488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:00.381172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:00.381744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:00.406450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.407064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.407827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.408697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.409481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.410172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.449063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Getting quotas for project 4914f89b57484044972fa80c6294b3bd. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:00.459391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Getting quotas for user 5bcbbc66ca5044ea8acda1b137f1d5b3 and project 4914f89b57484044972fa80c6294b3bd. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:00.481018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:00.483462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:00.540996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf5b77f3-483b-4fcc-a415-34f579a31547 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.397300 Aug 29 15:48:00.541995 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1338/2696] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:48:00.554193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19c8d044-123e-48f9-b2c6-ed3c3654e9a6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:00.554897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19c8d044-123e-48f9-b2c6-ed3c3654e9a6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:00.639066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19c8d044-123e-48f9-b2c6-ed3c3654e9a6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:00.652948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19c8d044-123e-48f9-b2c6-ed3c3654e9a6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:00.658322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19c8d044-123e-48f9-b2c6-ed3c3654e9a6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:00.660447 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19c8d044-123e-48f9-b2c6-ed3c3654e9a6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1278 microversion: 2.54 time: 0.110541 Aug 29 15:48:00.661589 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1339/2697] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:00 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:00.666516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:00.669834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:00.684456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.685142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.686358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.690360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.690920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.691477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.929035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:00.941707 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b5fa326-d712-4c6f-802f-e0c0028aa91c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.277592 Aug 29 15:48:00.952017 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1340/2698] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:00 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:00.967609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:00.968407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:00.975803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.976214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.976657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.977572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:00.977991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:00.978496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:00.983962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:01.025144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.040100 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eabd50d7-d141-4415-93bb-f2fadc75230c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.963113 Aug 29 15:48:01.040702 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1359/2699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:00 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:01.145031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.157480 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9f2efc98-48a4-452f-84ac-ecd7f471401c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.204184 Aug 29 15:48:01.159088 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1341/2700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:00 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:01.684323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:01.684846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:01.687865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:01.693286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.693773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.694202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.694891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.695364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.695785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.921320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.929714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.931196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:01.932429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf0fdef1-d5ab-4855-86e5-7c1d0689d281 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1282 microversion: 2.54 time: 0.252527 Aug 29 15:48:01.933339 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1360/2701] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:01 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:01.968390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:01.968904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:01.984228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.984736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.985177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:01.995134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:01.997136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:01.997613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.067084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:02.068475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:02.078405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.079196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.079922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.081539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.082257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.082905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.123582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:02.340953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:02.348951 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1dc42c57-d9ad-425a-a118-f5f1e03647ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.387590 Aug 29 15:48:02.364873 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1342/2702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:01 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:02.370461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-dea01b67-57cf-4756-98c3-2088594f697f req-8269ac58-471f-4a8b-bf78-7b1d3fbdf08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb84f67-110d-46c5-951f-1cd0d8960752", "tag": "9b664fb1-f709-4164-9948-6d594b28e987"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:02.381110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dea01b67-57cf-4756-98c3-2088594f697f req-8269ac58-471f-4a8b-bf78-7b1d3fbdf08c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.381890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dea01b67-57cf-4756-98c3-2088594f697f req-8269ac58-471f-4a8b-bf78-7b1d3fbdf08c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.382537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dea01b67-57cf-4756-98c3-2088594f697f req-8269ac58-471f-4a8b-bf78-7b1d3fbdf08c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.403858 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-dea01b67-57cf-4756-98c3-2088594f697f req-8269ac58-471f-4a8b-bf78-7b1d3fbdf08c service nova] Creating event network-changed:9b664fb1-f709-4164-9948-6d594b28e987 for instance bcb84f67-110d-46c5-951f-1cd0d8960752 on n-h2-836830-13 Aug 29 15:48:02.413094 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-dea01b67-57cf-4756-98c3-2088594f697f req-8269ac58-471f-4a8b-bf78-7b1d3fbdf08c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046326 Aug 29 15:48:02.414094 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1343/2703] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:02.423688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:02.424700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:02.431762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.433120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.434335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.435809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.437434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.438807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.648902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:02.719263 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ad5bcc8-5c4e-4f79-9452-7d7c0c668731 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.657169 Aug 29 15:48:02.747082 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1361/2704] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:02 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:02.967141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:02.968170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:02.974869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:02.978095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.978885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.979686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:02.981250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:02.982006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:02.982772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.086590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.098936 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-195d26d9-f9bf-4bfa-8a9c-d53f9fb60eb1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.681993 Aug 29 15:48:03.099575 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1344/2705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:02 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:03.206966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.225573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.227760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:03.229535 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-990e45d7-b584-402d-bc8e-7aa95086b8f3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1330 microversion: 2.54 time: 0.274273 Aug 29 15:48:03.252110 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1362/2706] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:02 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1330 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:03.372159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:03.372835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:03.392730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.394690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.397012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.399567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.400088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.400540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.764057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:03.764972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:03.780312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.782375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.783306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:03.786183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:03.787009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:03.787497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.061690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.105904 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4f868bb-78c8-41a1-80cb-7da6ebda7ff1 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.737487 Aug 29 15:48:04.108031 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1345/2707] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:03 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:04.128457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:04.129309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:04.142890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.143770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.144521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.145396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.146009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.146663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.439152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.448689 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae40a604-6a37-4feb-8481-c862764119d3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.332239 Aug 29 15:48:04.467268 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1346/2708] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:04 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:04.473798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:04.474421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:04.485888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.486719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.487431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.488624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.489276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.489899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.605575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.613915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.624350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.635536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aaee85f3-9fac-4573-8609-94d723d732a0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1336 microversion: 2.54 time: 0.166464 Aug 29 15:48:04.638572 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1347/2709] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:04 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1336 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:04.647147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c701d125-09c9-48cd-9a71-cf95dc4b7560 req-d12be940-e3ad-490e-88f3-dc6e39d9b5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6758da-aca1-49f4-a63e-8eaa135fdccb", "tag": "31b96c08-4370-46cf-b5f9-c1bc43e329ec"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:04.664030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c701d125-09c9-48cd-9a71-cf95dc4b7560 req-d12be940-e3ad-490e-88f3-dc6e39d9b5dd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:04.665211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c701d125-09c9-48cd-9a71-cf95dc4b7560 req-d12be940-e3ad-490e-88f3-dc6e39d9b5dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:04.666191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c701d125-09c9-48cd-9a71-cf95dc4b7560 req-d12be940-e3ad-490e-88f3-dc6e39d9b5dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:04.696792 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c701d125-09c9-48cd-9a71-cf95dc4b7560 req-d12be940-e3ad-490e-88f3-dc6e39d9b5dd service nova] Creating event network-changed:31b96c08-4370-46cf-b5f9-c1bc43e329ec for instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb on n-h1-836830-13 Aug 29 15:48:04.717079 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c701d125-09c9-48cd-9a71-cf95dc4b7560 req-d12be940-e3ad-490e-88f3-dc6e39d9b5dd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075031 Aug 29 15:48:04.719392 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1348/2710] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:04.732825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:04.742296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4193da60-193b-44a9-ba8a-678591956611 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.984654 Aug 29 15:48:04.755195 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1363/2711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:03 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:05.129165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.130934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:05.139699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.143320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.143734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.144787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.145338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.146094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.376612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.386802 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3622d71-8c16-4d5f-8a3d-75c1ff39ad5a tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.261255 Aug 29 15:48:05.387728 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1349/2712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:05.477689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.478339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:05.489821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.490316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.490748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.493194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.493677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.501327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.666829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.667577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:05.680983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.681505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.681940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.682645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.683147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.683782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.805640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.818360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.820340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.821783 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-725d9378-26ed-40ea-a4f1-9beda81fb80a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1336 microversion: 2.54 time: 0.160289 Aug 29 15:48:05.824009 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1350/2713] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:05.830361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:05.831489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:05.842259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.843551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.844970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.845910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:05.847125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:05.847822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:05.868978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:05.872672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:05.895006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5caeb9d5-62c9-4875-968b-d12e213aeb45 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.421149 Aug 29 15:48:05.898867 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1364/2714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:06.130952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:06.150883 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2468edcb-fc48-479f-8aa2-74a9afa14105 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.324457 Aug 29 15:48:06.161297 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1351/2715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:06.243841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-44514b81-dd10-4acc-9693-6611110b6aa7 req-5f8eab01-529d-4904-9f1c-a68bdefc2833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74ba016-abd0-4f53-9116-cd86687ec625", "name": "network-vif-plugged", "status": "completed", "tag": "a5a81870-30a7-47e0-93e6-255202bb7745"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:06.264061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-44514b81-dd10-4acc-9693-6611110b6aa7 req-5f8eab01-529d-4904-9f1c-a68bdefc2833 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.264585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-44514b81-dd10-4acc-9693-6611110b6aa7 req-5f8eab01-529d-4904-9f1c-a68bdefc2833 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.270259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-44514b81-dd10-4acc-9693-6611110b6aa7 req-5f8eab01-529d-4904-9f1c-a68bdefc2833 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.302845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-44514b81-dd10-4acc-9693-6611110b6aa7 req-5f8eab01-529d-4904-9f1c-a68bdefc2833 service nova] Creating event network-vif-plugged:a5a81870-30a7-47e0-93e6-255202bb7745 for instance a74ba016-abd0-4f53-9116-cd86687ec625 on n-h2-836830-13 Aug 29 15:48:06.317421 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-44514b81-dd10-4acc-9693-6611110b6aa7 req-5f8eab01-529d-4904-9f1c-a68bdefc2833 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077208 Aug 29 15:48:06.319688 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1352/2716] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:06.412010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.413017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:06.422539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.423143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.423459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.424173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.424628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.425054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.479157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-369ee98a-9e8c-42de-8c91-9cc56de5999c tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Calling method '.version_select at 0x7f32ee9849d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.611220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-369ee98a-9e8c-42de-8c91-9cc56de5999c tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] 10.222.0.83 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.623448 Aug 29 15:48:06.612371 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1365/2717] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:48:05 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:48:06.628842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-075e34ab-2adf-4a5d-ab06-a6b4052fd257 tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Action: 'create', calling method: .version_select at 0x7f32ee2bf1f0>, body: {"pool": "non_exist_pool"} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:06.811902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-075e34ab-2adf-4a5d-ab06-a6b4052fd257 tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] HTTP exception thrown: Floating IP pool not found. Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-075e34ab-2adf-4a5d-ab06-a6b4052fd257 tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Request method failure captured: Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 26 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-1rUPzgQFfYTUdkAoP-P47n417QVbGCAvABpb1XXSPWfYmARdG1jeN6hnfTXW3y3hXUzyp7ftPSmHmHnmg5fZE9L_Aa-oYLp1wzdvLfJ_OKDxMvlBog7EoUT9hCG1me8_7tXjDps8PrjJJ-mdVujuoVP8-m3KA6zwy9_2fxSePvfY Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 774de53546094c33a65521de121366e7 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1192655619 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/774de53546094c33a65521de121366e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_774de53546094c33a65521de121366e7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/774de53546094c33a65521de121366e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/774de53546094c33a65521de121366e7"}]}] Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1192655619 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 774de53546094c33a65521de121366e7 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1192655619 Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FloatingIPsNegativeTestJSON-1192655619-project Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 59d14bdc698a4695a5905f38dd21937d Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1192655619-project Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: {"pool": "non_exist_pool"} Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: exception: Floating IP pool not found. Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:06.813571 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:06.817711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 29 15:48:06.817711 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.817711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-075e34ab-2adf-4a5d-ab06-a6b4052fd257 tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Returning 404 to user: Floating IP pool not found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:06.817711 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-075e34ab-2adf-4a5d-ab06-a6b4052fd257 tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.191470 Aug 29 15:48:06.817711 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1366/2718] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 15:48:06 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:48:06.834517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1849b88-70da-41ad-a737-a4446c9bae0a tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Calling method '.version_select at 0x7f32eebf3280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.944704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG neutronclient.v2_0.client [None req-e1849b88-70da-41ad-a737-a4446c9bae0a tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 067d793e-249d-4fe2-b79b-95e9d3d3184a could not be found", "detail": ""}} {{(pid=129133) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 29 15:48:06.945331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e1849b88-70da-41ad-a737-a4446c9bae0a tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] HTTP exception thrown: Floating IP not found for ID 067d793e-249d-4fe2-b79b-95e9d3d3184a Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1849b88-70da-41ad-a737-a4446c9bae0a tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Request method failure captured: Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-floating-ips/067d793e-249d-4fe2-b79b-95e9d3d3184a HTTP/1.1 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-1rUPzgQFfYTUdkAoP-P47n417QVbGCAvABpb1XXSPWfYmARdG1jeN6hnfTXW3y3hXUzyp7ftPSmHmHnmg5fZE9L_Aa-oYLp1wzdvLfJ_OKDxMvlBog7EoUT9hCG1me8_7tXjDps8PrjJJ-mdVujuoVP8-m3KA6zwy9_2fxSePvfY Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 774de53546094c33a65521de121366e7 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1192655619 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/774de53546094c33a65521de121366e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_774de53546094c33a65521de121366e7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/774de53546094c33a65521de121366e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/774de53546094c33a65521de121366e7"}]}] Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1192655619 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 774de53546094c33a65521de121366e7 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1192655619 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-FloatingIPsNegativeTestJSON-1192655619-project Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 59d14bdc698a4695a5905f38dd21937d Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1192655619-project Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: exception: Floating IP not found for ID 067d793e-249d-4fe2-b79b-95e9d3d3184a Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '067d793e-249d-4fe2-b79b-95e9d3d3184a'} Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 067d793e-249d-4fe2-b79b-95e9d3d3184a could not be found Aug 29 15:48:06.946788 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95dcead3-4286-4dec-9aca-9df497adfd7a'] Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 067d793e-249d-4fe2-b79b-95e9d3d3184a. Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 067d793e-249d-4fe2-b79b-95e9d3d3184a Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 067d793e-249d-4fe2-b79b-95e9d3d3184a Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1849b88-70da-41ad-a737-a4446c9bae0a tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] Returning 404 to user: Floating IP not found for ID 067d793e-249d-4fe2-b79b-95e9d3d3184a {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1849b88-70da-41ad-a737-a4446c9bae0a tempest-FloatingIPsNegativeTestJSON-1192655619 tempest-FloatingIPsNegativeTestJSON-1192655619-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/067d793e-249d-4fe2-b79b-95e9d3d3184a" status: 404 len: 111 microversion: 2.1 time: 0.127241 Aug 29 15:48:06.956946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1367/2719] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:48:06 2022] DELETE /compute/v2.1/os-floating-ips/067d793e-249d-4fe2-b79b-95e9d3d3184a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:48:06.976023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:06.976672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:06.991013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.991542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.992142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:06.992871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:06.993330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:06.993754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.323128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.338317 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef8e3877-3dd8-4bfa-b99e-2057169299eb tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.933643 Aug 29 15:48:07.351841 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1353/2720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:06 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:07.358243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:07.359128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:07.365680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.366498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.367235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.368270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.371424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.372283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.478957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.489127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.492819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.497658 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ddec21a-b806-4e3f-a0f3-684fef6c4797 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1336 microversion: 2.54 time: 0.544505 Aug 29 15:48:07.513363 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1368/2721] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:06 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1336 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:07.528888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:07.531603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:07.541090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.541653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.542091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.544494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:07.544957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:07.545381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:07.745253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.755736 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-036d28bc-2c52-42bd-84d7-d74a72e6c78d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.402539 Aug 29 15:48:07.756344 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1354/2722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:07 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:07.969143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:07.980353 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d2d24350-220d-458c-bd49-00c90faba638 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.461578 Aug 29 15:48:07.984100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1369/2723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:07 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:08.366272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.367107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:08.377557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.381825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.382734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.383644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.387407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.388238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.526292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.527395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:08.534989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.535763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.536350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.537191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.537784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.538663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.634881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.645798 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-887a598a-7fd7-45b9-80d2-a5e38ce9008c tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.286897 Aug 29 15:48:08.661204 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1355/2724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:08.746938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.758503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.760697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:08.763303 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91d20542-12e5-418e-bb4c-e5fead2d8fb5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1336 microversion: 2.54 time: 0.241098 Aug 29 15:48:08.777705 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1370/2725] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1336 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:08.778391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:08.779257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:08.793802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.794312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.794761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:08.795516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:08.795992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:08.798171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.011904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:09.012488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:09.031872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.032927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.033395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.038276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.039649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.044262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.288402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.301820 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-43326a2c-6db0-4ea8-8784-b22e9d388f89 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.527120 Aug 29 15:48:09.303795 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1356/2726] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:09.540344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.553532 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-963eb5f1-66fc-4e28-9afa-f14140d4509a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.551524 Aug 29 15:48:09.556034 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1371/2727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:08 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:09.668154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:09.669353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:09.687829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.689371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.689999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.691852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.693679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.694314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.793439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:09.794204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:09.804713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.805619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.806219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.807654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:09.808375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:09.809124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:09.945046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.961701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.965089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:09.967247 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a20eba0-cc9a-4add-9fc3-480ba4fccc8c tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1336 microversion: 2.54 time: 0.179221 Aug 29 15:48:09.990896 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1372/2728] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:09 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1336 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:10.007077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.018426 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54f18317-2073-4acc-a877-392d9001bd62 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.354204 Aug 29 15:48:10.019569 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1357/2729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:09 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:10.328508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:10.330493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:10.339411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.340616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.341453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.342536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.343244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.343891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.578000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:10.579647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:10.581956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:10.593771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.599437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.600356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.601349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.602026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.602670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.674955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=20 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:10.936112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:10.947493 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-36e45b66-3e5f-4870-9895-31de554892e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.624107 Aug 29 15:48:10.949663 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1373/2730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:10 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:10.955965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-67617cdf-421b-4772-b0fb-08c8db23ccba req-2dfe73eb-6db8-423a-8a69-c5e3599e800b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb84f67-110d-46c5-951f-1cd0d8960752", "name": "network-vif-plugged", "status": "completed", "tag": "9b664fb1-f709-4164-9948-6d594b28e987"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:10.969763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-67617cdf-421b-4772-b0fb-08c8db23ccba req-2dfe73eb-6db8-423a-8a69-c5e3599e800b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:10.970510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-67617cdf-421b-4772-b0fb-08c8db23ccba req-2dfe73eb-6db8-423a-8a69-c5e3599e800b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:10.972019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-67617cdf-421b-4772-b0fb-08c8db23ccba req-2dfe73eb-6db8-423a-8a69-c5e3599e800b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:10.994608 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-67617cdf-421b-4772-b0fb-08c8db23ccba req-2dfe73eb-6db8-423a-8a69-c5e3599e800b service nova] Creating event network-vif-plugged:9b664fb1-f709-4164-9948-6d594b28e987 for instance bcb84f67-110d-46c5-951f-1cd0d8960752 on n-h2-836830-13 Aug 29 15:48:11.006803 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-67617cdf-421b-4772-b0fb-08c8db23ccba req-2dfe73eb-6db8-423a-8a69-c5e3599e800b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055519 Aug 29 15:48:11.008199 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1374/2731] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:11.021234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.022363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:11.035374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.036235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.037012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.037939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.038652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.039870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.253409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.266725 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e7b8113-0002-40e3-8c9d-e4fb8d68affb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.693731 Aug 29 15:48:11.282466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.287566 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1358/2732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:10 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:11.291258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.296501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.297131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:11.298753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.300082 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19ea3691-43f9-448e-8b27-37a28e5a3f3f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1336 microversion: 2.54 time: 0.290560 Aug 29 15:48:11.300667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1375/2733] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1336 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:11.327734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.328544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.329213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.330202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.330875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.331520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.725038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:11.732421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:11.753574 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a1717cd-a03f-4d04-8759-cdacecb8ab7e tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.464262 Aug 29 15:48:11.754780 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1359/2734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:11.970877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:11.971612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:11.991066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.991570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.992000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:11.993327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:11.993784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:11.994205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.291599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.293186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:12.303272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.303942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.304694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.305641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.306591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.307280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.718887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:12.738008 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eaf534bb-8df3-43d1-8123-aa2d0c8cf2fa tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.452171 Aug 29 15:48:12.754861 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1360/2735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:12.764234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:12.765759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:12.812907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.816664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.817586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.820836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:12.822631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:12.825820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:12.932381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:12.959621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45ad3f54-5d3f-48dd-b73b-76e730e8a4d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.991770 Aug 29 15:48:12.976543 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1376/2736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:11 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:13.018679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.025547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.048423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.049400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.050088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.051121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.051981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.052681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.145828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.159291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.165154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.168180 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5daa7f2b-b047-46f3-bbd6-91a2817fc108 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1357 microversion: 2.54 time: 0.411703 Aug 29 15:48:13.168972 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1361/2737] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1357 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:13.175534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2f022d45-4f36-476e-8e37-3d3412c4fc4f req-8b80732c-917a-476b-a496-05f05b20cc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6758da-aca1-49f4-a63e-8eaa135fdccb", "name": "network-vif-plugged", "status": "completed", "tag": "31b96c08-4370-46cf-b5f9-c1bc43e329ec"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:13.187250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2f022d45-4f36-476e-8e37-3d3412c4fc4f req-8b80732c-917a-476b-a496-05f05b20cc95 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.187994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2f022d45-4f36-476e-8e37-3d3412c4fc4f req-8b80732c-917a-476b-a496-05f05b20cc95 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.188680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2f022d45-4f36-476e-8e37-3d3412c4fc4f req-8b80732c-917a-476b-a496-05f05b20cc95 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.203766 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2f022d45-4f36-476e-8e37-3d3412c4fc4f req-8b80732c-917a-476b-a496-05f05b20cc95 service nova] Creating event network-vif-plugged:31b96c08-4370-46cf-b5f9-c1bc43e329ec for instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb on n-h1-836830-13 Aug 29 15:48:13.209954 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2f022d45-4f36-476e-8e37-3d3412c4fc4f req-8b80732c-917a-476b-a496-05f05b20cc95 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039649 Aug 29 15:48:13.216657 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1362/2738] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:13.223495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf7daaed-d7da-4c13-a357-ae8c17adf2a7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Action: 'create', calling method: .version_select at 0x7f32edbde940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-991730359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcg+9aaZJtXsYBD1wxk0Iz0R6DqK9+MGJYLLcP7iNfN/UqgkldCQiH83VUrAM/wvJFKfboOGVmoY9OxnwmmvxGGd/c5RZdiOVq0HKLZ2vSTRWtoOvACz0hJvNtiYPDqIw=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:13.244751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-bf7daaed-d7da-4c13-a357-ae8c17adf2a7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Getting quotas for project 4914f89b57484044972fa80c6294b3bd. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:13.250596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-bf7daaed-d7da-4c13-a357-ae8c17adf2a7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Getting quotas for user 5bcbbc66ca5044ea8acda1b137f1d5b3 and project 4914f89b57484044972fa80c6294b3bd. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:13.283109 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf7daaed-d7da-4c13-a357-ae8c17adf2a7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.064926 Aug 29 15:48:13.284101 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1363/2739] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 15:48:13 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 15:48:13.296582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-991730359", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:13.301784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.318864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:13.320814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.321476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.325844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.326906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.327545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.328122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.506840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:13.509156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:13.512071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:13.512631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:13.513153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:13.676688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.702738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.707166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.707857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.709448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.714211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.716035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.802510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:13.821929 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba1b0e5b-a7b2-48a0-9f5c-54f6e4115313 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.843539 Aug 29 15:48:13.822772 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1377/2740] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:12 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:13.830699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.834181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.834693 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ab2dfe2-c864-42bd-8c2b-ac60c6e15296 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "POST /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1/action" status: 202 len: 1139 microversion: 2.54 time: 0.540287 Aug 29 15:48:13.836752 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1364/2741] 10.222.0.83 () {62 vars in 1320 bytes} [Mon Aug 29 15:48:13 2022] POST /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1/action => generated 1139 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:48:13.865198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.865927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.868729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.869875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.870616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.871898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.881417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:13.884289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:13.893756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.895745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.896400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:13.898235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:13.898938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:13.909761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:14.177681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.197204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.202949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.205598 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-37006e94-a1a3-461a-b7b2-6c128bc30a9a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.347810 Aug 29 15:48:14.207101 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1365/2742] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:14.214752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.216089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:14.228494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:14.229223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:14.230278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:14.231547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:14.232119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:14.233295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:14.506077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.514592 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6ce6cee-7727-417d-971a-5a5260d82b3f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1325 microversion: 2.1 time: 0.306191 Aug 29 15:48:14.520116 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1366/2743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:14 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:14.571548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:14.580358 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2f16f0f7-e740-4838-b649-449c3bc35c15 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.755753 Aug 29 15:48:14.581045 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1378/2744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:13 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:14.845794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:14.846573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:14.863227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:14.863971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:14.864549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:14.865433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:14.866065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:14.866906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.174072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.188958 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b2cbf39a-de2f-42ea-a885-0201ad1de542 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1316 microversion: 2.1 time: 0.349031 Aug 29 15:48:15.205105 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1367/2745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:14 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:15.233373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:15.234346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:15.251292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.251983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.252566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.253407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.253991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.254663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.392451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.409132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.410586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.411835 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a60cfb1-412d-44cc-880a-d73f5d8c05fe tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.184203 Aug 29 15:48:15.427136 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1379/2746] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:15 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:15.543830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:15.546227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:15.576151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.576151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.576151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.577148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.577758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.578440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.610004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:15.610683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:15.627361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.629119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.631864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.635525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:15.637246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:15.639745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:15.968696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:15.978913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e43e2701-efce-4a99-882a-44b58f90c817 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.440984 Aug 29 15:48:15.980270 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1368/2747] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:15 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:16.003474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.004341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.025306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.025825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.026275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.027056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.027533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.027963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.343709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.359869 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cbe6b693-c52b-4f1e-8c11-a82d831978e2 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.761638 Aug 29 15:48:16.366679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1380/2748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:15 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:16.394412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.395324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.417643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.418382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.418996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.420007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.420665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.421284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.437732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.470169 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5329432a-148b-444c-bfd8-0698ab43ac0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.471912 Aug 29 15:48:16.471902 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1369/2749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:15 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:16.476922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.477768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.501208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.503506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.511470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.515772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.516791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.517439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.750693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.767348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.775554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:16.778047 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c35e08ae-6e68-44d8-8c7b-b4de93ec4235 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.304762 Aug 29 15:48:16.783857 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1370/2750] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:16 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:16.797698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bc950826-ff8e-4db6-a79e-545f22fae3e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1601481000", "metadata": {"": ""}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bc950826-ff8e-4db6-a79e-545f22fae3e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action HTTP/1.1 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 107 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1601481000", "metadata": {"": ""}}} Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bcb84f67-110d-46c5-951f-1cd0d8960752', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1601481000', 'metadata': {'': ''}}}} Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'': ''} Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:16.802581 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:16.806759 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:16.809905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bc950826-ff8e-4db6-a79e-545f22fae3e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:16.811349 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bc950826-ff8e-4db6-a79e-545f22fae3e7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action" status: 400 len: 170 microversion: 2.1 time: 0.026141 Aug 29 15:48:16.815985 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1371/2751] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Aug 29 15:48:16 2022] POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action => generated 170 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:16.822968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:16.824325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:16.832813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.833479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.834090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.835396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:16.836004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:16.836824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:16.981743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.000913 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3827eafa-e9d3-4712-baec-b09f13bcebb9 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 200 len: 1503 microversion: 2.1 time: 0.610626 Aug 29 15:48:17.003242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1381/2752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:16 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 1503 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:17.026392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:17.027862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:17.038092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.040253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.042689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.045830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.046333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.047860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.174169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.188327 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1448f01-060d-4811-8e05-9696786c0e91 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.370864 Aug 29 15:48:17.194061 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1372/2753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:16 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:17.222814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:17.224137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:17.243056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.244853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.245668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.249555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.250593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.253664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.494211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.511679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e94eb3b-0ad6-4148-8ce0-73b327e962ef tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 200 len: 1504 microversion: 2.1 time: 0.490099 Aug 29 15:48:17.513663 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1382/2754] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:17 2022] GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:17.518996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:17.519805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:17.533373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.535650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.537871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.540444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.543227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.545977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.711766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:17.728334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39a4786a-7de7-4bdd-a626-68721a4e9c0b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.508471 Aug 29 15:48:17.729245 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1373/2755] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:17 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:17.734662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:17.749199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:17.765442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.766065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.766643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.767574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:17.768146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:17.768855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:17.803238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:17.994539 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-58178b07-bb3d-4017-937b-f0923a12ca07 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 204 len: 0 microversion: 2.1 time: 0.261877 Aug 29 15:48:17.995500 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1374/2756] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:17 2022] DELETE /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:18.009834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9ec1ccc-77a8-4af9-b29d-7b442c3ad27b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1848325317", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9ec1ccc-77a8-4af9-b29d-7b442c3ad27b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action HTTP/1.1 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 619 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1848325317", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bcb84f67-110d-46c5-951f-1cd0d8960752', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1848325317', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:48:18.021012 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:48:18.024314 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:18.028940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9ec1ccc-77a8-4af9-b29d-7b442c3ad27b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:18.031600 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9ec1ccc-77a8-4af9-b29d-7b442c3ad27b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action" status: 400 len: 938 microversion: 2.1 time: 0.031017 Aug 29 15:48:18.035790 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1375/2757] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Aug 29 15:48:17 2022] POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action => generated 938 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:18.043262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.049243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.059164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.064491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.064745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.065169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.066302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.066879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.067565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.072864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:18.073085 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f3f5469-3c65-4e80-ab10-6d47b46b4e11 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.558089 Aug 29 15:48:18.078133 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1383/2758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:17 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:18.086680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.092643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.117002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.117507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.117993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.123794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.124300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.124755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.170202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:18.202982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:18.322779 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a086ebd-0fd6-461d-b865-c6900c6ee6c7 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 204 len: 0 microversion: 2.1 time: 0.243034 Aug 29 15:48:18.324841 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1384/2759] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:18 2022] DELETE /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:18.331551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.332564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.342279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.342788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.343255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.344331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.344988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.345601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.361772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.382760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.388742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.390154 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be86fb7c-e88a-48e2-b6a1-f7d2869a18ac tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.353237 Aug 29 15:48:18.390860 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1376/2760] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:18.402066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.403251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.416144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.419480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.420528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.437409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.439834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.440438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.676616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.685168 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77bf71ec-79ae-4a18-abd0-4d178a6be5b3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.358598 Aug 29 15:48:18.685968 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1385/2761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:18.737633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:18.768177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6a918042-7498-491f-b5cc-7c9abccc3ae2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 200 len: 1510 microversion: 2.1 time: 0.375927 Aug 29 15:48:18.768718 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1377/2762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:18.786928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:18.787760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:18.794520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.795275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.795907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.796614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:18.797214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:18.797780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:18.937886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1387425748", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:19.006041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.015004 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8ae9648-06f7-45bb-8f6a-d4fb4e5c1080 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.231821 Aug 29 15:48:19.015621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1378/2763] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:18 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:19.050389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:19.102307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3b2bb936-671f-4012-bd0f-dc04a3671895 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Action: 'create', calling method: .version_select at 0x7f32edbdd550>, body: {"keypair": {"name": "tempest-keypair-1784321153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfCXETmEKu+/Dzh5vdqG6vXhNYL4cDLQndi/O1+etZ9p9tPR70mO7810GyGjBB5ZWkE2hZMR4hQ0uyDinBlI7vKt2Gu03fVK07NvK1p/5CYbObW6uBN+vjbKJK4rjGVng=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:19.119573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3b2bb936-671f-4012-bd0f-dc04a3671895 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Getting quotas for project 09841e55e1b145aaae76652d19a35da6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:19.126769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3b2bb936-671f-4012-bd0f-dc04a3671895 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Getting quotas for user 023ee959a1ca446fb620544563307863 and project 09841e55e1b145aaae76652d19a35da6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:19.156125 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3b2bb936-671f-4012-bd0f-dc04a3671895 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139081 Aug 29 15:48:19.157438 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1379/2764] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:48:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:19.168560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c067a81-2c9f-4bee-8dc5-a80069066f57 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c067a81-2c9f-4bee-8dc5-a80069066f57 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action HTTP/1.1 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 285 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bcb84f67-110d-46c5-951f-1cd0d8960752', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:19.174020 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:48:19.177851 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:19.180405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c067a81-2c9f-4bee-8dc5-a80069066f57 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:19.181413 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c067a81-2c9f-4bee-8dc5-a80069066f57 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action" status: 400 len: 619 microversion: 2.1 time: 0.022825 Aug 29 15:48:19.183518 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1380/2765] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Aug 29 15:48:19 2022] POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:48:19.189667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.190744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.199412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.200294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.200887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.201772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.202964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.203631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.403315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.412810 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9ddefc06-f93d-4adb-bb38-871287dfb187 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.228085 Aug 29 15:48:19.429345 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1381/2766] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:19.438899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.440002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.446475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.447331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.447964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.449770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.450428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.451060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.469358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:19.469969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:19.470245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:19.470660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:19.471092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:19.489882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.490382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.490814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.491750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.492390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.493822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.530196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Getting quotas for project d8c72636d6db42cfb42f0c535863a4b2. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:19.536201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Getting quotas for user 1ada57c2de1f4c1f90d6f8173289bbb1 and project d8c72636d6db42cfb42f0c535863a4b2. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:19.550992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:19.553466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:19.608066 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-afa9856b-2b75-4905-b6a1-25b6895878e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920789 Aug 29 15:48:19.609510 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1386/2767] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:19.614513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.615510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.624406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.625186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.625779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.626671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.627298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.628053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.685703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.695296 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fe5c2d9-de51-4a69-91f7-5a2b4236516a tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.264523 Aug 29 15:48:19.717052 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1382/2768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:19.727734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-acd38d58-9562-4989-9613-1291ca60f9be tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.729018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-acd38d58-9562-4989-9613-1291ca60f9be tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.788902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-acd38d58-9562-4989-9613-1291ca60f9be tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.798998 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-acd38d58-9562-4989-9613-1291ca60f9be tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1217 microversion: 2.1 time: 0.080399 Aug 29 15:48:19.799993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1383/2769] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:19.805884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.806915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.815429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.816073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.816640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.817445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.818015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.818547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.840290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.862214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.863738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:19.864970 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09f494d2-cc34-4d05-9d26-b27182c39dff tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.254262 Aug 29 15:48:19.867653 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1387/2770] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:19.884574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:19.885198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:19.912684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.914814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.915281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:19.917765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:19.918612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:19.919069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.174747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.186881 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-df2036c7-a0fe-4780-a1de-6d301311d8f5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.384139 Aug 29 15:48:20.189091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1384/2771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:20.228007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-921094740"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:20.238385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.260260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.262249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.263784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.265672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.267758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.268947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.300595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.316045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d33a90ee-6004-46dc-908b-2b3fc9a7f674 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 200 len: 1510 microversion: 2.1 time: 0.447228 Aug 29 15:48:20.316657 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1388/2772] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:19 2022] GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 1510 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:20.436228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:20.437121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.450997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.452664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.453216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.454049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.454660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.459859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.783734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:20.793021 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8fe1393-7ef5-438f-9910-16da79be34a0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.360360 Aug 29 15:48:20.798640 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc1859cc-0ab5-4d38-a795-009ee28cf15e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action" status: 202 len: 0 microversion: 2.1 time: 0.590932 Aug 29 15:48:20.801207 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1389/2773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:20 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:20.807572 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1385/2774] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:20 2022] POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:48:20.828483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-871708141"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:20.832966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:20.834258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.839419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:20.848415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.852573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.853334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.854039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.855540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.856471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.857394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.858062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.859009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:20.859701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.865771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:20.869648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:20.982775 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Cannot 'createImage' instance bcb84f67-110d-46c5-951f-1cd0d8960752 while it is in task_state image_snapshot_pending Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action HTTP/1.1 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 84 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-871708141"}} Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: exception: Cannot 'createImage' instance bcb84f67-110d-46c5-951f-1cd0d8960752 while it is in task_state image_snapshot_pending Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bcb84f67-110d-46c5-951f-1cd0d8960752', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-871708141'}}} Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:48:20.984818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance bcb84f67-110d-46c5-951f-1cd0d8960752 while it is in task_state image_snapshot_pending Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance bcb84f67-110d-46c5-951f-1cd0d8960752 while it is in task_state image_snapshot_pending Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:20.989081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 409 to user: Cannot 'createImage' instance bcb84f67-110d-46c5-951f-1cd0d8960752 while it is in task_state image_snapshot_pending {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:20.996039 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aff79345-4a63-4245-98c2-c4af5b463766 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action" status: 409 len: 167 microversion: 2.1 time: 0.176092 Aug 29 15:48:20.996039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1390/2775] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:20 2022] POST /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752/action => generated 167 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:48:20.997963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:20.998670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.007293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.010065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.010550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.011491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.012018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.012456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.054345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.068110 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1c7667a0-7079-4137-8f16-543439d7ed5c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1221 microversion: 2.1 time: 0.245766 Aug 29 15:48:21.087482 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1386/2776] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:20 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:21.097817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff4584e7-a141-44a9-b641-0e045254d95b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '.version_select at 0x7f32edbbb1f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.196707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.215227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.217353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:21.218910 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33f25319-3ffe-4e7a-a7ae-5f8589829fa3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.225744 Aug 29 15:48:21.237300 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1391/2777] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:20 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:21.340321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.341183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.351485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.360045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.365269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.366309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.367063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.375124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.400628 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff4584e7-a141-44a9-b641-0e045254d95b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/images/22babbdd-ffd0-4b98-bfe5-9dda1c84849b" status: 204 len: 0 microversion: 2.1 time: 0.311697 Aug 29 15:48:21.401350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1387/2778] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:21 2022] DELETE /compute/v2.1/images/22babbdd-ffd0-4b98-bfe5-9dda1c84849b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:21.412222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:21.413429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:21.436990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.437710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.438382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:21.439338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:21.439996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:21.440624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.290666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.302719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71b26f9a-8dad-43c8-94f2-d7754a0e1bb0 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 200 len: 1510 microversion: 2.1 time: 0.967997 Aug 29 15:48:22.304847 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1392/2779] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 1510 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:22.316086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:22.318396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:22.353613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.355554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.357894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.358852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.359563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.361023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.788491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.802673 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30083f09-f167-4746-af2d-06afc4a27528 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1512 microversion: 2.1 time: 0.496522 Aug 29 15:48:22.822163 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1393/2780] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:22 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1512 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:22.835800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6e1f2379-2b15-4c21-af8e-718a42ce906a req-d4f03386-90f7-4cf7-b74d-194b1b069a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6758da-aca1-49f4-a63e-8eaa135fdccb", "name": "network-vif-deleted", "tag": "31b96c08-4370-46cf-b5f9-c1bc43e329ec"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:22.856792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6e1f2379-2b15-4c21-af8e-718a42ce906a req-d4f03386-90f7-4cf7-b74d-194b1b069a0f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.865040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6e1f2379-2b15-4c21-af8e-718a42ce906a req-d4f03386-90f7-4cf7-b74d-194b1b069a0f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.867107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6e1f2379-2b15-4c21-af8e-718a42ce906a req-d4f03386-90f7-4cf7-b74d-194b1b069a0f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.874491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:22.900150 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-249bb0f8-b094-410a-942a-db9c1892fe7d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1534 microversion: 2.1 time: 1.493263 Aug 29 15:48:22.909533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1388/2781] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:21 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1534 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:22.918717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6e1f2379-2b15-4c21-af8e-718a42ce906a req-d4f03386-90f7-4cf7-b74d-194b1b069a0f service nova] Creating event network-vif-deleted:31b96c08-4370-46cf-b5f9-c1bc43e329ec for instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb on n-h1-836830-13 Aug 29 15:48:22.930778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:22.933019 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6e1f2379-2b15-4c21-af8e-718a42ce906a req-d4f03386-90f7-4cf7-b74d-194b1b069a0f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107599 Aug 29 15:48:22.933997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1394/2782] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:22.934325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:22.965556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:22.966341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:22.982534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.986944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.987641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:22.988374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:22.988835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:22.989258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.011325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.012360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.015004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.020132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.020826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.023302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.170439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.183167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.184801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.186009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-705e275d-eb33-4f16-af21-1923e05fda95 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.243342 Aug 29 15:48:23.186584 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1395/2783] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:22 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:23.222570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.261829 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8acc69f9-78d8-41a3-a8d3-452015879a73 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1275 microversion: 2.1 time: 0.344908 Aug 29 15:48:23.263306 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1389/2784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:22 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1275 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:23.328713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:23.329525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:23.344822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.355429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.358741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.361231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.367740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.368726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.516640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:23.533631 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cdc8c031-53e9-42fc-8928-70f70b36b5bd tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 200 len: 1468 microversion: 2.1 time: 0.209023 Aug 29 15:48:23.535560 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1396/2785] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:23 2022] GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 1468 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:23.830888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:23.832830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:23.841613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.842106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.842541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.858944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7482e370-c522-4223-96eb-aded8e05c1f6 req-2e9a92c9-0a7e-4ccf-8422-a064c6b57274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74ba016-abd0-4f53-9116-cd86687ec625", "name": "network-vif-deleted", "tag": "a5a81870-30a7-47e0-93e6-255202bb7745"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:23.866593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.867322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.867773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.890032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7482e370-c522-4223-96eb-aded8e05c1f6 req-2e9a92c9-0a7e-4ccf-8422-a064c6b57274 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:23.891648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7482e370-c522-4223-96eb-aded8e05c1f6 req-2e9a92c9-0a7e-4ccf-8422-a064c6b57274 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:23.892272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7482e370-c522-4223-96eb-aded8e05c1f6 req-2e9a92c9-0a7e-4ccf-8422-a064c6b57274 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:23.946059 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7482e370-c522-4223-96eb-aded8e05c1f6 req-2e9a92c9-0a7e-4ccf-8422-a064c6b57274 service nova] Creating event network-vif-deleted:a5a81870-30a7-47e0-93e6-255202bb7745 for instance a74ba016-abd0-4f53-9116-cd86687ec625 on n-h2-836830-13 Aug 29 15:48:23.962578 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7482e370-c522-4223-96eb-aded8e05c1f6 req-2e9a92c9-0a7e-4ccf-8422-a064c6b57274 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289400 Aug 29 15:48:23.971941 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1390/2786] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:23.978221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:23.979297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.018879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.022414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.027670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.030123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.031059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.033656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.255052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.284421 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7768a519-c7dd-4f01-b248-54700df3016b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1489 microversion: 2.1 time: 0.458238 Aug 29 15:48:24.285023 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1397/2787] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:23 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1489 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:24.299574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.301521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.321168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.321677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.322114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.322822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.323986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.324613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.414939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.420073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.427922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.431492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.433223 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-21be05c2-6dcd-4865-b416-d8c2124fbee5 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.146736 Aug 29 15:48:24.433795 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1398/2788] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:24.440975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.441669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.451067 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-743b58a8-8176-4882-9428-ad9cd3343cbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1540 microversion: 2.1 time: 0.477366 Aug 29 15:48:24.453468 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1391/2789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:23 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1540 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:24.457477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.458607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.460378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.461305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.461933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.462529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.468607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.471627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.487805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.488308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.488756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.489464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.489917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.490343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.550577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.550961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:24.560215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67799e0d-5c2b-4cda-923c-83d39b4dbff3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1275 microversion: 2.1 time: 0.122292 Aug 29 15:48:24.571046 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1399/2790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:24.571046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.571046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.576522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.577229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.577840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.578713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.579346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.579920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.635851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.636597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.637398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.637918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lazy-loading 'fault' on Instance uuid a74ba016-abd0-4f53-9116-cd86687ec625 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:24.753022 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a78210c7-06a6-4221-93f9-b999d1b43b17 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 204 len: 0 microversion: 2.1 time: 0.296205 Aug 29 15:48:24.753948 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1392/2791] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:24 2022] DELETE /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:24.762638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '085145c4942d4c889c291a99eb1d009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a31c64e992417d8862b3443fa8c105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:24.766487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:24.767521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:24.784470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e22bb2d-5ccd-4a3d-9cff-2d5517fe1d42 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 200 len: 1306 microversion: 2.1 time: 0.221839 Aug 29 15:48:24.790456 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1400/2792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 1306 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:24.793403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.794708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.796025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.796995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:24.797705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:24.798428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:24.908704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "84704dab-9a21-4ed1-8b74-8b6d0888173d"}], "security_groups": [{"name": "tempest-securitygroup--1884740557"}], "key_name": "tempest-keypair-1784321153", "user_data": "}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:25.102286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] validate_networks() for [('84704dab-9a21-4ed1-8b74-8b6d0888173d', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:25.164419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.173697 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-74a8d3d0-1a03-4656-b172-20b0128ac752 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1495 microversion: 2.1 time: 0.415257 Aug 29 15:48:25.174911 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1393/2793] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:24 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1495 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:25.434378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:25.461952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.462974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.503131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.503816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.504465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.505982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.508187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.508791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.562652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:25.633024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.642278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.644730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.645990 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d2f0794-490a-4f71-9a09-cc943bab1ba1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.190810 Aug 29 15:48:25.656930 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1394/2794] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:25.660659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.661275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.667832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.668259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.668707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.669392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.669853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.670273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.760563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:25.761028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:25.761816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:25.762372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:25.762936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:25.774489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.774979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.775431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.776200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.777854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.778285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.788797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:25.799871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Getting quotas for project 09841e55e1b145aaae76652d19a35da6. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:25.806356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Getting quotas for user 023ee959a1ca446fb620544563307863 and project 09841e55e1b145aaae76652d19a35da6. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:25.821586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:25.824518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:25.887964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e9d72061-6eb7-420c-8384-445264351824 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.984102 Aug 29 15:48:25.896791 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1401/2795] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:25.906439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.908537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.920610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.921100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.921699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.923692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.924440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.925241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.934198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:25.962068 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-af12e04c-6e71-4176-a345-eccf93d65e03 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1540 microversion: 2.1 time: 0.312385 Aug 29 15:48:25.964158 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1395/2796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1540 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:25.975371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:25.976171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: a74ba016-abd0-4f53-9116-cd86687ec625] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:25.989132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.990329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.990880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:25.991727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:25.992438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:25.993111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.024623 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] HTTP exception thrown: Instance a74ba016-abd0-4f53-9116-cd86687ec625 could not be found. Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Request method failure captured: Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 HTTP/1.1 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-HKggexkuEozbMh5j6-Q8pi2hQx89bX7jhN-iWrQozS2DM2X20pKIET2ZgKx3pqwYUEza6XahpYZwppMx496Sp4tFPfve9OEQX32BHv7d-ghWTZXej3vd5PUnVSbqBcWZq4PKfYnIq-_XhHLV7tBUE9cXqqq3haAQWIVWYRduUryQ Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 99a31c64e992417d8862b3443fa8c105 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-MultipleCreateTestJSON-1370542177 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/99a31c64e992417d8862b3443fa8c105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_99a31c64e992417d8862b3443fa8c105", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/99a31c64e992417d8862b3443fa8c105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/99a31c64e992417d8862b3443fa8c105"}]}] Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-MultipleCreateTestJSON-1370542177 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 99a31c64e992417d8862b3443fa8c105 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1370542177 Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-MultipleCreateTestJSON-1370542177-project Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 085145c4942d4c889c291a99eb1d009a Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-MultipleCreateTestJSON-1370542177-project Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance a74ba016-abd0-4f53-9116-cd86687ec625 could not be found. Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a74ba016-abd0-4f53-9116-cd86687ec625'} Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74ba016-abd0-4f53-9116-cd86687ec625 could not be found. Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74ba016-abd0-4f53-9116-cd86687ec625 could not be found. Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:26.027570 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.031656 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:26.031656 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:26.031656 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:26.031656 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:26.031656 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:26.031656 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74ba016-abd0-4f53-9116-cd86687ec625 could not be found. Aug 29 15:48:26.031656 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.036391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Returning 404 to user: Instance a74ba016-abd0-4f53-9116-cd86687ec625 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:26.037980 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4232f61a-bfd1-45e6-8c8d-30392650b9f2 tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625" status: 404 len: 111 microversion: 2.1 time: 0.072423 Aug 29 15:48:26.042035 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1396/2797] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/a74ba016-abd0-4f53-9116-cd86687ec625 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:26.050560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-602fbb48-c9d7-433c-9fe4-2d28367462fc tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.052197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-602fbb48-c9d7-433c-9fe4-2d28367462fc tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.184348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-602fbb48-c9d7-433c-9fe4-2d28367462fc tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.199281 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-602fbb48-c9d7-433c-9fe4-2d28367462fc tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1226 microversion: 2.1 time: 0.153358 Aug 29 15:48:26.200154 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1397/2798] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:26.213294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.215314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] [instance: 2f6758da-aca1-49f4-a63e-8eaa135fdccb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.236918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.244043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.246266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.247230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.248361 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45864a26-2b8f-49c5-955a-8eb0b44f7773 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.348843 Aug 29 15:48:26.248628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.250849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.251471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.251593 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1402/2799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:25 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:26.260706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.265639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.269949 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] HTTP exception thrown: Instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb could not be found. Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Request method failure captured: Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb HTTP/1.1 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-HKggexkuEozbMh5j6-Q8pi2hQx89bX7jhN-iWrQozS2DM2X20pKIET2ZgKx3pqwYUEza6XahpYZwppMx496Sp4tFPfve9OEQX32BHv7d-ghWTZXej3vd5PUnVSbqBcWZq4PKfYnIq-_XhHLV7tBUE9cXqqq3haAQWIVWYRduUryQ Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 99a31c64e992417d8862b3443fa8c105 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-MultipleCreateTestJSON-1370542177 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/99a31c64e992417d8862b3443fa8c105"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_99a31c64e992417d8862b3443fa8c105", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/99a31c64e992417d8862b3443fa8c105"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/99a31c64e992417d8862b3443fa8c105"}]}] Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-MultipleCreateTestJSON-1370542177 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 99a31c64e992417d8862b3443fa8c105 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1370542177 Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-MultipleCreateTestJSON-1370542177-project Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 085145c4942d4c889c291a99eb1d009a Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-MultipleCreateTestJSON-1370542177-project Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb could not be found. Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '2f6758da-aca1-49f4-a63e-8eaa135fdccb'} Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb could not be found. Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb could not be found. Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:26.271616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb could not be found. Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] Returning 404 to user: Instance 2f6758da-aca1-49f4-a63e-8eaa135fdccb could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:26.276989 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbee9ec2-9df3-4759-9b54-ba90376b95ee tempest-MultipleCreateTestJSON-1370542177 tempest-MultipleCreateTestJSON-1370542177-project] 10.222.0.83 "GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb" status: 404 len: 111 microversion: 2.1 time: 0.071996 Aug 29 15:48:26.279067 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1398/2800] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/2f6758da-aca1-49f4-a63e-8eaa135fdccb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:26.284249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.284750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.286190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.288962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.289452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.289899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.603603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.612925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f293a620-b9b4-4d0e-a59e-f0c241293e02 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1495 microversion: 2.1 time: 0.360380 Aug 29 15:48:26.617039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1403/2801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1495 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:26.677064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.677748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:26.701475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.702228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.706665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.707882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:26.708277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:26.708720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:26.915729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.924464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.932366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:26.934302 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e2a1b0b-2dff-4ca9-8831-ffc4338cd3c7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.267060 Aug 29 15:48:26.935063 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1399/2802] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:26.997938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:26.999921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.020662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.021175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.021644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.022587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.023134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.023517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.220552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.221178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.228593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.229418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.230067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.231435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.232163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.232816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.405783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.429182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2fd925d2-d8a3-4b00-ae37-a4b9b0ebda58 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1540 microversion: 2.1 time: 0.441234 Aug 29 15:48:27.451679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1404/2803] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:26 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1540 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:27.462149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.465767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.485055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.485987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.487826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.489041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.490853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.492200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.717823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.728235 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7602858c-027e-4bcb-9123-3fd86a7403c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.275233 Aug 29 15:48:27.729727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1405/2804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:27.735713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f57caafa-2e4c-45b8-b975-1d00b74def90 req-dd25f9ed-f173-4592-8e6e-f3fb7aa97021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2847ea65-8be6-4458-9d02-aab8b85011b2", "name": "network-vif-deleted", "tag": "6766b945-4112-49a8-8486-809660723e2f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:27.755762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f57caafa-2e4c-45b8-b975-1d00b74def90 req-dd25f9ed-f173-4592-8e6e-f3fb7aa97021 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.757501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f57caafa-2e4c-45b8-b975-1d00b74def90 req-dd25f9ed-f173-4592-8e6e-f3fb7aa97021 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.758178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f57caafa-2e4c-45b8-b975-1d00b74def90 req-dd25f9ed-f173-4592-8e6e-f3fb7aa97021 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.774271 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f57caafa-2e4c-45b8-b975-1d00b74def90 req-dd25f9ed-f173-4592-8e6e-f3fb7aa97021 service nova] Creating event network-vif-deleted:6766b945-4112-49a8-8486-809660723e2f for instance 2847ea65-8be6-4458-9d02-aab8b85011b2 on n-h1-836830-13 Aug 29 15:48:27.780684 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f57caafa-2e4c-45b8-b975-1d00b74def90 req-dd25f9ed-f173-4592-8e6e-f3fb7aa97021 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049187 Aug 29 15:48:27.781579 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1406/2805] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:27.796330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.797516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.804949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.805753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.806399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.809170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.809877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.810537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.851273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.852283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.852931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.853590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'fault' on Instance uuid 2847ea65-8be6-4458-9d02-aab8b85011b2 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:27.875772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.883979 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b96e58ae-1f7d-42a3-af31-030c868bd9bb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1222 microversion: 2.1 time: 0.667266 Aug 29 15:48:27.891829 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1400/2806] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1222 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:27.922237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:27.935325 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-36ba89a2-906e-4144-8e84-478e756f31d0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 200 len: 1305 microversion: 2.1 time: 0.147279 Aug 29 15:48:27.936542 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1407/2807] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 1305 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:27.961745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:27.962643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:27.971356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.972060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.972671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:27.973517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:27.974120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:27.974842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.102120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.137522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.141146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.145697 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f38a30b4-71b0-4a18-b320-ab8df162d321 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.187020 Aug 29 15:48:28.147538 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1401/2808] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:27 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:28.463664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:28.464401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:28.484955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.485452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.485881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.486760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.487528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.488157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.619242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e70bb9fb-d310-4e9b-af28-534fb28967cf req-ec4d52ba-01fd-4e55-bf86-f9494c8665c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c", "tag": "52c3f5bd-a607-478d-b7f3-8a16a81fbcc9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:28.635469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:28.640883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e70bb9fb-d310-4e9b-af28-534fb28967cf req-ec4d52ba-01fd-4e55-bf86-f9494c8665c4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.641383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e70bb9fb-d310-4e9b-af28-534fb28967cf req-ec4d52ba-01fd-4e55-bf86-f9494c8665c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.641820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e70bb9fb-d310-4e9b-af28-534fb28967cf req-ec4d52ba-01fd-4e55-bf86-f9494c8665c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.670641 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e70bb9fb-d310-4e9b-af28-534fb28967cf req-ec4d52ba-01fd-4e55-bf86-f9494c8665c4 service nova] Creating event network-changed:52c3f5bd-a607-478d-b7f3-8a16a81fbcc9 for instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c on n-h1-836830-13 Aug 29 15:48:28.677559 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e70bb9fb-d310-4e9b-af28-534fb28967cf req-ec4d52ba-01fd-4e55-bf86-f9494c8665c4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062615 Aug 29 15:48:28.679911 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1402/2809] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:28.716660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:28.727166 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42926bcb-9a2f-4fa5-813c-ef759de48306 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1540 microversion: 2.1 time: 0.267161 Aug 29 15:48:28.740167 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1408/2810] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:28 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1540 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:28.752475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:28.753983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:28.762580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.763172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.763618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.764397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.764897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.765331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.918123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:28.918590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:28.926290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.930492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.930907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:28.932412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:28.934369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:28.934884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.052323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.062870 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-879a811c-c5a9-42ca-b6fb-9bd8eba4d980 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1284 microversion: 2.1 time: 0.149743 Aug 29 15:48:29.068085 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1409/2811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:28 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:29.075688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:29.077856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.094631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.095290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.095747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.096461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.104990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.105640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.148871 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 HTTP/1.1 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '2847ea65-8be6-4458-9d02-aab8b85011b2'} Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:29.157591 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:29.162090 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5204699-b500-42f9-a699-468ec1b2aae1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 404 len: 111 microversion: 2.1 time: 0.087638 Aug 29 15:48:29.163068 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1410/2812] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:29 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:29.189183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:29.190906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.209936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.213415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.217416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.220569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.221094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.221534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.257518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.274014 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0232b5ee-f6e1-40dd-bed9-94109dc29e1a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.526992 Aug 29 15:48:29.275451 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1403/2813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:28 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:29.384683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1297961643", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9bbf042d-13bc-4426-83e8-c7e73123f015"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:29.413277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.428700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.430272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:29.431480 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d60373ee-c6dd-4315-bf9b-410d8dae95e0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.255035 Aug 29 15:48:29.446951 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1411/2814] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:29 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:29.494455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] validate_networks() for [('9bbf042d-13bc-4426-83e8-c7e73123f015', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:29.752267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:29.752900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:29.760876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.761756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.762440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:29.763398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:29.766327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:29.767197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.379507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.389147 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2d99174-88b8-4b10-95f2-2eb5ff3b02b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1522 microversion: 2.1 time: 0.641257 Aug 29 15:48:30.403054 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1412/2815] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:29 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:30.407414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:30.408033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:30.415850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.416607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.417775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.418670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.419356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.420018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.517475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.530986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff6dbc8a-47b3-48f6-a882-4f67354169bf tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1284 microversion: 2.1 time: 0.133005 Aug 29 15:48:30.535871 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1413/2816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:30 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:30.545183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:30.545692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:30.556736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.557235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.567480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.568558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.569043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.569480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.844814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:30.855871 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6826538d-e961-45a4-806d-86439eade009 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.318905 Aug 29 15:48:30.857047 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1414/2817] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:30 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:30.862241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:30.863092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:30.876734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.878406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.879931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.883596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:30.884081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:30.884514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:30.941240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:31.019714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:31.020918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:31.021641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:31.022716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:31.023447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:31.054645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.055964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.057004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.059439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.064881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.065988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.111618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:31.120157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Getting quotas for user 853f8300f9bb403b9cea4834c5a1edcb and project 2d32eb4fb5ea49e6ad495a8175ae5e3e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:31.129405 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-454cb830-9fdf-4888-bcd2-91aa39d5167e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 204 len: 0 microversion: 2.1 time: 0.270609 Aug 29 15:48:31.140240 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1415/2818] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:30 2022] DELETE /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:31.146721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.147997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.165467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.165976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.166422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.167327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.167789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.168131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:31.168341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.171906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:31.246582 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-68d16d8b-feec-4491-959b-410abc47c181 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.865755 Aug 29 15:48:31.254668 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1404/2819] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:31.259747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.260377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.283355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.283857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.284298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.290722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.291531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.295795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.344166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.352978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.355401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.357107 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31b66a88-2fbc-49c3-a2dd-c18de134dfdc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.215353 Aug 29 15:48:31.358035 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1416/2820] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:31.382527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-368a1a09-bb9a-4920-8529-9847f534b903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.383438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-368a1a09-bb9a-4920-8529-9847f534b903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.488791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-368a1a09-bb9a-4920-8529-9847f534b903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.498726 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-368a1a09-bb9a-4920-8529-9847f534b903 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1215 microversion: 2.1 time: 0.129729 Aug 29 15:48:31.500182 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1417/2821] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:31.560777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.561573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.570759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.571957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.572656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.575989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.577723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.578404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.757783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:31.769384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:31.781728 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd8be9d8-8fe7-457e-a9d1-d934e494bbef tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1284 microversion: 2.1 time: 0.229303 Aug 29 15:48:31.782919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1418/2822] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:31.888283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:31.890712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:31.898221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.899086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.899738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:31.900933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:31.902174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:31.902913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.138554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.153766 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2fc85c6-0a03-4a5f-a30e-637b8a62965c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.280931 Aug 29 15:48:32.156993 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1419/2823] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:32.361755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.373629 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06455990-6a7d-4517-9c09-4b73a942947c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1528 microversion: 2.1 time: 1.115800 Aug 29 15:48:32.377669 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1405/2824] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:31 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1528 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:32.383791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.384418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.395733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.397666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.398154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.401718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.402304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.403425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.520986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.521638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.543056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.543598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.544238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.545135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.547012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.547642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.637074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.649538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.653356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.657518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-decacfb3-e1f5-47e0-840e-7b1915aeaec6 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.276029 Aug 29 15:48:32.660500 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1420/2825] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:32.754672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:32.764158 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42b24338-9c05-4690-9c11-419f65f146f9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1267 microversion: 2.1 time: 0.247341 Aug 29 15:48:32.769502 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1406/2826] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:32.805052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:32.807218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:32.817321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.818581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.819326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:32.820335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:32.821546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:32.822194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.186623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.189707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.202905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.203774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.204610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.206480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.207291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.208408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.328202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.343198 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4506b061-7b06-4710-8246-4f7329c09dc7 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.543133 Aug 29 15:48:33.347635 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1421/2827] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:32 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:33.404410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.405419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.414322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.417566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.419909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.422046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.422718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.423915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.714841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.722720 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-59817531-67db-408e-bb45-19fe252d63e9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.547001 Aug 29 15:48:33.723352 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1407/2828] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:33.733267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.740365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.759636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.760319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.761013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.761896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.771837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.772847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.912269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.921779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.930071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:33.931604 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-641946d4-8327-4f3f-86a9-9aa13d2c6ad7 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.202641 Aug 29 15:48:33.933305 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1408/2829] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:33.942486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:33.949398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:33.955977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.956478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.956921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:33.957630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:33.958089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:33.958513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.258560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.279953 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-92966001-b6e4-4602-b10b-7a6cfdde8e87 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1273 microversion: 2.1 time: 0.341114 Aug 29 15:48:34.282442 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1409/2830] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:34.317096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.325871 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f85e5fe-b298-4e94-8012-dc47f259ced1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1528 microversion: 2.1 time: 0.925824 Aug 29 15:48:34.327718 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1422/2831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:33 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1528 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:34.371459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:34.372088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:34.378398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.378894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.379625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.380704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.381315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.382072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.750713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:34.750713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:34.755155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.755913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.756501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.757354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.757998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.758569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.832891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:34.846420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-641a9d3a-20e2-4c2a-a14b-6e7eb03ec650 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.478993 Aug 29 15:48:34.847810 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1410/2832] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:34 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:34.959621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:34.960485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:34.968525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.969196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.969784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:34.970659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:34.971331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:34.971904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.163636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.174406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.176737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.179406 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fba5a4c-679b-4773-852f-3f784e04712a tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.223548 Aug 29 15:48:35.180179 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1411/2833] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:34 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:35.234545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.245864 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bcf657d-ee8a-44fc-ac4a-61a78add0cd3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.502844 Aug 29 15:48:35.248588 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1423/2834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:34 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:35.282147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4a20d2dc-3652-45ec-a399-0a295f3ff26d req-f2cc7f2d-9ac8-4b3f-b1d8-aa0d18aba88e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1abacf35-4c11-4331-bc1b-6dd4d88f1190", "tag": "58fe0723-fb16-41da-b1e9-0813b4aabe19"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:35.296886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4a20d2dc-3652-45ec-a399-0a295f3ff26d req-f2cc7f2d-9ac8-4b3f-b1d8-aa0d18aba88e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.297383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4a20d2dc-3652-45ec-a399-0a295f3ff26d req-f2cc7f2d-9ac8-4b3f-b1d8-aa0d18aba88e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.297820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4a20d2dc-3652-45ec-a399-0a295f3ff26d req-f2cc7f2d-9ac8-4b3f-b1d8-aa0d18aba88e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.301975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:35.302465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:35.315864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.316717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.321205 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4a20d2dc-3652-45ec-a399-0a295f3ff26d req-f2cc7f2d-9ac8-4b3f-b1d8-aa0d18aba88e service nova] Creating event network-changed:58fe0723-fb16-41da-b1e9-0813b4aabe19 for instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 on n-h2-836830-13 Aug 29 15:48:35.325745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.326981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.327737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.328377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.333955 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4a20d2dc-3652-45ec-a399-0a295f3ff26d req-f2cc7f2d-9ac8-4b3f-b1d8-aa0d18aba88e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062426 Aug 29 15:48:35.336293 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1412/2835] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:35.350743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:35.352816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:35.361135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.361858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.362516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.363545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:35.364222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:35.364870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:35.555380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:35.567451 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6e026f6-64bb-476f-9637-24d81c4f3a3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1486 microversion: 2.1 time: 0.221580 Aug 29 15:48:35.580698 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1413/2836] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:35 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1486 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:35.789929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:36.058322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.070156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-14fdaf58-c9ff-46b7-a9aa-121e04e23c1c tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.772296 Aug 29 15:48:36.070740 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1424/2837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:35 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:36.081991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.084935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.098360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.099896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.100761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.101754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.102516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.103221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.157121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8515bd16-1714-4528-8812-e31e6c206d5a req-f5d599cf-3dc1-4a36-8318-f534ba410e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c", "name": "network-vif-plugged", "status": "completed", "tag": "52c3f5bd-a607-478d-b7f3-8a16a81fbcc9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:36.176969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8515bd16-1714-4528-8812-e31e6c206d5a req-f5d599cf-3dc1-4a36-8318-f534ba410e8e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.177466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8515bd16-1714-4528-8812-e31e6c206d5a req-f5d599cf-3dc1-4a36-8318-f534ba410e8e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.177901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8515bd16-1714-4528-8812-e31e6c206d5a req-f5d599cf-3dc1-4a36-8318-f534ba410e8e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.195881 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8515bd16-1714-4528-8812-e31e6c206d5a req-f5d599cf-3dc1-4a36-8318-f534ba410e8e service nova] Creating event network-vif-plugged:52c3f5bd-a607-478d-b7f3-8a16a81fbcc9 for instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c on n-h1-836830-13 Aug 29 15:48:36.201863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8515bd16-1714-4528-8812-e31e6c206d5a req-f5d599cf-3dc1-4a36-8318-f534ba410e8e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376895 Aug 29 15:48:36.219386 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1414/2838] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:36.237406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c60cb064-b205-4dbd-9679-ebe52a944326 req-53114a0f-da8d-4383-bc59-b7c59fa3d1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb84f67-110d-46c5-951f-1cd0d8960752", "name": "network-vif-deleted", "tag": "9b664fb1-f709-4164-9948-6d594b28e987"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:36.265027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c60cb064-b205-4dbd-9679-ebe52a944326 req-53114a0f-da8d-4383-bc59-b7c59fa3d1d4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.265843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c60cb064-b205-4dbd-9679-ebe52a944326 req-53114a0f-da8d-4383-bc59-b7c59fa3d1d4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.267442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c60cb064-b205-4dbd-9679-ebe52a944326 req-53114a0f-da8d-4383-bc59-b7c59fa3d1d4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.289681 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c60cb064-b205-4dbd-9679-ebe52a944326 req-53114a0f-da8d-4383-bc59-b7c59fa3d1d4 service nova] Creating event network-vif-deleted:9b664fb1-f709-4164-9948-6d594b28e987 for instance bcb84f67-110d-46c5-951f-1cd0d8960752 on n-h2-836830-13 Aug 29 15:48:36.299851 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c60cb064-b205-4dbd-9679-ebe52a944326 req-53114a0f-da8d-4383-bc59-b7c59fa3d1d4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077453 Aug 29 15:48:36.301017 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1415/2839] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:36.309201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.310243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.321274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.322151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.322882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.325622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.326303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.327322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.440881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.447989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:36.458940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.460605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.466851 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-45f54c1b-8be0-44e8-80a6-96cdd8b00302 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.159611 Aug 29 15:48:36.468181 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1416/2840] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:36.477116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.482616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.498877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.499397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.503363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.504281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.505252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.505822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.657010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.667395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a23cefae-b3ad-4ae7-bb47-0ab31a42fad5 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.594813 Aug 29 15:48:36.679886 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1425/2841] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:36.679886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:36.679886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:36.693443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.693950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.694493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.695243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.695696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.696116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.771193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:36.771684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:36.772119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:36.772826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lazy-loading 'fault' on Instance uuid bcb84f67-110d-46c5-951f-1cd0d8960752 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:36.868466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:36.877265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b5749d9-c559-4d3c-a345-30199415e4cd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 200 len: 1315 microversion: 2.1 time: 0.206708 Aug 29 15:48:36.899157 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1426/2842] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:37.099547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:37.100524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:37.110478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.112071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.112406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.113120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.113741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.114185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.365865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.377423 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3f2920e4-a4fd-4175-9317-1f81a7316511 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1317 microversion: 2.1 time: 0.907976 Aug 29 15:48:37.378351 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1417/2843] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:36 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1317 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:37.496393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:37.497014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:37.503387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.504100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.504525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.505362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.506176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.506602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.537974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.549195 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71d31388-eba7-4c63-a4d1-1546f2586cc4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.461100 Aug 29 15:48:37.550906 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1427/2844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:37 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:37.597940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.607627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.610149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:37.611751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9b6f0c1-e1ca-44c1-b29c-bc1c5f484bdd tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.120752 Aug 29 15:48:37.612457 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1418/2845] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:37 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:37.690483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:37.691248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:37.700825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.701601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.702174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.703014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.704544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.705398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.904981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:37.905900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:37.912539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.913031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.913795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.914605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:37.915335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:37.915809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:37.931055 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 HTTP/1.1 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bcb84f67-110d-46c5-951f-1cd0d8960752'} Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:37.934003 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:48:37.938529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dac6821a-ceaf-4739-9d48-f18f2b4351f6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 404 len: 111 microversion: 2.1 time: 0.036485 Aug 29 15:48:37.942171 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1419/2846] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:37 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:48:37.947147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e2d82a1-9d29-4059-bf78-0b5d5ad38dae tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'create', calling method: .version_select at 0x7f32edb5c160>, body: {"keypair": {"name": "tempest-keypair-551115605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk6Or4hKECzhNRYLah3AdFy3IsbL9D3Ya/tUBriYplOM/gGWwDi4nENdWJQdnqRcT3jWLqWt149GrLCsbntVcPNWaS/6mWAwUVSS4DkW2YqZdLioluoJVZLb5lQHgFXGg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:37.964101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3e2d82a1-9d29-4059-bf78-0b5d5ad38dae tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for project 062ee746b4614e629a9d853a6d84a368. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:37.971491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3e2d82a1-9d29-4059-bf78-0b5d5ad38dae tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for user 215e000f15f44b41aa38a41a941c16da and project 062ee746b4614e629a9d853a6d84a368. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:37.990791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:38.000178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e2d82a1-9d29-4059-bf78-0b5d5ad38dae tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056798 Aug 29 15:48:38.006925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82a74806-c92a-4bdb-8ce5-166e062fe5c2 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.320601 Aug 29 15:48:38.007368 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1420/2847] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:48:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:38.007771 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1428/2848] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:37 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:38.399194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:38.400216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.409004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.409577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.410109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.411017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.411732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.412285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.735554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:38.752156 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1601667a-c1ee-438c-8f71-b71195131796 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1467 microversion: 2.1 time: 0.357514 Aug 29 15:48:38.756775 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1421/2849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:38 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1467 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:38.774387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:38.779698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:38.799073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.799576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.800981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.801710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.802169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.802597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.919016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b98c0b6e-6802-4973-be56-cd959e304d6f req-5bd227ea-2b89-478d-8a88-5828a0f20787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba41f76-a8f6-4e44-9942-a5cb7b54ef96", "tag": "9eb6caab-7ba5-407d-a3c3-332b6ec2299f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:38.944149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b98c0b6e-6802-4973-be56-cd959e304d6f req-5bd227ea-2b89-478d-8a88-5828a0f20787 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:38.944600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b98c0b6e-6802-4973-be56-cd959e304d6f req-5bd227ea-2b89-478d-8a88-5828a0f20787 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:38.945108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b98c0b6e-6802-4973-be56-cd959e304d6f req-5bd227ea-2b89-478d-8a88-5828a0f20787 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:38.993475 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b98c0b6e-6802-4973-be56-cd959e304d6f req-5bd227ea-2b89-478d-8a88-5828a0f20787 service nova] Creating event network-changed:9eb6caab-7ba5-407d-a3c3-332b6ec2299f for instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 on n-h1-836830-13 Aug 29 15:48:39.003935 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b98c0b6e-6802-4973-be56-cd959e304d6f req-5bd227ea-2b89-478d-8a88-5828a0f20787 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.569506 Aug 29 15:48:39.008737 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1429/2850] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:39.023639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:39.024410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:39.025525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.038425 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6c25f07-c463-4410-a129-8c63a5ae1a57 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.280226 Aug 29 15:48:39.039212 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1422/2851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:38 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:39.053746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1293713938", "metadata": {"image_type": "test"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:39.059915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.060808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:39.061575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.062429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.066517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.067146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.067956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.077872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.079198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.079980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.083166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.084217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.093539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.161998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Getting quotas for project d8c72636d6db42cfb42f0c535863a4b2. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:39.169718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Getting quotas for user 1ada57c2de1f4c1f90d6f8173289bbb1 and project d8c72636d6db42cfb42f0c535863a4b2. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:39.208294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.221892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.223753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.225314 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17d8d73a-21ae-4076-a51f-570c169122cc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.215364 Aug 29 15:48:39.227281 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1430/2852] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:39 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:39.245051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:39.246679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:39.254682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.255212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.255687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.256469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:39.256922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:39.257390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:39.576643 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1709ea4-829b-401c-b39d-74eec8151253 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "POST /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c/action" status: 202 len: 0 microversion: 2.1 time: 0.531620 Aug 29 15:48:39.585583 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1423/2853] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:39 2022] POST /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:48:39.620699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:39.631286 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ecdbd37-8fa7-4d1c-908f-ef837c182995 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.402441 Aug 29 15:48:39.634127 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1431/2854] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:39 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:39.648739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8028b8fb-0b09-4047-8642-c605b3ce2eec tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaa0280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:39.731408 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8028b8fb-0b09-4047-8642-c605b3ce2eec tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.087775 Aug 29 15:48:39.732002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1432/2855] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:39 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:39.871920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-360800662", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f0a6211c-15a9-4651-919e-885c3d0e4778"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:39.967603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] validate_networks() for [('f0a6211c-15a9-4651-919e-885c3d0e4778', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:40.062265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:40.063746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:40.070867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.071487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.072005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.072764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.074536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.075270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.292317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.310089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1c63592-be3b-45c3-a640-f59b682ac2d4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.251096 Aug 29 15:48:40.313239 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1433/2856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:40 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:40.334930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:40.335889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:40.344529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.346065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.346855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.347998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.350229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.351097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.574767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.591079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.592952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:40.594140 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be36bb7c-e552-40d5-9128-a1b52c9d89b9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.264527 Aug 29 15:48:40.594709 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1434/2857] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:40 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:40.655827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:40.656623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:40.663583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.664252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.664824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:40.665687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:40.666289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:40.667518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.079903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.089332 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ae12779-b418-4b87-be96-af2d7279c005 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.438077 Aug 29 15:48:41.090767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:41.091388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:41.092123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:41.092855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:41.093557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:41.100443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.109394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1435/2858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:40 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:41.114523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bcba659a-1aba-4da7-8b35-11a000b17357 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eef84f70>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.115128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=23 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.117600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.119460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.120976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.129249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.129998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.130615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.173041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:41.175787 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bcba659a-1aba-4da7-8b35-11a000b17357 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.065127 Aug 29 15:48:41.176450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1436/2859] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:41.187800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for user 71e0809663664b319388bcc890b6fdec and project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:41.213211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:41.216304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:41.274952 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33a4cdea-bf13-4de0-95c9-562115d5b758 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692659 Aug 29 15:48:41.276612 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1424/2860] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:48:41.287223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6916ede0-e240-4c1a-9ba7-078e4c8da257 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.288323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6916ede0-e240-4c1a-9ba7-078e4c8da257 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:41.334159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.335054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:41.356928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.357552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.361380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.362224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.364215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.364726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.498719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=14 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.506416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6916ede0-e240-4c1a-9ba7-078e4c8da257 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.519553 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6916ede0-e240-4c1a-9ba7-078e4c8da257 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1210 microversion: 2.1 time: 0.235835 Aug 29 15:48:41.521170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1437/2861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1210 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:41.622576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:41.623613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:41.645141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.647992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.649017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.649952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:41.650575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:41.651566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:41.742002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.746000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.756074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.757858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.759075 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09aadf2f-47d8-4e6a-bc9c-85949170ca89 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.142968 Aug 29 15:48:41.759846 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1438/2862] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:41.830832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-424596711", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:41.842408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:41.848571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:41.852377 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ae64c14-cc21-4197-a4bd-772884b42f19 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.522424 Aug 29 15:48:41.853563 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1425/2863] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:41 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:41.920338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] validate_networks() for [('5c5d881c-0bfc-43c0-bfab-44566705c02e', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:42.114426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:42.115763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:42.128096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.128825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.129566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.130628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.131296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.131878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.711844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:48:42.712274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:48:42.712733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:48:42.713177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:48:42.714130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:48:42.724904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.725399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.725840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.726598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.727368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.727803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.751662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for project 062ee746b4614e629a9d853a6d84a368. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:42.758229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for user 215e000f15f44b41aa38a41a941c16da and project 062ee746b4614e629a9d853a6d84a368. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:42.776856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:48:42.781129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:48:42.830837 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-35bcb043-faca-43f7-8ee6-d88c3b06ab34 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.008159 Aug 29 15:48:42.832105 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1439/2864] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:48:42.840227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-669771f4-84dd-4ed1-99d5-cf9a4751b27a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed96fdc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:42.944246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-669771f4-84dd-4ed1-99d5-cf9a4751b27a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.110649 Aug 29 15:48:42.955253 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1440/2865] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:42 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:42.967820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:42.968735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:42.982928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.984014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.985806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:42.987537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:42.990240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:42.991621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.137640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.187706 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9069e59-d7c2-4329-9443-8a12c94ea722 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 1.074713 Aug 29 15:48:43.190544 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1426/2866] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:42 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:43.203368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.203895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.204128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:43.219902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-86925b69-fd5b-47b7-8546-740ae66a68e6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1270 microversion: 2.1 time: 0.255796 Aug 29 15:48:43.220493 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1441/2867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:42 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:43.223842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.225864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.227624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.231781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd32fdce-08b1-479d-aa10-7b079bed109b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.231950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.233511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.234419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd32fdce-08b1-479d-aa10-7b079bed109b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:43.236752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.420691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cd32fdce-08b1-479d-aa10-7b079bed109b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.431209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.434190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd32fdce-08b1-479d-aa10-7b079bed109b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1224 microversion: 2.1 time: 0.211942 Aug 29 15:48:43.437181 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1442/2868] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1224 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:43.443262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:43.444491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:43.455043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.456036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.457314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.458597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:43.459313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:43.459949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:43.466841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.472692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.479225 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54aceb5a-37ba-4dd4-8437-c9b4e1997c0e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.287101 Aug 29 15:48:43.494706 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1427/2869] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:43.730853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:43.747932 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a5219bf-6701-4c4a-b2ec-1e589b1c25e3 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.309228 Aug 29 15:48:43.762218 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1443/2870] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:43.971740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a585491f-72c6-409d-a1be-3bd602746b46 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb373a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:44.097969 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a585491f-72c6-409d-a1be-3bd602746b46 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.130219 Aug 29 15:48:44.098580 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1428/2871] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:43 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:44.215410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:44.216046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:44.236535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.238312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.247644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:44.248273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:44.253052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.254013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.254488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.260736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.269541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.270037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.270477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.271229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.271813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.272092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.482774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:44.508222 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad8f0bde-e347-4d05-8eca-34c55b0d4a70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1268 microversion: 2.1 time: 0.266566 Aug 29 15:48:44.508838 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1429/2872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:44 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1268 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:44.537570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:44.546062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:44.592803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:44.602106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.602622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.609655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.613638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.614727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.620647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.928299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:44.942665 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7394d37-d4c6-473e-9b3f-92cbf0feaacb tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.736014 Aug 29 15:48:44.944323 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1444/2873] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:44 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:44.961571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:44.964954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:44.977964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.986710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.995512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:44.996709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:44.997421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:44.998048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.010667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.027439 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4d73f96-eb3e-4115-a5cd-bfbd4feaa61e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1276 microversion: 2.1 time: 0.505398 Aug 29 15:48:45.050411 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1430/2874] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:44 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1276 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:45.069847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.075119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:45.086124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.092891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.099524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.100888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.102014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.103383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.205141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.227370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.234822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:45.241994 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7be92ed8-b4da-4789-826b-28051e87a3e9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.289154 Aug 29 15:48:45.243830 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1445/2875] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:44 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:45.258949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-928ea05a-2bc9-469a-a612-08ea907a23ed tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed991c10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.374846 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-928ea05a-2bc9-469a-a612-08ea907a23ed tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.129192 Aug 29 15:48:45.375481 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1446/2876] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:45 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:45.540191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:45.541207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:45.556401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.557377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.569104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:45.573992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:45.574781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:45.575543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.387589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:46.396796 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e57dffde-49ad-4b49-a49d-684d0ebf81c5 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 1.344783 Aug 29 15:48:46.403553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:46.416524 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1431/2877] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:45 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:46.416524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:46.416524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:46.434882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c80cb858-9cac-45a1-8f63-6fa121244691 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 0.900879 Aug 29 15:48:46.436788 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1447/2878] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:45 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:46.454376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:46.456458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.457068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:46.460889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.464066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.466556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.468489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.475640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.482594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.483126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.483640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.484249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.484697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.499972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.695575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:46.714773 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b89af6dc-b162-4b4c-b7fb-504b894e57a1 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1282 microversion: 2.1 time: 0.276525 Aug 29 15:48:46.715716 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1448/2879] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:46 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:46.734064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:46.734757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:46.761284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.761880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.766817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.770777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:46.774322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:46.774977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:46.988861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:47.023460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:47.025612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:47.037510 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d431e373-ccfa-441d-9151-28ee9d8b58ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.320576 Aug 29 15:48:47.042076 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1449/2880] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:46 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:47.068364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53844374-f547-4fd4-8bb1-e429c422b4ec tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed991790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:47.150152 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53844374-f547-4fd4-8bb1-e429c422b4ec tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.085538 Aug 29 15:48:47.152238 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1450/2881] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:47 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:47.412816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4c9caaca-dedf-4af8-bba1-ab3cab24a7e6 req-1113bc48-7d61-4316-95d1-731fd00cd505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abacf35-4c11-4331-bc1b-6dd4d88f1190", "name": "network-vif-plugged", "status": "completed", "tag": "58fe0723-fb16-41da-b1e9-0813b4aabe19"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:47.434375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c9caaca-dedf-4af8-bba1-ab3cab24a7e6 req-1113bc48-7d61-4316-95d1-731fd00cd505 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.435791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c9caaca-dedf-4af8-bba1-ab3cab24a7e6 req-1113bc48-7d61-4316-95d1-731fd00cd505 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.438933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c9caaca-dedf-4af8-bba1-ab3cab24a7e6 req-1113bc48-7d61-4316-95d1-731fd00cd505 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.465457 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4c9caaca-dedf-4af8-bba1-ab3cab24a7e6 req-1113bc48-7d61-4316-95d1-731fd00cd505 service nova] Creating event network-vif-plugged:58fe0723-fb16-41da-b1e9-0813b4aabe19 for instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 on n-h2-836830-13 Aug 29 15:48:47.480383 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4c9caaca-dedf-4af8-bba1-ab3cab24a7e6 req-1113bc48-7d61-4316-95d1-731fd00cd505 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070847 Aug 29 15:48:47.487857 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1451/2882] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:47.506132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:47.507561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:47.520940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.521505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.521958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.523122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.523660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.527755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.775564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:47.794961 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2194780c-80bc-48f0-a0aa-12805e30a7e3 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 1.384942 Aug 29 15:48:47.796538 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1432/2883] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:46 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:47.801541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:47.802396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:47.821109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.827972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.828701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:47.829609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:47.830228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:47.830808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.141162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.158264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8aa741cc-e750-4c4f-a62d-e4b3b3b0f6e6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.668212 Aug 29 15:48:48.159692 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1452/2884] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:47 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:48.176635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:48.177649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:48.192530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.193323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.196365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.198792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.201612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.202385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.352328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.372916 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-416bd461-9839-46fd-a31a-6bfd7b578166 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1282 microversion: 2.1 time: 0.210958 Aug 29 15:48:48.375991 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1453/2885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:48 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:48.393146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:48.394083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:48.411015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.412632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.415507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.417326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.419438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.421005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.585283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.597550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.601592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.606225 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0cb2974c-7bd9-4f2e-97d0-baf4b445cb2b tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.228308 Aug 29 15:48:48.607389 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1454/2886] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:48 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:48.613997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3185cc3-0626-4290-b8ce-a9f571f0d627 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed9d7280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:48.689757 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3185cc3-0626-4290-b8ce-a9f571f0d627 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.080634 Aug 29 15:48:48.692158 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1455/2887] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:48 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:48.797992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:48.816747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:48.818250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:48.833670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-749fa77c-9bf6-4877-b1b8-4d0f6d0270c6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 1.035649 Aug 29 15:48:48.847067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.847067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.847067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.847067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:48.847067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:48.847067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:48.856310 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1433/2888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:47 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:49.186245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.187507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.198708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.199245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.199728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.200440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.219404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.219904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.426402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.437754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5bf4fe12-a707-4351-b50a-b2cabe42d2ce tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1352 microversion: 2.1 time: 0.625842 Aug 29 15:48:49.438339 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1456/2889] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:48 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1352 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:49.474802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9fb841fb-479b-4e0c-a077-bb87184e91d8 req-8f9a7e1f-0deb-41a7-bec8-0c2dccf1f746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e71d3d-5e1a-4a22-8afa-2a402706a1b5", "tag": "59264794-ffe2-4e30-8861-1ee39b44bd66"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:49.521662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9fb841fb-479b-4e0c-a077-bb87184e91d8 req-8f9a7e1f-0deb-41a7-bec8-0c2dccf1f746 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.522778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9fb841fb-479b-4e0c-a077-bb87184e91d8 req-8f9a7e1f-0deb-41a7-bec8-0c2dccf1f746 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.523864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9fb841fb-479b-4e0c-a077-bb87184e91d8 req-8f9a7e1f-0deb-41a7-bec8-0c2dccf1f746 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.567624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9fb841fb-479b-4e0c-a077-bb87184e91d8 req-8f9a7e1f-0deb-41a7-bec8-0c2dccf1f746 service nova] Creating event network-changed:59264794-ffe2-4e30-8861-1ee39b44bd66 for instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 on n-h1-836830-13 Aug 29 15:48:49.586856 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9fb841fb-479b-4e0c-a077-bb87184e91d8 req-8f9a7e1f-0deb-41a7-bec8-0c2dccf1f746 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131756 Aug 29 15:48:49.592590 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1457/2890] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:49.603771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.607812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.623190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.623934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.626384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.627369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.630345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.630993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.734850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.759678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:49.780471 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-52bdf593-8b03-4d01-8a3a-828003d46110 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.598879 Aug 29 15:48:49.800342 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1434/2891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:49.806994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:49.808705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:49.819078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.820085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.821220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.822516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:49.825674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:49.826632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:49.937882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.952897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.958709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:49.975526 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99e59d5b-d8e6-43f2-988d-ccb25779bbca tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.172578 Aug 29 15:48:49.978055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1435/2892] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:49.986616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-915866fa-f96a-494a-b568-dfb803d45036 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb13b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.010452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.019481 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f107dd89-3669-40b2-a805-ae9fbc6d128d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.425292 Aug 29 15:48:50.023559 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1458/2893] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:50.035963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b8b70d91-5223-4e8d-9b08-d7bee8ab309c req-b77bb01c-d3ef-40e9-9331-c1e783a08aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba41f76-a8f6-4e44-9942-a5cb7b54ef96", "name": "network-vif-plugged", "status": "completed", "tag": "9eb6caab-7ba5-407d-a3c3-332b6ec2299f"}, {"server_uuid": "b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c", "name": "network-vif-plugged", "status": "completed", "tag": "52c3f5bd-a607-478d-b7f3-8a16a81fbcc9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:50.063802 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-915866fa-f96a-494a-b568-dfb803d45036 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.084317 Aug 29 15:48:50.064952 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1436/2894] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:49 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:50.066170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b8b70d91-5223-4e8d-9b08-d7bee8ab309c req-b77bb01c-d3ef-40e9-9331-c1e783a08aa7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.066680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b8b70d91-5223-4e8d-9b08-d7bee8ab309c req-b77bb01c-d3ef-40e9-9331-c1e783a08aa7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.068592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b8b70d91-5223-4e8d-9b08-d7bee8ab309c req-b77bb01c-d3ef-40e9-9331-c1e783a08aa7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.075908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.084392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.097311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.098152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.098728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.099995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.100658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.101230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.117071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b8b70d91-5223-4e8d-9b08-d7bee8ab309c req-b77bb01c-d3ef-40e9-9331-c1e783a08aa7 service nova] Creating event network-vif-plugged:9eb6caab-7ba5-407d-a3c3-332b6ec2299f for instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 on n-h1-836830-13 Aug 29 15:48:50.117589 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b8b70d91-5223-4e8d-9b08-d7bee8ab309c req-b77bb01c-d3ef-40e9-9331-c1e783a08aa7 service nova] Creating event network-vif-plugged:52c3f5bd-a607-478d-b7f3-8a16a81fbcc9 for instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c on n-h1-836830-13 Aug 29 15:48:50.139745 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b8b70d91-5223-4e8d-9b08-d7bee8ab309c req-b77bb01c-d3ef-40e9-9331-c1e783a08aa7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114505 Aug 29 15:48:50.140510 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1459/2895] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:50.460264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.461153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.475714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.476208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.476643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.482265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.482790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.483283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.574444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.593971 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40fe8ef7-b7f9-4c05-b8b9-d99690d25cfa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 0.527520 Aug 29 15:48:50.595000 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1437/2896] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:50 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:50.782640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:50.801129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71dd1055-0324-4297-9637-c40cdcb1f944 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1542 microversion: 2.1 time: 0.344550 Aug 29 15:48:50.805714 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1460/2897] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:50 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1542 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:50.810024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.811285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.821914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.822108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:50.824211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.826221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.827442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:50.829315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.830031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.830862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.846893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.847437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.847862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:50.857531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:50.858033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:50.858476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.089047 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e569095-734c-43d9-90c5-5bfd9db22ce0 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.272236 Aug 29 15:48:51.090490 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1461/2898] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:48:50 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:51.102139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:51.103718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:51.131635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.132769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.133370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.134261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.135155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.138031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.147819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:51.155787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.169661 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5d3c688-d0dc-4e94-b0d1-d024a61173d8 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.366835 Aug 29 15:48:51.170255 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1438/2899] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:50 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:51.202819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:51.203733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:51.216217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=5 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:51.223477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.224347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.225242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.226192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.226830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.227488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.379740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.392232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.393675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.394865 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-188301cc-3b29-4b03-a8ed-3d536b38f8c2 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.303269 Aug 29 15:48:51.415756 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1462/2900] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:51 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:51.423767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1768d948-9dcb-4b7d-92dc-fad5e3f983fd tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed98c5e0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:51.526522 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1768d948-9dcb-4b7d-92dc-fad5e3f983fd tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.108776 Aug 29 15:48:51.537635 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1463/2901] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:51 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:51.618544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:51.619586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:51.645954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.646453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.646877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.654898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.658564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.659417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.667712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:51.696621 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f3aeaf5c-4cb5-41dd-baa1-eec2bf8c8ca2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.514645 Aug 29 15:48:51.698596 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1439/2902] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:51 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:51.707451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1c5f70ab-3ff2-441d-959f-c2b8774805df req-5efa495a-73c7-43ca-840d-c57a1586a426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15608c5c-acbc-4327-ade5-30c5b31166bc", "tag": "77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:51.718648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:51.745575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1c5f70ab-3ff2-441d-959f-c2b8774805df req-5efa495a-73c7-43ca-840d-c57a1586a426 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:51.745575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1c5f70ab-3ff2-441d-959f-c2b8774805df req-5efa495a-73c7-43ca-840d-c57a1586a426 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:51.745575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1c5f70ab-3ff2-441d-959f-c2b8774805df req-5efa495a-73c7-43ca-840d-c57a1586a426 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:51.783536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1c5f70ab-3ff2-441d-959f-c2b8774805df req-5efa495a-73c7-43ca-840d-c57a1586a426 service nova] Creating event network-changed:77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48 for instance 15608c5c-acbc-4327-ade5-30c5b31166bc on n-h2-836830-13 Aug 29 15:48:51.791913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1c5f70ab-3ff2-441d-959f-c2b8774805df req-5efa495a-73c7-43ca-840d-c57a1586a426 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091851 Aug 29 15:48:51.800250 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1440/2903] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:52.193740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:52.195353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:52.208778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.209577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.210169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.211049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.211671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.212259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.445092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:52.484510 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94e49245-e7e2-4399-9e34-94382a71570b tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1315 microversion: 2.1 time: 0.287084 Aug 29 15:48:52.485748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1441/2904] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:52 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:52.500217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:52.502822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:52.537125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.539494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.542912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.543366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.543877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.546537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.738211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:52.780615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:52.784086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:52.793246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:52.795806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:52.796050 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-039dc486-26cb-47a5-a91a-c01f6981e8fc tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.309011 Aug 29 15:48:52.802583 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1442/2905] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:52 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:52.814860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4773a4da-31f2-46f2-b923-8f0f8566ecdd tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaf1c10>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:52.817401 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b1980077-3fd2-4e11-bf2f-4ef2280af6ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 1.205176 Aug 29 15:48:52.829667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1464/2906] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:51 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:52.842944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:52.847819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:52.858487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.858984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.863067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.863835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:52.864305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:52.864738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:52.911240 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4773a4da-31f2-46f2-b923-8f0f8566ecdd tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.107323 Aug 29 15:48:52.920321 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1443/2907] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:52 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:53.326813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:53.334725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b1f970a-84c8-45fb-a10e-093abd32acc3 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.503706 Aug 29 15:48:53.335334 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1465/2908] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:52 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:53.505987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:53.507266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:53.524840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.525329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.525770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.526780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.527342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.527771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.827013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:53.827535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:53.828222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:53.836262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:53.840730 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2cbb969b-65ad-4273-8c21-cb228ba53bc0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1502 microversion: 2.1 time: 0.334654 Aug 29 15:48:53.842805 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1444/2909] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:53 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:53.849255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:53.849763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.850021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:53.851002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.851577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.852429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.852987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.853592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.876480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.876985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.881848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:53.887327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:53.888052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:53.891297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.082879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:54.102882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:54.108256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:54.110028 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b4944a5-373d-4c3d-b1b1-d81cd6b37913 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.286340 Aug 29 15:48:54.111132 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1466/2910] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:53 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:48:54.116647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:54.117419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:54.125438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.129397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:54.133597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.134253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.135187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.136364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.137314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.139681 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b569615d-a916-4de6-bbb3-c0a90fdb3bee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 0.295544 Aug 29 15:48:54.140398 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1445/2911] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:53 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:54.174083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lazy-loading 'flavor' on Instance uuid 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:48:54.287057 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-523ccdc2-3a44-4070-aa48-d42168943da6 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "POST /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96/action" status: 202 len: 0 microversion: 2.1 time: 0.174461 Aug 29 15:48:54.301236 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1467/2912] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:48:54 2022] POST /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:48:54.312669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-135dd6f5-d3b0-4cbc-b69c-a2d445751866 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eda25ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:54.410238 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-135dd6f5-d3b0-4cbc-b69c-a2d445751866 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.106570 Aug 29 15:48:54.410935 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1468/2913] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:54 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:54.424066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:54.425938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:54.441523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.442352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.443146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.444086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.444639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.445363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.505686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:54.507222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:54.524930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.526806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.529125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.530094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.532362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.533018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.599138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:54.745739 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1eff27ef-1b98-4b73-aaa9-91092ccf22e8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 204 len: 0 microversion: 2.42 time: 0.602543 Aug 29 15:48:54.746199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1446/2914] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:48:54 2022] DELETE /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:48:54.756692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:54.757986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:54.766350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.766845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.767384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.768096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:54.769049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:54.769333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:54.969820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:54.980458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62ee2f53-d641-40ef-8b63-4bad7501aafb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.229980 Aug 29 15:48:54.984485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1447/2915] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:54 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:54.990902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:54.991754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:55.016100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.016621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.017258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.018132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.018624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.019076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.312159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.322396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.324430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.325685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a535e3f4-3112-4cff-8cee-9a357a1d0561 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2952 microversion: 2.42 time: 0.339874 Aug 29 15:48:55.326251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1448/2916] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:54 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2952 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:55.337344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.351289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:55.351914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:55.356976 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-989db844-de8e-4ec7-991b-1ffbf430f676 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1510 microversion: 2.1 time: 0.943488 Aug 29 15:48:55.358225 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1469/2917] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:54 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1510 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:55.365884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:55.375310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:55.381021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.381791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.384391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.385909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.386995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.389546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.390433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.393876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.394803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.396328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.398804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.399596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.514126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.528820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.530614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.532289 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9ec5a20-4486-41ea-952c-c8bc9105991e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.204782 Aug 29 15:48:55.532973 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1449/2918] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:55 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:55.553660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d7c7a1d-5120-4abd-b1e7-ac13bdf52a2f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb37670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:55.614935 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d7c7a1d-5120-4abd-b1e7-ac13bdf52a2f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.080824 Aug 29 15:48:55.622759 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1450/2919] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:55 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:55.622759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1225dd1f-a2f5-4f51-b47a-f1a9c05080ce req-c2f35936-dee3-4997-9070-f145a9aa3d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1abacf35-4c11-4331-bc1b-6dd4d88f1190", "tag": "58fe0723-fb16-41da-b1e9-0813b4aabe19"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:55.646819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:55.649660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1225dd1f-a2f5-4f51-b47a-f1a9c05080ce req-c2f35936-dee3-4997-9070-f145a9aa3d46 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:55.650151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1225dd1f-a2f5-4f51-b47a-f1a9c05080ce req-c2f35936-dee3-4997-9070-f145a9aa3d46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:55.651807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1225dd1f-a2f5-4f51-b47a-f1a9c05080ce req-c2f35936-dee3-4997-9070-f145a9aa3d46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:55.656436 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e19a6cf8-6fb2-4389-8ab5-ced430caac47 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 0.295924 Aug 29 15:48:55.665981 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1225dd1f-a2f5-4f51-b47a-f1a9c05080ce req-c2f35936-dee3-4997-9070-f145a9aa3d46 service nova] Creating event network-changed:58fe0723-fb16-41da-b1e9-0813b4aabe19 for instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 on n-h2-836830-13 Aug 29 15:48:55.682794 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1225dd1f-a2f5-4f51-b47a-f1a9c05080ce req-c2f35936-dee3-4997-9070-f145a9aa3d46 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063950 Aug 29 15:48:55.688051 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1451/2920] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:55.692629 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1470/2921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:55 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:55.788495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4b372b6-57b4-4bd3-8809-73406494877b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Action: 'create', calling method: .version_select at 0x7f32edb13e50>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-924693743", "policies": ["affinity"]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:55.822120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c4b372b6-57b4-4bd3-8809-73406494877b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:55.834432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c4b372b6-57b4-4bd3-8809-73406494877b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:55.910990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c4b372b6-57b4-4bd3-8809-73406494877b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:55.924259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c4b372b6-57b4-4bd3-8809-73406494877b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:55.958388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4b372b6-57b4-4bd3-8809-73406494877b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.268730 Aug 29 15:48:55.974380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88167fd7-a50e-4b2b-bb84-0e8f38bb214b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Action: 'create', calling method: .version_select at 0x7f32ed9384c0>, body: {"server_group": {"name": "tempest-server-group-1857596785", "policies": ["affinity"]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:55.979987 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1452/2922] 10.222.0.83 () {60 vars in 1174 bytes} [Mon Aug 29 15:48:55 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:55.999795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-88167fd7-a50e-4b2b-bb84-0e8f38bb214b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:56.008349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:56.009011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:56.018436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.019093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.019560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.020167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.020632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.021086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.031498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-88167fd7-a50e-4b2b-bb84-0e8f38bb214b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:56.132226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-88167fd7-a50e-4b2b-bb84-0e8f38bb214b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:56.139468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-88167fd7-a50e-4b2b-bb84-0e8f38bb214b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:56.170182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88167fd7-a50e-4b2b-bb84-0e8f38bb214b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.204326 Aug 29 15:48:56.177854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1471/2923] 10.222.0.83 () {60 vars in 1173 bytes} [Mon Aug 29 15:48:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:56.190686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-857d1b67-d2f5-4d1f-9391-e4a81b912394 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Action: 'create', calling method: .version_select at 0x7f32ed938d30>, body: {"server_group": {"name": "tempest-server-group-1857596785", "policies": ["affinity"]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:56.230115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-857d1b67-d2f5-4d1f-9391-e4a81b912394 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:56.237373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:56.252019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-857d1b67-d2f5-4d1f-9391-e4a81b912394 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:56.298546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.311202 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e58aa8f-e142-47c0-8e20-64cb379a2cfc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.309191 Aug 29 15:48:56.314457 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1453/2924] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:56 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:48:56.319850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f12f110b-5b83-41c1-a3d7-fba9ed526669 req-961c1664-8e60-4217-a25b-e0ab4f76e83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e71d3d-5e1a-4a22-8afa-2a402706a1b5", "name": "network-vif-plugged", "status": "completed", "tag": "59264794-ffe2-4e30-8861-1ee39b44bd66"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:56.340110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f12f110b-5b83-41c1-a3d7-fba9ed526669 req-961c1664-8e60-4217-a25b-e0ab4f76e83d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.347326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f12f110b-5b83-41c1-a3d7-fba9ed526669 req-961c1664-8e60-4217-a25b-e0ab4f76e83d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.348896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f12f110b-5b83-41c1-a3d7-fba9ed526669 req-961c1664-8e60-4217-a25b-e0ab4f76e83d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.358350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-857d1b67-d2f5-4d1f-9391-e4a81b912394 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:56.370418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-857d1b67-d2f5-4d1f-9391-e4a81b912394 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:56.375870 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f12f110b-5b83-41c1-a3d7-fba9ed526669 req-961c1664-8e60-4217-a25b-e0ab4f76e83d service nova] Creating event network-vif-plugged:59264794-ffe2-4e30-8861-1ee39b44bd66 for instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 on n-h1-836830-13 Aug 29 15:48:56.385834 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f12f110b-5b83-41c1-a3d7-fba9ed526669 req-961c1664-8e60-4217-a25b-e0ab4f76e83d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069365 Aug 29 15:48:56.388548 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1454/2925] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:56.394022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:56.398938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:56.406711 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-857d1b67-d2f5-4d1f-9391-e4a81b912394 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.219753 Aug 29 15:48:56.411276 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1472/2926] 10.222.0.83 () {60 vars in 1173 bytes} [Mon Aug 29 15:48:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:56.418930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.419683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.420284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.421198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.421818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:56.422448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.423298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:56.424380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.436371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.445447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.448092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.449312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.462953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.464510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.706646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.726144 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5bd18d6c-1012-4e16-80ae-3cfd59b3676d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1493 microversion: 2.1 time: 0.312751 Aug 29 15:48:56.728806 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1473/2927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:56 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1493 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:56.741839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5037a742-a73d-45c4-8506-f9f289de99fd tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:56.820094 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5037a742-a73d-45c4-8506-f9f289de99fd tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/9f02a481-68ae-44b3-bef5-a1097dd10364" status: 204 len: 0 microversion: 2.1 time: 0.090683 Aug 29 15:48:56.823697 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1474/2928] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:48:56 2022] DELETE /compute/v2.1/os-server-groups/9f02a481-68ae-44b3-bef5-a1097dd10364 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:56.826356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:56.826980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:56.845506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.846173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.846407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.847080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:56.847541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:56.847973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:56.860694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.867618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:56.877976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.880711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:56.891546 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c159681a-db92-4a44-b672-25d28a995fac tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2952 microversion: 2.42 time: 0.500252 Aug 29 15:48:56.893696 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1455/2929] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:56 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2952 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:56.902107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b31506c-70f2-4129-a55f-1235b9bcb41c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaf3430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.005070 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2b31506c-70f2-4129-a55f-1235b9bcb41c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.109964 Aug 29 15:48:57.013222 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1456/2930] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:56 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:57.023385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.024015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:57.045985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.046469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.046909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.047650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.048105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.048569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.132879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:57.146670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:57.150188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:57.157764 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1035644e-ce9a-4893-aad0-b9473647eab1 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1408 microversion: 2.54 time: 0.335495 Aug 29 15:48:57.158381 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1475/2931] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:56 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:57.165783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.168916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:57.180508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.187227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.187981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.200117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.200871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.201480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.252210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:48:57.505273 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73ca0273-9c52-4eb9-ba8d-80a2b4631362 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 204 len: 0 microversion: 2.1 time: 0.345294 Aug 29 15:48:57.505948 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1476/2932] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:48:57 2022] DELETE /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:57.515467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:57.531709 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cdc00b54-f363-4e21-8d97-2ef18f17cde4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 0.518449 Aug 29 15:48:57.533074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8414d738-f045-4543-aa6b-d6e2e41ccabc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.533625 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1457/2933] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:57 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:57.542940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.544388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:57.560716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.561579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.562542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.563638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.565212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.565829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.570432 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8414d738-f045-4543-aa6b-d6e2e41ccabc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.063214 Aug 29 15:48:57.575076 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1477/2934] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:48:57 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:57.586079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:57.586829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:57.604268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.604783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.605209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.605925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:57.606408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:57.606796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:57.990185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.001501 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe9e2e85-b4b0-4bb9-b6eb-1e3dfc5886b0 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1499 microversion: 2.1 time: 0.426071 Aug 29 15:48:58.004110 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1478/2935] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:57 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1499 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:58.009409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e35aa34-0c43-4457-944d-61f70877bbf1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.058703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e35aa34-0c43-4457-944d-61f70877bbf1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/a9e02433-51c9-4453-a462-4b7300f0ce7c" status: 204 len: 0 microversion: 2.1 time: 0.047685 Aug 29 15:48:58.062809 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1479/2936] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:48:58 2022] DELETE /compute/v2.1/os-server-groups/a9e02433-51c9-4453-a462-4b7300f0ce7c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:58.084926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.085915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:58.110913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.111565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.112243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.113062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.115398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.116442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.134229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.144347 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-34a94424-6030-4a4d-ab5d-4d5719df7d3c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.609365 Aug 29 15:48:58.145727 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1458/2937] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:57 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:58.163003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b584f6d3-f27a-4b43-b3c4-a6c2a9e2456a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaf3430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.263716 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b584f6d3-f27a-4b43-b3c4-a6c2a9e2456a tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.116448 Aug 29 15:48:58.264686 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1459/2938] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:58 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:58.293665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ef77840-15bc-4d48-8bf6-d307f2387a31 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.329823 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ef77840-15bc-4d48-8bf6-d307f2387a31 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.062380 Aug 29 15:48:58.331082 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1460/2939] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:48:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:58.337237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.338114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:58.346280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.347170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.347836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.349051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.350043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.350801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.478434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.491829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.496316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.497615 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a75128bf-be17-4ed2-9768-7e24d94917d3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1414 microversion: 2.54 time: 0.165188 Aug 29 15:48:58.527886 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1461/2940] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:58 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1414 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:58.554666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-196e180c-eb4a-4de4-a0cd-3a4949c26398 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Action: 'create', calling method: .version_select at 0x7f32edb13c10>, body: {"server_group": {"name": "tempest-server-group-823124105", "policies": ["affinity"]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:58.612452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-196e180c-eb4a-4de4-a0cd-3a4949c26398 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:58.635991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-196e180c-eb4a-4de4-a0cd-3a4949c26398 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:58.732211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:58.743245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.764902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.774318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:58.779519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-196e180c-eb4a-4de4-a0cd-3a4949c26398 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:58.785687 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a155584-5333-4dc5-b094-3a227eef6c48 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2952 microversion: 2.42 time: 0.711149 Aug 29 15:48:58.786989 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1480/2941] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:58 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2952 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:58.797115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.797851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:58.805110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-196e180c-eb4a-4de4-a0cd-3a4949c26398 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:58.823991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.824508 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-196e180c-eb4a-4de4-a0cd-3a4949c26398 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.293034 Aug 29 15:48:58.825294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.825952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.826899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:58.827589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:58.828257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:58.830899 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1462/2942] 10.222.0.83 () {60 vars in 1173 bytes} [Mon Aug 29 15:48:58 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:58.836628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e2f768a-8c1f-4131-bad3-b9c620d25656 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.871736 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e2f768a-8c1f-4131-bad3-b9c620d25656 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/6877d869-c72d-400b-85b1-c855f8a508fe" status: 204 len: 0 microversion: 2.1 time: 0.039598 Aug 29 15:48:58.878539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1463/2943] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:48:58 2022] DELETE /compute/v2.1/os-server-groups/6877d869-c72d-400b-85b1-c855f8a508fe => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:58.884527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca1fd758-8443-40b4-b09a-968fb7140267 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:58.899723 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca1fd758-8443-40b4-b09a-968fb7140267 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.019681 Aug 29 15:48:58.907241 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1464/2944] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:48:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:48:58.912427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99a7969a-5dc1-4f9a-a230-4e9157eb2abc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Action: 'create', calling method: .version_select at 0x7f32edb38790>, body: {"server_group": {"name": "tempest-server-group-1981138876", "policies": ["anti-affinity"]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:58.968476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-99a7969a-5dc1-4f9a-a230-4e9157eb2abc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:58.995204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-99a7969a-5dc1-4f9a-a230-4e9157eb2abc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:59.066750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-99a7969a-5dc1-4f9a-a230-4e9157eb2abc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:48:59.072469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-99a7969a-5dc1-4f9a-a230-4e9157eb2abc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_groups'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:48:59.074775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:59.087988 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-95c5c7ed-dab0-4171-8e58-4a77e7dc62aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1310 microversion: 2.1 time: 0.299778 Aug 29 15:48:59.089973 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1481/2945] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:58 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1310 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:59.094861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.095703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.101965 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99a7969a-5dc1-4f9a-a230-4e9157eb2abc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.193495 Aug 29 15:48:59.102888 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1465/2946] 10.222.0.83 () {60 vars in 1173 bytes} [Mon Aug 29 15:48:58 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:59.112845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.113710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.114170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.114869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.115707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e24a367b-76fd-4216-901e-7b755c423ff4 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.116220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.117252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.168647 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e24a367b-76fd-4216-901e-7b755c423ff4 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/63579fbc-4303-422a-9f9e-e08e8ec8dfe0" status: 204 len: 0 microversion: 2.1 time: 0.057928 Aug 29 15:48:59.172274 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1466/2947] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:48:59 2022] DELETE /compute/v2.1/os-server-groups/63579fbc-4303-422a-9f9e-e08e8ec8dfe0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:48:59.180227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.180852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.188011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.188529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.188970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.189698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.190156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.190618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.346931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:59.362718 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-872867bb-e3ad-4e3c-96d4-deb156d8c53e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1499 microversion: 2.1 time: 0.271419 Aug 29 15:48:59.363343 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1482/2948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1499 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:59.374356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0abd3b94-b4ec-46f5-8774-720fd1ddfc03 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.394444 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0abd3b94-b4ec-46f5-8774-720fd1ddfc03 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029162 Aug 29 15:48:59.394834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:59.395938 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1483/2949] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:48:59.402184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98e0fed0-ba9e-4b85-92e4-65ff9732245d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaa00d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.428341 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dac0a695-6332-44f9-914e-567a6303d9dc tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.257588 Aug 29 15:48:59.446833 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1467/2950] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:59.467725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98e0fed0-ba9e-4b85-92e4-65ff9732245d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.070531 Aug 29 15:48:59.475781 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1484/2951] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:48:59.481501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1979863439", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e1d5e847-17e0-4c9c-a608-be1fa771b440"}]}, "os:scheduler_hints": {"group": "8aae68c6-cd72-4b07-9230-2d6608276d07"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:48:59.530305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.531712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.543773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.547558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.549064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.550079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.550199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] validate_networks() for [('e1d5e847-17e0-4c9c-a608-be1fa771b440', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:48:59.550920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.551696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.636874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:59.640865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:48:59.654336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:59.659094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:48:59.660378 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-36ca9c61-4d9c-4236-9e0c-038b97cd687f tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1414 microversion: 2.54 time: 0.142914 Aug 29 15:48:59.664453 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1485/2952] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:48:59.824450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:48:59.834389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:48:59.850636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.853946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.859001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:48:59.860850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:48:59.861959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:48:59.862946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.363613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.391222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.397257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.400055 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b295fd3-40ed-4d92-ad96-7fbd9e16d51f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2952 microversion: 2.42 time: 0.587796 Aug 29 15:49:00.404308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1486/2953] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:48:59 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2952 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:00.409795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:00.413386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:00.426472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.435050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.435913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.436912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.437600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.438430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.735928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:00.750450 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ad442f5a-f933-4e9e-91da-8fbf4fc5c9e5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1493 microversion: 2.1 time: 0.344482 Aug 29 15:49:00.763050 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1487/2954] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:00 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1493 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:00.763050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:00.763050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:00.779209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.779711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.780156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.780867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.781323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.781748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.883884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:00.885015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:00.886222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:00.886943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:00.887617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:00.935435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.936301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.938768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.945592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:00.946476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:00.947174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:00.998644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:01.012224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:01.055079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:01.075546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:01.190873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=129132) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 29 15:49:01.240789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_group_members'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:01.249286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_group_members'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:01.277370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '853f8300f9bb403b9cea4834c5a1edcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d32eb4fb5ea49e6ad495a8175ae5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.287006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d6198f3-3b15-4784-9d06-c30b111cee13 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 200 len: 1499 microversion: 2.1 time: 0.534615 Aug 29 15:49:01.290513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1488/2955] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:00 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 1499 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:01.299921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.303618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.318912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.319692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.328154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.329150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.329747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.331922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.376266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_group_members'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:01.393394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Getting quotas for user 3fb56832bbeb4a74b67ba0c1f68b3aa6 and project 7ff0e0f8d06044de8b8be818bc760176. Resources: {'server_group_members'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:01.420468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:01.461909 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0b03887-2a0f-4743-b9ed-f280f02e076b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984313 Aug 29 15:49:01.466878 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1468/2956] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:48:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:01.475437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fac349a8-1505-436a-9e0f-316b39790848 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb131f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.576783 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fac349a8-1505-436a-9e0f-316b39790848 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.110492 Aug 29 15:49:01.587912 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1469/2957] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:01.600315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.600956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:01.619915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.620485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.628605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.631561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:01.632057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:01.632852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:01.809581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.820814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.823621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:01.824837 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eac784dc-212a-4e7b-879d-d197b4b5a692 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1414 microversion: 2.54 time: 0.235156 Aug 29 15:49:01.835087 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1470/2958] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1414 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:01.991771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:01.992462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.003073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.003831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.004443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.005519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.006123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.006815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.145541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.157646 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b58174c0-8690-4c8f-9844-347164ba7214 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.865489 Aug 29 15:49:02.174822 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1489/2959] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.185904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6cc4810a-00b8-439f-a5b9-312292eecf75 req-1b941b44-2807-4733-ab96-9b3716c7b09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15608c5c-acbc-4327-ade5-30c5b31166bc", "name": "network-vif-plugged", "status": "completed", "tag": "77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:02.204636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cc4810a-00b8-439f-a5b9-312292eecf75 req-1b941b44-2807-4733-ab96-9b3716c7b09c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.205880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cc4810a-00b8-439f-a5b9-312292eecf75 req-1b941b44-2807-4733-ab96-9b3716c7b09c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.218801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cc4810a-00b8-439f-a5b9-312292eecf75 req-1b941b44-2807-4733-ab96-9b3716c7b09c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.283503 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6cc4810a-00b8-439f-a5b9-312292eecf75 req-1b941b44-2807-4733-ab96-9b3716c7b09c service nova] Creating event network-vif-plugged:77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48 for instance 15608c5c-acbc-4327-ade5-30c5b31166bc on n-h2-836830-13 Aug 29 15:49:02.303078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6cc4810a-00b8-439f-a5b9-312292eecf75 req-1b941b44-2807-4733-ab96-9b3716c7b09c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121610 Aug 29 15:49:02.304391 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1490/2960] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:02.315448 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-22490c1f-bb6f-4bcf-93d3-07aeffac87f2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1646 microversion: 2.1 time: 0.485495 Aug 29 15:49:02.318069 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1471/2961] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:01 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1646 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.327448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cade2da9-fcfc-4ab6-be06-b3567e2a07b0 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.328296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cade2da9-fcfc-4ab6-be06-b3567e2a07b0 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.344701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.345423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.371622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.373418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.374037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.376027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.377731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.378347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.442284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cade2da9-fcfc-4ab6-be06-b3567e2a07b0 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:02.457455 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cade2da9-fcfc-4ab6-be06-b3567e2a07b0 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1213 microversion: 2.1 time: 0.137200 Aug 29 15:49:02.459316 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1472/2962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.469019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b7d467dc-0d9a-4e2a-9402-9f7c6e874b45 req-f5491664-75aa-49ad-8322-a4d7778a2ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba41f76-a8f6-4e44-9942-a5cb7b54ef96", "name": "network-vif-deleted", "tag": "9eb6caab-7ba5-407d-a3c3-332b6ec2299f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:02.490200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7d467dc-0d9a-4e2a-9402-9f7c6e874b45 req-f5491664-75aa-49ad-8322-a4d7778a2ace service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.490691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7d467dc-0d9a-4e2a-9402-9f7c6e874b45 req-f5491664-75aa-49ad-8322-a4d7778a2ace service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.491155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b7d467dc-0d9a-4e2a-9402-9f7c6e874b45 req-f5491664-75aa-49ad-8322-a4d7778a2ace service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.509283 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b7d467dc-0d9a-4e2a-9402-9f7c6e874b45 req-f5491664-75aa-49ad-8322-a4d7778a2ace service nova] Creating event network-vif-deleted:9eb6caab-7ba5-407d-a3c3-332b6ec2299f for instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 on n-h1-836830-13 Aug 29 15:49:02.518142 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b7d467dc-0d9a-4e2a-9402-9f7c6e874b45 req-f5491664-75aa-49ad-8322-a4d7778a2ace service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057121 Aug 29 15:49:02.523995 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1473/2963] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:02.535938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.537052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.547528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.548410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.549486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.550435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.554001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.554653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.600150 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 HTTP/1.1 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '5ba41f76-a8f6-4e44-9942-a5cb7b54ef96'} Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:02.602726 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.608137 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.608137 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:02.608137 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:02.608137 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:02.608137 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:02.608137 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.608137 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.611838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:02.615102 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c46012a4-c5bc-4fb1-bc4e-54289c18410d tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 404 len: 111 microversion: 2.1 time: 0.089333 Aug 29 15:49:02.619178 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1474/2964] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:02.625114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.626362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.633466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.634129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.635106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.636753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.637384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.637986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.853313 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0035660d-599f-47c7-81cb-dcbc5503c0f4 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1646 microversion: 2.1 time: 0.232152 Aug 29 15:49:02.856173 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1475/2965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1646 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.860946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3b484977-d48e-4842-bec2-5eeb146ab9a4 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaa9700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.926787 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3b484977-d48e-4842-bec2-5eeb146ab9a4 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.069509 Aug 29 15:49:02.927752 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1476/2966] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:02.939602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.940314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:02.952377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.953033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.954269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.955106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:02.955713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:02.956732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:02.979674 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 HTTP/1.1 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '5ba41f76-a8f6-4e44-9942-a5cb7b54ef96'} Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:02.982493 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:02.986802 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:02.987671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:02.988575 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2cf04a67-c0a1-4ed0-93bd-d7bfbe2738e9 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 404 len: 111 microversion: 2.1 time: 0.060009 Aug 29 15:49:02.989701 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1477/2967] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:02 2022] DELETE /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:02.997265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:02.998046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.004875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.005505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.006447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.009678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.010798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.011406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.137370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.143951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.156325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.158056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.159418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba850096-f579-4e32-911f-14ae964f94a9 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1414 microversion: 2.54 time: 0.168607 Aug 29 15:49:03.160916 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1478/2968] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1414 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:03.162412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.164962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.166120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.169942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.170549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.170777 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89007c27-c0b8-4692-a7e5-03f14b6e7a36 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2931 microversion: 2.42 time: 0.863747 Aug 29 15:49:03.171203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.172080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.172980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.173483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.184477 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1491/2969] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:02 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2931 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:03.206775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.208832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e77f1074-cde8-483d-8ca6-63c8673582fd tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.046608 Aug 29 15:49:03.209944 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1479/2970] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:03.216074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.216987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.218864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.225928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.227296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.228040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.229275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.230300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.231008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.231375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.233695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.234265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.238529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.240284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.241567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.271334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 HTTP/1.1 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5ba41f76-a8f6-4e44-9942-a5cb7b54ef96'} Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.273331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.278437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.278437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.278437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.278437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:03.278437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:03.278437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. Aug 29 15:49:03.278437 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.284255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:03.289560 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d2975ce7-9b91-4e18-afbb-c3e0692e698e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96" status: 404 len: 111 microversion: 2.1 time: 0.103734 Aug 29 15:49:03.290978 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1492/2971] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/5ba41f76-a8f6-4e44-9942-a5cb7b54ef96 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:03.302338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-13", "block_migration": true, "disk_over_commit": false}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:03.305777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.325694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.328202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.328644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.329529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.330337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.331325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.482235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lazy-loading 'flavor' on Instance uuid 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:03.484527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.497277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Going to try to live migrate instance to n-h2-836830-13 {{(pid=129133) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:49:03.497701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06cdde65-ed12-441d-b956-2eeb4773ecb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.286409 Aug 29 15:49:03.511634 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1480/2972] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:03.523685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.524202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.574611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.575482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.576092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.577005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.577660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.578290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.607483 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 HTTP/1.1 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '2847ea65-8be6-4458-9d02-aab8b85011b2'} Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:03.611063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.614982 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.617771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:03.618813 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aecf4da9-559e-4116-b5d1-0520e30b292a tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 404 len: 111 microversion: 2.1 time: 0.106082 Aug 29 15:49:03.619596 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1481/2973] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:03 2022] DELETE /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:03.641963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.642732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.695531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.696341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.709287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.709287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.709287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.709566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.829939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:03.847452 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2044cd29-66f6-4ab9-9b5d-1e858bab6676 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1209 microversion: 2.1 time: 0.225683 Aug 29 15:49:03.860865 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1482/2974] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1209 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:03.883342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.887039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 2847ea65-8be6-4458-9d02-aab8b85011b2] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.898235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.903728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.904685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.906656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.907264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.907710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 HTTP/1.1 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '2847ea65-8be6-4458-9d02-aab8b85011b2'} Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:03.931549 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 2847ea65-8be6-4458-9d02-aab8b85011b2 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:03.937122 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5a16ecc7-2570-4d76-bbbc-a3741f00ce89 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2" status: 404 len: 111 microversion: 2.1 time: 0.070941 Aug 29 15:49:03.940708 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1483/2975] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/servers/2847ea65-8be6-4458-9d02-aab8b85011b2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:03.950664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:03.951224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:03.957535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.958022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.958456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.959246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:03.959702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:03.960125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:03.977364 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d HTTP/1.1 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'f2d3ca4c-bcb4-444d-a316-0ba73c73182d'} Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:03.979894 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:03.983892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d266940-2edf-44f8-a8b4-3dfed6743ef1 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 404 len: 111 microversion: 2.1 time: 0.040314 Aug 29 15:49:03.985834 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1484/2976] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:03 2022] DELETE /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:03.990755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2021396e-c3da-460b-9c50-7e4aeac0409f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb5b1f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.076187 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2021396e-c3da-460b-9c50-7e4aeac0409f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1424 microversion: 2.1 time: 0.086991 Aug 29 15:49:04.087775 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1485/2977] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:03 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:04.107189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.108093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: f2d3ca4c-bcb4-444d-a316-0ba73c73182d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.117142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.117849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.118461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.120166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.120845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.121654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.140684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d HTTP/1.1 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'f2d3ca4c-bcb4-444d-a316-0ba73c73182d'} Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.142562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.147440 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.147440 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.147440 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.147440 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:04.147440 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:04.147440 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. Aug 29 15:49:04.147440 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.149283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance f2d3ca4c-bcb4-444d-a316-0ba73c73182d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:04.150574 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e723cb85-90db-4b92-994f-e7dba4588b79 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d" status: 404 len: 111 microversion: 2.1 time: 0.060998 Aug 29 15:49:04.152090 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1486/2978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/f2d3ca4c-bcb4-444d-a316-0ba73c73182d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:04.163629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.164420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.173796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.175124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.175721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.176592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.178941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.179675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.197199 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db HTTP/1.1 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '336ce67a-6ab6-43ab-9ae8-1cc6dcd015db'} Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:04.199766 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.204080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.205570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:04.206770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d54398f7-7844-4642-8a1a-308c1ea5a557 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 404 len: 111 microversion: 2.1 time: 0.047992 Aug 29 15:49:04.210366 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1487/2979] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:04 2022] DELETE /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:04.216240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.230921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.246033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.246531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.246967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.247707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.252276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.252795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.403447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.414088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.426603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.428057 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed25ae7c-ca68-46f2-88b3-756c19a495e3 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1399 microversion: 2.54 time: 0.216443 Aug 29 15:49:04.443588 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1488/2980] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1399 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:04.450285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.451151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.464560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.465337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.466433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.467503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.468152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.469039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.739519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.750995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.753455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:04.754109 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e55227e7-8579-48ca-aa6e-ca4ae0cb1f88 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2864 microversion: 2.42 time: 0.309002 Aug 29 15:49:04.754924 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1489/2981] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2864 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:04.779370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.782802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.789347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.790237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.790763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.791767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.792348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.792905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.809014 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db HTTP/1.1 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '336ce67a-6ab6-43ab-9ae8-1cc6dcd015db'} Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:04.810808 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 336ce67a-6ab6-43ab-9ae8-1cc6dcd015db could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef974e46-9b9d-4690-848b-02f732f9667e tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db" status: 404 len: 111 microversion: 2.1 time: 0.052142 Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1490/2982] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/336ce67a-6ab6-43ab-9ae8-1cc6dcd015db => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:04.819276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-unplugged", "status": "completed", "tag": "e65b0349-4179-4165-9636-d17fd8a0a033"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-unplugged", "status": "completed", "tag": "1ff5da3d-8e87-4515-81d9-3b8ba6e95e80"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-unplugged", "status": "completed", "tag": "c9522880-8b9a-466b-815f-947dc37f0279"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-unplugged", "status": "completed", "tag": "3d078389-4765-402b-87e7-e088b9a2e62a"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-unplugged", "status": "completed", "tag": "d1de827f-efc1-4f79-bef5-1c199a88d94d"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-unplugged", "status": "completed", "tag": "ecd0e964-9c43-41f4-b26c-045a5a86c754"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:04.832118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.832598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.833030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.847438 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Creating event network-vif-unplugged:e65b0349-4179-4165-9636-d17fd8a0a033 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:04.848077 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Creating event network-vif-unplugged:1ff5da3d-8e87-4515-81d9-3b8ba6e95e80 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:04.848559 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Creating event network-vif-unplugged:c9522880-8b9a-466b-815f-947dc37f0279 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:04.849297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Creating event network-vif-unplugged:3d078389-4765-402b-87e7-e088b9a2e62a for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:04.849532 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Creating event network-vif-unplugged:d1de827f-efc1-4f79-bef5-1c199a88d94d for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:04.850107 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] Creating event network-vif-unplugged:ecd0e964-9c43-41f4-b26c-045a5a86c754 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:04.857398 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3015296e-4a27-47e0-8d9a-10cf0e613a42 req-447a41a7-f129-49d1-a11b-c4c920dacd0e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.042222 Aug 29 15:49:04.857930 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1491/2983] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:04.863017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07bb071b-b928-4c05-af31-90c46bca32ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '.version_select at 0x7f32edad6dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.897504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07bb071b-b928-4c05-af31-90c46bca32ea tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-991730359" status: 204 len: 0 microversion: 2.54 time: 0.038239 Aug 29 15:49:04.898839 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1492/2984] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 15:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-991730359 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:49:04.906088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-56916bc7-2478-4c6b-87ff-42075923f42e req-91374fe2-b81b-4fe5-92cb-af41a10d90a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-deleted", "tag": "ecd0e964-9c43-41f4-b26c-045a5a86c754"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:04.920300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-56916bc7-2478-4c6b-87ff-42075923f42e req-91374fe2-b81b-4fe5-92cb-af41a10d90a8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.921054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-56916bc7-2478-4c6b-87ff-42075923f42e req-91374fe2-b81b-4fe5-92cb-af41a10d90a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.922239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-56916bc7-2478-4c6b-87ff-42075923f42e req-91374fe2-b81b-4fe5-92cb-af41a10d90a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.939823 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-56916bc7-2478-4c6b-87ff-42075923f42e req-91374fe2-b81b-4fe5-92cb-af41a10d90a8 service nova] Creating event network-vif-deleted:ecd0e964-9c43-41f4-b26c-045a5a86c754 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:04.945635 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-56916bc7-2478-4c6b-87ff-42075923f42e req-91374fe2-b81b-4fe5-92cb-af41a10d90a8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045231 Aug 29 15:49:04.946577 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1493/2985] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:04.953710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:04.954620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:04.961524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.962048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.962495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.963409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:04.963858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:04.964414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:04.967441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:05.127252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.145987 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7acae334-bd52-49b2-b1c0-b35c22db1386 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1324 microversion: 2.1 time: 0.195864 Aug 29 15:49:05.146902 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1494/2986] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:04 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1324 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.163252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.163607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.169906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.170446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.170824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.171723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.172171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.172591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.188425 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c HTTP/1.1 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7a905e81-88ea-4a7b-b20f-c32d13e84a8c'} Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:05.190372 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-afcf7c2c-dd6b-4baf-addf-be74021fda84 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 404 len: 111 microversion: 2.1 time: 0.042662 Aug 29 15:49:05.195914 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1495/2987] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:05 2022] DELETE /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:05.204182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.205335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.212542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.213037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.213521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.214293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.214652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.215259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.318868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.327555 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78f17036-c987-498f-8082-91485516f5ec tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1265 microversion: 2.1 time: 0.133775 Aug 29 15:49:05.328833 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1496/2988] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.334399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.335807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.343597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.344304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.345041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.345747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.346204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.346626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.376387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:05.473390 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a40b7f5-9b9e-42ee-836c-7ba64b1cf5d0 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "DELETE /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 204 len: 0 microversion: 2.54 time: 0.142935 Aug 29 15:49:05.474221 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1497/2989] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:49:05 2022] DELETE /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:49:05.484309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e959fad6-9729-4950-9aea-2d13419de3e2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaa9f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.570441 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e959fad6-9729-4950-9aea-2d13419de3e2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1433 microversion: 2.1 time: 0.093506 Aug 29 15:49:05.572289 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1498/2990] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1433 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.587646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.590292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 7a905e81-88ea-4a7b-b20f-c32d13e84a8c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.597669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.598176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.598613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.599372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.599828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.600282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.615381 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c HTTP/1.1 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7a905e81-88ea-4a7b-b20f-c32d13e84a8c'} Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:05.617272 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 7a905e81-88ea-4a7b-b20f-c32d13e84a8c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:05.622066 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d0a4d0ba-2f38-4af3-a7c2-fdf43fed4fe4 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c" status: 404 len: 111 microversion: 2.1 time: 0.046736 Aug 29 15:49:05.622878 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1499/2991] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/7a905e81-88ea-4a7b-b20f-c32d13e84a8c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:05.645420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.646063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.659551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.662892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.663171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.664205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.664730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.665174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.766781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.779859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.781471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:05.782792 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9cecbda7-5998-4ec9-8da0-83cf72189c7e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1405 microversion: 2.54 time: 0.158463 Aug 29 15:49:05.796394 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1500/2992] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:05.815792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d906df5-8435-45d1-82f1-5fb329bd3da3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5/action" status: 202 len: 0 microversion: 2.1 time: 2.523211 Aug 29 15:49:05.820083 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1493/2993] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:03 2022] POST /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5/action => generated 0 bytes in 2528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:05.826537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.828824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.834223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-23866141-cc6e-4d87-b1ab-da0de971a9ee tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb38dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.873031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.876516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.878317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.879114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.884734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.885922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.940955 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-23866141-cc6e-4d87-b1ab-da0de971a9ee tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 200 len: 1433 microversion: 2.1 time: 0.142051 Aug 29 15:49:05.941753 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1501/2994] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 1433 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:05.952152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:05.952829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:05.985104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.985882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.986641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:05.987642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:05.988385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:05.989135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.299982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.309815 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54ace507-1017-4e18-a16f-349ebf270ec2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.367126 Aug 29 15:49:06.310511 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1502/2995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:06.316520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.317570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.325230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.325819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.326404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.327241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.327771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.328269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.397364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=16 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:06.578057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.586309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-677ab91e-193d-4444-92a7-ac99335fb5c5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1467 microversion: 2.1 time: 0.274036 Aug 29 15:49:06.586895 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1503/2996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1467 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:06.592661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.593563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.599790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.600651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.601294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.602244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.602919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.603565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.739063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.753168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.754657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.756103 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-698f0476-4b18-40d9-97eb-34274c8c3932 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2660 microversion: 2.42 time: 0.934949 Aug 29 15:49:06.757061 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1494/2997] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:05 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2660 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:06.759354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.764112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.765067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.768342 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-48adf552-038b-4611-94f1-e3000733555d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1522 microversion: 2.1 time: 0.179775 Aug 29 15:49:06.774751 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1504/2998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:06.777642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0389fc4a-6197-4d2f-b80a-565113836396 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb38310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.783959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.784776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.785360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.794186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.794953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.795425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.836928 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0389fc4a-6197-4d2f-b80a-565113836396 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/648e7a49-e66c-42cf-859c-64f1df130787" status: 200 len: 784 microversion: 2.1 time: 0.066180 Aug 29 15:49:06.837917 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1505/2999] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/images/648e7a49-e66c-42cf-859c-64f1df130787 => generated 784 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:06.843590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.844211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.851757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.852440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.853040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.854629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.855155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.855638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.891092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:06.901656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c757725b-5d5c-4ae0-a055-a8d01fbdd300 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1271 microversion: 2.1 time: 0.141613 Aug 29 15:49:06.902881 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1495/3000] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:06.908810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:06.910199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:06.922244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.922758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.923257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:06.923991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:06.924459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:06.924896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.012731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:07.021906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:07.023892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:07.025080 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d61d6cbc-d19e-4590-9a52-cda22588dfb4 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1405 microversion: 2.54 time: 0.120932 Aug 29 15:49:07.026320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1496/3001] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:07.031209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e395ab8-0cd3-491d-b78d-46336a616b81 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.040291 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e395ab8-0cd3-491d-b78d-46336a616b81 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012631 Aug 29 15:49:07.041791 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1497/3002] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:49:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:07.047295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3cebc92e-735c-4ab9-821d-03455f02ae38 req-4df2dabc-8df3-46b9-a31d-6478f2b7bf60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-deleted", "tag": "d1de827f-efc1-4f79-bef5-1c199a88d94d"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-deleted", "tag": "e65b0349-4179-4165-9636-d17fd8a0a033"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:07.059539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:07.068767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3cebc92e-735c-4ab9-821d-03455f02ae38 req-4df2dabc-8df3-46b9-a31d-6478f2b7bf60 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.069255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3cebc92e-735c-4ab9-821d-03455f02ae38 req-4df2dabc-8df3-46b9-a31d-6478f2b7bf60 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.069690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3cebc92e-735c-4ab9-821d-03455f02ae38 req-4df2dabc-8df3-46b9-a31d-6478f2b7bf60 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.071821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f8380da1-2dfa-4c5e-8cce-ac29c80ae9c4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1522 microversion: 2.1 time: 0.232473 Aug 29 15:49:07.087556 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3cebc92e-735c-4ab9-821d-03455f02ae38 req-4df2dabc-8df3-46b9-a31d-6478f2b7bf60 service nova] Creating event network-vif-deleted:d1de827f-efc1-4f79-bef5-1c199a88d94d for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:07.087790 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1506/3003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:06 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:07.088997 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3cebc92e-735c-4ab9-821d-03455f02ae38 req-4df2dabc-8df3-46b9-a31d-6478f2b7bf60 service nova] Creating event network-vif-deleted:e65b0349-4179-4165-9636-d17fd8a0a033 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:07.096060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3cebc92e-735c-4ab9-821d-03455f02ae38 req-4df2dabc-8df3-46b9-a31d-6478f2b7bf60 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052284 Aug 29 15:49:07.098434 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1498/3004] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:07.105000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1810191816"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:07.108309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:07.115880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.116563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbe2f088-c1f7-404b-be18-c5e3a53eaf98 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edad6ee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.118998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.122360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.126354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.128635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.131370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.372779 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d154376-85e2-4feb-b8ca-df51083f38d9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc/action" status: 202 len: 0 microversion: 2.1 time: 0.271690 Aug 29 15:49:07.373665 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1499/3005] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:07 2022] POST /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:49:07.380472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.382012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:07.389646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.390452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.391745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.392885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.393503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.394084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.779312 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbe2f088-c1f7-404b-be18-c5e3a53eaf98 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "DELETE /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 204 len: 0 microversion: 2.1 time: 0.678874 Aug 29 15:49:07.779873 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1507/3006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:07 2022] DELETE /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:07.784103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:07.784764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8cfcc58-9469-4b97-acc4-f6a3242626b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '.version_select at 0x7f32edb130d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.795640 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75280d42-f61f-4460-8568-9ae5d05676bf tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.420084 Aug 29 15:49:07.796829 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1500/3007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:07 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:07.808089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:07.809311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:07.816601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.817091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.817525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:07.818291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:07.818749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:07.819251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.035867 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8cfcc58-9469-4b97-acc4-f6a3242626b7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617" status: 204 len: 0 microversion: 2.1 time: 0.254948 Aug 29 15:49:08.036835 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1508/3008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:07 2022] DELETE /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:08.044696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec54a21c-417a-4433-a120-afbb5acbba42 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaf33a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.083188 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ec54a21c-417a-4433-a120-afbb5acbba42 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] HTTP exception thrown: Image not found. Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec54a21c-417a-4433-a120-afbb5acbba42 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Request method failure captured: Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c HTTP/1.1 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_CHCi2QSb5B4NGGH8dvbhDZYBigNOvRVq4ZtTCdVHCcfaEEvzQrRcokhxjS4xW0zqOjS5AGA2hLQyTMA0SK_lbVjKf1iNcWoM2a5b9QSGsx46-5wYCXp2AtQY2u8CsKYvDugNsrTHM9pRmOp7J5xGTi4reNbY9YQuDXbszvFVYsFI Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d8c72636d6db42cfb42f0c535863a4b2 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8c72636d6db42cfb42f0c535863a4b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8c72636d6db42cfb42f0c535863a4b2", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8c72636d6db42cfb42f0c535863a4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8c72636d6db42cfb42f0c535863a4b2"}]}] Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d8c72636d6db42cfb42f0c535863a4b2 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerTestJSON-1888966700-project Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 1ada57c2de1f4c1f90d6f8173289bbb1 Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerTestJSON-1888966700-project Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '578ac3e3-e4a0-4ea5-bede-5402127f6c1c'} Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 578ac3e3-e4a0-4ea5-bede-5402127f6c1c Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:49:08.085207 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 578ac3e3-e4a0-4ea5-bede-5402127f6c1c could not be found. Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec54a21c-417a-4433-a120-afbb5acbba42 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec54a21c-417a-4433-a120-afbb5acbba42 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 404 len: 62 microversion: 2.1 time: 0.048586 Aug 29 15:49:08.090649 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1509/3009] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:08.107164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.108241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.118401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.119268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.122416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.124180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.124942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.126632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.259214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.269760 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e83b65d-bda0-43b7-955a-6359de746478 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1271 microversion: 2.1 time: 0.181451 Aug 29 15:49:08.274349 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1510/3010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:08.286401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcc06cdf-2388-4043-8cc0-8cf26e1edba9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '.version_select at 0x7f32edaa9310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.324163 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-bcc06cdf-2388-4043-8cc0-8cf26e1edba9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Image not found. Aug 29 15:49:08.326530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcc06cdf-2388-4043-8cc0-8cf26e1edba9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617 HTTP/1.1 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '64eaad36-a39c-4ddf-9db1-97e5b6dfb617'} Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 64eaad36-a39c-4ddf-9db1-97e5b6dfb617 Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 29 15:49:08.327009 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 64eaad36-a39c-4ddf-9db1-97e5b6dfb617 could not be found. Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:08.331551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcc06cdf-2388-4043-8cc0-8cf26e1edba9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:08.336819 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcc06cdf-2388-4043-8cc0-8cf26e1edba9 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617" status: 404 len: 62 microversion: 2.1 time: 0.058243 Aug 29 15:49:08.336819 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1511/3011] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:08.342517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.349367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.350146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.352309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.355860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0111baa2-444b-4002-b15f-d6bbae0ff8ff tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 2387 microversion: 2.42 time: 0.557449 Aug 29 15:49:08.358738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1501/3012] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:07 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 2387 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:08.362559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.367135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.368497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1090943351"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:08.369225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.370838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.373065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.374652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.375995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.380239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.380734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.381173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.381878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.382335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.382755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.388095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:08.509205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.528092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.530594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:08.532095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fd47ef98-dd3a-4f6d-83d6-d63fd49f445e tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1405 microversion: 2.54 time: 0.191664 Aug 29 15:49:08.533620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1512/3013] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:08.547594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.549687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.568061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.569122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.569519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.571813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.572310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.573282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.673599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1426cb6f-f4ec-44cc-a623-9a6ab1aaf6d5 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "POST /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c/action" status: 202 len: 0 microversion: 2.1 time: 0.313459 Aug 29 15:49:08.674521 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1502/3014] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:08 2022] POST /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 15:49:08.686419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd7f5114-70bf-4cb6-bec8-e05c53ddccae tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed93f310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.758601 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd7f5114-70bf-4cb6-bec8-e05c53ddccae tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.076961 Aug 29 15:49:08.759764 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1503/3015] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:08.826252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:08.827245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:08.829966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:08.844405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.844916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.845366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:08.846192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:08.846562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:08.846993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.174704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.192400 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-64c04137-b5fd-4923-bb20-55c47f29ae08 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1534 microversion: 2.1 time: 0.654550 Aug 29 15:49:09.220099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1513/3016] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1534 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:09.233137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-04f64a3c-469b-4c66-aac3-dac40024c763 req-9f28fa42-f55c-449f-bf8d-45194cd40f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-deleted", "tag": "1ff5da3d-8e87-4515-81d9-3b8ba6e95e80"}, {"server_uuid": "ed62d5ed-12ad-4742-93f2-d6687ec2db55", "name": "network-vif-deleted", "tag": "3d078389-4765-402b-87e7-e088b9a2e62a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:09.265930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-04f64a3c-469b-4c66-aac3-dac40024c763 req-9f28fa42-f55c-449f-bf8d-45194cd40f1a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.266704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-04f64a3c-469b-4c66-aac3-dac40024c763 req-9f28fa42-f55c-449f-bf8d-45194cd40f1a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.270718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-04f64a3c-469b-4c66-aac3-dac40024c763 req-9f28fa42-f55c-449f-bf8d-45194cd40f1a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.334672 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-04f64a3c-469b-4c66-aac3-dac40024c763 req-9f28fa42-f55c-449f-bf8d-45194cd40f1a service nova] Creating event network-vif-deleted:1ff5da3d-8e87-4515-81d9-3b8ba6e95e80 for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:09.337513 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-04f64a3c-469b-4c66-aac3-dac40024c763 req-9f28fa42-f55c-449f-bf8d-45194cd40f1a service nova] Creating event network-vif-deleted:3d078389-4765-402b-87e7-e088b9a2e62a for instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 on n-h1-836830-13 Aug 29 15:49:09.360350 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-04f64a3c-469b-4c66-aac3-dac40024c763 req-9f28fa42-f55c-449f-bf8d-45194cd40f1a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138607 Aug 29 15:49:09.366238 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1514/3017] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:09.383968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.385036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.386641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.398617 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f0491a8-934c-4db9-93cd-4acfe3107424 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.582224 Aug 29 15:49:09.402238 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1504/3018] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:08 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:09.414381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.415306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.428314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.429309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.433602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.434726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.435421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.435993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.441550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.444238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.448299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.454648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.456912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.461258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.572330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.605073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.606972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.608220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a6e7f630-e87d-463f-91d5-cf62da67736f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.204881 Aug 29 15:49:09.617612 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1505/3019] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:09.631265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.633136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:09.654823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.654823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.654823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.657550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.657550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.657550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.765997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.766487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.766925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.767411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lazy-loading 'fault' on Instance uuid 517ec077-87d3-419c-8d58-f6eaa59fd4c1 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:09.859736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.880193 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2d740c12-08a4-4d7f-aa8b-a9bfb8960ccb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.509704 Aug 29 15:49:09.881129 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1515/3020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:09.891297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-753587e1-d1c9-4010-8374-d3027c7fd32c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb22820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:09.905762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.921686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.931127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bcbbc66ca5044ea8acda1b137f1d5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4914f89b57484044972fa80c6294b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:09.939289 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23f21b73-4ad5-4dfb-a416-a985c6bfa331 tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 200 len: 1410 microversion: 2.54 time: 0.320190 Aug 29 15:49:09.940041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1506/3021] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 1410 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:09.946690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-525b1119-7bdf-448b-9701-cfc5d6203de7 req-c51d1c64-20c5-4ceb-ae3e-866db7afc73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c", "name": "network-vif-unplugged", "status": "completed", "tag": "52c3f5bd-a607-478d-b7f3-8a16a81fbcc9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:09.973329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-525b1119-7bdf-448b-9701-cfc5d6203de7 req-c51d1c64-20c5-4ceb-ae3e-866db7afc73e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:09.976668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-525b1119-7bdf-448b-9701-cfc5d6203de7 req-c51d1c64-20c5-4ceb-ae3e-866db7afc73e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:09.978278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-525b1119-7bdf-448b-9701-cfc5d6203de7 req-c51d1c64-20c5-4ceb-ae3e-866db7afc73e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:09.982903 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-753587e1-d1c9-4010-8374-d3027c7fd32c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.100403 Aug 29 15:49:09.984001 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1516/3022] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:09 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:10.002838 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-525b1119-7bdf-448b-9701-cfc5d6203de7 req-c51d1c64-20c5-4ceb-ae3e-866db7afc73e service nova] Creating event network-vif-unplugged:52c3f5bd-a607-478d-b7f3-8a16a81fbcc9 for instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c on n-h1-836830-13 Aug 29 15:49:10.009679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-525b1119-7bdf-448b-9701-cfc5d6203de7 req-c51d1c64-20c5-4ceb-ae3e-866db7afc73e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067688 Aug 29 15:49:10.011879 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1507/3023] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:10.216304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.217218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.226601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.227271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.227702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.228392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.228942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.229368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.379724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.389534 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-286f149a-9102-474e-bd8b-b5b7215e75a2 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1534 microversion: 2.1 time: 0.178190 Aug 29 15:49:10.394569 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1517/3024] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1534 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:10.424428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.426042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.433605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.434224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.434770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.436351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.436983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.437543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.634543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.635628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.661804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.663802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.664401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.671422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.672194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.673464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.755965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.765518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6361bc3a-9e05-4ee4-88c5-9859a2cf3e5b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.346396 Aug 29 15:49:10.767727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1508/3025] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:10.803381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.825265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.826878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:10.828830 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a068031e-81cd-4a44-85e2-020c8e3b61eb tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.198396 Aug 29 15:49:10.829631 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1518/3026] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:10.903465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.904199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.915512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.916012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.916730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.920254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.920758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.922844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.968651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:10.970402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] [instance: 517ec077-87d3-419c-8d58-f6eaa59fd4c1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:10.993036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.994098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:10.994952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:10.997035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:10.999392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.000006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.009223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:11.032594 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] HTTP exception thrown: Instance 517ec077-87d3-419c-8d58-f6eaa59fd4c1 could not be found. Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Request method failure captured: Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 HTTP/1.1 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-vD8u6abLOz54K_1z_Fw750N5IYT67FywxE3yKEBc48SjTaTfekums7Md2t27JckD5rgP8GRz2cIFPXTxRH7DiKTHP5PJ3Ww3XIB3mwfNv1oO96xn9bxsaA9iKFrHT1BoTV3ZrTDuyHGHPFwWW17otrA9dazwOM0OgJQGxlpZgjrE Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.54 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4914f89b57484044972fa80c6294b3bd Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerShowV254Test-144152401 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4914f89b57484044972fa80c6294b3bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4914f89b57484044972fa80c6294b3bd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4914f89b57484044972fa80c6294b3bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4914f89b57484044972fa80c6294b3bd"}]}] Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerShowV254Test-144152401 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4914f89b57484044972fa80c6294b3bd Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerShowV254Test-144152401 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerShowV254Test-144152401-project Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 5bcbbc66ca5044ea8acda1b137f1d5b3 Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerShowV254Test-144152401-project Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 517ec077-87d3-419c-8d58-f6eaa59fd4c1 could not be found. Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '517ec077-87d3-419c-8d58-f6eaa59fd4c1'} Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517ec077-87d3-419c-8d58-f6eaa59fd4c1 could not be found. Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517ec077-87d3-419c-8d58-f6eaa59fd4c1 could not be found. Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.034562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.039125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.039125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.039125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.039125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:11.039125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:11.039125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517ec077-87d3-419c-8d58-f6eaa59fd4c1 could not be found. Aug 29 15:49:11.039125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.040388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] Returning 404 to user: Instance 517ec077-87d3-419c-8d58-f6eaa59fd4c1 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:11.042144 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3dc6a7f-0a3e-44d5-a2d4-e1f0b85cdb5d tempest-ServerShowV254Test-144152401 tempest-ServerShowV254Test-144152401-project] 10.222.0.83 "GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1" status: 404 len: 111 microversion: 2.54 time: 0.076875 Aug 29 15:49:11.043597 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1519/3027] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/517ec077-87d3-419c-8d58-f6eaa59fd4c1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:49:11.052282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d2ba526-0719-4656-8d74-f2141029d3dc tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edac6d30>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.119642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d2ba526-0719-4656-8d74-f2141029d3dc tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.074306 Aug 29 15:49:11.120401 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1520/3028] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:11.206370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.206882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.224295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.224943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.225241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.225970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.226430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.227145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.274602 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 HTTP/1.1 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '71b09ab0-6837-4646-8938-c0c1b194ee07'} Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:11.279860 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.283637 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.286469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:11.287781 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-51c98005-7d29-441c-8fe9-09cafc71d5ce tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 404 len: 111 microversion: 2.1 time: 0.085787 Aug 29 15:49:11.291251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1521/3029] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:11 2022] DELETE /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:11.298265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-19dfe066-a094-4649-9c32-14faaba29950 req-42f96f2a-fa42-4840-a232-569f50d47fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e71d3d-5e1a-4a22-8afa-2a402706a1b5", "name": "network-vif-unplugged", "status": "completed", "tag": "59264794-ffe2-4e30-8861-1ee39b44bd66"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:11.328144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-19dfe066-a094-4649-9c32-14faaba29950 req-42f96f2a-fa42-4840-a232-569f50d47fdf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.336505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-19dfe066-a094-4649-9c32-14faaba29950 req-42f96f2a-fa42-4840-a232-569f50d47fdf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.337466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-19dfe066-a094-4649-9c32-14faaba29950 req-42f96f2a-fa42-4840-a232-569f50d47fdf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.370102 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-19dfe066-a094-4649-9c32-14faaba29950 req-42f96f2a-fa42-4840-a232-569f50d47fdf service nova] Creating event network-vif-unplugged:59264794-ffe2-4e30-8861-1ee39b44bd66 for instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 on n-h1-836830-13 Aug 29 15:49:11.370929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:11.380806 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-19dfe066-a094-4649-9c32-14faaba29950 req-42f96f2a-fa42-4840-a232-569f50d47fdf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087983 Aug 29 15:49:11.381438 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1522/3030] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:11.384368 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7eb1df9-a97e-4be4-97cf-81ae36b1cfc5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.485152 Aug 29 15:49:11.385659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1509/3031] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:10 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:11.413206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.413933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.424858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.425589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: 71b09ab0-6837-4646-8938-c0c1b194ee07] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.434818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.435378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.435779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.436497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.436957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.440749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.441242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.441673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.448194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.450096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.450618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.451717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.491705 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 HTTP/1.1 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '71b09ab0-6837-4646-8938-c0c1b194ee07'} Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.498360 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.502346 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.502346 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.502346 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.502346 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:11.502346 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:11.502346 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. Aug 29 15:49:11.502346 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.504604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance 71b09ab0-6837-4646-8938-c0c1b194ee07 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:11.505740 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c573be58-46d3-46a4-8b87-0fefcb0c2ccb tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07" status: 404 len: 111 microversion: 2.1 time: 0.123258 Aug 29 15:49:11.506832 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1523/3032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/71b09ab0-6837-4646-8938-c0c1b194ee07 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:11.527392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.528292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.534861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:11.550679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.551675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.552356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.553328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.558607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.559459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.601243 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d HTTP/1.1 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b8812e03-0998-482f-9c15-31e6bc87c95d'} Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:11.606487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.610658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.614802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:11.616434 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0caef973-f8db-4b4f-a8cb-95000ec68f51 tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 404 len: 111 microversion: 2.1 time: 0.105143 Aug 29 15:49:11.618638 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1524/3033] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:11 2022] DELETE /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:11.629016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.633592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] [instance: b8812e03-0998-482f-9c15-31e6bc87c95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.654264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.655238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.655932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.656853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.657746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.658410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.691843 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] HTTP exception thrown: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Request method failure captured: Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d HTTP/1.1 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN5GsIdXB-jv2vQxyYGaJgxppZG8sUl5r0K08AqBKNQgbmzp8_5on850rMYiYwcAtRX5kK4MQT5RhNYlZgAvxyFGwbKjozqL_Hf8JRpei9ehtX8Tf8-DGLNdsauAC0EQpGsd7ZiK4kL8_yEq3WN7rgaKtBEyUY6Eti-L6142fG_MMn0 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2d32eb4fb5ea49e6ad495a8175ae5e3e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2d32eb4fb5ea49e6ad495a8175ae5e3e"}]}] Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 2d32eb4fb5ea49e6ad495a8175ae5e3e Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-86893665 Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 853f8300f9bb403b9cea4834c5a1edcb Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-86893665-project Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b8812e03-0998-482f-9c15-31e6bc87c95d'} Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:11.702331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.708149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:11.708149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:11.708149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:11.708149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:11.708149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:11.708149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. Aug 29 15:49:11.708149 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:11.712053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] Returning 404 to user: Instance b8812e03-0998-482f-9c15-31e6bc87c95d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:11.721037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-df1cc601-f1da-47a5-b0b6-b8cd286438ee tempest-DeleteServersTestJSON-86893665 tempest-DeleteServersTestJSON-86893665-project] 10.222.0.83 "GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d" status: 404 len: 111 microversion: 2.1 time: 0.096334 Aug 29 15:49:11.722020 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1525/3034] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/b8812e03-0998-482f-9c15-31e6bc87c95d => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:11.728097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-497ec253-d8c3-41fb-98cc-0d1bc4d5c12b req-128b73fb-6702-4502-88dd-30be83431898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d05a13-4f2b-4f04-8181-acd8427ffb81", "tag": "646de7a8-7bc5-4bf2-8dc1-6298b756cc80"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:11.754778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-497ec253-d8c3-41fb-98cc-0d1bc4d5c12b req-128b73fb-6702-4502-88dd-30be83431898 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.755296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-497ec253-d8c3-41fb-98cc-0d1bc4d5c12b req-128b73fb-6702-4502-88dd-30be83431898 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.755724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-497ec253-d8c3-41fb-98cc-0d1bc4d5c12b req-128b73fb-6702-4502-88dd-30be83431898 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.781224 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-497ec253-d8c3-41fb-98cc-0d1bc4d5c12b req-128b73fb-6702-4502-88dd-30be83431898 service nova] Creating event network-changed:646de7a8-7bc5-4bf2-8dc1-6298b756cc80 for instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 on n-h2-836830-13 Aug 29 15:49:11.794628 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-497ec253-d8c3-41fb-98cc-0d1bc4d5c12b req-128b73fb-6702-4502-88dd-30be83431898 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071271 Aug 29 15:49:11.798578 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1526/3035] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:11.808028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:11.808746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:11.825399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.825893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.826389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:11.827047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:11.831324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:11.831678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.308435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.324289 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90ec4781-a0f3-49c8-a80b-34a25a0e0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1540 microversion: 2.1 time: 0.915247 Aug 29 15:49:12.324921 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1510/3036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1540 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:12.343925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.346348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:12.367585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.368294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.369116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.370745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.374335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.375047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.454479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=40 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:12.519472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.544225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.546591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.548005 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76a52933-dcff-44e8-b12d-f50902ad25fd tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.218441 Aug 29 15:49:12.548570 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1511/3037] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:12.555112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10461518-eef4-48e2-8e4e-33c9609819a9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed90e790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.629589 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10461518-eef4-48e2-8e4e-33c9609819a9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.079964 Aug 29 15:49:12.630272 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1512/3038] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:12.640517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:12.644351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:12.654451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.654958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.655631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.656188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:12.656653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:12.657232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:12.715226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.738347 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82858a0b-0135-4680-b341-ac20ec0d4c88 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.938374 Aug 29 15:49:12.749881 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1527/3039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:11 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:12.878498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:12.890181 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60a44a20-a79e-4b6c-bff1-e8f53551c8d9 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.256532 Aug 29 15:49:12.891779 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1513/3040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:12 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:13.349259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.350194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.354494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:13.361409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.363850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.364584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.365561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.366234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.366881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.573472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.574783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.589315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.596705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.597382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.598328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.598937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.599558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.781417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.795539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.796991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:13.798173 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ebaf2aa7-91df-411c-b722-d3710f9c9b3f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.229370 Aug 29 15:49:13.803396 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1514/3041] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:13.810713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b941010-e9ca-464b-a04a-7ab2dfbd6e30 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed94d820>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.887830 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b941010-e9ca-464b-a04a-7ab2dfbd6e30 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.083173 Aug 29 15:49:13.895937 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1515/3042] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:13.902575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:13.903414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:13.919230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.919996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.927742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:13.928732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:13.929365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:13.929951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.222527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.248400 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e064648-1398-4a38-85d4-7ccae1d8f381 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.350163 Aug 29 15:49:14.262920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1516/3043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:14.273972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.286184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.287384 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2b6593ec-5f16-4b93-9d75-174b9825d771 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1540 microversion: 2.1 time: 0.942594 Aug 29 15:49:14.289135 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1528/3044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:13 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1540 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:14.290141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.302337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-11a83c02-6fb0-4e2d-9f79-3bb6432b8fc4 req-fa918601-2387-4f09-a023-12e67e922ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e71d3d-5e1a-4a22-8afa-2a402706a1b5", "tag": "59264794-ffe2-4e30-8861-1ee39b44bd66"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:14.309144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.312173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.312847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.314943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.315520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.318129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.331730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-11a83c02-6fb0-4e2d-9f79-3bb6432b8fc4 req-fa918601-2387-4f09-a023-12e67e922ebd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.332453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-11a83c02-6fb0-4e2d-9f79-3bb6432b8fc4 req-fa918601-2387-4f09-a023-12e67e922ebd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.334440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-11a83c02-6fb0-4e2d-9f79-3bb6432b8fc4 req-fa918601-2387-4f09-a023-12e67e922ebd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.375560 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-11a83c02-6fb0-4e2d-9f79-3bb6432b8fc4 req-fa918601-2387-4f09-a023-12e67e922ebd service nova] Creating event network-changed:59264794-ffe2-4e30-8861-1ee39b44bd66 for instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 on n-h1-836830-13 Aug 29 15:49:14.391000 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-11a83c02-6fb0-4e2d-9f79-3bb6432b8fc4 req-fa918601-2387-4f09-a023-12e67e922ebd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099485 Aug 29 15:49:14.394694 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1529/3045] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:14.408086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1d6fc9ad-e7fc-4bda-9b7c-a777a57a676f req-362a79c0-40f1-4037-99af-10a1361ded23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c", "name": "network-vif-plugged", "status": "completed", "tag": "52c3f5bd-a607-478d-b7f3-8a16a81fbcc9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:14.438749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d6fc9ad-e7fc-4bda-9b7c-a777a57a676f req-362a79c0-40f1-4037-99af-10a1361ded23 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.440640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d6fc9ad-e7fc-4bda-9b7c-a777a57a676f req-362a79c0-40f1-4037-99af-10a1361ded23 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.441234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d6fc9ad-e7fc-4bda-9b7c-a777a57a676f req-362a79c0-40f1-4037-99af-10a1361ded23 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.474270 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1d6fc9ad-e7fc-4bda-9b7c-a777a57a676f req-362a79c0-40f1-4037-99af-10a1361ded23 service nova] Creating event network-vif-plugged:52c3f5bd-a607-478d-b7f3-8a16a81fbcc9 for instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c on n-h1-836830-13 Aug 29 15:49:14.493628 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1d6fc9ad-e7fc-4bda-9b7c-a777a57a676f req-362a79c0-40f1-4037-99af-10a1361ded23 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094491 Aug 29 15:49:14.498010 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1530/3046] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:14.857406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:14.873639 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7798e190-cdc4-419b-a674-54ab4875c1be tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.608335 Aug 29 15:49:14.882241 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1517/3047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:14.893212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:14.896515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:14.913266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.916140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.919404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:14.920328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:14.922550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:14.925644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.081570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.093294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-858990834", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": "none"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:15.099476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.101276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:15.102919 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82ab06a4-f542-4e7d-807d-9c6765f03407 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.219396 Aug 29 15:49:15.126154 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1518/3048] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:14 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:15.145096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a39b4ccd-d7f5-414f-9a60-7e10f8301085 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed90fe50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.296840 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a39b4ccd-d7f5-414f-9a60-7e10f8301085 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.169400 Aug 29 15:49:15.297425 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1519/3049] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:15.298225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:15.300324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:15.303523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:15.304563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:15.307731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:15.317404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.320384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.337521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.338691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.339602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.340141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.341766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.342452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.343435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.344777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.345415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.346059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.347974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.348151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.400350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Getting quotas for project 5d9ee7e4ec4d4690b901fe6354191dec. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:15.408965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Getting quotas for user 5a0d010ab0524a1a93a92821e4b43e67 and project 5d9ee7e4ec4d4690b901fe6354191dec. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:15.424053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:15.432729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:15.514421 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-007582c4-5f53-4a60-83a8-98f60ddc6a40 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.723222 Aug 29 15:49:15.524210 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1531/3050] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 15:49:15.540103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:15.540893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:15.549012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.549746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.550339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:15.551232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:15.551837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:15.552409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.028006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.057618 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04e86082-41b4-4e8f-a9b4-47e3d2b92779 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1540 microversion: 2.1 time: 0.521949 Aug 29 15:49:16.058427 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1532/3051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1540 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.066771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c093cad-6f79-4371-878a-85d310694103 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.078001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c093cad-6f79-4371-878a-85d310694103 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.160367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.173263 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4fa8706f-56f5-44e8-9bff-8f7da1b49142 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.873451 Aug 29 15:49:16.188166 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1520/3052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:15 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.196900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.203190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.215338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c093cad-6f79-4371-878a-85d310694103 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.215601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.215932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.216369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.217071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.223111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c093cad-6f79-4371-878a-85d310694103 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.223794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.224275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.229370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c093cad-6f79-4371-878a-85d310694103 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.232375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c093cad-6f79-4371-878a-85d310694103 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1277 microversion: 2.57 time: 0.169483 Aug 29 15:49:16.233612 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1533/3053] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:16.242662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.260071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:16.270656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.271180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.271662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.272304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.276157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.276809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.426800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.451775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.454200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.455669 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77c4f2a4-797a-4a12-8bbe-6ae7b0db74f2 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.219027 Aug 29 15:49:16.456393 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1534/3054] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:16.461081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-014f47fe-5eb6-4d69-a1ee-742378de7a05 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eda935e0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:16.571135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:16.576440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:16.577069 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-014f47fe-5eb6-4d69-a1ee-742378de7a05 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.119416 Aug 29 15:49:16.578720 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1535/3055] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.599989 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98875c1b-d92e-44cd-b8ff-1d63e87562b8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.409650 Aug 29 15:49:16.611908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1521/3056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:16 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:16.648821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-50b9677e-76db-4b84-8d8b-866bd80464fc req-7426a5dc-f182-447b-aed9-a0abc8613703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15608c5c-acbc-4327-ade5-30c5b31166bc", "name": "network-vif-plugged", "status": "completed", "tag": "77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:16.669252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-50b9677e-76db-4b84-8d8b-866bd80464fc req-7426a5dc-f182-447b-aed9-a0abc8613703 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:16.670152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-50b9677e-76db-4b84-8d8b-866bd80464fc req-7426a5dc-f182-447b-aed9-a0abc8613703 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:16.670733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-50b9677e-76db-4b84-8d8b-866bd80464fc req-7426a5dc-f182-447b-aed9-a0abc8613703 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:16.695329 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-50b9677e-76db-4b84-8d8b-866bd80464fc req-7426a5dc-f182-447b-aed9-a0abc8613703 service nova] Creating event network-vif-plugged:77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48 for instance 15608c5c-acbc-4327-ade5-30c5b31166bc on n-h2-836830-13 Aug 29 15:49:16.711434 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-50b9677e-76db-4b84-8d8b-866bd80464fc req-7426a5dc-f182-447b-aed9-a0abc8613703 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066507 Aug 29 15:49:16.712544 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1536/3057] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:17.079550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.080297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.105715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.113023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.117717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.119015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.124104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.124757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.195184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.196183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.217123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.218023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.218670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.219613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.220273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.220900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.827691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:17.842041 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eb6ed04e-bcc3-4486-9909-238c34b156a0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.651749 Aug 29 15:49:17.843210 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1537/3058] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:17.863803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:17.866652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:17.898336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.898874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.899643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:17.908468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:17.908975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:17.909422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.006698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.022336 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa0071c2-8545-45c3-8152-31a918e1bf9b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1540 microversion: 2.1 time: 0.946958 Aug 29 15:49:18.035745 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1522/3059] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1540 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:18.059815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.060729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.076771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.077594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.078221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.079193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.079816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.080400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.092542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.102220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.113248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.114848 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a67ec2e1-4901-4456-a436-547b576effcf tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1347 microversion: 2.57 time: 0.270656 Aug 29 15:49:18.115688 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1538/3060] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:17 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1347 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:18.124249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5566678-8766-49ca-87d4-967ca38cd055 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eda93af0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.187004 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5566678-8766-49ca-87d4-967ca38cd055 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.070040 Aug 29 15:49:18.195098 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1539/3061] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:18.201626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.202533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.213682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.221072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.221877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.222842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.223546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.229917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.303647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.333570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.335629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.339264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d9599a36-572b-468f-addf-ad90b1f859e7 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.301999 Aug 29 15:49:18.340598 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1523/3062] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:18.596944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:18.615966 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ded760bb-a88b-40ac-9d5f-16c3ab5bbadf tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.419396 Aug 29 15:49:18.621471 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1540/3063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:18.874139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:18.875705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:18.893230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.894081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.894692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:18.895868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:18.896766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:18.900344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.045819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.050028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.063499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.064279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.064894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.065771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.067536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.068166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.165192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.175266 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6eebeede-b0b2-49be-b912-174e64c044f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.312254 Aug 29 15:49:19.188355 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1524/3064] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:18 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:19.197602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.198843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.205427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.206150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.206753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.207664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.208698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.209333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.349940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.362608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.372097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.375603 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-db580b82-3793-45d6-855b-30c07ba0e890 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1335 microversion: 2.57 time: 0.183911 Aug 29 15:49:19.377449 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1525/3065] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1335 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:19.383124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-094c76cc-efe9-4290-8a22-7d4c7de083af tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eda43280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.454333 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-094c76cc-efe9-4290-8a22-7d4c7de083af tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.075457 Aug 29 15:49:19.455367 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1526/3066] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:19.465344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.465970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.486613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.487386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.493612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.494678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.495345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.495971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.662717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.672312 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b3c876e-3063-4c8a-9f9f-eba487a01f0c tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1535 microversion: 2.1 time: 0.631072 Aug 29 15:49:19.678314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1541/3067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1535 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:19.687872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:19.689638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:19.705259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.707689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.707953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.708736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.709666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:19.710607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:19.711261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:19.723052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.724521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:19.725725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-773faf8d-060b-4c07-93b4-2e1e63ac399e tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.267212 Aug 29 15:49:19.739487 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1527/3068] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:20.060879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.069265 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-755e3a01-898e-4f7f-8aef-c2dc3c085036 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.389842 Aug 29 15:49:20.079135 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1542/3069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:19 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:20.200432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:20.201056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:20.212757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.215782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.220980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.221954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.222589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.223245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.399977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:20.401455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:20.418066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.426988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.431649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.433333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.433978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.434581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.511001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.525187 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3e65fd6-b218-4c84-9b62-69ee5cc16608 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.329766 Aug 29 15:49:20.526536 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1528/3070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:20 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:20.538965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-32721ba7-1ae7-46ee-8df5-aefe02fb0ad6 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed90e160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:20.628524 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-32721ba7-1ae7-46ee-8df5-aefe02fb0ad6 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.100704 Aug 29 15:49:20.632499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1529/3071] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:20 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:20.654370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-18d89537-7dad-4dd3-8374-ccbbcbacad8d req-86eb8e44-c424-4644-8a30-f2810c559028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d05a13-4f2b-4f04-8181-acd8427ffb81", "name": "network-vif-plugged", "status": "completed", "tag": "646de7a8-7bc5-4bf2-8dc1-6298b756cc80"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:20.676699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-18d89537-7dad-4dd3-8374-ccbbcbacad8d req-86eb8e44-c424-4644-8a30-f2810c559028 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.677433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-18d89537-7dad-4dd3-8374-ccbbcbacad8d req-86eb8e44-c424-4644-8a30-f2810c559028 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.678086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-18d89537-7dad-4dd3-8374-ccbbcbacad8d req-86eb8e44-c424-4644-8a30-f2810c559028 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.692640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.714812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.720838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:20.722068 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f63efc79-561c-4bf8-8063-ae80672dd755 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1356 microversion: 2.57 time: 0.326296 Aug 29 15:49:20.722654 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1543/3072] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:20 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1356 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:20.731663 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-18d89537-7dad-4dd3-8374-ccbbcbacad8d req-86eb8e44-c424-4644-8a30-f2810c559028 service nova] Creating event network-vif-plugged:646de7a8-7bc5-4bf2-8dc1-6298b756cc80 for instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 on n-h2-836830-13 Aug 29 15:49:20.740833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:20.741712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:20.754479 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-18d89537-7dad-4dd3-8374-ccbbcbacad8d req-86eb8e44-c424-4644-8a30-f2810c559028 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119278 Aug 29 15:49:20.763389 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1530/3073] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:20.774725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:20.778943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.779485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.779932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.780646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.781102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.781482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:20.781616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.810059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.813438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.815226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:20.828381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:20.829159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:20.833163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.054275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:21.054943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:21.055405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:21.056157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:21.056672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:21.134441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.157334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b10f8bd0-1323-4188-bba8-0e071bfbfb40 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1522 microversion: 2.1 time: 0.428405 Aug 29 15:49:21.159108 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1544/3074] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:20 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:21.165540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.169903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.170528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.177000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.177693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.178462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.179347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.180014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.180588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.186088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.186741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.189122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.192110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.192809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.193356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.269271 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef594d5d-8e59-46fc-834f-6f3dcc8b7131 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "POST /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e/action" status: 202 len: 1137 microversion: 2.57 time: 0.503575 Aug 29 15:49:21.293770 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1531/3075] 10.222.0.83 () {62 vars in 1320 bytes} [Mon Aug 29 15:49:20 2022] POST /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e/action => generated 1137 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 29 15:49:21.307144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.308498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.315881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.316555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.317102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.317975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.318544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.319123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.324738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.334727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.336607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.338794 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-668299ba-b59d-45e6-8ccf-66db3a09bc96 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.173775 Aug 29 15:49:21.351546 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1545/3076] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:21.362076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.362898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.377287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.388707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.390251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.391265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.393610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.394313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.460921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:21.484284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:21.610579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.629175 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e87fdb5-4235-4488-accd-362bd001c939 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.332837 Aug 29 15:49:21.631772 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1532/3077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:21.649583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.651078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.659862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.660426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.661011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.662038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.663473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.665666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.729818 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02d8cb23-4177-43f3-91be-81129a52fbc5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 204 len: 0 microversion: 2.1 time: 0.375870 Aug 29 15:49:21.734365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1546/3078] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:21 2022] DELETE /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:21.758619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.761221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.777436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.778838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.779399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.780388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.781179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:21.781821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:21.854257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.865501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.867552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:21.870771 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90590a17-c139-4735-b1e9-f669ef338be4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.234168 Aug 29 15:49:21.889903 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1533/3079] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:21.901293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31f67023-2665-4950-bd13-9357d44b3b6d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed91e4c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.978367 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31f67023-2665-4950-bd13-9357d44b3b6d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.087256 Aug 29 15:49:21.980636 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1534/3080] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:21.987493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:21.988386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:21.998507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:21.999305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.000150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.001097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.001891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.002547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.039508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.071285 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-346f93a7-9815-464d-a09d-21e723db44f0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.332968 Aug 29 15:49:22.073744 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1547/3081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:22.299321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.310784 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d9a3f86-aa5c-4e09-826a-5d485e47db0e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1528 microversion: 2.1 time: 0.328696 Aug 29 15:49:22.312388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1535/3082] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:21 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1528 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:22.367393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:22.367998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:22.381550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.382858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.383500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.384389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.386033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.387131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.500475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.515196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.518382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.519640 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fbbab0a4-6751-41b1-b2b8-06bfb1d6589b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.156410 Aug 29 15:49:22.520437 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1548/3083] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:22 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:22.621073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29579ad3-04d5-43b7-80ea-024e6f060d8e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1364928461", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:22.624589 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-29579ad3-04d5-43b7-80ea-024e6f060d8e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] HTTP exception thrown: min_count must be <= max_count Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29579ad3-04d5-43b7-80ea-024e6f060d8e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Request method failure captured: Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 184 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAC4NLqcNX_KraR3GLRzl3GOfFRiXr53gvICNFiisrfiFwveE60T6TE1cw8sOrpJ3lNsCNuOcsYNI6KzGnQmouSaRYLoCMSHowupyk8hxy5y692GJNK7gA57_9Cq5sG-OQx1nDJLc4WIzXaiguTCj0KOR4FW6TLsCb4RvVtSVkpBPA Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_12c5cbaae6dd4425b4048fc8a2f94e79", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/12c5cbaae6dd4425b4048fc8a2f94e79"}]}] Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 26954960fb8a407e9212fcc2b83ddd87 Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1364928461", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: exception: min_count must be <= max_count Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1364928461', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 29 15:49:22.626751 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.640967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29579ad3-04d5-43b7-80ea-024e6f060d8e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Returning 400 to user: min_count must be <= max_count {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:22.640967 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29579ad3-04d5-43b7-80ea-024e6f060d8e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.177942 Aug 29 15:49:22.640967 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1536/3084] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:22 2022] POST /compute/v2.1/servers => generated 74 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:22.655036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:22.656316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:22.663749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.664576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.665257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.666719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.667438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.668088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.734643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72b77776-a180-4c51-9047-f24dc73e61ce tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-462559482", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "max_count": 0}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72b77776-a180-4c51-9047-f24dc73e61ce tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Request method failure captured: Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 167 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAC4NLqcNX_KraR3GLRzl3GOfFRiXr53gvICNFiisrfiFwveE60T6TE1cw8sOrpJ3lNsCNuOcsYNI6KzGnQmouSaRYLoCMSHowupyk8hxy5y692GJNK7gA57_9Cq5sG-OQx1nDJLc4WIzXaiguTCj0KOR4FW6TLsCb4RvVtSVkpBPA Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_12c5cbaae6dd4425b4048fc8a2f94e79", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/12c5cbaae6dd4425b4048fc8a2f94e79"}]}] Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 26954960fb8a407e9212fcc2b83ddd87 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-462559482", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "max_count": 0}} Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-462559482', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'max_count': 0}}} Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 0 Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:22.746968 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:49:22.751085 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.754125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72b77776-a180-4c51-9047-f24dc73e61ce tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:22.757923 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72b77776-a180-4c51-9047-f24dc73e61ce tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.040010 Aug 29 15:49:22.763659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1537/3085] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:22 2022] POST /compute/v2.1/servers => generated 130 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:22.875621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-077f45df-92cb-4be8-95f9-cdb1ba3d818e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1563469555", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "max_count": 2.5}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-077f45df-92cb-4be8-95f9-cdb1ba3d818e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Request method failure captured: Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 170 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAC4NLqcNX_KraR3GLRzl3GOfFRiXr53gvICNFiisrfiFwveE60T6TE1cw8sOrpJ3lNsCNuOcsYNI6KzGnQmouSaRYLoCMSHowupyk8hxy5y692GJNK7gA57_9Cq5sG-OQx1nDJLc4WIzXaiguTCj0KOR4FW6TLsCb4RvVtSVkpBPA Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_12c5cbaae6dd4425b4048fc8a2f94e79", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/12c5cbaae6dd4425b4048fc8a2f94e79"}]}] Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 26954960fb8a407e9212fcc2b83ddd87 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1563469555", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "max_count": 2.5}} Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1563469555', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'max_count': 2.5}}} Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:22.880362 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:49:22.884252 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.890426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-077f45df-92cb-4be8-95f9-cdb1ba3d818e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:22.891981 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-077f45df-92cb-4be8-95f9-cdb1ba3d818e tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020927 Aug 29 15:49:22.894710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1538/3086] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:22.912203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:22.913095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:22.940378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:22.943501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.946087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.946087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.946463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:22.947069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:22.948203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:22.952518 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb755d9b-bd10-485c-87bf-1c53b6d3396c tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.302489 Aug 29 15:49:22.963502 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1549/3087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:22 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:22.981644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33b3581b-68ca-4096-9594-b15c15c4b88c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-454032283", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 0}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33b3581b-68ca-4096-9594-b15c15c4b88c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Request method failure captured: Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 167 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAC4NLqcNX_KraR3GLRzl3GOfFRiXr53gvICNFiisrfiFwveE60T6TE1cw8sOrpJ3lNsCNuOcsYNI6KzGnQmouSaRYLoCMSHowupyk8hxy5y692GJNK7gA57_9Cq5sG-OQx1nDJLc4WIzXaiguTCj0KOR4FW6TLsCb4RvVtSVkpBPA Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_12c5cbaae6dd4425b4048fc8a2f94e79", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/12c5cbaae6dd4425b4048fc8a2f94e79"}]}] Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 26954960fb8a407e9212fcc2b83ddd87 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-454032283", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 0}} Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-454032283', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'min_count': 0}}} Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 0 Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:22.988953 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:22.993772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33b3581b-68ca-4096-9594-b15c15c4b88c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:22.996094 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33b3581b-68ca-4096-9594-b15c15c4b88c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021579 Aug 29 15:49:22.996849 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1550/3088] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:22 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:49:23.003637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-468a8001-60f0-457c-91f3-09b814c6a42b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eda68b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.054383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.070517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.072065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.073815 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0cdbc120-9c5b-43eb-af6f-0fe5e35767a3 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.177866 Aug 29 15:49:23.074770 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1539/3089] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:22 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:23.082383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2626b09c-3090-4598-81a9-e14e6707b47c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1558203143", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 2.5}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:23.083114 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-468a8001-60f0-457c-91f3-09b814c6a42b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.085219 Aug 29 15:49:23.084888 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1551/3090] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:22 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2626b09c-3090-4598-81a9-e14e6707b47c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Request method failure captured: Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 170 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAC4NLqcNX_KraR3GLRzl3GOfFRiXr53gvICNFiisrfiFwveE60T6TE1cw8sOrpJ3lNsCNuOcsYNI6KzGnQmouSaRYLoCMSHowupyk8hxy5y692GJNK7gA57_9Cq5sG-OQx1nDJLc4WIzXaiguTCj0KOR4FW6TLsCb4RvVtSVkpBPA Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_12c5cbaae6dd4425b4048fc8a2f94e79", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/12c5cbaae6dd4425b4048fc8a2f94e79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/12c5cbaae6dd4425b4048fc8a2f94e79"}]}] Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 12c5cbaae6dd4425b4048fc8a2f94e79 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1625406455 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 26954960fb8a407e9212fcc2b83ddd87 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1625406455-project Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1558203143", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 2.5}} Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1558203143', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'min_count': 2.5}}} Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 2.5 Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:23.091757 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 29 15:49:23.096230 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:23.098567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2626b09c-3090-4598-81a9-e14e6707b47c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:23.099515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.100060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2626b09c-3090-4598-81a9-e14e6707b47c tempest-MultipleCreateNegativeTestJSON-1625406455 tempest-MultipleCreateNegativeTestJSON-1625406455-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021108 Aug 29 15:49:23.100336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.105850 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1540/3091] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:23.133413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.134133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.134685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.136598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.137077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.137520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.338000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.338888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.348917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.349412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.349864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.350572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.351073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.351509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.363515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.372862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e922a9e9-dd66-45d3-a9d2-e84ba87ea521 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.283368 Aug 29 15:49:23.374739 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1552/3092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:23.548799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.549861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.562662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.564912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.565753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.567346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.567831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.568268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.608556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.625423 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f905ab5d-b522-4c44-93d1-b64b83d57fb7 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1528 microversion: 2.1 time: 0.291174 Aug 29 15:49:23.626830 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1541/3093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:23.717719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.731724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.733711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:23.735157 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69adc91b-d556-4238-bf64-87e213a964df tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.193087 Aug 29 15:49:23.739313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1553/3094] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:23.974968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:23.975690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:23.983971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.984618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.985139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:23.985932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:23.986622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:23.987892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.101208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.102222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.118232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.119048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.120269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.122651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.124299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.128153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.319108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.341822 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92173f4e-d666-4f9e-84c4-5a5ab2874dd5 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1313 microversion: 2.1 time: 0.369220 Aug 29 15:49:24.360459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1542/3095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:23 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:24.380888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eeede7ad-e982-4ba3-a926-fecbc212a9e2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed929c10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.393260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.424443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.431169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.437632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff00ee0e-2f7b-466e-9e9b-827343be3b67 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.341333 Aug 29 15:49:24.440907 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1554/3096] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:24.462535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.464698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.493012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.495842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.507339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.517913 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eeede7ad-e982-4ba3-a926-fecbc212a9e2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.155411 Aug 29 15:49:24.518947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.519822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.520270 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1543/3097] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:24.520942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.571571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8a0d154e-89b3-4590-abce-d84a22950907 req-9a077ea5-6c7b-456f-b7bd-fb50538333e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15608c5c-acbc-4327-ade5-30c5b31166bc", "name": "network-vif-unplugged", "status": "completed", "tag": "77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:24.603248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8a0d154e-89b3-4590-abce-d84a22950907 req-9a077ea5-6c7b-456f-b7bd-fb50538333e9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.614190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8a0d154e-89b3-4590-abce-d84a22950907 req-9a077ea5-6c7b-456f-b7bd-fb50538333e9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.616426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8a0d154e-89b3-4590-abce-d84a22950907 req-9a077ea5-6c7b-456f-b7bd-fb50538333e9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.652054 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8a0d154e-89b3-4590-abce-d84a22950907 req-9a077ea5-6c7b-456f-b7bd-fb50538333e9 service nova] Creating event network-vif-unplugged:77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48 for instance 15608c5c-acbc-4327-ade5-30c5b31166bc on n-h2-836830-13 Aug 29 15:49:24.668563 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8a0d154e-89b3-4590-abce-d84a22950907 req-9a077ea5-6c7b-456f-b7bd-fb50538333e9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102823 Aug 29 15:49:24.670131 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1544/3098] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:24.684915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.687117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.708937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.709518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.710062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.710944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.711517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.712033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.879920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.906830 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-153b9a15-e68b-4473-b616-c965ed128cb2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.464171 Aug 29 15:49:24.924081 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1555/3099] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:24.930732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:24.931776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:24.940410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.941802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.942517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.943842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:24.944632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:24.945220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:24.981354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:24.985486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:24.990927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a582ea0d-45af-4e15-b1ec-f3c663ff1601 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1528 microversion: 2.1 time: 0.318198 Aug 29 15:49:25.012987 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1545/3100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1528 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:25.043349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.053503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.055017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.056484 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b45a41ab-7409-40fc-900d-daed1fcf3300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.130591 Aug 29 15:49:25.057278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1556/3101] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:24 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:25.383045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:25.384416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:25.406048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.411291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.411996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.417632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.418364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.419260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.465131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:25.466500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:25.469295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:25.478482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.479904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.480584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.482049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.482738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.483573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.647728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.658013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.664271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.673225 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef40e5e2-610c-4812-9dc0-1948f8c3b6fc tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.213111 Aug 29 15:49:25.687573 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1557/3102] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:25.698774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d685eb5-0d23-4029-ab4f-ed3c889f5e3f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edaa4820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:25.804666 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d685eb5-0d23-4029-ab4f-ed3c889f5e3f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.115420 Aug 29 15:49:25.818225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1558/3103] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:25.934546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:25.937345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:25.961607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.967192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:25.971840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.975254 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6abb4013-456e-4e48-8c1d-e2e2fbee42fb tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1498 microversion: 2.1 time: 0.597753 Aug 29 15:49:25.975835 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1546/3104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1498 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:25.980696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.982070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:25.985239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:25.987105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:25.996570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a98574e-701b-41c9-9509-18c75641b0ba tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.027613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.server_groups [None req-2a98574e-701b-41c9-9509-18c75641b0ba tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Querying cell 28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) for 1 instances {{(pid=129133) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:49:26.029508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a98574e-701b-41c9-9509-18c75641b0ba tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.030670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a98574e-701b-41c9-9509-18c75641b0ba tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.031684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a98574e-701b-41c9-9509-18c75641b0ba tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.071962 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a98574e-701b-41c9-9509-18c75641b0ba tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups/8aae68c6-cd72-4b07-9230-2d6608276d07" status: 200 len: 221 microversion: 2.1 time: 0.079571 Aug 29 15:49:26.078844 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1547/3105] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/os-server-groups/8aae68c6-cd72-4b07-9230-2d6608276d07 => generated 221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:26.092443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.095473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.107967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.108749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.109187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.111654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.113654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.114288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.220006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:26.600516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.651342 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6569dd10-6a34-449a-a938-c95a28183039 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1528 microversion: 2.1 time: 0.570450 Aug 29 15:49:26.652157 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1548/3106] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:26 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1528 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:26.668692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.669640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.688439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.689220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.689758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.690681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.691186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.691772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.892303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.902316 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-58cdfeb5-6c17-49d2-a6dd-db883f1d38b0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.975501 Aug 29 15:49:26.902475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.907170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1559/3107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:25 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:26.912128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.921055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.924581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.928059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.929894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:26.931942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.932869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.935056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.935677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-802e7695-ff95-48dd-bad0-8c49a2437300 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.269962 Aug 29 15:49:26.937600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.938255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.938514 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1549/3108] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:26 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:26.961351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:26.962346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:26.976942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.978086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.986585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:26.991310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:26.992063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:26.992800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.008212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:27.145900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.158733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.161847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.164721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d479c985-88e3-4b07-b66f-84b60aab9973 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.215811 Aug 29 15:49:27.169956 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25d53d8f-3595-45bf-86c2-55ba0cdae11b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 204 len: 0 microversion: 2.1 time: 0.261205 Aug 29 15:49:27.170853 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1560/3109] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:26 2022] DELETE /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:27.187162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cea0074-fedb-44da-8467-9c41c50ce581 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eda414c0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.187564 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1550/3110] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:26 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:27.196061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.199647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.217735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.218390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.218957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.219800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.220405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.220984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.281590 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2cea0074-fedb-44da-8467-9c41c50ce581 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.108646 Aug 29 15:49:27.290728 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1561/3111] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:27.460398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-0114acc0-6cce-4741-a16a-49d4260d898c req-23855db1-ee58-462f-a25e-58c129ccfc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15608c5c-acbc-4327-ade5-30c5b31166bc", "name": "network-vif-deleted", "tag": "77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:27.485958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0114acc0-6cce-4741-a16a-49d4260d898c req-23855db1-ee58-462f-a25e-58c129ccfc5d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.492049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0114acc0-6cce-4741-a16a-49d4260d898c req-23855db1-ee58-462f-a25e-58c129ccfc5d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.492818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0114acc0-6cce-4741-a16a-49d4260d898c req-23855db1-ee58-462f-a25e-58c129ccfc5d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.517783 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-0114acc0-6cce-4741-a16a-49d4260d898c req-23855db1-ee58-462f-a25e-58c129ccfc5d service nova] Creating event network-vif-deleted:77e6bd26-c5a0-4e04-b7ed-21c0a42b9f48 for instance 15608c5c-acbc-4327-ade5-30c5b31166bc on n-h2-836830-13 Aug 29 15:49:27.535047 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-0114acc0-6cce-4741-a16a-49d4260d898c req-23855db1-ee58-462f-a25e-58c129ccfc5d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084503 Aug 29 15:49:27.539400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.540591 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1562/3112] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:27.549643 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-634f6b15-9065-41e7-ba3c-75a2f8cf930b tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1504 microversion: 2.1 time: 0.360589 Aug 29 15:49:27.550359 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1551/3113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1504 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:27.678055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.679546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.690658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.706512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.707859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.708618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.709091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.709524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.857090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:27.866335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f6d8fd67-4df0-4e13-9f4d-b0fa8b734eda tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1486 microversion: 2.1 time: 0.193619 Aug 29 15:49:27.867278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1563/3114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1486 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:27.926336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.928149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.955326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.964929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:27.966116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:27.971149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.973354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.975117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.986536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.988897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.989553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.991474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.994819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:27.995921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:27.998792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:27.999446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.142281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.157570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.160853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.162646 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0bad93f-a1f4-44eb-8870-fbeff8a1ea6b tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.202970 Aug 29 15:49:28.177720 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1564/3115] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:28.200885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.201489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.210208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.210714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.214676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.215443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.215909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.216840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.219644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:28.355819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.368874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.372240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.373495 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a25768e1-54e2-4ed5-9aec-76faa8e16f5e tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.176646 Aug 29 15:49:28.374279 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1565/3116] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:28.406502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:28.412518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c829df31-7556-4b69-8e1b-d816d05336b1 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32eda68b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.418841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6fc740f8-362c-4619-9706-3cbaa711490c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1503 microversion: 2.1 time: 0.497324 Aug 29 15:49:28.434901 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1552/3117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:27 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1503 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:28.491423 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c829df31-7556-4b69-8e1b-d816d05336b1 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.116222 Aug 29 15:49:28.492439 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1566/3118] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:28.575271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.575826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.590671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.592158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.593209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.595086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.596525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.597046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.889677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:28.890707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:28.904804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:28.910106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.910610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.911078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:28.911799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:28.912265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:28.912692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.004373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.016841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dee21032-745f-4789-93ed-d4d5fc318b53 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1504 microversion: 2.1 time: 0.446736 Aug 29 15:49:29.043484 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1553/3119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:29.071956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.089266 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-913dde8f-7270-437a-9cd7-9767f2851e5b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1486 microversion: 2.1 time: 0.199382 Aug 29 15:49:29.090685 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1567/3120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:28 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1486 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:29.188577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:29.189493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.196952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.198356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.198960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.200402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.201155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.202317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.339423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.357438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.364980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.373616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a08a755-d951-49d3-8c3d-41f5fb822cc3 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.182172 Aug 29 15:49:29.373616 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1554/3121] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:29 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:29.401987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:29.402611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.417677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.418186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.418624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.419378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.419938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.420240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.447142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:29.449852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:29.469656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.476094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.482033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.483469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:29.484173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:29.484837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:29.964318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.979164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.981249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:29.982475 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-861a9413-8188-423a-8438-76370f68ae2c tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.584994 Aug 29 15:49:30.005251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1568/3122] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:29 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:30.017664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dcdfa6cb-f5f5-482e-91d9-5f30dabd23b9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edac6ca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.079579 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dcdfa6cb-f5f5-482e-91d9-5f30dabd23b9 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.073079 Aug 29 15:49:30.081198 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1569/3123] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:30.086539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.087492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.100012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.100762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.101359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.102241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.102852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.104322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.127155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.149346 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4c26cb9-b614-4672-872e-26c9e67376b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1493 microversion: 2.1 time: 0.698708 Aug 29 15:49:30.150940 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1555/3124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:29 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1493 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:30.156255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.169228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.198716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.212807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.218145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.219553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.222424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.224944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.341903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.347916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.350487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.352495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lazy-loading 'fault' on Instance uuid 15608c5c-acbc-4327-ade5-30c5b31166bc {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:30.849742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:30.877406 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8141954-badc-4361-9371-f5933f27c505 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1504 microversion: 2.1 time: 0.793993 Aug 29 15:49:30.879870 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1570/3125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1504 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:30.890720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07dcfc6b-b6bb-4060-9991-6cada41c78c2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '.version_select at 0x7f32eda39940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.894385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07dcfc6b-b6bb-4060-9991-6cada41c78c2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.894885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07dcfc6b-b6bb-4060-9991-6cada41c78c2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.895357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07dcfc6b-b6bb-4060-9991-6cada41c78c2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.904362 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07dcfc6b-b6bb-4060-9991-6cada41c78c2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.021028 Aug 29 15:49:30.904972 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1571/3126] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:30.919448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:30.920080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:30.947974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.948487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.948935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:30.956329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:30.956989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:30.957450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.094931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.113880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.115372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.116284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.116586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b92e9b52-02a2-4067-ae13-76250a41ed0f tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1604 microversion: 2.42 time: 0.202426 Aug 29 15:49:31.118099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1572/3127] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:31.125336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.125474 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-222cdac6-f92f-4640-99e6-96107437133f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 200 len: 1314 microversion: 2.1 time: 0.972824 Aug 29 15:49:31.126331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.135393 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1556/3128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:30 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 1314 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:31.135964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.135964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.136449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.137158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.144535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.144535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.147126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.148271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.165481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.170809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.171322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.172068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.172535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.172961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.349888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf41d6aa-6582-4cd0-9b39-ad8ce7c64ec8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1646 microversion: 2.1 time: 0.230442 Aug 29 15:49:31.351365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1573/3129] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1646 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:31.356911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e63d322-a124-45d5-8902-398229ccc744 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb239d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.454890 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e63d322-a124-45d5-8902-398229ccc744 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.100551 Aug 29 15:49:31.465216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.476726 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1574/3130] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:31.480016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.487079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:31.494636 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d3080404-57b0-4d0c-8c1e-870beb1ba576 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.364966 Aug 29 15:49:31.511281 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1557/3131] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:31.696908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1904265669", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f0a6211c-15a9-4651-919e-885c3d0e4778"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:31.837984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] validate_networks() for [('f0a6211c-15a9-4651-919e-885c3d0e4778', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:31.897829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:31.898679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:31.911198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.911399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.913303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:31.914745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:31.921203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:31.921920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.242846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.257816 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d3b6ef2-a827-412a-8b9a-0da67fc771a3 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1504 microversion: 2.1 time: 0.363873 Aug 29 15:49:32.272304 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1558/3132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:31 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:32.281482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.282838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.294101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.294868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.295593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.296710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.297361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.297982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.366229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:32.371881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.372704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.373433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.374173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lazy-loading 'fault' on Instance uuid ed62d5ed-12ad-4742-93f2-d6687ec2db55 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:32.469298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.479658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.480915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f4abb1099f2648998f7542cd84a737c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f8b491e736447ebb4436c6bdd9125f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:32.482172 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5c7d6de3-1598-4c75-a4d4-639cfc79a896 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 200 len: 1609 microversion: 2.42 time: 0.208294 Aug 29 15:49:32.482742 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1559/3133] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 1609 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:32.501953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.503808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.538441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.540625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.542846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.547561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.549890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.550517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.602139 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc HTTP/1.1 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '15608c5c-acbc-4327-ade5-30c5b31166bc'} Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.605277 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:49:32.609996 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:32.614114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:32.616590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67f082ce-6f23-43c5-a183-2ed5bb76eb36 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 404 len: 111 microversion: 2.1 time: 0.118603 Aug 29 15:49:32.619862 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1560/3134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:32.630139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c19fe7b1-2dc9-465b-8a49-79854dcdacd2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ee4f8d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.717019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:32.717959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:32.718515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:32.719007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:32.719875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:32.737189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.737828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.738660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.740959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.743698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.744093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.766534 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c19fe7b1-2dc9-465b-8a49-79854dcdacd2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.145378 Aug 29 15:49:32.771591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1561/3135] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:32.777309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:32.778269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:32.789029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.790149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.790851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.792469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:32.793787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:32.794483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:32.829764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:32.858031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for user 71e0809663664b319388bcc890b6fdec and project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:32.913334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:32.916122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:33.037396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.056643 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14c7caaf-94dd-493c-808d-0f5645da2f48 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362835 Aug 29 15:49:33.058187 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1575/3136] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:33.065800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-373210552", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:33.076544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.080996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.083038 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-414e8403-2273-4bac-88d1-d8bb1e4e0c7b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.309219 Aug 29 15:49:33.109365 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1562/3137] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:32 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:33.118628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4e3dd215-e41c-47d9-89b5-d5eb485e67b3 req-fc62b2c2-2233-4894-a909-1d65f26051aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d05a13-4f2b-4f04-8181-acd8427ffb81", "name": "network-vif-deleted", "tag": "646de7a8-7bc5-4bf2-8dc1-6298b756cc80"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:33.162437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e3dd215-e41c-47d9-89b5-d5eb485e67b3 req-fc62b2c2-2233-4894-a909-1d65f26051aa service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.162907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e3dd215-e41c-47d9-89b5-d5eb485e67b3 req-fc62b2c2-2233-4894-a909-1d65f26051aa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.163441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4e3dd215-e41c-47d9-89b5-d5eb485e67b3 req-fc62b2c2-2233-4894-a909-1d65f26051aa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.188866 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4e3dd215-e41c-47d9-89b5-d5eb485e67b3 req-fc62b2c2-2233-4894-a909-1d65f26051aa service nova] Creating event network-vif-deleted:646de7a8-7bc5-4bf2-8dc1-6298b756cc80 for instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 on n-h2-836830-13 Aug 29 15:49:33.196282 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4e3dd215-e41c-47d9-89b5-d5eb485e67b3 req-fc62b2c2-2233-4894-a909-1d65f26051aa service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084387 Aug 29 15:49:33.197191 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1563/3138] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:33.203457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] validate_networks() for [('5c5d881c-0bfc-43c0-bfab-44566705c02e', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:33.205696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e809eba-cf8d-4ca4-81db-630e131eceb7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.206525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e809eba-cf8d-4ca4-81db-630e131eceb7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.414215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e809eba-cf8d-4ca4-81db-630e131eceb7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.422892 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e809eba-cf8d-4ca4-81db-630e131eceb7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1211 microversion: 2.1 time: 0.223981 Aug 29 15:49:33.426555 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1564/3139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1211 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:33.450970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.453672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.468727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.469607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.470239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.471148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.472155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.472746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.525122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:33.546563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.547165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.547607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.548061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lazy-loading 'fault' on Instance uuid 59d05a13-4f2b-4f04-8181-acd8427ffb81 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:33.695409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb56832bbeb4a74b67ba0c1f68b3aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0e0f8d06044de8b8be818bc760176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:33.704014 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fec368ff-857b-41ab-9b54-c67a24592de1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 200 len: 1303 microversion: 2.1 time: 0.276117 Aug 29 15:49:33.707451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1565/3140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 1303 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:33.729501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:33.738153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:33.767334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.769932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.771654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.773943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:33.779898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:33.780588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:33.847142 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] HTTP exception thrown: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Request method failure captured: Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 HTTP/1.1 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN54loznc1vAPivynEmRXFhzETbxQ3prG1J6iKyKp7zls5iqFsQz5iJCzpGYVHXYFcu42NHQjGXHhunTFIHg4xgb1SxgZOQKQVS_6Z2xf9465IejH4VJtXviibsXXcABVrpryTkWGZ-cqENl3C6gFtaGx0a8_lgPxKEf3ZYvBj7vjbg Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d2f8b491e736447ebb4436c6bdd9125f Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d2f8b491e736447ebb4436c6bdd9125f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d2f8b491e736447ebb4436c6bdd9125f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d2f8b491e736447ebb4436c6bdd9125f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d2f8b491e736447ebb4436c6bdd9125f"}]}] Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d2f8b491e736447ebb4436c6bdd9125f Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TaggedBootDevicesTest_v242-1396449650-project Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f4abb1099f2648998f7542cd84a737c4 Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1396449650-project Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ed62d5ed-12ad-4742-93f2-d6687ec2db55'} Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.856676 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:33.861358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:33.867526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Returning 404 to user: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:33.871237 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-289db147-2a0d-482e-bef3-e3a01dbd8da5 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 404 len: 111 microversion: 2.42 time: 0.162401 Aug 29 15:49:33.879954 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1566/3141] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:33.897447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53ec7a9a-2c19-47a1-ab31-4916afa31c2f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edc30ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.066768 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53ec7a9a-2c19-47a1-ab31-4916afa31c2f tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.183894 Aug 29 15:49:34.069760 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1567/3142] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:33 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:34.071870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:34.074623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:34.075541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:34.076203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:34.076859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:34.094609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e939c68-9b32-403f-905f-e39f4cdeb417 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '.version_select at 0x7f32ee96e9d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.112148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.113265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.115075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.118278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.120199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.121256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.181915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for project 062ee746b4614e629a9d853a6d84a368. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:34.196148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Getting quotas for user 215e000f15f44b41aa38a41a941c16da and project 062ee746b4614e629a9d853a6d84a368. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:34.224924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:34.227185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:34.235124 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e939c68-9b32-403f-905f-e39f4cdeb417 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056769755" status: 204 len: 0 microversion: 2.42 time: 0.163798 Aug 29 15:49:34.235692 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1568/3143] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 15:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056769755 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:49:34.248729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.252652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.289975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.290478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.293475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.296571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.298328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.298787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.347426 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79fe2080-d8c1-47ad-a58f-d9939b4d6855 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.287798 Aug 29 15:49:34.352184 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1576/3144] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:34.373039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5af0bdc-e3e4-4da7-a8b1-726268100abb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.377975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5af0bdc-e3e4-4da7-a8b1-726268100abb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.479636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.489547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.498156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.504302 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f993855d-6bcd-4958-a77b-6a0fb6707f5b tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.267398 Aug 29 15:49:34.504883 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1569/3145] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:34.524798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.529796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.551664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.553922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.554481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.560067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.560722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.565502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.665260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5af0bdc-e3e4-4da7-a8b1-726268100abb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.695109 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5af0bdc-e3e4-4da7-a8b1-726268100abb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1224 microversion: 2.1 time: 0.330360 Aug 29 15:49:34.705703 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1577/3146] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1224 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:34.739540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.740788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:34.755345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.758975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.761640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.764067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.767059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.768905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.814999 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] HTTP exception thrown: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Request method failure captured: Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 HTTP/1.1 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_nA2Y46xtv1nTJs6dVUx0rzHeWY6Zl4QkUXzgoB1XvBgFjobiZjOiYj23WTfPtln-5VnaljBWIcw9DpqMTe_kPJ22CK1LttR8aQn5amNWmOyuE0EtlL0Pj7qFByA_mIo8Km0cQt7gN-nP1Fvl38bs9MhaSoQ1WUliCMpVGuuQVzGg Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ff0e0f8d06044de8b8be818bc760176", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ff0e0f8d06044de8b8be818bc760176"}]}] Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3fb56832bbeb4a74b67ba0c1f68b3aa6 Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '59d05a13-4f2b-4f04-8181-acd8427ffb81'} Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:34.817658 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.821882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:34.821882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:34.821882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:34.821882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:34.821882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:34.821882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:34.821882 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:34.823178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:34.827122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Returning 404 to user: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:34.828987 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ecfbf78-2a7e-4d7c-b0a5-140494364a35 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 404 len: 111 microversion: 2.1 time: 0.097400 Aug 29 15:49:34.829926 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1578/3147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:34.844162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ad264f4-74c6-4200-b94b-e67623ccd6cc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:34.855405 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-80a7c6d0-7992-49db-9295-3140f72b60e9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1207 microversion: 2.1 time: 0.343454 Aug 29 15:49:34.859893 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1570/3148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1207 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:34.876816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.server_groups [None req-6ad264f4-74c6-4200-b94b-e67623ccd6cc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Querying cell 28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) for 1 instances {{(pid=129132) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:49:34.885652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ad264f4-74c6-4200-b94b-e67623ccd6cc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:34.891840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ad264f4-74c6-4200-b94b-e67623ccd6cc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:34.895941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ad264f4-74c6-4200-b94b-e67623ccd6cc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:34.955195 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ad264f4-74c6-4200-b94b-e67623ccd6cc tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.111056 Aug 29 15:49:34.959887 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1579/3149] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:34.969964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-892aa3b7-d9e4-4ea7-a2b5-7c969b1eb307 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.009112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.server_groups [None req-892aa3b7-d9e4-4ea7-a2b5-7c969b1eb307 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Querying cell 28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) for 1 instances {{(pid=129133) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 29 15:49:35.009901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-892aa3b7-d9e4-4ea7-a2b5-7c969b1eb307 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.010581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-892aa3b7-d9e4-4ea7-a2b5-7c969b1eb307 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.011141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-892aa3b7-d9e4-4ea7-a2b5-7c969b1eb307 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.052481 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-892aa3b7-d9e4-4ea7-a2b5-7c969b1eb307 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups/8aae68c6-cd72-4b07-9230-2d6608276d07" status: 200 len: 183 microversion: 2.1 time: 0.087722 Aug 29 15:49:35.066718 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1571/3150] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:49:34 2022] GET /compute/v2.1/os-server-groups/8aae68c6-cd72-4b07-9230-2d6608276d07 => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:35.068402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.069278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.083583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-66ed06d5-f0f5-43ea-b5e9-861cb224a0a3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed91ec10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.085351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.085954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.086476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.088371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.089969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.091110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.128156 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] HTTP exception thrown: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Request method failure captured: Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 HTTP/1.1 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_nA2Y46xtv1nTJs6dVUx0rzHeWY6Zl4QkUXzgoB1XvBgFjobiZjOiYj23WTfPtln-5VnaljBWIcw9DpqMTe_kPJ22CK1LttR8aQn5amNWmOyuE0EtlL0Pj7qFByA_mIo8Km0cQt7gN-nP1Fvl38bs9MhaSoQ1WUliCMpVGuuQVzGg Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ff0e0f8d06044de8b8be818bc760176", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ff0e0f8d06044de8b8be818bc760176"}]}] Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3fb56832bbeb4a74b67ba0c1f68b3aa6 Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '59d05a13-4f2b-4f04-8181-acd8427ffb81'} Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:35.129872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.134709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.137108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Returning 404 to user: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:35.142249 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b31881ba-98cf-4472-b653-fd2a84a56e4f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 404 len: 111 microversion: 2.1 time: 0.079925 Aug 29 15:49:35.146421 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1580/3151] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:35 2022] DELETE /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:35.160693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.164026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] [instance: 59d05a13-4f2b-4f04-8181-acd8427ffb81] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.180816 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-66ed06d5-f0f5-43ea-b5e9-861cb224a0a3 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.100262 Aug 29 15:49:35.186356 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1572/3152] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:35.190770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.195118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.197945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.199983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.209197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.209995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.231833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] HTTP exception thrown: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Request method failure captured: Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 HTTP/1.1 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_nA2Y46xtv1nTJs6dVUx0rzHeWY6Zl4QkUXzgoB1XvBgFjobiZjOiYj23WTfPtln-5VnaljBWIcw9DpqMTe_kPJ22CK1LttR8aQn5amNWmOyuE0EtlL0Pj7qFByA_mIo8Km0cQt7gN-nP1Fvl38bs9MhaSoQ1WUliCMpVGuuQVzGg Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ff0e0f8d06044de8b8be818bc760176", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ff0e0f8d06044de8b8be818bc760176"}]}] Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3fb56832bbeb4a74b67ba0c1f68b3aa6 Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '59d05a13-4f2b-4f04-8181-acd8427ffb81'} Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.234483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.240063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.240063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.240063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.240063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:35.240063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:35.240063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. Aug 29 15:49:35.240063 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.242870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Returning 404 to user: Instance 59d05a13-4f2b-4f04-8181-acd8427ffb81 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:35.244042 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b413b04-1b41-444f-87c0-f1e3ce555f92 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81" status: 404 len: 111 microversion: 2.1 time: 0.093511 Aug 29 15:49:35.249147 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1581/3153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/59d05a13-4f2b-4f04-8181-acd8427ffb81 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:35.255898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-082439d6-1082-47e0-81a0-8de2018858c1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.272446 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-082439d6-1082-47e0-81a0-8de2018858c1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] HTTP exception thrown: Instance group 63579fbc-4303-422a-9f9e-e08e8ec8dfe0 could not be found. Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-082439d6-1082-47e0-81a0-8de2018858c1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Request method failure captured: Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-server-groups/63579fbc-4303-422a-9f9e-e08e8ec8dfe0 HTTP/1.1 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN_nA2Y46xtv1nTJs6dVUx0rzHeWY6Zl4QkUXzgoB1XvBgFjobiZjOiYj23WTfPtln-5VnaljBWIcw9DpqMTe_kPJ22CK1LttR8aQn5amNWmOyuE0EtlL0Pj7qFByA_mIo8Km0cQt7gN-nP1Fvl38bs9MhaSoQ1WUliCMpVGuuQVzGg Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ff0e0f8d06044de8b8be818bc760176", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ff0e0f8d06044de8b8be818bc760176"}]}] Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3fb56832bbeb4a74b67ba0c1f68b3aa6 Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance group 63579fbc-4303-422a-9f9e-e08e8ec8dfe0 could not be found. Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '63579fbc-4303-422a-9f9e-e08e8ec8dfe0'} Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 63579fbc-4303-422a-9f9e-e08e8ec8dfe0 could not be found. Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 63579fbc-4303-422a-9f9e-e08e8ec8dfe0 could not be found. Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.286373 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 63579fbc-4303-422a-9f9e-e08e8ec8dfe0 could not be found. Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-082439d6-1082-47e0-81a0-8de2018858c1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Returning 404 to user: Instance group 63579fbc-4303-422a-9f9e-e08e8ec8dfe0 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:35.294338 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-082439d6-1082-47e0-81a0-8de2018858c1 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/63579fbc-4303-422a-9f9e-e08e8ec8dfe0" status: 404 len: 117 microversion: 2.1 time: 0.037841 Aug 29 15:49:35.295036 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1573/3154] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:49:35 2022] DELETE /compute/v2.1/os-server-groups/63579fbc-4303-422a-9f9e-e08e8ec8dfe0 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:35.300504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e939672f-bea5-44f0-b8eb-c6f5b0481a31 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.314956 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e939672f-bea5-44f0-b8eb-c6f5b0481a31 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] HTTP exception thrown: Instance group 6877d869-c72d-400b-85b1-c855f8a508fe could not be found. Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e939672f-bea5-44f0-b8eb-c6f5b0481a31 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Request method failure captured: Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-server-groups/6877d869-c72d-400b-85b1-c855f8a508fe HTTP/1.1 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_nA2Y46xtv1nTJs6dVUx0rzHeWY6Zl4QkUXzgoB1XvBgFjobiZjOiYj23WTfPtln-5VnaljBWIcw9DpqMTe_kPJ22CK1LttR8aQn5amNWmOyuE0EtlL0Pj7qFByA_mIo8Km0cQt7gN-nP1Fvl38bs9MhaSoQ1WUliCMpVGuuQVzGg Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ff0e0f8d06044de8b8be818bc760176", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ff0e0f8d06044de8b8be818bc760176"}]}] Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3fb56832bbeb4a74b67ba0c1f68b3aa6 Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance group 6877d869-c72d-400b-85b1-c855f8a508fe could not be found. Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6877d869-c72d-400b-85b1-c855f8a508fe'} Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6877d869-c72d-400b-85b1-c855f8a508fe could not be found. Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6877d869-c72d-400b-85b1-c855f8a508fe could not be found. Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.326384 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.331505 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.331505 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.331505 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:35.331505 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:35.331505 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6877d869-c72d-400b-85b1-c855f8a508fe could not be found. Aug 29 15:49:35.331505 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.334143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e939672f-bea5-44f0-b8eb-c6f5b0481a31 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Returning 404 to user: Instance group 6877d869-c72d-400b-85b1-c855f8a508fe could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:35.335681 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e939672f-bea5-44f0-b8eb-c6f5b0481a31 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/6877d869-c72d-400b-85b1-c855f8a508fe" status: 404 len: 117 microversion: 2.1 time: 0.038994 Aug 29 15:49:35.336676 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1582/3155] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:49:35 2022] DELETE /compute/v2.1/os-server-groups/6877d869-c72d-400b-85b1-c855f8a508fe => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:35.344260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07e210fc-49ef-4c5e-ad46-3442add91e50 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.354243 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-07e210fc-49ef-4c5e-ad46-3442add91e50 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] HTTP exception thrown: Instance group a9e02433-51c9-4453-a462-4b7300f0ce7c could not be found. Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07e210fc-49ef-4c5e-ad46-3442add91e50 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Request method failure captured: Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-server-groups/a9e02433-51c9-4453-a462-4b7300f0ce7c HTTP/1.1 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN_nA2Y46xtv1nTJs6dVUx0rzHeWY6Zl4QkUXzgoB1XvBgFjobiZjOiYj23WTfPtln-5VnaljBWIcw9DpqMTe_kPJ22CK1LttR8aQn5amNWmOyuE0EtlL0Pj7qFByA_mIo8Km0cQt7gN-nP1Fvl38bs9MhaSoQ1WUliCMpVGuuQVzGg Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ff0e0f8d06044de8b8be818bc760176", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ff0e0f8d06044de8b8be818bc760176"}]}] Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3fb56832bbeb4a74b67ba0c1f68b3aa6 Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance group a9e02433-51c9-4453-a462-4b7300f0ce7c could not be found. Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'a9e02433-51c9-4453-a462-4b7300f0ce7c'} Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a9e02433-51c9-4453-a462-4b7300f0ce7c could not be found. Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a9e02433-51c9-4453-a462-4b7300f0ce7c could not be found. Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.368638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.377561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.377561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.377561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:35.377561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:35.377561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a9e02433-51c9-4453-a462-4b7300f0ce7c could not be found. Aug 29 15:49:35.377561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.390360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07e210fc-49ef-4c5e-ad46-3442add91e50 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Returning 404 to user: Instance group a9e02433-51c9-4453-a462-4b7300f0ce7c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:35.392073 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-07e210fc-49ef-4c5e-ad46-3442add91e50 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/a9e02433-51c9-4453-a462-4b7300f0ce7c" status: 404 len: 117 microversion: 2.1 time: 0.051243 Aug 29 15:49:35.393097 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1574/3156] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:49:35 2022] DELETE /compute/v2.1/os-server-groups/a9e02433-51c9-4453-a462-4b7300f0ce7c => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:35.409670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-989c34bb-cb82-4ce9-b3cc-c3b6c4fa8c1f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.457860 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-989c34bb-cb82-4ce9-b3cc-c3b6c4fa8c1f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] HTTP exception thrown: Instance group 9f02a481-68ae-44b3-bef5-a1097dd10364 could not be found. Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-989c34bb-cb82-4ce9-b3cc-c3b6c4fa8c1f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Request method failure captured: Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/os-server-groups/9f02a481-68ae-44b3-bef5-a1097dd10364 HTTP/1.1 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_nA2Y46xtv1nTJs6dVUx0rzHeWY6Zl4QkUXzgoB1XvBgFjobiZjOiYj23WTfPtln-5VnaljBWIcw9DpqMTe_kPJ22CK1LttR8aQn5amNWmOyuE0EtlL0Pj7qFByA_mIo8Km0cQt7gN-nP1Fvl38bs9MhaSoQ1WUliCMpVGuuQVzGg Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7ff0e0f8d06044de8b8be818bc760176", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7ff0e0f8d06044de8b8be818bc760176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7ff0e0f8d06044de8b8be818bc760176"}]}] Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 7ff0e0f8d06044de8b8be818bc760176 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerGroupTestJSON-1206171473 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3fb56832bbeb4a74b67ba0c1f68b3aa6 Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerGroupTestJSON-1206171473-project Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance group 9f02a481-68ae-44b3-bef5-a1097dd10364 could not be found. Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9f02a481-68ae-44b3-bef5-a1097dd10364'} Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9f02a481-68ae-44b3-bef5-a1097dd10364 could not be found. Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9f02a481-68ae-44b3-bef5-a1097dd10364 could not be found. Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.468035 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9f02a481-68ae-44b3-bef5-a1097dd10364 could not be found. Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-989c34bb-cb82-4ce9-b3cc-c3b6c4fa8c1f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Returning 404 to user: Instance group 9f02a481-68ae-44b3-bef5-a1097dd10364 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-989c34bb-cb82-4ce9-b3cc-c3b6c4fa8c1f tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/9f02a481-68ae-44b3-bef5-a1097dd10364" status: 404 len: 117 microversion: 2.1 time: 0.071016 Aug 29 15:49:35.472298 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1583/3157] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:49:35 2022] DELETE /compute/v2.1/os-server-groups/9f02a481-68ae-44b3-bef5-a1097dd10364 => generated 117 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:35.482930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1aaf1f53-2018-4050-aa0b-237e538991c8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.531929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.532463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.543451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.552245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.553199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.554313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.554963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.555751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.577691 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1aaf1f53-2018-4050-aa0b-237e538991c8 tempest-ServerGroupTestJSON-1206171473 tempest-ServerGroupTestJSON-1206171473-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/8aae68c6-cd72-4b07-9230-2d6608276d07" status: 204 len: 0 microversion: 2.1 time: 0.100276 Aug 29 15:49:35.581024 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1575/3158] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 15:49:35 2022] DELETE /compute/v2.1/os-server-groups/8aae68c6-cd72-4b07-9230-2d6608276d07 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:35.737163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.737783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.752775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.753565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.754166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.755108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.756056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.761210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.900646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:35.917053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:35.918812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:35.921491 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e3fb691-7fb4-4179-b414-aa604b14b2c4 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.394221 Aug 29 15:49:35.924789 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1584/3159] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:35.933713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:35.943759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:35.962571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.963772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.964379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:35.965249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:35.965871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:35.967159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.104877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.143481 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a36f3a23-af3c-4888-a053-b01a694adbb6 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1228 microversion: 2.1 time: 0.402599 Aug 29 15:49:36.144866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1576/3160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1228 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:36.199276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83b7d5df-2daf-4efd-8ec7-0dd0ff2339f0 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32efd91790>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:36.281882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83b7d5df-2daf-4efd-8ec7-0dd0ff2339f0 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1429 microversion: 2.1 time: 0.087883 Aug 29 15:49:36.284316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1577/3161] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:36 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:36.485177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:36.495685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7c84a810-719e-46a6-86cf-9a9c88176799 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1281 microversion: 2.1 time: 0.569221 Aug 29 15:49:36.516112 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1585/3162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:35 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1281 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:36.976418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:36.977656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:36.993916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.995712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.996330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:36.997411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:36.998077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:36.998675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.170873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.175981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.176635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.187217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.189474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.189474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.190595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.191794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.192427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.219604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.232910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.238291 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8da09f50-fb07-4240-8696-2aa3c75df7b6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.269501 Aug 29 15:49:37.239865 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1578/3163] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:36 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:37.298721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a6700cdd-3c9e-43fb-9fa7-2e8d36a7344b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edc30280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.378981 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a6700cdd-3c9e-43fb-9fa7-2e8d36a7344b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1438 microversion: 2.1 time: 0.085045 Aug 29 15:49:37.380011 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1579/3164] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:37.393981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b02dbbf9-cb1c-4613-9e07-d4a4a5105d63 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32ed90e550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.394693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.410162 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c4553ec-68e3-4481-976a-3aa603d34cfa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1284 microversion: 2.1 time: 0.237296 Aug 29 15:49:37.411197 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1586/3165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:37.483363 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b02dbbf9-cb1c-4613-9e07-d4a4a5105d63 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 200 len: 1438 microversion: 2.1 time: 0.093583 Aug 29 15:49:37.484453 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1580/3166] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 1438 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:37.498830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.500144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.520370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.521136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.521775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.522664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.523646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.524275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.531214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:37.532186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:37.545013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.550534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.550986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.560094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:37.560522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:37.561095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:37.683644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:37.691907 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2ca57b6-bd2e-44e0-8684-a7bfe8e53ec0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1269 microversion: 2.1 time: 0.170408 Aug 29 15:49:37.693071 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1581/3167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:38.027161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.050678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-439c4d9d-26d7-418a-9e84-8a0f0956b24b tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1467 microversion: 2.1 time: 0.556292 Aug 29 15:49:38.051686 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1587/3168] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:37 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1467 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:38.079363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-74c12c64-e68f-490f-98ff-757e8394a1ff tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edc30f70>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:38.269399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:38.270032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:38.314723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.315320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.320539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.321672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.322569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.325354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.944244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.961553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.965471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:38.969176 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-93493746-f072-43b6-8fde-9d7e061e164d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.708188 Aug 29 15:49:38.972260 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1588/3169] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:38 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:38.981712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:38.982350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:38.998259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:38.998760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:38.999237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:38.999952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.000417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.007057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.074946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-74c12c64-e68f-490f-98ff-757e8394a1ff tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "DELETE /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403" status: 204 len: 0 microversion: 2.1 time: 1.000193 Aug 29 15:49:39.075966 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1582/3170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:38 2022] DELETE /compute/v2.1/images/f155884c-1b72-4b35-b651-992e0973a403 => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:39.084546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.087216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.105401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.106071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.106536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.108483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.111533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.112080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.189199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:39.202723 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c3bdf4b2-544b-458b-b2a0-2ab6a747d5c8 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1282 microversion: 2.1 time: 0.229260 Aug 29 15:49:39.203932 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1589/3171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:38 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:39.210954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7e68785-6b52-4250-8d36-0bcdefee7955 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '.version_select at 0x7f32edb5b820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.240657 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a7e68785-6b52-4250-8d36-0bcdefee7955 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] HTTP exception thrown: Image not found. Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7e68785-6b52-4250-8d36-0bcdefee7955 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Request method failure captured: Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c HTTP/1.1 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_CHCi2QSb5B4NGGH8dvbhDZYBigNOvRVq4ZtTCdVHCcfaEEvzQrRcokhxjS4xW0zqOjS5AGA2hLQyTMA0SK_lbVjKf1iNcWoM2a5b9QSGsx46-5wYCXp2AtQY2u8CsKYvDugNsrTHM9pRmOp7J5xGTi4reNbY9YQuDXbszvFVYsFI Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d8c72636d6db42cfb42f0c535863a4b2 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8c72636d6db42cfb42f0c535863a4b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8c72636d6db42cfb42f0c535863a4b2", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8c72636d6db42cfb42f0c535863a4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8c72636d6db42cfb42f0c535863a4b2"}]}] Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d8c72636d6db42cfb42f0c535863a4b2 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerTestJSON-1888966700-project Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 1ada57c2de1f4c1f90d6f8173289bbb1 Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerTestJSON-1888966700-project Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '578ac3e3-e4a0-4ea5-bede-5402127f6c1c'} Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 578ac3e3-e4a0-4ea5-bede-5402127f6c1c to delete Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 578ac3e3-e4a0-4ea5-bede-5402127f6c1c could not be found. Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:39.243274 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:49:39.248634 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:39.251117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7e68785-6b52-4250-8d36-0bcdefee7955 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:39.252743 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7e68785-6b52-4250-8d36-0bcdefee7955 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "DELETE /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c" status: 404 len: 62 microversion: 2.1 time: 0.046657 Aug 29 15:49:39.254180 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1590/3172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:39 2022] DELETE /compute/v2.1/images/578ac3e3-e4a0-4ea5-bede-5402127f6c1c => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:39.426829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1047995962", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "2cb09e62-6a10-4d49-854a-232bd9d31a52"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:39.430876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:39.446866 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-456a84c7-a956-4f55-9da2-dd63cf4a4ae4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 0.368514 Aug 29 15:49:39.452711 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1583/3173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:39 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:39.461629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.466274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.483651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.484890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.485333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.487311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.488103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.488760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.531790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:39.542833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] validate_networks() for [('2cb09e62-6a10-4d49-854a-232bd9d31a52', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:49:39.693795 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a2234cc-98b6-496f-bac6-f9a21ea56c7c tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 204 len: 0 microversion: 2.1 time: 0.237854 Aug 29 15:49:39.695090 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1584/3174] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:39 2022] DELETE /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:39.705343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:39.708152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:39.725397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.729820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.730636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:39.731680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:39.734161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:39.735437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.235773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.249915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-439ee415-db25-4ed8-b8dd-0c95a63893f2 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1473 microversion: 2.1 time: 0.549148 Aug 29 15:49:40.250518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1585/3175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:39 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1473 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:40.273494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-41c3fdf9-34b4-4a3b-a3cd-d7baf47f9ea4 req-0678ee34-52bf-4379-8f1c-d2287aabb614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be59c56-9380-45c5-9fdd-7e361548a44b", "tag": "1b08f641-6926-4e20-a9d8-b523d8854ed9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:40.305070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-41c3fdf9-34b4-4a3b-a3cd-d7baf47f9ea4 req-0678ee34-52bf-4379-8f1c-d2287aabb614 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.305804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-41c3fdf9-34b4-4a3b-a3cd-d7baf47f9ea4 req-0678ee34-52bf-4379-8f1c-d2287aabb614 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.306240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-41c3fdf9-34b4-4a3b-a3cd-d7baf47f9ea4 req-0678ee34-52bf-4379-8f1c-d2287aabb614 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.322111 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-41c3fdf9-34b4-4a3b-a3cd-d7baf47f9ea4 req-0678ee34-52bf-4379-8f1c-d2287aabb614 service nova] Creating event network-changed:1b08f641-6926-4e20-a9d8-b523d8854ed9 for instance 8be59c56-9380-45c5-9fdd-7e361548a44b on n-h2-836830-13 Aug 29 15:49:40.334495 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-41c3fdf9-34b4-4a3b-a3cd-d7baf47f9ea4 req-0678ee34-52bf-4379-8f1c-d2287aabb614 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069932 Aug 29 15:49:40.347233 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1586/3176] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:40.354685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:40.355441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:40.363149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.363661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.364107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.364820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.365463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.366047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.489321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.502565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.504892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.507116 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-913ab327-97e5-44e4-98f9-49bc91154319 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.158085 Aug 29 15:49:40.516781 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1587/3177] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:40 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:40.528384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:40.532620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:40.542326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.543328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.543878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.544807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.545599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.546126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.875880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:40.886129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ab21848f-008f-48e4-969a-81be1b7d1c66 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.367330 Aug 29 15:49:40.887815 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1588/3178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:40 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:40.893051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:40.893865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:40.900925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.901684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.902305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:40.903768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:40.904395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:40.905018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.116590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:41.126281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5081e09-5ba0-4a0d-8255-24bee6b24ccb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 0.237051 Aug 29 15:49:41.127470 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1589/3179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:40 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:41.154462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:49:41.154902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:49:41.155989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:49:41.156476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:49:41.157111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:49:41.168102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.168593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.169031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.169760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.170433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.171383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.196741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Getting quotas for project 5f7aaa8aa8d145ba9dbfccf8cd4f9e9d. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:41.203387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Getting quotas for user 67dd0372f7b442b3997a91623e18529b and project 5f7aaa8aa8d145ba9dbfccf8cd4f9e9d. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:41.216557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:49:41.218790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:49:41.270409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-edb370a6-88b0-4204-b167-50bafff6c167 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.014592 Aug 29 15:49:41.271852 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1591/3180] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:49:41.282661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:41.283397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:41.285479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bba63dbe-8624-4f66-87a6-411ee79b2b46 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:41.288082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bba63dbe-8624-4f66-87a6-411ee79b2b46 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:41.307992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.308518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.308973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.312278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.312819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.313535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.439355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bba63dbe-8624-4f66-87a6-411ee79b2b46 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:41.448307 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bba63dbe-8624-4f66-87a6-411ee79b2b46 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1216 microversion: 2.1 time: 0.168493 Aug 29 15:49:41.449263 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1592/3181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:41 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:41.508595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:41.519904 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2aa32c4f-f55e-4ce9-b41b-2b4759debc03 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1473 microversion: 2.1 time: 0.241237 Aug 29 15:49:41.520845 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1590/3182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:41 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:41.542910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:41.543828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:41.579422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.580960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.583737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.584647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.585382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.586467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.910434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:41.912850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:41.940327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.942112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.943533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:41.944985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:41.950553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:41.951352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.213861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.225004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.226470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:42.232477 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-89a86fe8-87b6-4b04-8e11-949770f4d1d5 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.695930 Aug 29 15:49:42.233072 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1593/3183] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:41 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:42.244810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:42.245499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:42.269132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.274248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.275782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:42.277924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:42.280305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:42.281007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.117801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.138388 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7bb003e-d0ae-405c-817a-61200ccc0090 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 1.229582 Aug 29 15:49:43.139558 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1591/3184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:41 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:43.146746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e92cc42c-a498-43dd-b5ba-78667ab144b6 req-2ecda02f-2e73-46ff-8802-68ca99bee263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c", "name": "network-vif-unplugged", "status": "completed", "tag": "52c3f5bd-a607-478d-b7f3-8a16a81fbcc9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:43.173643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e92cc42c-a498-43dd-b5ba-78667ab144b6 req-2ecda02f-2e73-46ff-8802-68ca99bee263 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.174928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e92cc42c-a498-43dd-b5ba-78667ab144b6 req-2ecda02f-2e73-46ff-8802-68ca99bee263 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.175481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e92cc42c-a498-43dd-b5ba-78667ab144b6 req-2ecda02f-2e73-46ff-8802-68ca99bee263 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.198751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:43.204885 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e92cc42c-a498-43dd-b5ba-78667ab144b6 req-2ecda02f-2e73-46ff-8802-68ca99bee263 service nova] Creating event network-vif-unplugged:52c3f5bd-a607-478d-b7f3-8a16a81fbcc9 for instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c on n-h1-836830-13 Aug 29 15:49:43.228243 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e92cc42c-a498-43dd-b5ba-78667ab144b6 req-2ecda02f-2e73-46ff-8802-68ca99bee263 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086965 Aug 29 15:49:43.237042 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1592/3185] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:43.244348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:43.245972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:43.258959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.259997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.261266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.263613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.264563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.265231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.419840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:43.530950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.543580 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87e14f8f-51a3-46c7-8c27-95837e8fd984 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1268 microversion: 2.1 time: 0.304770 Aug 29 15:49:43.567545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1593/3186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:43 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1268 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:43.567545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:43.567545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:43.595373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.599561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.601547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.602569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.604588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.605060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.605550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.613365 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e90f750e-cd5b-4562-a4a8-2b98b301284a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 1.376385 Aug 29 15:49:43.635128 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1594/3187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:42 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:43.635128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-dcf577e3-e6ef-4849-b80a-dc6884cbfb07 req-4e70e34d-55db-4d2d-aed3-ba1e33847bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c", "name": "network-vif-deleted", "tag": "52c3f5bd-a607-478d-b7f3-8a16a81fbcc9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:43.660648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dcf577e3-e6ef-4849-b80a-dc6884cbfb07 req-4e70e34d-55db-4d2d-aed3-ba1e33847bf3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.664559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dcf577e3-e6ef-4849-b80a-dc6884cbfb07 req-4e70e34d-55db-4d2d-aed3-ba1e33847bf3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.665286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dcf577e3-e6ef-4849-b80a-dc6884cbfb07 req-4e70e34d-55db-4d2d-aed3-ba1e33847bf3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.678630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:43.695488 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-dcf577e3-e6ef-4849-b80a-dc6884cbfb07 req-4e70e34d-55db-4d2d-aed3-ba1e33847bf3 service nova] Creating event network-vif-deleted:52c3f5bd-a607-478d-b7f3-8a16a81fbcc9 for instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c on n-h1-836830-13 Aug 29 15:49:43.721426 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-dcf577e3-e6ef-4849-b80a-dc6884cbfb07 req-4e70e34d-55db-4d2d-aed3-ba1e33847bf3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096645 Aug 29 15:49:43.722616 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1595/3188] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:43.727388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.727881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.728855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.729156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:43.729312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lazy-loading 'fault' on Instance uuid b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:43.730210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:43.744185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.752729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.753628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.754541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:43.755213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:43.755820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:43.878571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.889781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.892587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:43.894034 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44f141a5-d434-4747-a2a1-27b79b990810 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.170138 Aug 29 15:49:43.894895 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1596/3189] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:43 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:44.161260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.161918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.163988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:44.173201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.173857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.174678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.175016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.175566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.176286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.222728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ada57c2de1f4c1f90d6f8173289bbb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c72636d6db42cfb42f0c535863a4b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.236031 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1dd77a88-43c9-4954-8b5f-f47157f5077d tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 200 len: 1307 microversion: 2.1 time: 0.679762 Aug 29 15:49:44.249399 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1594/3190] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:43 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 1307 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:44.258861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-00a370bf-984b-4e5d-9493-1aac6062e2c1 req-b71a02cc-88ef-45b6-8082-2c8359658beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc89f63d-1f29-4072-b28d-a31d5dd2247a", "tag": "c338fce7-12f4-4050-ae37-ce925ab5b97c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:44.271709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-00a370bf-984b-4e5d-9493-1aac6062e2c1 req-b71a02cc-88ef-45b6-8082-2c8359658beb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.272410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-00a370bf-984b-4e5d-9493-1aac6062e2c1 req-b71a02cc-88ef-45b6-8082-2c8359658beb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.273068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-00a370bf-984b-4e5d-9493-1aac6062e2c1 req-b71a02cc-88ef-45b6-8082-2c8359658beb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.291536 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-00a370bf-984b-4e5d-9493-1aac6062e2c1 req-b71a02cc-88ef-45b6-8082-2c8359658beb service nova] Creating event network-changed:c338fce7-12f4-4050-ae37-ce925ab5b97c for instance bc89f63d-1f29-4072-b28d-a31d5dd2247a on n-h2-836830-13 Aug 29 15:49:44.297115 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-00a370bf-984b-4e5d-9493-1aac6062e2c1 req-b71a02cc-88ef-45b6-8082-2c8359658beb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046584 Aug 29 15:49:44.297730 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1595/3191] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:44.578473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.579234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.589031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.589605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.595878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.596648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.597337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.597774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.734883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.747473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f81de10-becf-4b30-af88-9d0710c9a890 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1274 microversion: 2.1 time: 0.172584 Aug 29 15:49:44.749223 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1596/3192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:44.779432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.780484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.788496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.789633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.790371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.792329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.795231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.796130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.856966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:44.870315 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cad14e57-121b-492c-8a76-77d202f8ca10 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.713412 Aug 29 15:49:44.875115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1597/3193] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:44.921238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:44.922279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:44.930525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.931141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.936887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:44.937802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:44.938365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:44.938862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.039895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:45.051475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:45.053491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:45.055394 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07e1f0d3-436e-427e-851d-ab9f5986af25 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.139344 Aug 29 15:49:45.071930 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1598/3194] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:45.169966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:45.178748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ecef0e2c-fcef-4ea5-acf8-91c57dfa7595 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 0.405760 Aug 29 15:49:45.179649 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1597/3195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:44 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:45.262945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:45.263890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] [instance: b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:45.270331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.271128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.271751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.272462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.273616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.274219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.289531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] HTTP exception thrown: Instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c could not be found. Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Request method failure captured: Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c HTTP/1.1 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_CHCi2QSb5B4NGGH8dvbhDZYBigNOvRVq4ZtTCdVHCcfaEEvzQrRcokhxjS4xW0zqOjS5AGA2hLQyTMA0SK_lbVjKf1iNcWoM2a5b9QSGsx46-5wYCXp2AtQY2u8CsKYvDugNsrTHM9pRmOp7J5xGTi4reNbY9YQuDXbszvFVYsFI Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d8c72636d6db42cfb42f0c535863a4b2 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8c72636d6db42cfb42f0c535863a4b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d8c72636d6db42cfb42f0c535863a4b2", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d8c72636d6db42cfb42f0c535863a4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d8c72636d6db42cfb42f0c535863a4b2"}]}] Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d8c72636d6db42cfb42f0c535863a4b2 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1888966700 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerTestJSON-1888966700-project Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 1ada57c2de1f4c1f90d6f8173289bbb1 Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerTestJSON-1888966700-project Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c could not be found. Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c'} Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c could not be found. Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c could not be found. Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:45.291461 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c could not be found. Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] Returning 404 to user: Instance b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-85711b90-af5f-4742-bacb-aa86f388fc78 tempest-ImagesOneServerTestJSON-1888966700 tempest-ImagesOneServerTestJSON-1888966700-project] 10.222.0.83 "GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c" status: 404 len: 111 microversion: 2.1 time: 0.034896 Aug 29 15:49:45.297934 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1599/3196] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:45 2022] GET /compute/v2.1/servers/b0d4f2ca-fc65-4a6f-ae4e-11782f06b79c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:49:45.428518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:45.429105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:45.438528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.439068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.439712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.440600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.441222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.441816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.465723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] HTTP exception thrown: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Request method failure captured: Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 HTTP/1.1 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN54loznc1vAPivynEmRXFhzETbxQ3prG1J6iKyKp7zls5iqFsQz5iJCzpGYVHXYFcu42NHQjGXHhunTFIHg4xgb1SxgZOQKQVS_6Z2xf9465IejH4VJtXviibsXXcABVrpryTkWGZ-cqENl3C6gFtaGx0a8_lgPxKEf3ZYvBj7vjbg Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d2f8b491e736447ebb4436c6bdd9125f Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d2f8b491e736447ebb4436c6bdd9125f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d2f8b491e736447ebb4436c6bdd9125f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d2f8b491e736447ebb4436c6bdd9125f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d2f8b491e736447ebb4436c6bdd9125f"}]}] Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d2f8b491e736447ebb4436c6bdd9125f Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TaggedBootDevicesTest_v242-1396449650-project Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f4abb1099f2648998f7542cd84a737c4 Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1396449650-project Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ed62d5ed-12ad-4742-93f2-d6687ec2db55'} Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:45.467502 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.472195 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.478170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Returning 404 to user: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:45.479994 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ff6a259-c5bf-46f2-a74c-827c9ea2ecf8 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 404 len: 111 microversion: 2.42 time: 0.055230 Aug 29 15:49:45.481070 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1598/3197] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:49:45 2022] DELETE /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:45.489291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:45.489921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] [instance: ed62d5ed-12ad-4742-93f2-d6687ec2db55] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:45.504126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.504626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.505073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.505785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.506240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.506673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.532363 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] HTTP exception thrown: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Request method failure captured: Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 HTTP/1.1 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN54loznc1vAPivynEmRXFhzETbxQ3prG1J6iKyKp7zls5iqFsQz5iJCzpGYVHXYFcu42NHQjGXHhunTFIHg4xgb1SxgZOQKQVS_6Z2xf9465IejH4VJtXviibsXXcABVrpryTkWGZ-cqENl3C6gFtaGx0a8_lgPxKEf3ZYvBj7vjbg Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.42 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d2f8b491e736447ebb4436c6bdd9125f Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d2f8b491e736447ebb4436c6bdd9125f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d2f8b491e736447ebb4436c6bdd9125f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d2f8b491e736447ebb4436c6bdd9125f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d2f8b491e736447ebb4436c6bdd9125f"}]}] Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d2f8b491e736447ebb4436c6bdd9125f Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1396449650 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TaggedBootDevicesTest_v242-1396449650-project Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f4abb1099f2648998f7542cd84a737c4 Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1396449650-project Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'ed62d5ed-12ad-4742-93f2-d6687ec2db55'} Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.534382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. Aug 29 15:49:45.538409 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:45.541468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] Returning 404 to user: Instance ed62d5ed-12ad-4742-93f2-d6687ec2db55 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:45.542562 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-589fc9f6-5930-4b73-a867-b4a2adf037e1 tempest-TaggedBootDevicesTest_v242-1396449650 tempest-TaggedBootDevicesTest_v242-1396449650-project] 10.222.0.83 "GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55" status: 404 len: 111 microversion: 2.42 time: 0.057364 Aug 29 15:49:45.546769 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1600/3198] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:45 2022] GET /compute/v2.1/servers/ed62d5ed-12ad-4742-93f2-d6687ec2db55 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:45.769031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:45.769662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:45.780169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.780676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.781646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.785687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.786258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.786736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.894927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:45.895581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:45.908794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.910547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.912241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:45.914565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:45.916143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:45.917409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.218260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.228195 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-50df860b-9059-4310-b9b8-2cdc12f8e290 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.337167 Aug 29 15:49:46.235539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1601/3199] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:45 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:46.248518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:46.250633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:46.271473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.272280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.273021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.274535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.275730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.276324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.289292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.302706 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-93b46216-20d6-42dd-a800-72a86e4723dc tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.534150 Aug 29 15:49:46.303808 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1599/3200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:45 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:46.310636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:46.317267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:46.332507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.337003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.338355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.339472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:46.341272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:46.341993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:46.425230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.438656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.445526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.453190 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7d191ec1-70bd-4547-981f-6d345c93ad9f tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.210221 Aug 29 15:49:46.454141 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1602/3201] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:46 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:46.769827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:46.786610 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68e06ac9-7991-472a-924c-26b8d310a592 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 0.479552 Aug 29 15:49:46.787503 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1600/3202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:46 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:47.255777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.256331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.285241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.287602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.288070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.292889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.293402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.293853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.328787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.329413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.341690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.348149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.351586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.357205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.361720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.363560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.593959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.604302 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7693c738-baa7-459c-897d-4fcd4ed9baea tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.352368 Aug 29 15:49:47.605811 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1603/3203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:47.611365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b4e76b48-5b06-4342-bc0c-e9ed79730cd4 req-cb04a08a-b321-4aa8-b425-e9b57e7d018e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db709a4c-59da-4a5d-b582-94856cf0b95d", "tag": "4bf34fa7-a24c-4fdd-87e6-19d5910dd500"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:47.632600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b4e76b48-5b06-4342-bc0c-e9ed79730cd4 req-cb04a08a-b321-4aa8-b425-e9b57e7d018e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.633149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b4e76b48-5b06-4342-bc0c-e9ed79730cd4 req-cb04a08a-b321-4aa8-b425-e9b57e7d018e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.633675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b4e76b48-5b06-4342-bc0c-e9ed79730cd4 req-cb04a08a-b321-4aa8-b425-e9b57e7d018e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.636957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.645747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f18bc1b7-2829-4ab0-b522-d4ddd4248ae4 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.320724 Aug 29 15:49:47.647669 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1601/3204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:47.654063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.654949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.662392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.663139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.663891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.664897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.665515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.665639 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b4e76b48-5b06-4342-bc0c-e9ed79730cd4 req-cb04a08a-b321-4aa8-b425-e9b57e7d018e service nova] Creating event network-changed:4bf34fa7-a24c-4fdd-87e6-19d5910dd500 for instance db709a4c-59da-4a5d-b582-94856cf0b95d on n-h1-836830-13 Aug 29 15:49:47.666857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.677217 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b4e76b48-5b06-4342-bc0c-e9ed79730cd4 req-cb04a08a-b321-4aa8-b425-e9b57e7d018e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069820 Aug 29 15:49:47.680350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1604/3205] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:47.763538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.776102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.779117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:47.781004 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a059fcf-05b3-4f78-9174-eb7fc056919d tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1365 microversion: 2.57 time: 0.131872 Aug 29 15:49:47.795378 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1602/3206] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:47.809638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:47.810539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:47.828561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.829070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.829593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:47.830389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:47.830843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:47.831308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.030095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-340a1b32-16eb-4b68-aa16-6cd78eec3deb tempest-ListImagesTestJSON-1096363640 tempest-ListImagesTestJSON-1096363640-project] Calling method '.version_select at 0x7f32ee37a940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.106155 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-340a1b32-16eb-4b68-aa16-6cd78eec3deb tempest-ListImagesTestJSON-1096363640 tempest-ListImagesTestJSON-1096363640-project] 10.222.0.83 "GET /compute/v2.1/images/648e7a49-e66c-42cf-859c-64f1df130787" status: 200 len: 784 microversion: 2.1 time: 0.286907 Aug 29 15:49:48.106804 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1603/3207] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/images/648e7a49-e66c-42cf-859c-64f1df130787 => generated 784 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:48.121118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04b4c11c-4ba5-4f28-bcff-f3fa16592f9a tempest-ListImagesTestJSON-1096363640 tempest-ListImagesTestJSON-1096363640-project] Calling method '.version_select at 0x7f32ed9d2d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.127793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.137616 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3b338219-552b-4924-9c4c-15a5b60d16c8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 0.333389 Aug 29 15:49:48.138214 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1605/3208] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:47 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:48.203051 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04b4c11c-4ba5-4f28-bcff-f3fa16592f9a tempest-ListImagesTestJSON-1096363640 tempest-ListImagesTestJSON-1096363640-project] 10.222.0.83 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.085389 Aug 29 15:49:48.203659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1604/3209] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/images => generated 445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:49:48.217168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a4969c1-e253-4637-bbd5-1709ee8173a7 tempest-ListImagesTestJSON-1096363640 tempest-ListImagesTestJSON-1096363640-project] Calling method '.version_select at 0x7f32edb37280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.278939 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a4969c1-e253-4637-bbd5-1709ee8173a7 tempest-ListImagesTestJSON-1096363640 tempest-ListImagesTestJSON-1096363640-project] 10.222.0.83 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.066421 Aug 29 15:49:48.283624 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1606/3210] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:48.631770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.633530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:48.650279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.651811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.653967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.655221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.657365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.657889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.670432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.671398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:48.684489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.685192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.685793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.686654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.687286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.688041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.870103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:48.880178 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83812531-b9cc-49b4-a03a-5daab332a26b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.254903 Aug 29 15:49:48.881096 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1605/3211] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:48.887445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:48.888232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:48.900578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.905685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.906769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:48.907864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:48.910471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:48.911519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.001547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:49.011631 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1c36c17f-60d5-4b2b-9aca-e36e2373017b tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.346697 Aug 29 15:49:49.013646 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1607/3212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:49.041991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:49.065324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:49.068863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:49.074660 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0ee812a-215c-420f-9d39-ee3faeff1da2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1371 microversion: 2.57 time: 0.192366 Aug 29 15:49:49.092382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1606/3213] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:48 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:49.161647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:49.162380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:49.175221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.178381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.179413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.184225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.184945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.186892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.356945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-dfe918db-4e1b-452e-a5e0-8694c66f3f9a req-aafa9f22-ce3b-43f9-a4d6-df453c44d22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be59c56-9380-45c5-9fdd-7e361548a44b", "name": "network-vif-plugged", "status": "completed", "tag": "1b08f641-6926-4e20-a9d8-b523d8854ed9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:49.366554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:49.391104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-dfe918db-4e1b-452e-a5e0-8694c66f3f9a req-aafa9f22-ce3b-43f9-a4d6-df453c44d22f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.391869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-dfe918db-4e1b-452e-a5e0-8694c66f3f9a req-aafa9f22-ce3b-43f9-a4d6-df453c44d22f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.394584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-dfe918db-4e1b-452e-a5e0-8694c66f3f9a req-aafa9f22-ce3b-43f9-a4d6-df453c44d22f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.442428 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-dfe918db-4e1b-452e-a5e0-8694c66f3f9a req-aafa9f22-ce3b-43f9-a4d6-df453c44d22f service nova] Creating event network-vif-plugged:1b08f641-6926-4e20-a9d8-b523d8854ed9 for instance 8be59c56-9380-45c5-9fdd-7e361548a44b on n-h2-836830-13 Aug 29 15:49:49.458613 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-dfe918db-4e1b-452e-a5e0-8694c66f3f9a req-aafa9f22-ce3b-43f9-a4d6-df453c44d22f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105821 Aug 29 15:49:49.461629 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1607/3214] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:49.547368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:49.564360 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-514d06e1-3780-4571-b5dc-eb59660c1509 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 0.406253 Aug 29 15:49:49.569143 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1608/3215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:49 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:49.908877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:49.914755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:49.928186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.928952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.930228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:49.931217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:49.932409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:49.933164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.036768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:50.037395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:50.047953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.048459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.048898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.054198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.054687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.056903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.356462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.376677 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6ac1d75-ce1a-485d-8cec-5f24c7492f72 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.344568 Aug 29 15:49:50.379327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1609/3216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:50 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:50.412080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:50.413917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:50.430378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.433337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.436072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.437169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.438464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.440219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.656730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.670061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.672684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.674857 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5dc078d9-28a0-414d-8af0-e7abdeeabe86 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1356 microversion: 2.57 time: 0.294241 Aug 29 15:49:50.676135 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1610/3217] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:50 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1356 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:50.682973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:50.684286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:50.713695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.714496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.715203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.716272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.716979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.718090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.824356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.863907 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e57a84a-1bb8-4a7b-971b-9bd79f2d762b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.964664 Aug 29 15:49:50.875079 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1608/3218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:49 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:50.899542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:50.900758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:50.918288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.919539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.921840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.922773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:50.923806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:50.926624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:50.960729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:50.977036 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-242e03e2-2c2f-4948-ab46-792459a0ea6a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1311 microversion: 2.1 time: 0.299203 Aug 29 15:49:50.995693 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1611/3219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:50 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1311 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:51.032372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:49:51.301037 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d1e20d0-a06c-4c75-84a5-ebb6963ead33 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 204 len: 0 microversion: 2.57 time: 0.420414 Aug 29 15:49:51.313415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:51.314640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:51.316249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:51.318227 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1609/3220] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:49:50 2022] DELETE /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:49:51.330791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.342229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.346725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.347795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.348670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.349120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.444080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=22 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:51.597149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3ffd1d5-76eb-4ffe-9b19-d9c37aebe211 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32ee4ee310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYWQwgxS89x1hUrAOijsdpeKnP6i++zkV//h6Qe9+v/Wgo13SLbNlYbmPRRJNmBIuQxmFGN2bO61NRPyu8pg9Y0bPOy6oipkrtH5xBTJJUXl/i2qqH1Ug48dA8n8Xs9CQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3ffd1d5-76eb-4ffe-9b19-d9c37aebe211 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 257 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYWQwgxS89x1hUrAOijsdpeKnP6i++zkV//h6Qe9+v/Wgo13SLbNlYbmPRRJNmBIuQxmFGN2bO61NRPyu8pg9Y0bPOy6oipkrtH5xBTJJUXl/i2qqH1Ug48dA8n8Xs9CQ=="}} Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYWQwgxS89x1hUrAOijsdpeKnP6i++zkV//h6Qe9+v/Wgo13SLbNlYbmPRRJNmBIuQxmFGN2bO61NRPyu8pg9Y0bPOy6oipkrtH5xBTJJUXl/i2qqH1Ug48dA8n8Xs9CQ=='}}} Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 29 15:49:51.602402 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3ffd1d5-76eb-4ffe-9b19-d9c37aebe211 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3ffd1d5-76eb-4ffe-9b19-d9c37aebe211 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.268503 Aug 29 15:49:51.608344 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1610/3221] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:51 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:51.613140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:51.613140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:51.623129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.623656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.624085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.624813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:51.625275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:51.626527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:51.849722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:51.859294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:51.866380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:51.870684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc36f91f-4b05-4345-9635-7fcf7b410711 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1362 microversion: 2.57 time: 0.562028 Aug 29 15:49:51.872559 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1612/3222] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:51 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1362 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:51.888722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e42ac3e-52a8-4abf-91be-fb070615b2a8 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32edad6820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-17622790", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:51.919118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-4e42ac3e-52a8-4abf-91be-fb070615b2a8 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:51.926768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-4e42ac3e-52a8-4abf-91be-fb070615b2a8 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for user e2438498746744e69065723b725b493d and project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:51.952065 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4e42ac3e-52a8-4abf-91be-fb070615b2a8 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e42ac3e-52a8-4abf-91be-fb070615b2a8 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 2165 Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-17622790", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:51.975242 n-d-836830-13 devstack@n-api.service[129132]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-17622790', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:51.977846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:51.981810 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:51.984830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e42ac3e-52a8-4abf-91be-fb070615b2a8 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:51.985900 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e42ac3e-52a8-4abf-91be-fb070615b2a8 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.110317 Aug 29 15:49:51.986684 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1613/3223] 10.222.0.83 () {60 vars in 1160 bytes} [Mon Aug 29 15:49:51 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:51.998493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.000932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:52.015503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.016295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.016898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.018120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.018893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.019752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.222824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.246798 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bfb4ece-3fc1-4d91-8f5f-320456fcc304 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.639863 Aug 29 15:49:52.248592 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1611/3224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:51 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:52.256609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.257341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:52.271504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.284143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.284954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.285594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.287124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.287830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.288424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.294115 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb1f6686-43df-4704-a18b-7517778b0651 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.306068 Aug 29 15:49:52.299089 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1614/3225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:51 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:52.312041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c71e0d5b-773e-4cc4-802c-2c437c8bd3ad tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32edad68b0>, body: {"keypair": {"name": "tempest-keypair-500731590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNblYnbHwfwbY2BSzQNULw4852mGhIeTAS4AE14E0BSiDo2tPwp1NyE5fzaNwNhl346Tv2amIw1V+OhZtl8PT0DUiAi/N/u0YDOtaAjaV5zSAHUHjbIvQadHw36UIrPRTg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:52.331517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:52.351126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c71e0d5b-773e-4cc4-802c-2c437c8bd3ad tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:52.374037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c71e0d5b-773e-4cc4-802c-2c437c8bd3ad tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for user e2438498746744e69065723b725b493d and project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:52.414304 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c71e0d5b-773e-4cc4-802c-2c437c8bd3ad tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115085 Aug 29 15:49:52.416368 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1615/3226] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:52.432268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aade4825-ebef-480c-96f8-95d4d7e78cff tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32edb23ca0>, body: {"keypair": {"name": "tempest-keypair-500731590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANw27yJ7pjiFL+eID4pnwMsWm29zZfmPuqeiBoRdKNb54oJVcAZFMu/TSYgyDItWgXMyKJizC6+eEaJSHn7GkUvUJLJLRMDl5UdfmbuP8SGrm/ScuITpZWgZtH8H28mHA=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:52.455561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-aade4825-ebef-480c-96f8-95d4d7e78cff tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:52.472093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-aade4825-ebef-480c-96f8-95d4d7e78cff tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for user e2438498746744e69065723b725b493d and project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:52.526557 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-aade4825-ebef-480c-96f8-95d4d7e78cff tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] HTTP exception thrown: Key pair 'tempest-keypair-500731590' already exists. Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aade4825-ebef-480c-96f8-95d4d7e78cff tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 272 Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: {"keypair": {"name": "tempest-keypair-500731590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANw27yJ7pjiFL+eID4pnwMsWm29zZfmPuqeiBoRdKNb54oJVcAZFMu/TSYgyDItWgXMyKJizC6+eEaJSHn7GkUvUJLJLRMDl5UdfmbuP8SGrm/ScuITpZWgZtH8H28mHA=="}} Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: exception: Key pair 'tempest-keypair-500731590' already exists. Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-500731590', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANw27yJ7pjiFL+eID4pnwMsWm29zZfmPuqeiBoRdKNb54oJVcAZFMu/TSYgyDItWgXMyKJizC6+eEaJSHn7GkUvUJLJLRMDl5UdfmbuP8SGrm/ScuITpZWgZtH8H28mHA=='}}} Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'e2438498746744e69065723b725b493d-tempest-keypair-500731590' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 15:49:52.541681 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi session.flush() Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result.read() Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 29 15:49:52.546465 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'e2438498746744e69065723b725b493d-tempest-keypair-500731590' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 29, 15, 49, 52, 516281), 'updated_at': None, 'name': 'tempest-keypair-500731590', 'user_id': 'e2438498746744e69065723b725b493d', 'fingerprint': 'e8:d3:9a:bd:e5:a5:96:c7:1e:2e:8b:b9:72:be:44:b2', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANw27yJ7pjiFL+eID4pnwMsWm29zZfmPuqeiBoRdKNb54oJVcAZFMu/TSYgyDItWgXMyKJizC6+eEaJSHn7GkUvUJLJLRMDl5UdfmbuP8SGrm/ScuITpZWgZtH8H28mHA==', 'type': 'ssh'}] Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi keypair.create() Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._create() Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-500731590' already exists. Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 29 15:49:52.554284 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-500731590' already exists. Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-500731590' already exists. Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aade4825-ebef-480c-96f8-95d4d7e78cff tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 409 to user: Key pair 'tempest-keypair-500731590' already exists. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aade4825-ebef-480c-96f8-95d4d7e78cff tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.128297 Aug 29 15:49:52.564539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1616/3227] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:52 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:49:52.574033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29033c67-b312-4b5b-a67c-2a314cdbfb0c tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Calling method '.version_select at 0x7f32edb43a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.609781 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29033c67-b312-4b5b-a67c-2a314cdbfb0c tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-500731590" status: 202 len: 0 microversion: 2.1 time: 0.044623 Aug 29 15:49:52.610797 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1617/3228] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:49:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-500731590 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:52.626697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3fb4bce-0723-4226-b00c-4c9b013e5ed1 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32edb23ee0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL/NWwD4HqIttD4C0zGy9pcy0nEs+QvQATLibUeVx2Lc8D/L1nh4+b1sgxYUYDCQcbhezRO0YBf8A/sBJTq944Jltsj3MXBzitQN0/jO3dsPS0bJKFs6onL8mnM6yHBJg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3fb4bce-0723-4226-b00c-4c9b013e5ed1 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 247 Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL/NWwD4HqIttD4C0zGy9pcy0nEs+QvQATLibUeVx2Lc8D/L1nh4+b1sgxYUYDCQcbhezRO0YBf8A/sBJTq944Jltsj3MXBzitQN0/jO3dsPS0bJKFs6onL8mnM6yHBJg=="}} Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL/NWwD4HqIttD4C0zGy9pcy0nEs+QvQATLibUeVx2Lc8D/L1nh4+b1sgxYUYDCQcbhezRO0YBf8A/sBJTq944Jltsj3MXBzitQN0/jO3dsPS0bJKFs6onL8mnM6yHBJg=='}}} Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '' Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:52.631143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:49:52.635913 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.642046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3fb4bce-0723-4226-b00c-4c9b013e5ed1 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:52.643328 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3fb4bce-0723-4226-b00c-4c9b013e5ed1 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.022183 Aug 29 15:49:52.644176 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1618/3229] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:52 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:49:52.659454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f33eb3a8-f0b4-4e76-bff1-2a7c240088c4 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32edba1670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2019354838", "public_key": " "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:52.680874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f33eb3a8-f0b4-4e76-bff1-2a7c240088c4 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:52.687387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f33eb3a8-f0b4-4e76-bff1-2a7c240088c4 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for user e2438498746744e69065723b725b493d and project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:52.705366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:52.717703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-27b76d8e-9de8-4615-8789-7081b55bd291 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1494 microversion: 2.1 time: 0.467400 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f33eb3a8-f0b4-4e76-bff1-2a7c240088c4 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f33eb3a8-f0b4-4e76-bff1-2a7c240088c4 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 95 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2019354838", "public_key": " "}} Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2019354838', 'public_key': ' '}}} Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:49:52.731159 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f33eb3a8-f0b4-4e76-bff1-2a7c240088c4 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f33eb3a8-f0b4-4e76-bff1-2a7c240088c4 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071606 Aug 29 15:49:52.739701 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1619/3230] 10.222.0.83 () {60 vars in 1158 bytes} [Mon Aug 29 15:49:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 29 15:49:52.746573 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1612/3231] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:52 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1494 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:52.751503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-380315c7-fdbb-43f3-836d-f821b07bcf76 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32edba1280>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb7pU78Dhapr78+yd0z6noBHx9BSdgBJUz+jKW1nJmgtrh3JV+2y3B9LyPt+PPyoINTaXxWv5yr1F7Bv5ppyVmV6hmIfwxcVtvFXbQAfU2lr+nSWvZQtPE1KdmKpXgtUw=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:52.753337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.754202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:52.762468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-380315c7-fdbb-43f3-836d-f821b07bcf76 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 507 Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb7pU78Dhapr78+yd0z6noBHx9BSdgBJUz+jKW1nJmgtrh3JV+2y3B9LyPt+PPyoINTaXxWv5yr1F7Bv5ppyVmV6hmIfwxcVtvFXbQAfU2lr+nSWvZQtPE1KdmKpXgtUw=="}} Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb7pU78Dhapr78+yd0z6noBHx9BSdgBJUz+jKW1nJmgtrh3JV+2y3B9LyPt+PPyoINTaXxWv5yr1F7Bv5ppyVmV6hmIfwxcVtvFXbQAfU2lr+nSWvZQtPE1KdmKpXgtUw=='}}} Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 29 15:49:52.763628 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 29 15:49:52.766614 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.768524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-380315c7-fdbb-43f3-836d-f821b07bcf76 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:52.768524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-380315c7-fdbb-43f3-836d-f821b07bcf76 tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.030677 Aug 29 15:49:52.773703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.774582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.776685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.777346 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1620/3232] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:52 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:49:52.777785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.778456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.789850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98eed1de-9bca-4f5b-b420-21a0f5a2964d tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Action: 'create', calling method: .version_select at 0x7f32edb23ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-163758963", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:52.834537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-98eed1de-9bca-4f5b-b420-21a0f5a2964d tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:52.851544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-98eed1de-9bca-4f5b-b420-21a0f5a2964d tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Getting quotas for user e2438498746744e69065723b725b493d and project 4ad98a291c274a0397f8e496f3f4d13b. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:52.892159 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-98eed1de-9bca-4f5b-b420-21a0f5a2964d tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98eed1de-9bca-4f5b-b420-21a0f5a2964d tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 117 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-163758963", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: exception: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-163758963', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 29 15:49:52.894102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98eed1de-9bca-4f5b-b420-21a0f5a2964d tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:52.901391 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-98eed1de-9bca-4f5b-b420-21a0f5a2964d tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.117153 Aug 29 15:49:52.918976 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1621/3233] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:49:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:49:52.924893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:52.925549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:52.939179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.939687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.940139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:52.943997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:52.944492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:52.944935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.092045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19accfae-3c74-433e-b443-1b3db748a918 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1647 microversion: 2.1 time: 0.343314 Aug 29 15:49:53.095693 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1613/3234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:52 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1647 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:53.100553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d505e8cb-e744-4c63-b1ba-2f07257371ee tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Calling method '.version_select at 0x7f32ee82d310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.136738 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d505e8cb-e744-4c63-b1ba-2f07257371ee tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-609960039 not found for user e2438498746744e69065723b725b493d Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d505e8cb-e744-4c63-b1ba-2f07257371ee tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Request method failure captured: Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-609960039 HTTP/1.1 Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAfvdK4JcEsaSvllcqYd7XcGyxV-EODhC4G5IDbESo3uvM7Fa_GkCfSnJhrZ2rBp1jz0y1HQjACy-XI5hqb8AwpAXzvVguCvd1S3RGyQjdyZI1kMmljgG2dS4AMbQEwgagjmLk6ycE28gdskliGb9lqkvdbmdgHKECkQNmuDuq7G1k Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4ad98a291c274a0397f8e496f3f4d13b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4ad98a291c274a0397f8e496f3f4d13b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4ad98a291c274a0397f8e496f3f4d13b"}]}] Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 4ad98a291c274a0397f8e496f3f4d13b Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1779007520 Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e2438498746744e69065723b725b493d Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1779007520-project Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: exception: Keypair tempest-keypair-non-existent-609960039 not found for user e2438498746744e69065723b725b493d Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'tempest-keypair-non-existent-609960039'} Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise self.value Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-609960039 not found for user e2438498746744e69065723b725b493d Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:53.141247 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-609960039 not found for user e2438498746744e69065723b725b493d Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-609960039 not found for user e2438498746744e69065723b725b493d Aug 29 15:49:53.146296 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:53.149332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d505e8cb-e744-4c63-b1ba-2f07257371ee tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] Returning 404 to user: Keypair tempest-keypair-non-existent-609960039 not found for user e2438498746744e69065723b725b493d {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:53.149332 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d505e8cb-e744-4c63-b1ba-2f07257371ee tempest-KeyPairsNegativeTestJSON-1779007520 tempest-KeyPairsNegativeTestJSON-1779007520-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-609960039" status: 404 len: 144 microversion: 2.1 time: 0.052011 Aug 29 15:49:53.152625 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1614/3235] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 15:49:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-609960039 => generated 144 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:49:53.159700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.166759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.167753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.174183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.176282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.177178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.177820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.179004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.179519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.180491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.181121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.182956 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eedb88a9-555b-4d16-9940-dee0f501aad6 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1362 microversion: 2.57 time: 0.261669 Aug 29 15:49:53.183998 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1622/3236] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:52 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:49:53.274943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.276446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.298543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.302406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.303182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.307571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.308552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.309065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.357660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:53.362436 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-313ca655-c1fe-457e-bd51-bdcb53ca0f66 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1647 microversion: 2.1 time: 0.209885 Aug 29 15:49:53.364246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1615/3237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1647 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:53.369669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.370405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.388634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.389426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.390722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.399527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.401805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.404792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.736875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.765820 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-588573cb-a790-4c97-924b-b6435ab71a22 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.493822 Aug 29 15:49:53.767063 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1623/3238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:49:53.784101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:53.788692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.789585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.790194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.791164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.792596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.794439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.820290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:53.832527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1aa8b57-0383-4f5e-8c40-078a9448e792 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.466961 Aug 29 15:49:53.833121 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1616/3239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:53.895969 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d7181e5-c98d-4c8e-bed0-4e5936467e07 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.127600 Aug 29 15:49:53.904605 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1624/3240] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:49:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:53.919317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:53.920147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:53.930828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.935871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.937565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:53.939310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:53.942874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:53.943518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.152518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-361d8ac6-8a6b-44e0-9147-28cb8155f9d8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b/action" status: 202 len: 0 microversion: 2.1 time: 0.239700 Aug 29 15:49:54.153783 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1617/3241] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:53 2022] POST /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:49:54.164691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.165331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.178344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.182563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.183814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.184777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.187842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.188618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.210397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.211146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.228894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.231476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.232596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.235604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.236332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.238389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.341748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.342247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.342943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.344055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lazy-loading 'fault' on Instance uuid ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:54.458716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:54.469411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:54.470877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a0d010ab0524a1a93a92821e4b43e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d9ee7e4ec4d4690b901fe6354191dec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:54.478050 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c6aaf582-8cb7-4e6c-b4d3-c991ebd6ba78 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 200 len: 1367 microversion: 2.57 time: 0.271991 Aug 29 15:49:54.484246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1618/3242] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:49:54.772654 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-130376e1-bbbf-4a41-9c4a-33303436735a tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1652 microversion: 2.1 time: 0.612986 Aug 29 15:49:54.786048 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1625/3243] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1652 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:54.792878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.794479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.801410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.802187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.803107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.804046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.804721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.805378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.855331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:54.856683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:54.860126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:54.895591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.897670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.901361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:54.903402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:54.907401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:54.909729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.101120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.109740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef491850-3917-4ef0-a2c6-61016ed2244c tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.322431 Aug 29 15:49:55.118712 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1619/3244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:55.345292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:55.353751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b857153-a786-4505-af30-650945f67617 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.503392 Aug 29 15:49:55.363785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1626/3245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:54 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:55.505576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:55.506198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] [instance: ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:55.524523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.528993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.529631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.531057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.534504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.535210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.572182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] HTTP exception thrown: Instance ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e could not be found. Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Request method failure captured: Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e HTTP/1.1 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN_6-IozGPmpxWzl3znWpBXHjkYVNHuWQKGZYO9xWXr7jdIwBnKSrR8AAiNbk-l-QjvmD64i-BS7hk4Gx44tJArVYJuinYt-_klV3Quy3XZdZdaPWcjgfAXE7mtnMq6qZvLGMhned-p0UoIZCbHLmn37ZOId8SNAFx9HrO-hPtHCYBM Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.57 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 5d9ee7e4ec4d4690b901fe6354191dec Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerShowV257Test-1581539252 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5d9ee7e4ec4d4690b901fe6354191dec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5d9ee7e4ec4d4690b901fe6354191dec", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5d9ee7e4ec4d4690b901fe6354191dec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5d9ee7e4ec4d4690b901fe6354191dec"}]}] Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerShowV257Test-1581539252 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 5d9ee7e4ec4d4690b901fe6354191dec Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerShowV257Test-1581539252 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerShowV257Test-1581539252-project Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 5a0d010ab0524a1a93a92821e4b43e67 Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerShowV257Test-1581539252-project Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e could not be found. Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e'} Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e could not be found. Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e could not be found. Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:49:55.579981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:55.583872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:49:55.583872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:49:55.583872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:49:55.583872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:49:55.583872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:49:55.583872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e could not be found. Aug 29 15:49:55.583872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:49:55.585306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] Returning 404 to user: Instance ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:49:55.594206 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-963f3916-c92b-4988-8352-1cc49be431d2 tempest-ServerShowV257Test-1581539252 tempest-ServerShowV257Test-1581539252-project] 10.222.0.83 "GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e" status: 404 len: 111 microversion: 2.57 time: 0.093755 Aug 29 15:49:55.595291 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1620/3246] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:49:55 2022] GET /compute/v2.1/servers/ffb71a56-0cf5-4c5d-a946-f54fabcbdf5e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:49:55.798032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:55.799094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:55.819814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.820608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.821473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:55.822467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:55.823476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:55.824286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.024124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3d00fd27-cb92-4bbf-8744-a95030f13bce req-23844d08-fbf6-40b3-88df-0481c05173a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc89f63d-1f29-4072-b28d-a31d5dd2247a", "name": "network-vif-plugged", "status": "completed", "tag": "c338fce7-12f4-4050-ae37-ce925ab5b97c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:56.045534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3d00fd27-cb92-4bbf-8744-a95030f13bce req-23844d08-fbf6-40b3-88df-0481c05173a4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.046025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3d00fd27-cb92-4bbf-8744-a95030f13bce req-23844d08-fbf6-40b3-88df-0481c05173a4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.046460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3d00fd27-cb92-4bbf-8744-a95030f13bce req-23844d08-fbf6-40b3-88df-0481c05173a4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.079785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a382387-81ea-4807-9f7c-ec7fe4d980dc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1632 microversion: 2.1 time: 0.286754 Aug 29 15:49:56.080382 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1627/3247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:55 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1632 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:56.108356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-836830-13", "block_migration": true, "disk_over_commit": false}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:56.111466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:56.115933 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3d00fd27-cb92-4bbf-8744-a95030f13bce req-23844d08-fbf6-40b3-88df-0481c05173a4 service nova] Creating event network-vif-plugged:c338fce7-12f4-4050-ae37-ce925ab5b97c for instance bc89f63d-1f29-4072-b28d-a31d5dd2247a on n-h2-836830-13 Aug 29 15:49:56.125677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3d00fd27-cb92-4bbf-8744-a95030f13bce req-23844d08-fbf6-40b3-88df-0481c05173a4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108418 Aug 29 15:49:56.130062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1621/3248] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 15:49:56.133091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.133600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.134045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.136177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.137631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.138418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.140139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:56.140842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:56.172251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.175154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.177633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.180804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:56.182094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:56.186236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:56.258420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lazy-loading 'flavor' on Instance uuid 8be59c56-9380-45c5-9fdd-7e361548a44b {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:49:56.292497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Going to try to live migrate instance to n-h1-836830-13 {{(pid=129132) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:49:56.951618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:56.964052 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-275035af-b37e-4008-adcd-a9d9e9817e14 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.830779 Aug 29 15:49:56.964813 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1622/3249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:56 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:57.302381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-235e0162-8a55-4725-9770-9ba4cc10aa1d tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32ee2bfa60>, body: {"keypair": {"name": "tempest-keypair-1488239561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjx7yYSA4apXLoLA4/fvIfvlpQ2UCgvNwEixJICyCgb+xvInxsEfDGWUMmPDKcxwCBe5V1eUYBKiNfY61hKIKWPaP4jNlt8uoQrPJW9R+afqHHFumRAM3tmH4sGeM8F8g=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:57.321226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-235e0162-8a55-4725-9770-9ba4cc10aa1d tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:57.329606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-235e0162-8a55-4725-9770-9ba4cc10aa1d tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:57.378614 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-235e0162-8a55-4725-9770-9ba4cc10aa1d tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.412623 Aug 29 15:49:57.379433 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1623/3250] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Aug 29 15:49:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 414 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:49:57.390039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.391050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:57.409437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.410255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.410947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.411985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:57.412684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:57.413341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:57.711330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:57.726224 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e85c417d-7634-4586-9127-53d8ae7a8e6d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1324 microversion: 2.1 time: 0.344992 Aug 29 15:49:57.743317 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1624/3251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:57.745553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-992b0308-4a5e-44a2-b5e3-5cda80ac0cd1 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32ee468040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.772930 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-992b0308-4a5e-44a2-b5e3-5cda80ac0cd1 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs/tempest-keypair-1488239561" status: 200 len: 513 microversion: 2.2 time: 0.039465 Aug 29 15:49:57.778366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1625/3252] 10.222.0.83 () {60 vars in 1258 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1488239561 => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:57.788114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2f91c223-86be-41b4-8932-a3beb3f0aaa8 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32f2aab430>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.829357 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2f91c223-86be-41b4-8932-a3beb3f0aaa8 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488239561" status: 204 len: 0 microversion: 2.2 time: 0.046193 Aug 29 15:49:57.830409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1626/3253] 10.222.0.83 () {60 vars in 1261 bytes} [Mon Aug 29 15:49:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488239561 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:49:57.860366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ee05400-3528-41c0-9b26-373fdbda37c4 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32ee240280>, body: {"keypair": {"name": "tempest-keypair-1059340002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEajVHXoln5EGf0ajplUZoLguIgdMzSyKeQG4iYz+TZgiHKqM7Xym1XrCUWRZrNNls2T+JI49dsO7sHdFoRTYf47BZPO6Tx7YXYiKPVd4bhvSgk2b4KHBmvGebfKaFNP0A=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:57.895977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-9ee05400-3528-41c0-9b26-373fdbda37c4 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:57.907971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-9ee05400-3528-41c0-9b26-373fdbda37c4 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:57.988434 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ee05400-3528-41c0-9b26-373fdbda37c4 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.138103 Aug 29 15:49:57.990317 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1627/3254] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Aug 29 15:49:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:49:57.995384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:57.996249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.019231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.020174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.020830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.021847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.022501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.023148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.476338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:58.491832 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d2598d98-a6a9-4d50-8cdf-8811c6093456 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.499398 Aug 29 15:49:58.495741 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1628/3255] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:57 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:58.508395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a6e238b-7e75-4caf-87e1-ffa1346828a8 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32ee240ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.580566 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a6e238b-7e75-4caf-87e1-ffa1346828a8 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059340002" status: 204 len: 0 microversion: 2.2 time: 0.082003 Aug 29 15:49:58.581417 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1629/3256] 10.222.0.83 () {60 vars in 1261 bytes} [Mon Aug 29 15:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059340002 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:58.588670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6fd4f688-b296-43dd-b89f-c22e92b98bcf req-c5c6aa1b-ce99-4019-be1b-16eb77836d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db709a4c-59da-4a5d-b582-94856cf0b95d", "name": "network-vif-plugged", "status": "completed", "tag": "4bf34fa7-a24c-4fdd-87e6-19d5910dd500"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:58.608205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6fd4f688-b296-43dd-b89f-c22e92b98bcf req-c5c6aa1b-ce99-4019-be1b-16eb77836d22 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.608937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6fd4f688-b296-43dd-b89f-c22e92b98bcf req-c5c6aa1b-ce99-4019-be1b-16eb77836d22 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.610247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6fd4f688-b296-43dd-b89f-c22e92b98bcf req-c5c6aa1b-ce99-4019-be1b-16eb77836d22 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.641865 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6fd4f688-b296-43dd-b89f-c22e92b98bcf req-c5c6aa1b-ce99-4019-be1b-16eb77836d22 service nova] Creating event network-vif-plugged:4bf34fa7-a24c-4fdd-87e6-19d5910dd500 for instance db709a4c-59da-4a5d-b582-94856cf0b95d on n-h1-836830-13 Aug 29 15:49:58.661464 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6fd4f688-b296-43dd-b89f-c22e92b98bcf req-c5c6aa1b-ce99-4019-be1b-16eb77836d22 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077353 Aug 29 15:49:58.683394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1630/3257] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:49:58.731913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-888b1575-df65-44f2-b3b0-145a07e09e93 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32f2aab0d0>, body: {"keypair": {"name": "tempest-keypair-1635053803", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:58.786754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-888b1575-df65-44f2-b3b0-145a07e09e93 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:58.799691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-888b1575-df65-44f2-b3b0-145a07e09e93 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:58.861721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-888b1575-df65-44f2-b3b0-145a07e09e93 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.171490 Aug 29 15:49:58.869280 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1631/3258] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Aug 29 15:49:58 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:49:58.876525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:58.877441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:58.886881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.887688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.888328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.889542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:58.890716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:58.891774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:58.975802 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80b8dd8d-2c01-4df2-bbf1-20eebee519b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b/action" status: 202 len: 0 microversion: 2.1 time: 2.874924 Aug 29 15:49:58.976667 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1628/3259] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:49:56 2022] POST /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b/action => generated 0 bytes in 2876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:49:58.983916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38671b89-54e2-4eeb-853a-7973d71dc2b9 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32edb38790>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.074187 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38671b89-54e2-4eeb-853a-7973d71dc2b9 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1635053803" status: 204 len: 0 microversion: 2.2 time: 0.085743 Aug 29 15:49:59.078367 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1629/3260] 10.222.0.83 () {60 vars in 1261 bytes} [Mon Aug 29 15:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1635053803 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:49:59.091191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.092149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:59.116776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.117459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.118430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.121354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.122208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.122806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.377578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.397524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1d45430-60c9-4a14-bbd3-b7b0c5cbbe52 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.316430 Aug 29 15:49:59.399097 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1630/3261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:59.407805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25ff2abd-8046-41ea-b9cd-13464c7030f3 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32edb5b700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1050723708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeEoYUE3LbXcGtYRc3gijfC6fnaHDL8cDOy/48TLbnq8nqxr1KnbWYdxzxVDd+rVz6BAPAAB0vEJH0tH5VPLBokTpBDFHJRVbOoo3M1yYJ+3pOuIn+gL91AO/x4QVy9Cg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:59.450297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-25ff2abd-8046-41ea-b9cd-13464c7030f3 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:59.458619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-25ff2abd-8046-41ea-b9cd-13464c7030f3 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:59.491241 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25ff2abd-8046-41ea-b9cd-13464c7030f3 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.088619 Aug 29 15:49:59.492238 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1631/3262] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Aug 29 15:49:59 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:49:59.506934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53c7f232-7783-49f6-b76d-4cc6b7acc410 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32edb23e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1996960139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkrB8RzvWNa4joS1JIsfjZcbpzRXrLmchDzh5977m5zuTUmpYLh8fagd88whLceU/LLY7JubTY2763YeF8XbhhuMbUT9E4psXRoUz0veLpa7nEvKNbbkAO/0vtp/68SQ=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:59.534659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-53c7f232-7783-49f6-b76d-4cc6b7acc410 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:59.544475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-53c7f232-7783-49f6-b76d-4cc6b7acc410 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:59.586275 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-53c7f232-7783-49f6-b76d-4cc6b7acc410 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.082979 Aug 29 15:49:59.587319 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1632/3263] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Aug 29 15:49:59 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 29 15:49:59.607541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.608723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:59.626938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.627648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.628181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.629015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.629588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.630288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.639207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:49:59.647593 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d9345aaa-d673-4e1e-8a41-14dc606973b0 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1521 microversion: 2.1 time: 0.776518 Aug 29 15:49:59.654734 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1632/3264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:58 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1521 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:49:59.681065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-663e7ba6-9bb6-46fb-9bba-c94581ecb279 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32f2aab1f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2056994133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzSwrI3Qb9Uana5tYyf/YwMRP4O2xWiVxjg2BKWWXbJL3rGhl1CwxkKKCQ4WNNFTNw17t2vGkRybX0JgSZSH7XBPu7lpHC+vBH44LT31Hduq1Vp5iJjUPU8QVf68EaHCQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:49:59.708629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-663e7ba6-9bb6-46fb-9bba-c94581ecb279 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:49:59.725991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-663e7ba6-9bb6-46fb-9bba-c94581ecb279 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:49:59.763762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:49:59.816494 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-663e7ba6-9bb6-46fb-9bba-c94581ecb279 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.160304 Aug 29 15:49:59.824783 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1633/3265] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Aug 29 15:49:59 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:49:59.838966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:49:59.842509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:49:59.856830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.857341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.857777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.858520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:49:59.858978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:49:59.859430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:49:59.937739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:00.124725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-753fddd3-6a2c-48a5-a60c-35b5988179ad tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 204 len: 0 microversion: 2.1 time: 0.297058 Aug 29 15:50:00.130180 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1634/3266] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:49:59 2022] DELETE /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:00.132925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.136311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-70d77658-dc50-4511-9d99-b13130040748 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32ee2ccc10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.142181 n-d-836830-13 devstack@n-api.service[129133]: WARNING oslo_db.sqlalchemy.utils [None req-70d77658-dc50-4511-9d99-b13130040748 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:50:00.149083 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f28011d4-0ea4-4af0-8ae9-c83375b63024 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1316 microversion: 2.1 time: 0.558560 Aug 29 15:50:00.149958 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1633/3267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:49:59 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.159084 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-70d77658-dc50-4511-9d99-b13130040748 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.023690 Aug 29 15:50:00.159084 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1635/3268] 10.222.0.83 () {60 vars in 1177 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.164190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.165084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:00.185693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.186325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.186850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.187690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.188345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.188838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.191206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9816efd9-cb96-476e-ae9c-a93dd6369212 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32edbb6430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.271685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9816efd9-cb96-476e-ae9c-a93dd6369212 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2056994133" status: 204 len: 0 microversion: 2.2 time: 0.101773 Aug 29 15:50:00.272286 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1634/3269] 10.222.0.83 () {60 vars in 1321 bytes} [Mon Aug 29 15:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2056994133 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:00.282840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-666853cf-9c18-495b-ace8-9c34bf2d3085 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32edbcd160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.356198 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-666853cf-9c18-495b-ace8-9c34bf2d3085 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1996960139" status: 204 len: 0 microversion: 2.2 time: 0.077075 Aug 29 15:50:00.358786 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1635/3270] 10.222.0.83 () {60 vars in 1321 bytes} [Mon Aug 29 15:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1996960139 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:00.368811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0011b1a1-0d17-409e-8fcb-3610c5d7902b tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32edba13a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.410911 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0011b1a1-0d17-409e-8fcb-3610c5d7902b tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1050723708" status: 204 len: 0 microversion: 2.2 time: 0.047808 Aug 29 15:50:00.411772 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1636/3271] 10.222.0.83 () {60 vars in 1321 bytes} [Mon Aug 29 15:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1050723708 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:50:00.433652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.434713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:00.446931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.447992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.448818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.450445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:00.451241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:00.451924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:00.625793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.634865 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6651502b-7bf5-4f39-9d04-44467ee99e99 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.214286 Aug 29 15:50:00.635651 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1637/3272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.641341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-301de398-3797-48bd-bc00-488d5eff9ebd tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32edc0f280>, body: {"keypair": {"name": "tempest-keypair-296778441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlt+UM2ifJ9C+AaPUhM6vnuqDsei1X7U9i25QJDs0TcF+ppVMHLX3vWWgjdLMHgE83McDx/8LUlBl93UPEydW9vTAllFs4JHylEjKUbhrETukMZhHMkF/UV+6QEuzs3gA=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:00.671459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-301de398-3797-48bd-bc00-488d5eff9ebd tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:00.682144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-301de398-3797-48bd-bc00-488d5eff9ebd tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:00.716750 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-301de398-3797-48bd-bc00-488d5eff9ebd tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.073395 Aug 29 15:50:00.718145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1638/3273] 10.222.0.83 () {62 vars in 1199 bytes} [Mon Aug 29 15:50:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 29 15:50:00.788032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:00.797799 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b840df3a-037d-4315-8af1-09026173360d tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1527 microversion: 2.1 time: 0.638319 Aug 29 15:50:00.798408 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1636/3274] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1527 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:00.827324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff7c1bc4-6685-47f7-a4ff-501fd0964990 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32ee37b310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.843943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff7c1bc4-6685-47f7-a4ff-501fd0964990 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs/tempest-keypair-296778441" status: 200 len: 512 microversion: 2.2 time: 0.020485 Aug 29 15:50:00.855495 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1637/3275] 10.222.0.83 () {60 vars in 1255 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-296778441 => generated 512 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:00.857904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb8dff85-460e-4e69-af97-ab7b586590f1 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32ee4eeb80>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.862025 n-d-836830-13 devstack@n-api.service[129133]: WARNING oslo_db.sqlalchemy.utils [None req-fb8dff85-460e-4e69-af97-ab7b586590f1 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:50:00.875649 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb8dff85-460e-4e69-af97-ab7b586590f1 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.021592 Aug 29 15:50:00.885455 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1638/3276] 10.222.0.83 () {60 vars in 1177 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:00.890760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ce2c919-d3c2-4137-9b89-fed0a2dd6c79 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32ee7f2dc0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.933842 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ce2c919-d3c2-4137-9b89-fed0a2dd6c79 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296778441" status: 204 len: 0 microversion: 2.2 time: 0.047202 Aug 29 15:50:00.934438 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1639/3277] 10.222.0.83 () {60 vars in 1258 bytes} [Mon Aug 29 15:50:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296778441 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:00.945483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76b8ec4c-3809-4ab4-9fe3-21588bdb5a30 tempest-ComputeTenantNetworksTest-2019053078 tempest-ComputeTenantNetworksTest-2019053078-project] Calling method '.version_select at 0x7f32edbbb0d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:00.947605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Action: 'create', calling method: .version_select at 0x7f32ee55bca0>, body: {"keypair": {"name": "tempest-keypair-2096951215", "type": "x509"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:00.996358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:01.005627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:01.051756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.processutils [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmplr103o50/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmplr103o50/temp.key -subj /CN=28d34b8794c642fab7dda0d0e1b9b2f8 -extensions v3_req_client {{(pid=129133) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 15:50:01.399665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.processutils [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmplr103o50/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmplr103o50/temp.key -subj /CN=28d34b8794c642fab7dda0d0e1b9b2f8 -extensions v3_req_client" returned: 0 in 0.350s {{(pid=129133) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 15:50:01.402041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.processutils [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmplr103o50/temp.key -password pass: {{(pid=129133) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 29 15:50:01.466970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.processutils [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] CMD "openssl pkcs12 -export -inkey /tmp/tmplr103o50/temp.key -password pass:" returned: 0 in 0.064s {{(pid=129133) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 29 15:50:01.550332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:01.566265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Getting quotas for user 28d34b8794c642fab7dda0d0e1b9b2f8 and project 75d361eb1cce4fb08e7947c1470cdeb6. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:01.605500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-16d395c2-6823-4ed3-a64f-16e161cd7843 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.664672 Aug 29 15:50:01.609738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1640/3278] 10.222.0.83 () {62 vars in 1198 bytes} [Mon Aug 29 15:50:00 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 670 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:01.675357 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76b8ec4c-3809-4ab4-9fe3-21588bdb5a30 tempest-ComputeTenantNetworksTest-2019053078 tempest-ComputeTenantNetworksTest-2019053078-project] 10.222.0.83 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.956650 Aug 29 15:50:01.675993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1639/3279] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 15:50:00 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:01.685370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.686248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:01.707280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.707983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.708480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.709229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.709698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.710138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.720973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1969799723", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:01.802935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] validate_networks() for [('5333e2b9-539f-4666-a39e-be59a530ac31', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:01.910462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:01.920980 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02441461-23cb-4efd-a9c3-70232d5f130d tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1504 microversion: 2.1 time: 0.242986 Aug 29 15:50:01.922145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1640/3280] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:01.929429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d92665df-1116-46e2-ad12-93ec3e843095 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32edbcda60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.941502 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d92665df-1116-46e2-ad12-93ec3e843095 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs/tempest-keypair-2096951215" status: 200 len: 1534 microversion: 2.2 time: 0.017776 Aug 29 15:50:01.943193 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1641/3281] 10.222.0.83 () {60 vars in 1258 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2096951215 => generated 1534 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:01.949027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:01.949994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:01.957720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.958819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.959466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:01.960359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:01.961029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:01.961637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.140590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:02.157261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71c3f4c0-41c3-49cb-9f33-f419b2fa38fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.212491 Aug 29 15:50:02.157964 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1642/3282] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:01 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:02.163967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81e0582c-ffc7-4f2b-b215-78186690091d tempest-ComputeTenantNetworksTest-2019053078 tempest-ComputeTenantNetworksTest-2019053078-project] Calling method '.version_select at 0x7f32edc0f820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.278156 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81e0582c-ffc7-4f2b-b215-78186690091d tempest-ComputeTenantNetworksTest-2019053078 tempest-ComputeTenantNetworksTest-2019053078-project] 10.222.0.83 "GET /compute/v2.1/os-tenant-networks/847e2b61-dec5-4dd8-b3c4-a4928db6a08a" status: 200 len: 140 microversion: 2.1 time: 0.119006 Aug 29 15:50:02.279265 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1643/3283] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/os-tenant-networks/847e2b61-dec5-4dd8-b3c4-a4928db6a08a => generated 140 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:02.292734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.295309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.316240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.318613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.320359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.321182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.322947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.323441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.718127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:02.732746 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e245452e-71d6-4da5-bc13-2f50518ce41e tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1527 microversion: 2.1 time: 0.440778 Aug 29 15:50:02.733737 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1644/3284] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1527 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:02.753166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.754020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.762475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.762976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.763545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.764253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.764707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.765128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:02.948191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-401eccc1-cb53-4bbc-b79d-79aa23c72248 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "DELETE /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.213403 Aug 29 15:50:02.948856 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1645/3285] 10.222.0.83 () {58 vars in 1296 bytes} [Mon Aug 29 15:50:02 2022] DELETE /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d/os-server-password => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:02.956504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3141702c-f9b3-4faa-86b4-b67253629b65 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32edba1a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.963088 n-d-836830-13 devstack@n-api.service[129132]: WARNING oslo_db.sqlalchemy.utils [None req-3141702c-f9b3-4faa-86b4-b67253629b65 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 15:50:02.971932 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3141702c-f9b3-4faa-86b4-b67253629b65 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.020821 Aug 29 15:50:02.984444 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1646/3286] 10.222.0.83 () {60 vars in 1177 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:02.989664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:02.990410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:02.997965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:02.998807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:02.999495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.000440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.001253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.001780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.030412 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bd0f7bc-0180-4d5a-9d6f-76d9bbc27a93 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.044590 Aug 29 15:50:03.031955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1647/3287] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 15:50:02 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d/os-server-password => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:50:03.037008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-24234209-3207-4888-9479-a7cbe4bb1891 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] Calling method '.version_select at 0x7f32edbdda60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.060868 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-24234209-3207-4888-9479-a7cbe4bb1891 tempest-KeyPairsV22TestJSON-1216567654 tempest-KeyPairsV22TestJSON-1216567654-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096951215" status: 204 len: 0 microversion: 2.2 time: 0.027701 Aug 29 15:50:03.066725 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1648/3288] 10.222.0.83 () {60 vars in 1261 bytes} [Mon Aug 29 15:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096951215 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:03.073081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.074099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:03.084030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.085055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.085859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.086794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.087559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.088223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.129179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:03.138500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.251180 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a70b4ef0-e403-4ac7-8d38-b6a524b7dda2 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "DELETE /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 204 len: 0 microversion: 2.1 time: 0.182743 Aug 29 15:50:03.254176 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1649/3289] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:03 2022] DELETE /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:03.275522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.281272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:03.297763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.304404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.307845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.315476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.316318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.317065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.623401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:03.632909 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fd5d5176-d694-494b-8e17-2cddaa37333c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.376063 Aug 29 15:50:03.634230 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1650/3290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:03 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:03.644859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:03.645816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:03.661416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.662050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.662768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.665262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.673441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.674294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.835398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.888647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:03.889246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:03.889588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:03.890006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:03.890679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:03.916270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.917337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.918605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.920305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:03.921059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:03.921780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:03.941555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:03.967769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Getting quotas for project 6f2f45b5051c4899a770a38958c70caa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:03.977907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Getting quotas for user ea31195933be4477a588150bb1f67822 and project 6f2f45b5051c4899a770a38958c70caa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:03.982010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.001581 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d23f6377-51a8-4043-9adb-5b2398d4e796 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1510 microversion: 2.1 time: 0.361867 Aug 29 15:50:04.004531 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1651/3291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:03 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:04.021735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-760c4627-b4f3-43a3-b9f7-5e14157c368d req-7b35572a-6a62-44d1-8a5e-6fdc71fc32f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be59c56-9380-45c5-9fdd-7e361548a44b", "name": "network-vif-unplugged", "status": "completed", "tag": "1b08f641-6926-4e20-a9d8-b523d8854ed9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:04.025886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:04.029947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:04.045271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-760c4627-b4f3-43a3-b9f7-5e14157c368d req-7b35572a-6a62-44d1-8a5e-6fdc71fc32f4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.046026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-760c4627-b4f3-43a3-b9f7-5e14157c368d req-7b35572a-6a62-44d1-8a5e-6fdc71fc32f4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.046648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-760c4627-b4f3-43a3-b9f7-5e14157c368d req-7b35572a-6a62-44d1-8a5e-6fdc71fc32f4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.065843 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-760c4627-b4f3-43a3-b9f7-5e14157c368d req-7b35572a-6a62-44d1-8a5e-6fdc71fc32f4 service nova] Creating event network-vif-unplugged:1b08f641-6926-4e20-a9d8-b523d8854ed9 for instance 8be59c56-9380-45c5-9fdd-7e361548a44b on n-h2-836830-13 Aug 29 15:50:04.074199 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-760c4627-b4f3-43a3-b9f7-5e14157c368d req-7b35572a-6a62-44d1-8a5e-6fdc71fc32f4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068264 Aug 29 15:50:04.075354 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1652/3292] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:04.081502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:04.082366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:04.090111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.091226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.097525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.098620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.099269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.100016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.110212 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8bccf68d-722e-495c-b2a2-ad4e6bf7ec3e tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.498699 Aug 29 15:50:04.111781 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1641/3293] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:04.123307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5adb2bf0-dccc-439f-9951-f68c47cbcf69 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:04.124160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5adb2bf0-dccc-439f-9951-f68c47cbcf69 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:04.462133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.476075 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6d077f2-35e0-488f-bc9b-ff20a7aa5ae4 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1527 microversion: 2.1 time: 0.398516 Aug 29 15:50:04.488275 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1653/3294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:04 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1527 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:04.517430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5adb2bf0-dccc-439f-9951-f68c47cbcf69 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:04.528221 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5adb2bf0-dccc-439f-9951-f68c47cbcf69 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1224 microversion: 2.1 time: 0.410000 Aug 29 15:50:04.528834 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1642/3295] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:04 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1224 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:04.661255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:04.662389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:04.665345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:04.684888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.690300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.690883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:04.692806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:04.693433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:04.701563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.025028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:05.026588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:05.049031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.049970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.050689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.051757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.053021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.055350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.408754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:05.421214 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e27e84d-7680-4e38-8e7c-2d6711a60255 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.765180 Aug 29 15:50:05.426939 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1654/3296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:04 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:05.501305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:05.502117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:05.514842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.531602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.532322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.534160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:05.536213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:05.538699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:05.941811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:05.964549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1bf18dac-1361-418f-a7c2-6373eec150d5 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1485 microversion: 2.1 time: 0.467816 Aug 29 15:50:05.965852 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1655/3297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:05 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1485 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:05.973979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:05.975863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:06.000734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.001123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.001565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.002285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.002743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.003201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.180210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.190821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2e28b2f-25fb-4945-9f59-e589b1d3965f tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1276 microversion: 2.1 time: 0.223264 Aug 29 15:50:06.205099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1656/3298] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:05 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:06.219999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e2e5050e-5b40-4ed9-84e8-27c22004035b req-807abb02-f23e-494e-8352-5ade27a948db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8be59c56-9380-45c5-9fdd-7e361548a44b", "tag": "1b08f641-6926-4e20-a9d8-b523d8854ed9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:06.267304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2e5050e-5b40-4ed9-84e8-27c22004035b req-807abb02-f23e-494e-8352-5ade27a948db service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.268625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2e5050e-5b40-4ed9-84e8-27c22004035b req-807abb02-f23e-494e-8352-5ade27a948db service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.271281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2e5050e-5b40-4ed9-84e8-27c22004035b req-807abb02-f23e-494e-8352-5ade27a948db service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.331875 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e2e5050e-5b40-4ed9-84e8-27c22004035b req-807abb02-f23e-494e-8352-5ade27a948db service nova] Creating event network-changed:1b08f641-6926-4e20-a9d8-b523d8854ed9 for instance 8be59c56-9380-45c5-9fdd-7e361548a44b on n-h2-836830-13 Aug 29 15:50:06.349033 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e2e5050e-5b40-4ed9-84e8-27c22004035b req-807abb02-f23e-494e-8352-5ade27a948db service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142568 Aug 29 15:50:06.350520 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1657/3299] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:06.365652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-717e1691-3084-430f-9929-9561ad04c465 req-974b6808-f170-4397-8be6-deb00872148c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db709a4c-59da-4a5d-b582-94856cf0b95d", "name": "network-vif-deleted", "tag": "4bf34fa7-a24c-4fdd-87e6-19d5910dd500"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:06.396060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-717e1691-3084-430f-9929-9561ad04c465 req-974b6808-f170-4397-8be6-deb00872148c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.398278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-717e1691-3084-430f-9929-9561ad04c465 req-974b6808-f170-4397-8be6-deb00872148c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.399655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-717e1691-3084-430f-9929-9561ad04c465 req-974b6808-f170-4397-8be6-deb00872148c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.437127 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-717e1691-3084-430f-9929-9561ad04c465 req-974b6808-f170-4397-8be6-deb00872148c service nova] Creating event network-vif-deleted:4bf34fa7-a24c-4fdd-87e6-19d5910dd500 for instance db709a4c-59da-4a5d-b582-94856cf0b95d on n-h1-836830-13 Aug 29 15:50:06.466499 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-717e1691-3084-430f-9929-9561ad04c465 req-974b6808-f170-4397-8be6-deb00872148c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114195 Aug 29 15:50:06.468356 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1658/3300] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:06.481036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:06.482853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:06.490736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.492339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.492995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.494731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:06.495339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:06.495790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:06.508996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67dd0372f7b442b3997a91623e18529b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7aaa8aa8d145ba9dbfccf8cd4f9e9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.521213 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7357886-1f91-48b3-a786-416c6c87c1db tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 200 len: 1510 microversion: 2.1 time: 1.500559 Aug 29 15:50:06.525431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1643/3301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:05 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 1510 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:06.880362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:06.896739 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7db676c-17a6-4eba-8d3a-f660dac331f9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.424638 Aug 29 15:50:06.912858 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1659/3302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:06 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:06.990103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:06.990373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.003666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.004187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.004638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.005366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.005830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.014172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Calling method '.version_select at 0x7f32ee984550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.015154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.063078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.063635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.064139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.064941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.068529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.069283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.085567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.086373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.086979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.095561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lazy-loading 'fault' on Instance uuid bc89f63d-1f29-4072-b28d-a31d5dd2247a {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:07.172019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215e000f15f44b41aa38a41a941c16da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '062ee746b4614e629a9d853a6d84a368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:07.188999 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef67d78a-bf9a-4eca-bfc6-a916a7f8154b tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 200 len: 1314 microversion: 2.1 time: 0.204209 Aug 29 15:50:07.189594 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1660/3303] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:06 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:07.190743 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b6432b5a-d9b9-4982-9197-7401b98dd3bd tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] 10.222.0.83 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.658003 Aug 29 15:50:07.192083 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1644/3304] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 15:50:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:07.222068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.222704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.239733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.240231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.240671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.241372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.241829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.242249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.342627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-31876231", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:07.409186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:07.424859 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4eb6d16a-b2fb-46d9-9b27-d6fd7eb08590 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1294 microversion: 2.1 time: 0.206758 Aug 29 15:50:07.438188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1661/3305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:07.459318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:07.549508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.550254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] [instance: db709a4c-59da-4a5d-b582-94856cf0b95d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.560090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.564516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.565702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.567984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.569132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.571826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.604545 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] HTTP exception thrown: Instance db709a4c-59da-4a5d-b582-94856cf0b95d could not be found. Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Request method failure captured: Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d HTTP/1.1 Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOATd6VAYoZeGD4mv82tqg9OGRVA8XiibtwQH0IsH0JxWFAfpVLKCV9ZLEV-QbAd6ljKuMv9rQdco8-12g4P_tS_F9D39ohYvTIaTi_kjMuin7na1AFknMz7bBBo-iY3M8j37rw_5zRZD62sM-8DOQECMxU1PRwAMyCSu3zTzXbwU0I Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 5f7aaa8aa8d145ba9dbfccf8cd4f9e9d Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerPasswordTestJSON-198714325 Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5f7aaa8aa8d145ba9dbfccf8cd4f9e9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5f7aaa8aa8d145ba9dbfccf8cd4f9e9d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5f7aaa8aa8d145ba9dbfccf8cd4f9e9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5f7aaa8aa8d145ba9dbfccf8cd4f9e9d"}]}] Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerPasswordTestJSON-198714325 Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 5f7aaa8aa8d145ba9dbfccf8cd4f9e9d Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerPasswordTestJSON-198714325 Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerPasswordTestJSON-198714325-project Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 67dd0372f7b442b3997a91623e18529b Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerPasswordTestJSON-198714325-project Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance db709a4c-59da-4a5d-b582-94856cf0b95d could not be found. Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'db709a4c-59da-4a5d-b582-94856cf0b95d'} Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db709a4c-59da-4a5d-b582-94856cf0b95d could not be found. Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db709a4c-59da-4a5d-b582-94856cf0b95d could not be found. Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:07.617302 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db709a4c-59da-4a5d-b582-94856cf0b95d could not be found. Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] Returning 404 to user: Instance db709a4c-59da-4a5d-b582-94856cf0b95d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa5becad-5e7b-44a8-8afc-4f26f17cfeb0 tempest-ServerPasswordTestJSON-198714325 tempest-ServerPasswordTestJSON-198714325-project] 10.222.0.83 "GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d" status: 404 len: 111 microversion: 2.1 time: 0.076118 Aug 29 15:50:07.630326 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1662/3306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/db709a4c-59da-4a5d-b582-94856cf0b95d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:50:07.919902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:07.921259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:07.935478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.938468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.940181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:07.943105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:07.943903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:07.944602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.123738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Getting quotas for project 1f1afd7f356f48c0a28802d75820fa0d. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:08.151215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Getting quotas for user 2a17e8433ab142cf99d200bfefde269d and project 1f1afd7f356f48c0a28802d75820fa0d. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:08.194588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Request method failure captured: Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 1750 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAuAfZADNqAbMWj2qfqH21bKhGZR7sOLZFz9MJIZ13z2PnbjxCvzaJSw2valAdayY4luqNQ4_ofTSnHODa6DwZOHbkbIwN9En0N5io5lkNB0DKaVt0v3pdLJ-k4pdRO9IZw91H-U_MrZg6OJ49Q6k759WAHDgC-khGQi8DprilEauc Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 1f1afd7f356f48c0a28802d75820fa0d Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1948304934 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1f1afd7f356f48c0a28802d75820fa0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1f1afd7f356f48c0a28802d75820fa0d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1f1afd7f356f48c0a28802d75820fa0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1f1afd7f356f48c0a28802d75820fa0d"}]}] Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1948304934 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 1f1afd7f356f48c0a28802d75820fa0d Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1948304934 Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 2a17e8433ab142cf99d200bfefde269d Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-31876231", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:08.210430 n-d-836830-13 devstack@n-api.service[129133]: exception: Maximum number of metadata items exceeds 128 Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-31876231', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:08.213212 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:08.218818 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92b005c4-a2e1-4e6f-9568-8619d5a9c739 tempest-AbsoluteLimitsNegativeTestJSON-1948304934 tempest-AbsoluteLimitsNegativeTestJSON-1948304934-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.880314 Aug 29 15:50:08.229353 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1645/3307] 10.222.0.83 () {60 vars in 1148 bytes} [Mon Aug 29 15:50:07 2022] POST /compute/v2.1/servers => generated 87 bytes in 887 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:50:08.243696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.250243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bc89f63d-1f29-4072-b28d-a31d5dd2247a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:08.272763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.275749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.276329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.277096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.277577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.278013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.318181 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Instance bc89f63d-1f29-4072-b28d-a31d5dd2247a could not be found. Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a HTTP/1.1 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance bc89f63d-1f29-4072-b28d-a31d5dd2247a could not be found. Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bc89f63d-1f29-4072-b28d-a31d5dd2247a'} Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc89f63d-1f29-4072-b28d-a31d5dd2247a could not be found. Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc89f63d-1f29-4072-b28d-a31d5dd2247a could not be found. Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.319991 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc89f63d-1f29-4072-b28d-a31d5dd2247a could not be found. Aug 29 15:50:08.324721 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.327984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Instance bc89f63d-1f29-4072-b28d-a31d5dd2247a could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:08.329105 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17a234f5-a511-4bd3-ae95-78a864364d46 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a" status: 404 len: 111 microversion: 2.1 time: 0.102061 Aug 29 15:50:08.333748 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1646/3308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:08 2022] GET /compute/v2.1/servers/bc89f63d-1f29-4072-b28d-a31d5dd2247a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:08.348206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ba85703-dd65-4656-84c5-646ded9125dd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '.version_select at 0x7f32ee4681f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.399436 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-1ba85703-dd65-4656-84c5-646ded9125dd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Image not found. Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ba85703-dd65-4656-84c5-646ded9125dd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617 HTTP/1.1 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: exception: Image not found. Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '64eaad36-a39c-4ddf-9db1-97e5b6dfb617'} Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 64eaad36-a39c-4ddf-9db1-97e5b6dfb617 to delete Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 64eaad36-a39c-4ddf-9db1-97e5b6dfb617 could not be found. Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.402108 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ba85703-dd65-4656-84c5-646ded9125dd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Image not found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ba85703-dd65-4656-84c5-646ded9125dd tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617" status: 404 len: 62 microversion: 2.1 time: 0.067247 Aug 29 15:50:08.407983 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1647/3309] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:08 2022] DELETE /compute/v2.1/images/64eaad36-a39c-4ddf-9db1-97e5b6dfb617 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:50:08.422910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.423524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:08.427843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.441439 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6fb9d937-3361-43ff-bff7-94e2ed1de914 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.525286 Aug 29 15:50:08.455681 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1663/3310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:07 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:08.461182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.461756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.462213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.472121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.473616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.474261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.474803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.475481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:08.504528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.505032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.505466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.506496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.507137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.507562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.527159 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc HTTP/1.1 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '15608c5c-acbc-4327-ade5-30c5b31166bc'} Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:08.529545 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:08.534944 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb5cee36-0744-4050-8f21-f5944429ffbb tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 404 len: 111 microversion: 2.1 time: 0.122000 Aug 29 15:50:08.538754 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1648/3311] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:08 2022] DELETE /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:50:08.550879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.554021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: 15608c5c-acbc-4327-ade5-30c5b31166bc] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:08.569248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.570203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.571395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.584418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.586138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.588383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.628299 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.638864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc HTTP/1.1 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '15608c5c-acbc-4327-ade5-30c5b31166bc'} Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.639390 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Instance 15608c5c-acbc-4327-ade5-30c5b31166bc could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f9c8cbe-05a8-48ca-9525-7a373900c8aa tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc" status: 404 len: 111 microversion: 2.1 time: 0.102135 Aug 29 15:50:08.643934 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1649/3312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:08 2022] GET /compute/v2.1/servers/15608c5c-acbc-4327-ade5-30c5b31166bc => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:08.657722 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed79569f-4321-4ff7-a5ad-9e5b8c38d258 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1282 microversion: 2.1 time: 0.200862 Aug 29 15:50:08.659007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-22cbb067-baf4-48af-81fc-4997cfca4b35 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '.version_select at 0x7f32f2aab700>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:08.666115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1664/3313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:08 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:08.719593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b51617f8-8966-42fd-9f99-aa0c28bedb7d req-a00c6973-cc66-4149-b708-efee52a1fee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc89f63d-1f29-4072-b28d-a31d5dd2247a", "name": "network-vif-deleted", "tag": "c338fce7-12f4-4050-ae37-ce925ab5b97c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:08.725075 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-22cbb067-baf4-48af-81fc-4997cfca4b35 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551115605" status: 202 len: 0 microversion: 2.1 time: 0.074349 Aug 29 15:50:08.729453 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1650/3314] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:50:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551115605 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:50:08.737904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b51617f8-8966-42fd-9f99-aa0c28bedb7d req-a00c6973-cc66-4149-b708-efee52a1fee4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:08.752097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b51617f8-8966-42fd-9f99-aa0c28bedb7d req-a00c6973-cc66-4149-b708-efee52a1fee4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:08.752800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b51617f8-8966-42fd-9f99-aa0c28bedb7d req-a00c6973-cc66-4149-b708-efee52a1fee4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:08.778623 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b51617f8-8966-42fd-9f99-aa0c28bedb7d req-a00c6973-cc66-4149-b708-efee52a1fee4 service nova] Creating event network-vif-deleted:c338fce7-12f4-4050-ae37-ce925ab5b97c for instance bc89f63d-1f29-4072-b28d-a31d5dd2247a on n-h2-836830-13 Aug 29 15:50:08.792873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b51617f8-8966-42fd-9f99-aa0c28bedb7d req-a00c6973-cc66-4149-b708-efee52a1fee4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080480 Aug 29 15:50:08.795660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1665/3315] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:09.468319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:09.470938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:09.480416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.481032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.481578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.482379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.482947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.483527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.688224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:09.689522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:09.704331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.705374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.706116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:09.707122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:09.707786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:09.708563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:10.381862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:10.393450 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ba431c7-94e6-4d4e-b4b7-8a8028b4dc64 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.710424 Aug 29 15:50:10.394651 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1666/3316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:09 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:10.428275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:10.438222 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-612ed0c6-6ca6-4811-8031-c990cdf9b421 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.974525 Aug 29 15:50:10.439092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1651/3317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:09 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:11.191013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7afd57c4-fadd-46be-b509-99400c97df74 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '.version_select at 0x7f32edb43a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:11.200869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=32 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:11.224429 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-7afd57c4-fadd-46be-b509-99400c97df74 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Image not found. Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7afd57c4-fadd-46be-b509-99400c97df74 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/images/22babbdd-ffd0-4b98-bfe5-9dda1c84849b HTTP/1.1 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: exception: Image not found. Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '22babbdd-ffd0-4b98-bfe5-9dda1c84849b'} Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22babbdd-ffd0-4b98-bfe5-9dda1c84849b to delete Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22babbdd-ffd0-4b98-bfe5-9dda1c84849b could not be found. Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:11.226607 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7afd57c4-fadd-46be-b509-99400c97df74 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Image not found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7afd57c4-fadd-46be-b509-99400c97df74 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/images/22babbdd-ffd0-4b98-bfe5-9dda1c84849b" status: 404 len: 62 microversion: 2.1 time: 0.044509 Aug 29 15:50:11.231186 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1667/3318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:11 2022] DELETE /compute/v2.1/images/22babbdd-ffd0-4b98-bfe5-9dda1c84849b => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:50:11.248772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:11.249617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:11.260740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.261308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.261894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.264120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.264736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.265172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.307274 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 HTTP/1.1 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bcb84f67-110d-46c5-951f-1cd0d8960752'} Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:11.308913 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.312652 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.313307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:11.315760 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-16c35214-28c5-4a7b-82c8-0c142f004b1f tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 404 len: 111 microversion: 2.1 time: 0.080063 Aug 29 15:50:11.318365 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1652/3319] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:11 2022] DELETE /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:11.330053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:11.330709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] [instance: bcb84f67-110d-46c5-951f-1cd0d8960752] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:11.365455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.366644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.370261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.371399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.372130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.372728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.418256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:11.419572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:11.433799 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] HTTP exception thrown: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Request method failure captured: Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 HTTP/1.1 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN-iCYo1vifv0z9GwaC_xgxzoLpJqfG5Z922aOs_9nd70oe9h85oEVMn5r0j7id_Et0ZKZBFRweySAvMatkD1Ogw698-50WWqWmhTy0DEqb4V10G5nLYYIs8laQwJG3oznUfRGwZW41NP09QHWxylN52Xf_MwgZN0sWtr9-NXmQkc1Y Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_062ee746b4614e629a9d853a6d84a368", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/062ee746b4614e629a9d853a6d84a368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/062ee746b4614e629a9d853a6d84a368"}]}] Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 062ee746b4614e629a9d853a6d84a368 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-366422749 Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 215e000f15f44b41aa38a41a941c16da Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-366422749-project Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bcb84f67-110d-46c5-951f-1cd0d8960752'} Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.436124 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. Aug 29 15:50:11.442890 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:11.445254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] Returning 404 to user: Instance bcb84f67-110d-46c5-951f-1cd0d8960752 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:11.447428 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-603e1043-4353-441e-85d6-6dd0c3ecd866 tempest-ImagesOneServerNegativeTestJSON-366422749 tempest-ImagesOneServerNegativeTestJSON-366422749-project] 10.222.0.83 "GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752" status: 404 len: 111 microversion: 2.1 time: 0.124837 Aug 29 15:50:11.448979 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1668/3320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:11 2022] GET /compute/v2.1/servers/bcb84f67-110d-46c5-951f-1cd0d8960752 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:11.454421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.457223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6bf2d1fe-4fcd-445b-bdcc-61e3bd94bafa req-b5ce5b6f-8b09-4641-93e1-2615272a7b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a", "tag": "7cb67774-d0d0-4e8d-b19b-f957d6710ec7"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:11.464033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.464563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.467949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.468931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.470196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.471778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6bf2d1fe-4fcd-445b-bdcc-61e3bd94bafa req-b5ce5b6f-8b09-4641-93e1-2615272a7b3c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.473492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6bf2d1fe-4fcd-445b-bdcc-61e3bd94bafa req-b5ce5b6f-8b09-4641-93e1-2615272a7b3c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.474232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6bf2d1fe-4fcd-445b-bdcc-61e3bd94bafa req-b5ce5b6f-8b09-4641-93e1-2615272a7b3c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.494602 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6bf2d1fe-4fcd-445b-bdcc-61e3bd94bafa req-b5ce5b6f-8b09-4641-93e1-2615272a7b3c service nova] Creating event network-changed:7cb67774-d0d0-4e8d-b19b-f957d6710ec7 for instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a on n-h2-836830-13 Aug 29 15:50:11.501208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6bf2d1fe-4fcd-445b-bdcc-61e3bd94bafa req-b5ce5b6f-8b09-4641-93e1-2615272a7b3c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050234 Aug 29 15:50:11.502592 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1669/3321] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:11.510904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:11.512093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:11.523018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.524546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.526007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.527754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:11.528529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:11.529701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:11.573369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:11.947563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:11.955746 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d3399b5-1352-43d5-b6a8-948a13dfbdbb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.543162 Aug 29 15:50:11.960092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1653/3322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:11 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:12.210908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:12.227998 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42f76170-b51f-45da-b8da-8b22a4e72fa8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.723864 Aug 29 15:50:12.228670 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1670/3323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:11 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:12.988472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:12.995346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:13.003831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:13.010327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.010937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.011630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.012329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.012790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.013242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.250827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:13.252217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:13.269797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.270298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.270732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.271474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:13.271928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:13.272390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:13.464971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:13.476800 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a837a7f2-56ac-4d8e-b19e-243325f63faf tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.492688 Aug 29 15:50:13.490920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1654/3324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:12 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:14.071665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:14.081388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-31923464-271f-420f-9ae3-09ee35d7e4c9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1504 microversion: 2.1 time: 0.835251 Aug 29 15:50:14.082671 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1671/3325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:13 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1504 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:14.499016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:14.499728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:14.539044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:14.541599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:14.542817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.546128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:14.547005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:14.547934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:14.925149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:14.934323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a34ead95-02c8-4820-be9d-cdaeaa54c630 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.440358 Aug 29 15:50:14.934917 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1655/3326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:14 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:15.102275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:15.104280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:15.121783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.122536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.123216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.124089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.124707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.125295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.856443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:15.867070 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8bfdb748-410a-43c1-8695-3d45a809bd3f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1479 microversion: 2.1 time: 0.768802 Aug 29 15:50:15.882609 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1672/3327] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:15 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1479 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:15.888455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05f4154b-821f-4b76-a17e-cc41f599d3fc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '.version_select at 0x7f32ee4eec10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:15.891978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f4154b-821f-4b76-a17e-cc41f599d3fc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.892471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f4154b-821f-4b76-a17e-cc41f599d3fc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.892913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f4154b-821f-4b76-a17e-cc41f599d3fc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.910925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05f4154b-821f-4b76-a17e-cc41f599d3fc tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.026784 Aug 29 15:50:15.928147 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1656/3328] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:50:15 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:15.933624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:15.934287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:15.942226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.942748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.946567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.950956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.951545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.951997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.958140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:15.958775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:15.969268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.970928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.971408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:15.975274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:15.975767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:15.976206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:16.408588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:16.418094 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-729d13cc-a4ee-4a81-9581-1ed2785e5c01 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.463941 Aug 29 15:50:16.432465 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1657/3329] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:15 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:16.950225 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb43d4f2-a8d6-47a6-ba74-8294bb649416 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1632 microversion: 2.1 time: 1.020634 Aug 29 15:50:16.959123 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1673/3330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:15 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1632 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:16.982848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62796357-e8e5-4172-8420-95dd2e63567b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Action: 'create', calling method: .version_select at 0x7f32ee5db550>, body: {"keypair": {"name": "tempest-keypair-932442749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3tUC4c/nOMQUGNw3yCxO8uC1nSFZK2U8OXyvHCCMIVEs36292425d92km671EN7qiPdg8miKpwnyaimhyf8UIft8MUeB3U7zjVt7HDdBZEE0eiP9BVIctIkIEPb/MysQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:17.006275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-62796357-e8e5-4172-8420-95dd2e63567b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:17.015275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-62796357-e8e5-4172-8420-95dd2e63567b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for user 71e0809663664b319388bcc890b6fdec and project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:17.059929 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-62796357-e8e5-4172-8420-95dd2e63567b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081877 Aug 29 15:50:17.067556 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1658/3331] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:50:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:17.438472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:17.439203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:17.447236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:17.447759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:17.448273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:17.449136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:17.449627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:17.450077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:18.171265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:18.256759 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dcbff618-a0dd-48fb-adff-c7d1d99dd547 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.822023 Aug 29 15:50:18.283500 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1674/3332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:17 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:19.280245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:19.280879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:19.283082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:19.298080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:19.298626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:19.299219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:19.299827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:19.300299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:19.300732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:19.688631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:19.708748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f93594e-c454-4a68-9b1c-48ac048c1465 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.432310 Aug 29 15:50:19.723176 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1659/3333] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:19 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:20.658494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-db821b6f-0491-4ea5-bdfc-30acaa9e6aee req-d0146987-9142-41d6-b73a-aefa75b8bb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a", "name": "network-vif-plugged", "status": "completed", "tag": "7cb67774-d0d0-4e8d-b19b-f957d6710ec7"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:20.678562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-db821b6f-0491-4ea5-bdfc-30acaa9e6aee req-d0146987-9142-41d6-b73a-aefa75b8bb11 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.679144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-db821b6f-0491-4ea5-bdfc-30acaa9e6aee req-d0146987-9142-41d6-b73a-aefa75b8bb11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.679878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-db821b6f-0491-4ea5-bdfc-30acaa9e6aee req-d0146987-9142-41d6-b73a-aefa75b8bb11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.713530 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-db821b6f-0491-4ea5-bdfc-30acaa9e6aee req-d0146987-9142-41d6-b73a-aefa75b8bb11 service nova] Creating event network-vif-plugged:7cb67774-d0d0-4e8d-b19b-f957d6710ec7 for instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a on n-h2-836830-13 Aug 29 15:50:20.724744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-db821b6f-0491-4ea5-bdfc-30acaa9e6aee req-d0146987-9142-41d6-b73a-aefa75b8bb11 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068560 Aug 29 15:50:20.727138 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1675/3334] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:20.732332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:20.733993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:20.758347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.758870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.761815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:20.765475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:20.781934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:20.785031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:21.298317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:21.314675 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed76a7a9-5950-4f48-aa91-4fa28123adfc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.587287 Aug 29 15:50:21.317868 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1660/3335] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:20 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:22.339536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:22.340945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:22.350443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.351320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.352467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:22.354411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:22.355651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:22.356369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:22.889495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:22.907463 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a62c34c-fcb5-46ea-81bb-780e4538f206 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1324 microversion: 2.1 time: 0.571706 Aug 29 15:50:22.910822 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1676/3336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:22 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1324 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:23.511406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1635010201", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f0a6211c-15a9-4651-919e-885c3d0e4778"}], "security_groups": [{"name": "tempest-securitygroup--1684373056"}], "key_name": "tempest-keypair-932442749", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:23.758822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] validate_networks() for [('f0a6211c-15a9-4651-919e-885c3d0e4778', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:23.932117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:23.932926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:23.957862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:23.958716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:23.960337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:23.966788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:23.967846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:23.971524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.594042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:24.627529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7555125b-2dba-4540-a3d6-d21286046628 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1521 microversion: 2.1 time: 0.700947 Aug 29 15:50:24.635145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1677/3337] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:23 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:24.933629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:24.935284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:24.935284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:24.935942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:24.936371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:24.952086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=43 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:24.955354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.956622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.957532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.958620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:24.959314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:24.960004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:24.993269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:25.003105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for user 71e0809663664b319388bcc890b6fdec and project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:25.036034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:25.039683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:25.144697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-09933d51-3d18-4362-ae67-1ddca9977302 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1841918803", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-09933d51-3d18-4362-ae67-1ddca9977302 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 243 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1841918803", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1841918803', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '5333e2b9-539f-4666-a39e-be59a530ac31'}]}}} Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:25.154083 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-09933d51-3d18-4362-ae67-1ddca9977302 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:25.158670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-09933d51-3d18-4362-ae67-1ddca9977302 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.015872 Aug 29 15:50:25.161536 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1678/3338] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:25 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:50:25.170179 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-32a5868e-d077-4571-92cc-e8f2b4873938 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.657406 Aug 29 15:50:25.172322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57e1c760-3a22-4ed8-bbd1-5dc89ab2bf3b tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:25.172888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57e1c760-3a22-4ed8-bbd1-5dc89ab2bf3b tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:25.174321 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1661/3339] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:25.189895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3f9da50-c5c5-40e2-b4a3-43cc0e6e8a98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:25.190542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3f9da50-c5c5-40e2-b4a3-43cc0e6e8a98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:25.199862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-57e1c760-3a22-4ed8-bbd1-5dc89ab2bf3b tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] HTTP exception thrown: Instance 96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0 could not be found. Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57e1c760-3a22-4ed8-bbd1-5dc89ab2bf3b tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0/metadata HTTP/1.1 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0 could not be found. Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': '96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0'} Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0 could not be found. Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0 could not be found. Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.205101 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.209291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:25.209291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:25.209291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0 could not be found. Aug 29 15:50:25.209291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.209291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57e1c760-3a22-4ed8-bbd1-5dc89ab2bf3b tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 404 to user: Instance 96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:25.209291 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57e1c760-3a22-4ed8-bbd1-5dc89ab2bf3b tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0/metadata" status: 404 len: 111 microversion: 2.1 time: 0.040226 Aug 29 15:50:25.210750 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1679/3340] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:50:25 2022] GET /compute/v2.1/servers/96ba0bf4-00b7-4bd1-8cb4-bc6ded0475b0/metadata => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:50:25.412081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e3f9da50-c5c5-40e2-b4a3-43cc0e6e8a98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:25.425264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3f9da50-c5c5-40e2-b4a3-43cc0e6e8a98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1234 microversion: 2.1 time: 0.243071 Aug 29 15:50:25.427446 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1662/3341] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:25 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1234 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:25.494866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8b01418-d7c8-4e7f-b173-0cfa2b0da1e3 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1773346865", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8b01418-d7c8-4e7f-b173-0cfa2b0da1e3 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 499 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1773346865", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1773346865', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5333e2b9-539f-4666-a39e-be59a530ac31'}]}}} Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:50:25.502687 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.506850 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.514974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8b01418-d7c8-4e7f-b173-0cfa2b0da1e3 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:25.517316 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8b01418-d7c8-4e7f-b173-0cfa2b0da1e3 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026596 Aug 29 15:50:25.519319 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1680/3342] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:25 2022] POST /compute/v2.1/servers => generated 687 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:50:25.860013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c28df9b-5d68-4800-9819-7c1aba0adb04 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-156218734", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c28df9b-5d68-4800-9819-7c1aba0adb04 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 499 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-156218734", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-156218734', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5333e2b9-539f-4666-a39e-be59a530ac31'}]}}} Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:50:25.865026 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:25.869298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c28df9b-5d68-4800-9819-7c1aba0adb04 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:25.878192 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c28df9b-5d68-4800-9819-7c1aba0adb04 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010475 Aug 29 15:50:25.880904 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1663/3343] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:25 2022] POST /compute/v2.1/servers => generated 689 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:50:26.017157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84807f87-50ee-4096-86b4-54390550a8b9 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-756721278", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84807f87-50ee-4096-86b4-54390550a8b9 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 753 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-756721278", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-756721278', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5333e2b9-539f-4666-a39e-be59a530ac31'}]}}} Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:26.027097 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:26.030181 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:26.032955 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.032955 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.037255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84807f87-50ee-4096-86b4-54390550a8b9 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:26.038422 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84807f87-50ee-4096-86b4-54390550a8b9 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026861 Aug 29 15:50:26.043157 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1681/3344] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:26 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 29 15:50:26.130416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28c54d8a-c138-42bb-9de5-769f7aa3ccaa tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-993317498", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28c54d8a-c138-42bb-9de5-769f7aa3ccaa tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 1265 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-993317498", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "5333e2b9-539f-4666-a39e-be59a530ac31"}]}} Aug 29 15:50:26.135050 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-993317498', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '5333e2b9-539f-4666-a39e-be59a530ac31'}]}}} Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.137608 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:50:26.138911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:50:26.140843 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 29 15:50:26.140843 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.140843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28c54d8a-c138-42bb-9de5-769f7aa3ccaa tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:26.140843 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28c54d8a-c138-42bb-9de5-769f7aa3ccaa tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.015064 Aug 29 15:50:26.147845 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1664/3345] 10.222.0.83 () {60 vars in 1148 bytes} [Mon Aug 29 15:50:26 2022] POST /compute/v2.1/servers => generated 2221 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 29 15:50:26.162014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56a96eb8-e78f-43ad-89ac-7df0649192e6 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:26.162597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-56a96eb8-e78f-43ad-89ac-7df0649192e6 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 66f98d6d-6b9e-4c0f-b908-eb377c38d205] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:26.178205 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-56a96eb8-e78f-43ad-89ac-7df0649192e6 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] HTTP exception thrown: Instance 66f98d6d-6b9e-4c0f-b908-eb377c38d205 could not be found. Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56a96eb8-e78f-43ad-89ac-7df0649192e6 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/66f98d6d-6b9e-4c0f-b908-eb377c38d205/metadata/test2 HTTP/1.1 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 66f98d6d-6b9e-4c0f-b908-eb377c38d205 could not be found. Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': '66f98d6d-6b9e-4c0f-b908-eb377c38d205', 'id': 'test2'} Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66f98d6d-6b9e-4c0f-b908-eb377c38d205 could not be found. Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66f98d6d-6b9e-4c0f-b908-eb377c38d205 could not be found. Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:26.193301 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:26.199004 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:26.199004 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:26.199004 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66f98d6d-6b9e-4c0f-b908-eb377c38d205 could not be found. Aug 29 15:50:26.199004 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:26.199004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56a96eb8-e78f-43ad-89ac-7df0649192e6 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 404 to user: Instance 66f98d6d-6b9e-4c0f-b908-eb377c38d205 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:26.199004 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-56a96eb8-e78f-43ad-89ac-7df0649192e6 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/66f98d6d-6b9e-4c0f-b908-eb377c38d205/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.043007 Aug 29 15:50:26.201488 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1682/3346] 10.222.0.83 () {58 vars in 1281 bytes} [Mon Aug 29 15:50:26 2022] GET /compute/v2.1/servers/66f98d6d-6b9e-4c0f-b908-eb377c38d205/metadata/test2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:26.213915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:26.214420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:26.236683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.237178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.237609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.260056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.263682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.266335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.388197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:26.451555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:26.452369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:26.471068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.473673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.479083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.480536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.481205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.485077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.723683 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37c32a9c-4b09-49f3-8dc2-cf2708f2aef4 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 204 len: 0 microversion: 2.1 time: 0.508741 Aug 29 15:50:26.728079 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1665/3347] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:26 2022] DELETE /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:26.751112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:26.760973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:26.783683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.784022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.794311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.798526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.799140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.799608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.844994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:26.864907 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-27672fac-2268-4be9-bb93-bd94ac1d14b9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1230 microversion: 2.1 time: 0.422421 Aug 29 15:50:26.865711 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1683/3348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:26 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1230 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:26.877068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:26.880892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:26.909574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.911734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.917719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.918791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:26.919489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:26.920121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:26.947980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:50:27.153862 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5cd40bc7-6e2e-49e5-a53c-e5bdbea96073 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 204 len: 0 microversion: 2.1 time: 0.419265 Aug 29 15:50:27.155295 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1666/3349] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:50:26 2022] DELETE /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:50:27.169793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:27.172371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:27.189072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.192413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.193101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.194147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:27.194981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:27.197759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:27.712290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:27.716588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:27.721890 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ebf9defe-8611-4740-b80f-371b848cff05 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1667 microversion: 2.1 time: 0.560273 Aug 29 15:50:27.729262 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1667/3350] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:27 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1667 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:28.209629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:28.213083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1339a39d-590e-4b24-886a-7d5c2c0c450f tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Action: 'create', calling method: .version_select at 0x7f32ee2448b0>, body: {"keypair": {"name": "tempest-keypair-1940067481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuYqPduweENGq6WJGI5boWWhEgVD4ynYeh44d27rvTEu2joeVAQEw10qvP/RaLvs448UaJ8LjiycvTPdKcqiNK3t4nttBMtNDjV7CUiu5IKPKdMAKUsleghRA6BtMGR1g=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:28.223578 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e9f2ab68-fa94-49ca-a761-c357efedb5c5 tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1527 microversion: 2.1 time: 1.356468 Aug 29 15:50:28.225895 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1684/3351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:26 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1527 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:28.231732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:28.232664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:28.246316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.247082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.248630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.249694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.250351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.250966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.265466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-1339a39d-590e-4b24-886a-7d5c2c0c450f tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Getting quotas for project 6d1b9fcde555493f86ea437619efbea9. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:28.281570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-1339a39d-590e-4b24-886a-7d5c2c0c450f tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Getting quotas for user d008ed466820477197b94d0c18f7eb1c and project 6d1b9fcde555493f86ea437619efbea9. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:28.342989 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1339a39d-590e-4b24-886a-7d5c2c0c450f tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.612373 Aug 29 15:50:28.343728 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1668/3352] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:50:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:28.462809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:28.471884 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3c887e58-6371-4055-baea-7251e83c795a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1292 microversion: 2.1 time: 0.244449 Aug 29 15:50:28.483490 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1685/3353] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:28 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1292 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:28.752073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:28.752695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:28.760706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.768040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.768754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:28.772080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:28.772827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:28.773624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:29.255477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:29.256788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:29.273439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:29.277102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:29.279257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:29.282046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:29.282600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:29.283083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:29.396293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:29.412767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd2da9ca-fab7-42b0-8902-f7ed1733c39b tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1667 microversion: 2.1 time: 0.664509 Aug 29 15:50:29.416728 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1669/3354] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:28 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1667 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:29.494477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:29.495306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:29.507052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:29.507311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:29.507754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:29.508460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:29.510773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:29.511176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:29.719582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:29.731905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b1547d4-d102-4055-a513-3babb1ae35fe tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1292 microversion: 2.1 time: 0.242003 Aug 29 15:50:29.732513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1670/3355] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:29 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1292 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:30.285868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:30.296169 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2216c370-93c5-453d-9d92-1c0c755811ca tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1527 microversion: 2.1 time: 1.052558 Aug 29 15:50:30.312901 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1686/3356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:29 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1527 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:30.440377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:30.441300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:30.455399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.459161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.460280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.463807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:30.465687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:30.467832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:30.815865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1363174631", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "89772877-a20c-4307-8a01-a5339df4c841"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:30.932403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] validate_networks() for [('89772877-a20c-4307-8a01-a5339df4c841', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:31.332725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:31.344234 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-140321a5-9e37-4893-a97f-6e6312247874 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1667 microversion: 2.1 time: 0.910923 Aug 29 15:50:31.347928 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1687/3357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:30 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1667 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:31.361106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:31.362022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:31.377059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:31.377837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:31.378447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:31.379394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:31.380019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:31.380612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.123950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:32.141776 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e964665-78e3-46bd-935b-8b0c5708314c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 0.792444 Aug 29 15:50:32.142466 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1688/3358] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:31 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:32.147325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:32.147943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:32.170737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.172810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.173726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:32.179623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:32.180415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:32.181657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.484754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:33.485772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:33.486832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:33.487458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:33.488111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:33.506700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.508629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.510759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.511730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.516757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.517473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.563251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Getting quotas for project 65947505462641c1ac004cdacaa8317b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:33.580880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Getting quotas for user f5aa55b1030d49a7abf035fd56d8b9c2 and project 65947505462641c1ac004cdacaa8317b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:33.622866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:33.625299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:33.753756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:33.757169 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5256624-259a-47ea-a284-366fbdf41f58 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.436846 Aug 29 15:50:33.763257 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1671/3359] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:33.764487 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8398ab13-0353-4ea9-b04c-39865fceacfb tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1527 microversion: 2.1 time: 1.620817 Aug 29 15:50:33.778651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:33.779532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:33.784077 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1689/3360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:32 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1527 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:33.790894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:33.791812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:33.800515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.801280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.802462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.803405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.804011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.804268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.807389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.808135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.810781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:33.813296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:33.815652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:33.818302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.291508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:34.312628 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ad4cf7b9-6bc6-40e8-bb25-ebecbd09722d tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1599 microversion: 2.1 time: 0.544711 Aug 29 15:50:34.314600 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1672/3361] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:33 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1599 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:34.340010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-868512682", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "89772877-a20c-4307-8a01-a5339df4c841"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:34.516826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] validate_networks() for [('89772877-a20c-4307-8a01-a5339df4c841', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:34.687655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:34.708493 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1fc6e82a-d65c-4310-bea1-a889979d33b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 0.922649 Aug 29 15:50:34.715606 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1690/3362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:33 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:34.754178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b5787874-a1da-40f3-9aa3-748904447a77 req-51c6e076-e479-4c90-99bc-184ecde43b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a", "name": "network-vif-deleted", "tag": "7cb67774-d0d0-4e8d-b19b-f957d6710ec7"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:34.789674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b5787874-a1da-40f3-9aa3-748904447a77 req-51c6e076-e479-4c90-99bc-184ecde43b75 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.790440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b5787874-a1da-40f3-9aa3-748904447a77 req-51c6e076-e479-4c90-99bc-184ecde43b75 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.793646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b5787874-a1da-40f3-9aa3-748904447a77 req-51c6e076-e479-4c90-99bc-184ecde43b75 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.833375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b5787874-a1da-40f3-9aa3-748904447a77 req-51c6e076-e479-4c90-99bc-184ecde43b75 service nova] Creating event network-vif-deleted:7cb67774-d0d0-4e8d-b19b-f957d6710ec7 for instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a on n-h2-836830-13 Aug 29 15:50:34.849203 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b5787874-a1da-40f3-9aa3-748904447a77 req-51c6e076-e479-4c90-99bc-184ecde43b75 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132146 Aug 29 15:50:34.859446 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1691/3363] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:34.865054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:34.865780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:34.890773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=70 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:34.911798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.912742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.913349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:34.920240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:34.920794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:34.924240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.022667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.028745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.036305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.037092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lazy-loading 'fault' on Instance uuid 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:35.404081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea31195933be4477a588150bb1f67822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2f45b5051c4899a770a38958c70caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:35.406271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:35.429611 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb474165-c790-4920-b21b-5e6a213c2aea tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 200 len: 1314 microversion: 2.1 time: 0.568551 Aug 29 15:50:35.443496 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1692/3364] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:34 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:35.456252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:35.457135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:35.477319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.478517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.479076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.484841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.485595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.488291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.922181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:35.932398 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9942227-1449-4a61-b03f-6b16f10d5e8e tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1599 microversion: 2.1 time: 0.487355 Aug 29 15:50:35.953419 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1693/3365] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:35 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1599 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:35.965317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:35.965937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:35.985927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.986430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:35.994750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:35.997649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:35.999981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:36.001187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:36.807844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:36.817196 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9965f823-1e49-4a95-8f42-d472670ef41a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 0.862514 Aug 29 15:50:36.817698 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1694/3366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:35 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:36.831150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:36.831778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] [instance: 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:36.862648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:36.863166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:36.868599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:36.870656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:36.871591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:36.873610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:36.942434 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] HTTP exception thrown: Instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a could not be found. Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Request method failure captured: Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a HTTP/1.1 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOAoIdgKg9pv4N_8IdAGW1W36P7KTZJXFM5DzSjNj6yicQpnrbCduelgQGlQVyUZ-ZAGecZVyPG2B-2ZmRtFlLF0FjOAxwEilPuGGwJq0WAXylPuRevQbhURvL07KcdCJu19p1GJsY-RLmHl0D56C5xR_6W9dTNdkREABvRVhoHhhYo Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f2f45b5051c4899a770a38958c70caa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f2f45b5051c4899a770a38958c70caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f2f45b5051c4899a770a38958c70caa"}]}] Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6f2f45b5051c4899a770a38958c70caa Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1550234674 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea31195933be4477a588150bb1f67822 Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1550234674-project Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a could not be found. Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a'} Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a could not be found. Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a could not be found. Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:36.944171 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a could not be found. Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] Returning 404 to user: Instance 5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:36.959930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e5993f9-78db-4031-83a1-9ffbd65642dc tempest-ServerMetadataNegativeTestJSON-1550234674 tempest-ServerMetadataNegativeTestJSON-1550234674-project] 10.222.0.83 "GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a" status: 404 len: 111 microversion: 2.1 time: 0.126944 Aug 29 15:50:36.964243 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1695/3367] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:36 2022] GET /compute/v2.1/servers/5d27ce3f-2bf8-4daf-a4b5-5eb41108d86a => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:36.981550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:36.982175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:36.992414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:36.992910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:36.994170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:36.994830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.009186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.009969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.158930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:37.160631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:37.161887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:37.162900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:37.167525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:37.227632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:37.237830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.239085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.241386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.244247 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0854bab-a845-47e2-ae54-5bec65686468 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1599 microversion: 2.1 time: 0.280908 Aug 29 15:50:37.244527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.245573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.246240 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1696/3368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:36 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1599 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:37.260143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a9f22785-34e1-41eb-ac53-edca3d5b0acb req-28e7b9b6-3c02-4dbd-94c2-5e89711f8de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b35c5d-d1f2-4b6a-9a6d-1b7db062a933", "tag": "512e1130-3666-4949-b9f1-618b6b254336"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:37.262854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.289249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a9f22785-34e1-41eb-ac53-edca3d5b0acb req-28e7b9b6-3c02-4dbd-94c2-5e89711f8de1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.293705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a9f22785-34e1-41eb-ac53-edca3d5b0acb req-28e7b9b6-3c02-4dbd-94c2-5e89711f8de1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.295255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a9f22785-34e1-41eb-ac53-edca3d5b0acb req-28e7b9b6-3c02-4dbd-94c2-5e89711f8de1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.324185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:37.346524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a9f22785-34e1-41eb-ac53-edca3d5b0acb req-28e7b9b6-3c02-4dbd-94c2-5e89711f8de1 service nova] Creating event network-changed:512e1130-3666-4949-b9f1-618b6b254336 for instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 on n-h1-836830-13 Aug 29 15:50:37.361801 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a9f22785-34e1-41eb-ac53-edca3d5b0acb req-28e7b9b6-3c02-4dbd-94c2-5e89711f8de1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110806 Aug 29 15:50:37.363699 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1697/3369] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:37.372110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Getting quotas for project 65947505462641c1ac004cdacaa8317b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:37.392882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Getting quotas for user f5aa55b1030d49a7abf035fd56d8b9c2 and project 65947505462641c1ac004cdacaa8317b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:37.437256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:37.443988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:37.660210 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a5c77f5-9672-4ced-8410-d7ab5b2cb5c8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.338940 Aug 29 15:50:37.666755 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1673/3370] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:37.846054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:37.847694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:37.867627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.870217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.873428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.874716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:37.875411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:37.877135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:37.956854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2077546388", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "451", "networks": [{"uuid": "89772877-a20c-4307-8a01-a5339df4c841"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:38.124939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] validate_networks() for [('89772877-a20c-4307-8a01-a5339df4c841', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:39.143738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:39.157972 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-175e2fa5-ee63-402e-bae1-b7711f385337 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 1.315117 Aug 29 15:50:39.159188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1698/3371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:37 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:39.176051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5e048721-c9ec-46a4-925d-e3855bf2663f req-3e88a821-cc0d-496f-99d7-49e3475ccd1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1abacf35-4c11-4331-bc1b-6dd4d88f1190", "name": "network-vif-deleted", "tag": "58fe0723-fb16-41da-b1e9-0813b4aabe19"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:39.195475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5e048721-c9ec-46a4-925d-e3855bf2663f req-3e88a821-cc0d-496f-99d7-49e3475ccd1b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:39.196218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5e048721-c9ec-46a4-925d-e3855bf2663f req-3e88a821-cc0d-496f-99d7-49e3475ccd1b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:39.200965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5e048721-c9ec-46a4-925d-e3855bf2663f req-3e88a821-cc0d-496f-99d7-49e3475ccd1b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.216901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-5e048721-c9ec-46a4-925d-e3855bf2663f req-3e88a821-cc0d-496f-99d7-49e3475ccd1b service nova] Creating event network-vif-deleted:58fe0723-fb16-41da-b1e9-0813b4aabe19 for instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 on n-h2-836830-13 Aug 29 15:50:39.241245 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5e048721-c9ec-46a4-925d-e3855bf2663f req-3e88a821-cc0d-496f-99d7-49e3475ccd1b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080099 Aug 29 15:50:39.242518 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1699/3372] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:39.252750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:39.265383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:39.278267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:39.279145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:39.281878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.282811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:39.283360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:39.283834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.405899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:39.410910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:39.411946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:39.412657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lazy-loading 'fault' on Instance uuid 1abacf35-4c11-4331-bc1b-6dd4d88f1190 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:50:39.643297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023ee959a1ca446fb620544563307863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09841e55e1b145aaae76652d19a35da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:39.652242 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44e91cb8-ec71-4e34-bf26-08a61ff02b6a tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 200 len: 1316 microversion: 2.1 time: 0.406983 Aug 29 15:50:39.659055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1700/3373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:39 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:40.179043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:40.179842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:40.192751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.193249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.193685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.199748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.201385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.202013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.822189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:40.823633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:40.824498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:40.825302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:40.826631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:40.843932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.844723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.846872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.847964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:40.848626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:40.850810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:40.879765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Getting quotas for project 65947505462641c1ac004cdacaa8317b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:40.887742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Getting quotas for user f5aa55b1030d49a7abf035fd56d8b9c2 and project 65947505462641c1ac004cdacaa8317b. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:40.912641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:40.915493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:40.986628 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e6f1ab3-f4d0-4e93-87fa-f7974c26e330 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.040213 Aug 29 15:50:40.988244 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1674/3374] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:40.993117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:40.995674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] [instance: 1abacf35-4c11-4331-bc1b-6dd4d88f1190] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:41.004244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.005409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.006070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.006976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:41.007713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:41.010199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:41.029732 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] HTTP exception thrown: Instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 could not be found. Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Request method failure captured: Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 HTTP/1.1 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN_ClIfUwlMb-A1LSwhywF2fg0LPXRiRunDOFgNHSnoK9CGq5epHNHvvkR6ZThzExGUO8QWXAOwuz9HHgE8ega0ZVQt6XoH29nSXv7iJB9Pe4qqbSAvWaEAqku3nHKvdpb8g6RySrxN9bAFBqQQgGMlO_y8OFBBPBK70Mpu1nP8hX30 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 09841e55e1b145aaae76652d19a35da6 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestFqdnHostnames-1952556192 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09841e55e1b145aaae76652d19a35da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_09841e55e1b145aaae76652d19a35da6", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/09841e55e1b145aaae76652d19a35da6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/09841e55e1b145aaae76652d19a35da6"}]}] Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestFqdnHostnames-1952556192 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 09841e55e1b145aaae76652d19a35da6 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1952556192 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestFqdnHostnames-1952556192-project Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 023ee959a1ca446fb620544563307863 Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestFqdnHostnames-1952556192-project Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 could not be found. Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '1abacf35-4c11-4331-bc1b-6dd4d88f1190'} Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 could not be found. Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 could not be found. Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:50:41.031566 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 could not be found. Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Returning 404 to user: Instance 1abacf35-4c11-4331-bc1b-6dd4d88f1190 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b8b40b8-9699-450e-91a6-408f34610512 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190" status: 404 len: 111 microversion: 2.1 time: 0.043409 Aug 29 15:50:41.038727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1675/3375] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:40 2022] GET /compute/v2.1/servers/1abacf35-4c11-4331-bc1b-6dd4d88f1190 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:50:41.044064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3caccb14-581f-4f9a-bc47-a5ece8a4d78c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:41.045670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3caccb14-581f-4f9a-bc47-a5ece8a4d78c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:41.205797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:41.218877 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-138163b9-36c4-4b8b-9461-35da0e43107e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 1.043029 Aug 29 15:50:41.220444 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1701/3376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:40 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:41.226131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-292d7ddc-78cc-41e5-a382-23ed3a2933d4 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] Calling method '.version_select at 0x7f32edb5b700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:41.267722 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-292d7ddc-78cc-41e5-a382-23ed3a2933d4 tempest-ServersTestFqdnHostnames-1952556192 tempest-ServersTestFqdnHostnames-1952556192-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784321153" status: 202 len: 0 microversion: 2.1 time: 0.038493 Aug 29 15:50:41.268892 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1702/3377] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784321153 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:50:41.329993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3caccb14-581f-4f9a-bc47-a5ece8a4d78c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:41.378042 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3caccb14-581f-4f9a-bc47-a5ece8a4d78c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1221 microversion: 2.1 time: 0.340564 Aug 29 15:50:41.383825 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1676/3378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:41 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1221 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:42.246393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:42.247473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:42.288206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.292129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.292819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.293787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.294669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.297923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.405666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:42.406552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:42.467428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.471259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.471769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:42.475202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:42.475703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:42.479628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:43.191971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:43.204176 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3a9f3f9-32e6-4020-abfd-db6e5dea72f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 0.963937 Aug 29 15:50:43.207384 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1703/3379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:42 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:43.832115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:43.847374 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5572faba-73c6-4a36-ad1e-c0d8a05aa8aa tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1273 microversion: 2.1 time: 1.446676 Aug 29 15:50:43.852905 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1677/3380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:42 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1273 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:44.228706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:44.229328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:44.256861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.257608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.258219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.259649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.260276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.260857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.566416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-657319274", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:44.686240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] validate_networks() for [('994d135c-3561-4f23-85b8-7576200126f4', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:50:44.810519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:44.822586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5ddba160-02cf-42d1-8755-637fef55bbea tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 0.598279 Aug 29 15:50:44.826462 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1704/3381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:44 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:44.875758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:44.876847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:44.890660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.891416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.893722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:44.896616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:44.898282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:44.901057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.156625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:45.166298 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11fb3613-b294-491f-9e4a-3c5496cfa7b8 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1279 microversion: 2.1 time: 0.295143 Aug 29 15:50:45.167842 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1705/3382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:44 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:45.415903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f6d2228a-c5c6-455b-a9a9-e6e27b476049 req-0c165985-ceeb-4ef1-a4fe-c8b763a35c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b35c5d-d1f2-4b6a-9a6d-1b7db062a933", "name": "network-vif-plugged", "status": "completed", "tag": "512e1130-3666-4949-b9f1-618b6b254336"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:45.448491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f6d2228a-c5c6-455b-a9a9-e6e27b476049 req-0c165985-ceeb-4ef1-a4fe-c8b763a35c9d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.449643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f6d2228a-c5c6-455b-a9a9-e6e27b476049 req-0c165985-ceeb-4ef1-a4fe-c8b763a35c9d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.452988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f6d2228a-c5c6-455b-a9a9-e6e27b476049 req-0c165985-ceeb-4ef1-a4fe-c8b763a35c9d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.492071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f6d2228a-c5c6-455b-a9a9-e6e27b476049 req-0c165985-ceeb-4ef1-a4fe-c8b763a35c9d service nova] Creating event network-vif-plugged:512e1130-3666-4949-b9f1-618b6b254336 for instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 on n-h1-836830-13 Aug 29 15:50:45.505573 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f6d2228a-c5c6-455b-a9a9-e6e27b476049 req-0c165985-ceeb-4ef1-a4fe-c8b763a35c9d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103303 Aug 29 15:50:45.506799 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1706/3383] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:45.849371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:45.858064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:45.894252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.895915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.897354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:45.904055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:45.904799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:45.905328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.053827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:47.070810 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b47df1b3-c759-4775-8736-c10d037a2548 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1360 microversion: 2.1 time: 1.227231 Aug 29 15:50:47.102188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1707/3384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:45 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1360 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:47.107883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:47.108805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:47.123002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:47.123914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:47.124670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.125554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:47.137378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:47.139078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:47.514475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:47.527018 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7bd700a5-7d78-4bec-9e2e-646a18bcec0d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1279 microversion: 2.1 time: 0.422932 Aug 29 15:50:47.527636 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1708/3385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:47 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1279 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:47.995398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:50:47.998563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:50:47.999333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:50:48.000666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:50:48.002350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:50:48.046853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.050701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.051445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.053928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.056268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.058684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.109198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:48.109799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:48.123994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Getting quotas for project bae88ae162c54e0f90d1465cb17cfbe1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:48.126625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.127170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.127609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.131209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.131696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.132132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.140528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Getting quotas for user 8ab128ff99e24153960e42b8897ac4f1 and project bae88ae162c54e0f90d1465cb17cfbe1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:48.182470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:50:48.191929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:50:48.316337 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-037e1e93-9b01-4316-9a7d-adf689fd2c60 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.078576 Aug 29 15:50:48.320839 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1678/3386] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:50:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 4082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:50:48.334679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-684080dc-abf9-44de-9548-3bdb0444d10d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:48.335630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-684080dc-abf9-44de-9548-3bdb0444d10d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:48.638473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-684080dc-abf9-44de-9548-3bdb0444d10d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:48.656554 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-684080dc-abf9-44de-9548-3bdb0444d10d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1213 microversion: 2.1 time: 0.326681 Aug 29 15:50:48.657582 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1679/3387] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:48 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:48.671329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:48.672277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:48.717958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.718474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.720007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.723699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.729245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.732411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.899205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:48.913918 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9630dc8-3f54-4cdd-b24d-7ad541779875 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1543 microversion: 2.1 time: 0.809068 Aug 29 15:50:48.914517 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1709/3388] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:48 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1543 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:48.937401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:48.938061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:48.946284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.947603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.948230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:48.949077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:48.949655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:48.950604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.098808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7da38886-7b57-4b1c-beec-6ee687e51b0a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165473 Aug 29 15:50:49.099744 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1710/3389] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:50:48 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:49.683958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:49.684607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:49.710146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.716763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.718770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:49.724882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:49.725710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:49.726315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.035153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:50.055646 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e32bd8a-54de-4d25-8777-3432d3f20a4d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1217 microversion: 2.1 time: 0.371681 Aug 29 15:50:50.076428 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1711/3390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:49 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1217 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:50.297361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:50.310925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-725a5226-44f3-4f20-9f38-700f9969aadd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 1.650785 Aug 29 15:50:50.312588 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1680/3391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:48 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:50.515116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d48d9e44-a97c-498f-b774-84338057ee91 req-b7a272e1-fdd1-4a45-9d89-ed14eb6a90bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248979b1-292e-4d51-95e3-c40715fa7c12", "tag": "1809ec2c-b326-4672-a875-72cd6b6089d8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:50.538104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d48d9e44-a97c-498f-b774-84338057ee91 req-b7a272e1-fdd1-4a45-9d89-ed14eb6a90bb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:50.538991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d48d9e44-a97c-498f-b774-84338057ee91 req-b7a272e1-fdd1-4a45-9d89-ed14eb6a90bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:50.541460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d48d9e44-a97c-498f-b774-84338057ee91 req-b7a272e1-fdd1-4a45-9d89-ed14eb6a90bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:50.559537 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d48d9e44-a97c-498f-b774-84338057ee91 req-b7a272e1-fdd1-4a45-9d89-ed14eb6a90bb service nova] Creating event network-changed:1809ec2c-b326-4672-a875-72cd6b6089d8 for instance 248979b1-292e-4d51-95e3-c40715fa7c12 on n-h1-836830-13 Aug 29 15:50:50.572422 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d48d9e44-a97c-498f-b774-84338057ee91 req-b7a272e1-fdd1-4a45-9d89-ed14eb6a90bb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062428 Aug 29 15:50:50.574350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1712/3392] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:51.078097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:51.078945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:51.097130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.100460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.101121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.102035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.103277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.103901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.338792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:51.339665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:51.347339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.348413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.348413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.349180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:51.351085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:51.351085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:51.424680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:51.437911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01c14bc5-e3ae-4408-870f-ba514dd8e52c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1283 microversion: 2.1 time: 0.363127 Aug 29 15:50:51.451561 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1681/3393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:51 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1283 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:52.414233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:52.430126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:52.445073 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a904740-71b9-4e1a-b9fa-e45d0be1705b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 1.112386 Aug 29 15:50:52.446413 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1713/3394] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:51 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:52.464207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:52.465515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:52.473856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.474597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.475226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.476168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.476790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.477359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.603244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-54c2aadd-c0a6-4fb4-817d-8901b283eebc req-2242ddc1-8cc7-43fe-84ab-67cdb0e4b777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b", "tag": "3d0a03d9-e8af-47f8-b07a-46fe4a9ff6cd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:52.613423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-54c2aadd-c0a6-4fb4-817d-8901b283eebc req-2242ddc1-8cc7-43fe-84ab-67cdb0e4b777 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:52.613920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-54c2aadd-c0a6-4fb4-817d-8901b283eebc req-2242ddc1-8cc7-43fe-84ab-67cdb0e4b777 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:52.614348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-54c2aadd-c0a6-4fb4-817d-8901b283eebc req-2242ddc1-8cc7-43fe-84ab-67cdb0e4b777 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:52.628773 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-54c2aadd-c0a6-4fb4-817d-8901b283eebc req-2242ddc1-8cc7-43fe-84ab-67cdb0e4b777 service nova] Creating event network-changed:3d0a03d9-e8af-47f8-b07a-46fe4a9ff6cd for instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b on n-h2-836830-13 Aug 29 15:50:52.635062 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-54c2aadd-c0a6-4fb4-817d-8901b283eebc req-2242ddc1-8cc7-43fe-84ab-67cdb0e4b777 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035979 Aug 29 15:50:52.636163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1714/3395] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:50:52.694723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:52.705331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b6988b5-75d1-47ae-bf4d-c8616a3dba7a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1271 microversion: 2.1 time: 0.245060 Aug 29 15:50:52.707189 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1682/3396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:52 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:53.230862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bc9fc75f-66d8-47f3-80c5-2b079b577603 req-978f1f2f-1fb0-43f9-81c6-c396115a57fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb734f6-bc3c-45ac-af35-5e727217dcdd", "tag": "11d44c95-4c88-4a86-b86c-c30b1845fa2f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:53.304621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc9fc75f-66d8-47f3-80c5-2b079b577603 req-978f1f2f-1fb0-43f9-81c6-c396115a57fe service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.305119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc9fc75f-66d8-47f3-80c5-2b079b577603 req-978f1f2f-1fb0-43f9-81c6-c396115a57fe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.306093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc9fc75f-66d8-47f3-80c5-2b079b577603 req-978f1f2f-1fb0-43f9-81c6-c396115a57fe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.371189 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bc9fc75f-66d8-47f3-80c5-2b079b577603 req-978f1f2f-1fb0-43f9-81c6-c396115a57fe service nova] Creating event network-changed:11d44c95-4c88-4a86-b86c-c30b1845fa2f for instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd on n-h2-836830-13 Aug 29 15:50:53.389551 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bc9fc75f-66d8-47f3-80c5-2b079b577603 req-978f1f2f-1fb0-43f9-81c6-c396115a57fe service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182590 Aug 29 15:50:53.392122 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1715/3397] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:53.467622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:53.468900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:53.490908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.491467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.492315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.494042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.494516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.494959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.729524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:53.732785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:53.761478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.763583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.764271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.766310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:53.769613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:53.770384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:53.995447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:54.010150 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4360f815-5010-45a7-8cb0-29748310460b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 0.548155 Aug 29 15:50:54.012373 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1683/3398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:53 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:54.352245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:54.364364 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6a28b526-fb68-4407-b660-2ebd93fbfba7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1271 microversion: 2.1 time: 0.640196 Aug 29 15:50:54.366366 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1716/3399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:53 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1271 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:55.034129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:55.034771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:55.049388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.051416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.052201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.054875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.060578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.061118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.386118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:55.387517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:55.403143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.404005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.404633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.405516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.407718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.408367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.827731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:55.840337 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf7f88fb-67be-4a37-8aa3-c29bf4ffb04b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.459172 Aug 29 15:50:55.841180 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1717/3400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:55 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:50:55.855128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bea4ba4a-0b9e-4261-afc1-dedc9dfa42ca req-84bc39e6-93ad-4749-9579-798317f1c56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b35c5d-d1f2-4b6a-9a6d-1b7db062a933", "tag": "512e1130-3666-4949-b9f1-618b6b254336"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:55.875001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bea4ba4a-0b9e-4261-afc1-dedc9dfa42ca req-84bc39e6-93ad-4749-9579-798317f1c56c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:55.877479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bea4ba4a-0b9e-4261-afc1-dedc9dfa42ca req-84bc39e6-93ad-4749-9579-798317f1c56c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:55.878097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bea4ba4a-0b9e-4261-afc1-dedc9dfa42ca req-84bc39e6-93ad-4749-9579-798317f1c56c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:55.912839 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bea4ba4a-0b9e-4261-afc1-dedc9dfa42ca req-84bc39e6-93ad-4749-9579-798317f1c56c service nova] Creating event network-changed:512e1130-3666-4949-b9f1-618b6b254336 for instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 on n-h1-836830-13 Aug 29 15:50:55.918402 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bea4ba4a-0b9e-4261-afc1-dedc9dfa42ca req-84bc39e6-93ad-4749-9579-798317f1c56c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075270 Aug 29 15:50:55.919569 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1718/3401] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:56.158650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:56.170559 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5935fcc2-0389-44f5-bce4-43c82db0dcfd tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 1.142318 Aug 29 15:50:56.189464 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1684/3402] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:55 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:56.864268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:56.865132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:56.877658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.880568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.881147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.886298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:56.901351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:56.902731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:56.943236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-67eede05-f712-4b27-9463-069fe2842350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Action: 'create', calling method: .version_select at 0x7f32ee72b9d0>, body: {"keypair": {"name": "tempest-keypair-1412321609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBud1xTH0RbyldzDIvNJ6llsZD/X4xh9EzmGV56VkYvI5E7aXCvuRX5TahSdl3FaHkhVn21pKgTxRtfcQzLHEP/EdAm9EVp5qBpqS1R2mfZ130MLsDk6TR9lehHaKDTszQ=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:56.974532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-67eede05-f712-4b27-9463-069fe2842350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Getting quotas for project a8591065e9fa421b8e44767aa38fd84f. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:50:56.983535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-67eede05-f712-4b27-9463-069fe2842350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Getting quotas for user a3e14fd42e5942199e28335124d59c75 and project a8591065e9fa421b8e44767aa38fd84f. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:50:57.063435 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-67eede05-f712-4b27-9463-069fe2842350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.453547 Aug 29 15:50:57.065875 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1719/3403] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:50:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:57.201013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:57.202461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:57.232328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:57.235195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:57.236335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.239316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:57.241635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:57.245839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:57.470049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:57.487560 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04efb990-ff8f-43e4-8513-1d71bb8de083 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.627197 Aug 29 15:50:57.492272 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1685/3404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:56 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:58.514489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:50:58.516223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:50:58.527917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:58.534333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.536147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.538773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.539651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:58.542520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:58.543258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:58.557486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=71 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:58.665612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=39 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:50:58.974998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:58.989864 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6753f946-e139-4919-ace8-ff10d4d52880 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 1.791292 Aug 29 15:50:59.009441 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1720/3405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:57 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:50:59.019919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-00820258-10d0-460b-9911-12c816064cab req-a1dce7ab-5192-434d-a39b-8b50bcfd629f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248979b1-292e-4d51-95e3-c40715fa7c12", "name": "network-vif-plugged", "status": "completed", "tag": "1809ec2c-b326-4672-a875-72cd6b6089d8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:50:59.038258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-00820258-10d0-460b-9911-12c816064cab req-a1dce7ab-5192-434d-a39b-8b50bcfd629f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:50:59.040301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-00820258-10d0-460b-9911-12c816064cab req-a1dce7ab-5192-434d-a39b-8b50bcfd629f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:50:59.041621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-00820258-10d0-460b-9911-12c816064cab req-a1dce7ab-5192-434d-a39b-8b50bcfd629f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:50:59.075968 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-00820258-10d0-460b-9911-12c816064cab req-a1dce7ab-5192-434d-a39b-8b50bcfd629f service nova] Creating event network-vif-plugged:1809ec2c-b326-4672-a875-72cd6b6089d8 for instance 248979b1-292e-4d51-95e3-c40715fa7c12 on n-h1-836830-13 Aug 29 15:50:59.091421 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-00820258-10d0-460b-9911-12c816064cab req-a1dce7ab-5192-434d-a39b-8b50bcfd629f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077577 Aug 29 15:50:59.095057 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1721/3406] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:50:59.527697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:50:59.546104 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c6cf7a0-8d60-4a51-9963-09e9babff523 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 1.036145 Aug 29 15:50:59.548814 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1686/3407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:50:58 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:00.017043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.017749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.029372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.029878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.030316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.031046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.031508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.031934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.568065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:00.568779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:00.591887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.594093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.596383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:00.603453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:00.609390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:00.609390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:01.724531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:01.734549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd1b12c6-98ce-4ffe-99f4-9fe9f7a87e4d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 1.722635 Aug 29 15:51:01.748493 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1722/3408] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:00 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:01.760743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b01cde19-e4a4-40b7-a922-be834086f86f req-dd83e424-8786-4b12-8c2b-d2ff785f22fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b", "name": "network-vif-plugged", "status": "completed", "tag": "3d0a03d9-e8af-47f8-b07a-46fe4a9ff6cd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:01.805181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b01cde19-e4a4-40b7-a922-be834086f86f req-dd83e424-8786-4b12-8c2b-d2ff785f22fc service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:01.806499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b01cde19-e4a4-40b7-a922-be834086f86f req-dd83e424-8786-4b12-8c2b-d2ff785f22fc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:01.809421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b01cde19-e4a4-40b7-a922-be834086f86f req-dd83e424-8786-4b12-8c2b-d2ff785f22fc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:01.840888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b01cde19-e4a4-40b7-a922-be834086f86f req-dd83e424-8786-4b12-8c2b-d2ff785f22fc service nova] Creating event network-vif-plugged:3d0a03d9-e8af-47f8-b07a-46fe4a9ff6cd for instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b on n-h2-836830-13 Aug 29 15:51:01.861021 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b01cde19-e4a4-40b7-a922-be834086f86f req-dd83e424-8786-4b12-8c2b-d2ff785f22fc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111040 Aug 29 15:51:01.865385 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1723/3409] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:01.871432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3587eaba-f915-477f-8b04-b5bd8cf990d8 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee542670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:01.996508 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3587eaba-f915-477f-8b04-b5bd8cf990d8 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/7834fa9f-8e49-40f6-8e20-ef5f7f9a6729" status: 200 len: 350 microversion: 2.1 time: 0.129444 Aug 29 15:51:01.997197 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1724/3410] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:51:01 2022] GET /compute/v2.1/os-volumes/7834fa9f-8e49-40f6-8e20-ef5f7f9a6729 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:02.336126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-46915f7f-0e05-4261-8b35-865a11f82369 req-0ecc70d8-5de6-4e7c-8683-f4f9bde7d720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8846f9-fc4d-4589-959f-51730b4a1924", "tag": "86097462-00f9-434b-9742-3d5d64dbf7f2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:02.354631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:02.363293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cd54291-437e-4166-a8fb-d4f32fa0f1ef tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 1.799347 Aug 29 15:51:02.367830 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1687/3411] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:00 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:02.382565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-46915f7f-0e05-4261-8b35-865a11f82369 req-0ecc70d8-5de6-4e7c-8683-f4f9bde7d720 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.383063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-46915f7f-0e05-4261-8b35-865a11f82369 req-0ecc70d8-5de6-4e7c-8683-f4f9bde7d720 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.383543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-46915f7f-0e05-4261-8b35-865a11f82369 req-0ecc70d8-5de6-4e7c-8683-f4f9bde7d720 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.413803 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-46915f7f-0e05-4261-8b35-865a11f82369 req-0ecc70d8-5de6-4e7c-8683-f4f9bde7d720 service nova] Creating event network-changed:86097462-00f9-434b-9742-3d5d64dbf7f2 for instance 7e8846f9-fc4d-4589-959f-51730b4a1924 on n-h2-836830-13 Aug 29 15:51:02.436490 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-46915f7f-0e05-4261-8b35-865a11f82369 req-0ecc70d8-5de6-4e7c-8683-f4f9bde7d720 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104749 Aug 29 15:51:02.437102 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1725/3412] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:02.774299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:02.775731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:02.791233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.792031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.792523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:02.793445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:02.793922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:02.794361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.077018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:03.091633 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-213dc610-9350-4b30-b4df-9824eabd7ae1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 0.321292 Aug 29 15:51:03.094741 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1688/3413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:02 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:03.394652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:03.395834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:03.424424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.424943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.425394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:03.426121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:03.426585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:03.427016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.007293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.023351 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc07f7c6-04ab-428b-b6e4-989178e1f63d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.631253 Aug 29 15:51:04.024022 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1726/3414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:03 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:04.122882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:04.124327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:04.141023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.145533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.148654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.154805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:04.158809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:04.160243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:04.604578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:04.622947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2cdf0382-1e31-48ed-a868-8a273c9df744 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 0.506950 Aug 29 15:51:04.626847 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1689/3415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:04 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:04.788078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-91d32f37-fda6-4f4e-a557-1a8e34115294 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee3c4160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:04.879453 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-91d32f37-fda6-4f4e-a557-1a8e34115294 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/60a19e51-fc43-4ccf-b450-ea623f344bd0" status: 200 len: 351 microversion: 2.1 time: 0.095351 Aug 29 15:51:04.887818 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1727/3416] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:51:04 2022] GET /compute/v2.1/os-volumes/60a19e51-fc43-4ccf-b450-ea623f344bd0 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:05.046599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:05.047791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:05.057717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.058649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.059619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.061854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.062846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.063639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.134566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1323299209", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "71b57c17-5556-4b2a-bd16-e50234163671"}], "security_groups": [{"name": "tempest-securitygroup--1837056042"}], "key_name": "tempest-keypair-1412321609", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:05.163825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:05.375757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:05.387864 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-463b6183-70b4-4823-8112-6e0b1c2b59e2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.345895 Aug 29 15:51:05.394121 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1690/3417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:05 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:05.497165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] validate_networks() for [('71b57c17-5556-4b2a-bd16-e50234163671', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:05.645937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:05.646577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:05.658772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.659557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.661002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.661973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:05.662116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:05.680948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:05.999493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:06.012697 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7fa9cac-73fd-4b30-bffa-0308f72aa9b4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 0.370151 Aug 29 15:51:06.013228 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1691/3418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:05 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:06.416904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:06.418504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:06.437388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.439692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.443541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.445554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:06.446515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:06.449150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:06.998299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:07.054227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:07.072322 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73199c24-3955-40a7-b4e0-891ef140811d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.659884 Aug 29 15:51:07.073187 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1692/3419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:06 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:07.083258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.084070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:07.099264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.099770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.100213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.100927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.101387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.101817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.391198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:07.402202 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-95105844-6404-4aa8-a31a-2c85a157c6b1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 0.327706 Aug 29 15:51:07.404034 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1693/3420] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:07.581725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Getting quotas for project a8591065e9fa421b8e44767aa38fd84f. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:07.598717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Getting quotas for user a3e14fd42e5942199e28335124d59c75 and project a8591065e9fa421b8e44767aa38fd84f. Resources: dict_keys(['metadata_items']) {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:07.616289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0b1af30-c570-4d22-8103-c424ae1331a9 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee240af0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.655572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:07.656128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:07.656702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:07.657244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:07.657739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:07.677286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.677895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.681611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.682592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:07.683202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:07.684286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:07.708740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0b1af30-c570-4d22-8103-c424ae1331a9 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/8a76d3b8-878b-4c03-9fbe-a13cafeea84a" status: 200 len: 350 microversion: 2.1 time: 0.096949 Aug 29 15:51:07.717654 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1694/3421] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/os-volumes/8a76d3b8-878b-4c03-9fbe-a13cafeea84a => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:07.724474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-86bb84dc-ab94-41df-99c2-b7bbb39c8400 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32f2ab0820>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.735269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Getting quotas for project a8591065e9fa421b8e44767aa38fd84f. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:07.745311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Getting quotas for user a3e14fd42e5942199e28335124d59c75 and project a8591065e9fa421b8e44767aa38fd84f. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:07.787932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:07.792142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:07.867681 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-86bb84dc-ab94-41df-99c2-b7bbb39c8400 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.148963 Aug 29 15:51:07.868704 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1695/3422] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:07.885410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e3e8f2c-f1b8-4a45-9ff4-8800917ac8a9 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32f2aa73a0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.913087 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-869ff8ae-cb38-49ef-a723-70d34f8dcaa3 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.783734 Aug 29 15:51:07.923199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1728/3423] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:05 2022] POST /compute/v2.1/servers => generated 407 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:07.932708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d5826ad-5e9a-418e-af6d-93cbed18cfb5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:07.935647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d5826ad-5e9a-418e-af6d-93cbed18cfb5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:08.081343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d5826ad-5e9a-418e-af6d-93cbed18cfb5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:08.095454 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d5826ad-5e9a-418e-af6d-93cbed18cfb5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1270 microversion: 2.1 time: 0.169700 Aug 29 15:51:08.110531 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1729/3424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:08.116494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.117423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:08.124983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.125931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.126650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.127994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.128738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.129437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.208249 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e3e8f2c-f1b8-4a45-9ff4-8800917ac8a9 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.327379 Aug 29 15:51:08.208958 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1696/3425] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 15:51:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:08.223795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d8113d5-144f-43a4-bc39-5495616ab16c tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee37a280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.478120 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d8113d5-144f-43a4-bc39-5495616ab16c tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.257937 Aug 29 15:51:08.479602 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1697/3426] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:08.494096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.497699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:08.502047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:08.507260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:08.514947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.516263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.517749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.518878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:08.520336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:08.521155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:08.525708 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1f34855-8e51-46e5-90e0-700bf836b147 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.412007 Aug 29 15:51:08.527397 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1730/3427] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:08.534101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca740c97-bfa6-4125-b3cf-dd7c49d17d55 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee780040>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.738048 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca740c97-bfa6-4125-b3cf-dd7c49d17d55 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.208687 Aug 29 15:51:08.739993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1731/3428] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:08.753657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9ce0979-0683-4ebe-806a-a846ff038ef1 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee424ee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:08.881218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:08.896174 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9803c957-1ce2-4c63-9f0d-8a82828410ba tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 0.414462 Aug 29 15:51:08.896979 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1698/3429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:08.921697 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9ce0979-0683-4ebe-806a-a846ff038ef1 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.171876 Aug 29 15:51:08.922354 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1732/3430] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:08.937290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-517e5d5a-8317-4189-9bbf-8db992281e43 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee240820>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.117774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.119358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:09.128356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.131917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.132721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.134890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.135065 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-517e5d5a-8317-4189-9bbf-8db992281e43 tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.201622 Aug 29 15:51:09.135678 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1699/3431] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:51:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:09.136295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.137674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.148805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1bef51e6-bc18-4e05-a9db-420d1fb8944f tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32ee82da60>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.343735 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1bef51e6-bc18-4e05-a9db-420d1fb8944f tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.198617 Aug 29 15:51:09.344597 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1700/3432] 10.222.0.83 () {58 vars in 1188 bytes} [Mon Aug 29 15:51:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:09.359860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-106405fc-0e94-480d-8e9c-77cdd44a617c tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] Calling method '.version_select at 0x7f32f2a47b80>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.387586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:09.396264 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a630646-0c97-4bcb-8f2e-ffbd20fcaa45 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1266 microversion: 2.1 time: 0.282947 Aug 29 15:51:09.400876 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1733/3433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:09 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:09.553091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:09.554092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:09.567975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.569686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.569914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-106405fc-0e94-480d-8e9c-77cdd44a617c tempest-VolumesTestJSON-1389077983 tempest-VolumesTestJSON-1389077983-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.215443 Aug 29 15:51:09.570136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.571932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.572143 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1701/3434] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 15:51:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:09.574195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.575973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.923507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-998b041e-a9d1-47eb-aaf8-d40438e33a5d req-7b132254-b175-466e-916c-d3a80dc95cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb734f6-bc3c-45ac-af35-5e727217dcdd", "name": "network-vif-plugged", "status": "completed", "tag": "11d44c95-4c88-4a86-b86c-c30b1845fa2f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:09.957056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-998b041e-a9d1-47eb-aaf8-d40438e33a5d req-7b132254-b175-466e-916c-d3a80dc95cc8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:09.958057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-998b041e-a9d1-47eb-aaf8-d40438e33a5d req-7b132254-b175-466e-916c-d3a80dc95cc8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:09.965032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-998b041e-a9d1-47eb-aaf8-d40438e33a5d req-7b132254-b175-466e-916c-d3a80dc95cc8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:09.990440 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-998b041e-a9d1-47eb-aaf8-d40438e33a5d req-7b132254-b175-466e-916c-d3a80dc95cc8 service nova] Creating event network-vif-plugged:11d44c95-4c88-4a86-b86c-c30b1845fa2f for instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd on n-h2-836830-13 Aug 29 15:51:10.002985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:10.026876 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f6c5cf0-e601-48e4-9fb6-9dc50f53dcab tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.471102 Aug 29 15:51:10.027521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-998b041e-a9d1-47eb-aaf8-d40438e33a5d req-7b132254-b175-466e-916c-d3a80dc95cc8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120494 Aug 29 15:51:10.028358 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1702/3435] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:10.030051 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1734/3436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:09 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:10.042768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:10.050059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:10.069620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.076664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.077333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.078115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.078606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.079137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.422177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:10.435516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:10.456913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.458826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.461783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.462818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:10.463539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:10.466561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:10.542100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:10.553896 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da49aef3-58ec-4c2e-b9a6-e9b6670822c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 0.522280 Aug 29 15:51:10.556330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1703/3437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:10 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:10.700702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:10.710399 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-505859a4-2666-477c-be37-09f15147b794 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1328 microversion: 2.1 time: 0.292359 Aug 29 15:51:10.712676 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1735/3438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:10 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1328 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:10.945284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-403854035", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "cbbdb120-c59f-45ff-973c-63435652ab18"}], "security_groups": [{"name": "tempest-securitygroup--1480275373"}], "key_name": "tempest-keypair-1940067481", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "edba1e92-ba8c-40c8-bfee-a930ad523427", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:11.054244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:11.054864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:11.073230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.075169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.075683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.076338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.076879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.077304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.194026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] validate_networks() for [('cbbdb120-c59f-45ff-973c-63435652ab18', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:11.610913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:11.629474 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-198661cb-e127-407f-80be-c56e2e0ad439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.578292 Aug 29 15:51:11.648138 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1736/3439] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:11 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:11.662624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:11.663330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:11.704179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.704869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.706906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.709005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.710317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Getting quotas for project 6d1b9fcde555493f86ea437619efbea9. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:11.715136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.720562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.725941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Getting quotas for user d008ed466820477197b94d0c18f7eb1c and project 6d1b9fcde555493f86ea437619efbea9. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:11.761528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:11.761960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:11.762437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:11.762850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:11.768057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:11.787957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.788839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.789445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.790609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:11.791342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:11.791929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:11.814174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Getting quotas for project 6d1b9fcde555493f86ea437619efbea9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:11.822078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Getting quotas for user d008ed466820477197b94d0c18f7eb1c and project 6d1b9fcde555493f86ea437619efbea9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:11.909585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:11.912860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edba1e92-ba8c-40c8-bfee-a930ad523427',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:12.157138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a1850080-8464-4b07-a296-de4d108c7f87 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.216415 Aug 29 15:51:12.158865 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1704/3440] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:51:10 2022] POST /compute/v2.1/servers => generated 407 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:51:12.167776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:12.168906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:12.183892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.184871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.185526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.186474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.187744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.189197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.399693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:12.415545 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88886dcc-87fb-423f-ae59-8e71b4c0ef59 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1328 microversion: 2.1 time: 0.254478 Aug 29 15:51:12.418686 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1705/3441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:12 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1328 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:12.447301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-129e7d39-b9fb-4404-a17e-31e420c952f0 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:12.448766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-129e7d39-b9fb-4404-a17e-31e420c952f0 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:12.550561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-129e7d39-b9fb-4404-a17e-31e420c952f0 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:12.571452 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-129e7d39-b9fb-4404-a17e-31e420c952f0 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1121 microversion: 2.1 time: 0.151073 Aug 29 15:51:12.575813 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1706/3442] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:12 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1121 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:12.654065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:12.654685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:12.666762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.667301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.667743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:12.668453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:12.668910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:12.673678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.029406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:13.044058 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b544097-6b43-44a4-906e-b56509ac6c0d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.394751 Aug 29 15:51:13.044959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1707/3443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:12 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:13.439710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:13.441587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:13.457372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.459270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.462399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.463656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.466481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.467148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.486510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:13.496845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f507e14-f1b1-4a34-b428-378ae5290274 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1321 microversion: 2.1 time: 1.845905 Aug 29 15:51:13.501777 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1737/3444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:11 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1321 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:13.583583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:13.597579 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1291c213-a915-4f77-9e20-4b9afd242027 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1328 microversion: 2.1 time: 0.161730 Aug 29 15:51:13.598195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:13.598987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:13.607214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.610875 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1708/3445] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:13 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1328 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:13.611079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.611445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.612180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:13.612651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:13.613089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:13.787882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:13.797977 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb93095a-0997-424c-a27d-96875a297cee tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1219 microversion: 2.1 time: 0.203972 Aug 29 15:51:13.808777 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1738/3446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:13 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1219 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:14.069844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:14.070367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:14.088198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.090372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.091473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.097106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.097763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.098443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.524750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:14.525922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:14.540974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.544341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.546919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.547969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.548909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.553047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.723681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:14.734420 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae6a9e4a-b2ca-42ce-9a33-71511ae98272 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.672462 Aug 29 15:51:14.748457 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1709/3447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:14 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:14.759500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:14.760586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:14.788248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.791558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.792261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:14.793094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:14.793638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:14.796002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.265279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.277362 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-84a23cde-9e0a-4779-a456-388e7f2f7350 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 0.527401 Aug 29 15:51:15.277965 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1710/3448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:14 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:15.292791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.293648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.306590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.310576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.311417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.315152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.315812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.316411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.350455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.367039 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aa11fd65-58f4-4423-92a7-b40d20057d3f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1512 microversion: 2.1 time: 0.846596 Aug 29 15:51:15.370576 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1739/3449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:14 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1512 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:15.397877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.398714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.408014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.410031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.412556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.413490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.414123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.415971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.544300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:15.554973 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed7ef8c6-24b8-4f34-8ccd-495d1ac79989 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1237 microversion: 2.1 time: 0.266744 Aug 29 15:51:15.565480 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1711/3450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1237 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:15.774041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:15.775555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:15.794271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.799445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.800264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.801239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:15.801948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:15.802606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:15.808653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:16.476920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:16.488195 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d908477-ca6c-4dab-b5df-9a0a8e3c4809 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1511 microversion: 2.1 time: 1.095760 Aug 29 15:51:16.492586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:16.506123 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3053afe7-d071-4931-936f-29f274be3472 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.747878 Aug 29 15:51:16.507807 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1740/3451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1511 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:16.510555 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1712/3452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:15 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:16.518727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:16.522727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:16.533649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:16.534464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:16.549136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.552352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.553180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.557928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.559049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.559771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.560438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.563112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.575109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.579153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.579808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:16.580520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:16.589176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:16.947484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:16.965469 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4b582c9d-93e5-42df-b737-2cc84c4e17d0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1510 microversion: 2.1 time: 0.437592 Aug 29 15:51:16.971071 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1713/3453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:16 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:16.976184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:16.978282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:16.998373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:16.999678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.001151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.003570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.004494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.007420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.125583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.134238 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0990872-435c-4b78-a6fe-3bec751f9a59 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1237 microversion: 2.1 time: 0.161780 Aug 29 15:51:17.135017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1714/3454] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:16 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1237 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:17.155755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:17.161968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.163215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:17.177349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.178460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.179590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.182359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.184109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.184783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.296942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:17.416109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:17.422619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:17.423164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:17.423611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:17.722608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:18.088756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:18.707908 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c1d09638-97f2-4d84-9d95-1ae132bda91e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.559373 Aug 29 15:51:18.723065 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1715/3455] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 15:51:17 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:18.723065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:18.723065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:18.737771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.738281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.738726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:18.744949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:18.745828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:18.748997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.160466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.208159 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13e14cc9-5269-444f-8d1f-f1168834c388 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 2.697820 Aug 29 15:51:19.209269 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1741/3456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:16 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 2701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:19.242287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d6b13ae5-bdc8-45b1-a3db-2bb15ada889f req-a9d6aca0-5d5b-4afe-af35-ccd2dcce708a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8846f9-fc4d-4589-959f-51730b4a1924", "name": "network-vif-plugged", "status": "completed", "tag": "86097462-00f9-434b-9742-3d5d64dbf7f2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:19.282435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d6b13ae5-bdc8-45b1-a3db-2bb15ada889f req-a9d6aca0-5d5b-4afe-af35-ccd2dcce708a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.282970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d6b13ae5-bdc8-45b1-a3db-2bb15ada889f req-a9d6aca0-5d5b-4afe-af35-ccd2dcce708a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.296084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d6b13ae5-bdc8-45b1-a3db-2bb15ada889f req-a9d6aca0-5d5b-4afe-af35-ccd2dcce708a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.347498 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d6b13ae5-bdc8-45b1-a3db-2bb15ada889f req-a9d6aca0-5d5b-4afe-af35-ccd2dcce708a service nova] Creating event network-vif-plugged:86097462-00f9-434b-9742-3d5d64dbf7f2 for instance 7e8846f9-fc4d-4589-959f-51730b4a1924 on n-h2-836830-13 Aug 29 15:51:19.365361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d6b13ae5-bdc8-45b1-a3db-2bb15ada889f req-a9d6aca0-5d5b-4afe-af35-ccd2dcce708a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139625 Aug 29 15:51:19.370182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.377850 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1742/3457] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:19.394524 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-869fa5ec-0428-4a13-9681-b6726d4ef7b3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 0.682173 Aug 29 15:51:19.395667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1716/3458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:18 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:19.403676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.404759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:19.409876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:19.427559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.437518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1363174631', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:19.443304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.444777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.445244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.446063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.461754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.462326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.468844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.469505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.469964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.481592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.482657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.485973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:19.781932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:19.969787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:19.988215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:19.989265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:19.990094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.428513 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-691faa1b-fae4-45d5-9322-ddbbeed43109 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1363174631" status: 200 len: 1514 microversion: 2.1 time: 1.031483 Aug 29 15:51:20.429246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1717/3459] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 15:51:19 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1363174631 => generated 1514 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:20.435122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:20.436063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:20.476192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.485772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.488127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.489916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.492044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.496362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.748701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:20.764711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f2aa4d0-78cf-4b9d-9038-905c98842b89 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1305 microversion: 2.1 time: 1.379699 Aug 29 15:51:20.804596 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1743/3460] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:19 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1305 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:20.822488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:20.826571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:20.843716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.844240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.844913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:20.846946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:20.847854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:20.849195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.235843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.245475 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-019bf7c0-7d6c-4d84-9ddf-17cda1984477 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 0.814909 Aug 29 15:51:21.249559 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1718/3461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:20 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:21.263728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:21.275847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.287880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:21.301072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.301807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.302422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.303355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.303967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.304562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.542637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:21.706702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:21.722453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.722958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.723450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.917796 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05a328d4-af38-4a6d-8cf8-e0d972f1c5f2 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.666538 Aug 29 15:51:21.939680 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1719/3462] 10.222.0.83 () {58 vars in 1173 bytes} [Mon Aug 29 15:51:21 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:21.945187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-cba2cd95-9832-4028-bf94-7e01213a5133 req-0ba678c6-0c9b-46cf-abcc-573fc13a6c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b64abb5-ddcc-41db-8e94-aafadbc5bad8", "tag": "19c65448-4185-4334-b94b-0352f0c971a3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:21.956944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cba2cd95-9832-4028-bf94-7e01213a5133 req-0ba678c6-0c9b-46cf-abcc-573fc13a6c8b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.957716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cba2cd95-9832-4028-bf94-7e01213a5133 req-0ba678c6-0c9b-46cf-abcc-573fc13a6c8b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.958325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cba2cd95-9832-4028-bf94-7e01213a5133 req-0ba678c6-0c9b-46cf-abcc-573fc13a6c8b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.971780 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-cba2cd95-9832-4028-bf94-7e01213a5133 req-0ba678c6-0c9b-46cf-abcc-573fc13a6c8b service nova] Creating event network-changed:19c65448-4185-4334-b94b-0352f0c971a3 for instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 on n-h1-836830-13 Aug 29 15:51:21.977570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-cba2cd95-9832-4028-bf94-7e01213a5133 req-0ba678c6-0c9b-46cf-abcc-573fc13a6c8b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036434 Aug 29 15:51:21.979078 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1720/3463] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:21.985666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:21.987906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:21.996462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.997330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:21.998065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:21.998994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:21.999701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.001538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.344185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.358882 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d826dc56-52dd-49c9-98fa-8ff02cc6acb6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1313 microversion: 2.1 time: 1.548227 Aug 29 15:51:22.375896 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1744/3464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:20 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1313 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:22.381053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:22.396448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.402349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.404519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.servers [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Removing options 'limit' from query {{(pid=129132) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:51:22.405463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:22.410882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31d59889-d462-4456-a53f-9d74f283b973 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1305 microversion: 2.1 time: 0.430030 Aug 29 15:51:22.411500 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1721/3465] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:21 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1305 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:22.424855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:22.432930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:22.460605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.464634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.465901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.467318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.467884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.469154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.470164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.471194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.472636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.475564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.475721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.480682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:22.601291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:22.622024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:22.622504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:22.622936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.141620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:23.159548 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-473b8d10-5abd-47ac-84dd-0e96abe703e5 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 0.746628 Aug 29 15:51:23.162510 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1722/3466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:22 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:23.292084 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28e2ba35-8cb2-49ae-98b9-05c178fc5ec9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.929094 Aug 29 15:51:23.292811 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1745/3467] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 15:51:22 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:23.317422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.324038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:23.324895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:23.367304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.371050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.371537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.372307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.377583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.381272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.383611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.383611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:23.390516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.391040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.406040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.412160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.418502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.419281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.608492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:23.713772 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15e76806-d8b0-455f-9ed8-2d377571c465 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.399975 Aug 29 15:51:23.715172 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1723/3468] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:23.723668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:23.724993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:23.734778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.735666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.736295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:23.737460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:23.738301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:23.738934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.235204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.247095 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-32ea3e15-d3a3-413e-a7d9-d72fc32b09a9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1305 microversion: 2.1 time: 0.530593 Aug 29 15:51:24.252238 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1724/3469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1305 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:24.266487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:24.279747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.280357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.servers [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Removing options 'limit' from query {{(pid=129133) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:51:24.282228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:24.295538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.300465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.301190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.303196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.303789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.304303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.319521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:24.339422 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4cba81f7-07df-47af-a3b0-58a6e1dff9ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1499 microversion: 2.1 time: 0.958520 Aug 29 15:51:24.340062 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1746/3470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:23 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1499 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:24.379183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:24.453768 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4cd1bc00-2a83-441d-a204-e482e918bca1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.200232 Aug 29 15:51:24.464008 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1725/3471] 10.222.0.83 () {58 vars in 1150 bytes} [Mon Aug 29 15:51:24 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:24.470855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:24.473624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:24.492419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.493212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.495960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.497952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:24.501618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:24.503712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:24.990845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-730791012", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "cdea073e-26d3-4946-bc21-0f28686cfa88"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:25.120222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] validate_networks() for [('cdea073e-26d3-4946-bc21-0f28686cfa88', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:51:25.227967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.237404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:25.243492 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42f24e63-3b77-4d42-86cd-b6efbc74384a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 0.783554 Aug 29 15:51:25.244592 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1726/3472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:24 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:25.260543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:25.263849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.282471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.282997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.283625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.284387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.284858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.285291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.332854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lazy-loading 'flavor' on Instance uuid 7e8846f9-fc4d-4589-959f-51730b4a1924 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:25.464891 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c9705f77-257f-4b38-9e8c-33f520a541a5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "POST /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924/action" status: 200 len: 32 microversion: 2.1 time: 0.215462 Aug 29 15:51:25.468361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1727/3473] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:25 2022] POST /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:51:25.480644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.495842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.499706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:25.511794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.514751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.515594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.517129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.518938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.520325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.598035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:25.639528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30b76940-1fa7-44dc-8d9d-a46aaeb69567 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.169594 Aug 29 15:51:25.640391 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1728/3474] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers => generated 1011 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:25.645477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6ea6f8bf-81ec-465c-a160-6b479f0bd7b9 req-7f5bf2ab-6b44-498d-967f-00e0ce4b3573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b28d1d0-b6c2-4164-b006-4a3bcac6274c", "tag": "80fb79a2-3f36-4e29-bf67-fd13b72df86e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:25.658497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ea6f8bf-81ec-465c-a160-6b479f0bd7b9 req-7f5bf2ab-6b44-498d-967f-00e0ce4b3573 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.659149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ea6f8bf-81ec-465c-a160-6b479f0bd7b9 req-7f5bf2ab-6b44-498d-967f-00e0ce4b3573 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.659698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ea6f8bf-81ec-465c-a160-6b479f0bd7b9 req-7f5bf2ab-6b44-498d-967f-00e0ce4b3573 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.675418 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6ea6f8bf-81ec-465c-a160-6b479f0bd7b9 req-7f5bf2ab-6b44-498d-967f-00e0ce4b3573 service nova] Creating event network-changed:80fb79a2-3f36-4e29-bf67-fd13b72df86e for instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c on n-h2-836830-13 Aug 29 15:51:25.682078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6ea6f8bf-81ec-465c-a160-6b479f0bd7b9 req-7f5bf2ab-6b44-498d-967f-00e0ce4b3573 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039567 Aug 29 15:51:25.682786 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1729/3475] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:25.688002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:25.688909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:25.695719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.696966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.703535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.703535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:25.703535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:25.703535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:25.968435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:25.977733 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c09e4c1d-8512-4aa4-8d59-d99cd6209971 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1305 microversion: 2.1 time: 0.293079 Aug 29 15:51:25.982836 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1730/3476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1305 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:25.988542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.010520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:26.021257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.021845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.022360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.023214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.023746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.024924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.436029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.445945 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30f269f5-21c1-4e6d-99bb-85abb3743096 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.461913 Aug 29 15:51:26.451884 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1731/3477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:25 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:26.467085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:26.496178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:26.499992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:26.571461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.572376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.572534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.579943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:26.580479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:26.580909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:26.879483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:27.046717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7c6b5d3-5eb1-457d-85a6-30e18a4ae989 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.578136 Aug 29 15:51:27.054647 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1732/3478] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:51:26 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:27.054647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:27.054647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:27.067098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:27.069079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.069515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.069855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.070636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.071231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.071665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.637939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:27.650480 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-685c7a78-19bc-4b3c-89cd-887baf4e75d1 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 0.600585 Aug 29 15:51:27.655777 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1733/3479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:27 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:27.660766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:27.669432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:27.684463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.687915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.689007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.690304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.691178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.692726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.902005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:51:27.902582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:51:27.903363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:51:27.903800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:51:27.904219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:51:27.938013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.938510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.938955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.943927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:27.943927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:27.943927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:27.990012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Getting quotas for project befd8f594a954a1ea3ea172fafed14a3. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:51:28.004064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Getting quotas for user 00dee611719b433284d4258833021ec6 and project befd8f594a954a1ea3ea172fafed14a3. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:51:28.035156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:51:28.039336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:51:28.112035 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-287df715-a9d5-44bc-9275-354bbdde42b2 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1814 microversion: 2.1 time: 0.454758 Aug 29 15:51:28.113279 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1734/3480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:27 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1814 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:28.137121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.138673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.160344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.163242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.171885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.173284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.173985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.174634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.176817 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-53f4f8de-c1b2-4696-91aa-4aacabaa812b tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.834438 Aug 29 15:51:28.177415 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1747/3481] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3837 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:51:28.195472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.236316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.241276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.servers [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Removing options 'limit' from query {{(pid=129132) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:51:28.246008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:28.264512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.265929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.270015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.277296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.278013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.279604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.346148 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-944cc7c4-e0cc-414a-8e89-dbb543f48dd7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.162863 Aug 29 15:51:28.346747 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1748/3482] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:28.351344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.351962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.362592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.363382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.364212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.365094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.365712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.366296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.518651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.544162 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3d9e2dd-fcbf-4641-92f1-1bb5b4d604ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.411127 Aug 29 15:51:28.548854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1735/3483] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:28.578954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.589213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.589697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.590141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.594761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.596951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.597528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.668698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53ac26cb-fc34-4d20-a874-29caafb879b9 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.117433 Aug 29 15:51:28.669332 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1736/3484] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:28.679072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ebedbd42-5d2c-45a3-9639-391f95824e45 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.686067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ebedbd42-5d2c-45a3-9639-391f95824e45 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.760958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.790773 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-12c96d41-1951-4ee7-871f-fba6ab9e9b93 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.440930 Aug 29 15:51:28.792368 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1749/3485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:28.817329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.830766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.835460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1363174631', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:28.855844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.856626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebedbd42-5d2c-45a3-9639-391f95824e45 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.857263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.858411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.861909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.862571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.864307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.869359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebedbd42-5d2c-45a3-9639-391f95824e45 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.872960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebedbd42-5d2c-45a3-9639-391f95824e45 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:28.879235 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ebedbd42-5d2c-45a3-9639-391f95824e45 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1261 microversion: 2.26 time: 0.207156 Aug 29 15:51:28.879755 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1737/3486] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:28.887390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:28.892982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:28.916170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.916684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.917128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:28.919580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:28.920048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:28.923338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.062755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:29.174480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:29.187559 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a12b9e9c-26e5-4c1b-98b3-0f46bae45e83 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 0.304656 Aug 29 15:51:29.188171 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1738/3487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:29.229076 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e1bc50d-af9f-4e11-873a-f2c7d62ed596 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1363174631" status: 200 len: 346 microversion: 2.1 time: 0.418620 Aug 29 15:51:29.231699 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1750/3488] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:51:28 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1363174631 => generated 346 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:29.244288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-95e12246-35b8-4595-aef1-ec4cc0446469 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:29.251400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95e12246-35b8-4595-aef1-ec4cc0446469 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.252224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95e12246-35b8-4595-aef1-ec4cc0446469 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.265739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95e12246-35b8-4595-aef1-ec4cc0446469 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.325909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-95e12246-35b8-4595-aef1-ec4cc0446469 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Going to try to stop instance {{(pid=129133) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:51:29.433963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b094f27-a838-4c1e-9484-8dfcfe0cf486 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Action: 'create', calling method: .version_select at 0x7f32edca5c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-49161426", "metadata": {"Type": "work"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:29.435678 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-95e12246-35b8-4595-aef1-ec4cc0446469 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "POST /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12/action" status: 202 len: 0 microversion: 2.1 time: 0.195847 Aug 29 15:51:29.437040 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1739/3489] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:29 2022] POST /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b094f27-a838-4c1e-9484-8dfcfe0cf486 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Request method failure captured: Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 120 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOCBhy4jYJUtFVijXu55XLO7G9bgwnxDX3zJzYci2Z3LbGgC45cUyTFrcVMQ1nBYIzS_5z4NrICi6JeNc6usaWqUMW-H5Xf-l6e2wBrlI4ONQ9oVh-3PVMRPgyGy295FdYXDDM5sC-myFqr2xYBGIlH34f2JB59UJ8ZZNvLPu9slcvw Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea52cef4ca497b904c97ab9e5b8500", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea52cef4ca497b904c97ab9e5b8500"}]}] Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 28b5bdf9d4904401b5c1cdd35c290e11 Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-49161426", "metadata": {"Type": "work"}}} Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-49161426', 'metadata': {'Type': 'work'}}}} Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:29.454464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.459422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b094f27-a838-4c1e-9484-8dfcfe0cf486 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:29.460193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.460278 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b094f27-a838-4c1e-9484-8dfcfe0cf486 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.208636 Aug 29 15:51:29.460361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.465889 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1751/3490] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 15:51:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:29.479883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.480448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.480905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.481643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.482103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.482562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.494163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e0f5516-6457-433a-a674-0d514011da8e tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Action: 'create', calling method: .version_select at 0x7f32ee6913a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1704101404", "metadata": {"Type": "work"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e0f5516-6457-433a-a674-0d514011da8e tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Request method failure captured: Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 120 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOCBhy4jYJUtFVijXu55XLO7G9bgwnxDX3zJzYci2Z3LbGgC45cUyTFrcVMQ1nBYIzS_5z4NrICi6JeNc6usaWqUMW-H5Xf-l6e2wBrlI4ONQ9oVh-3PVMRPgyGy295FdYXDDM5sC-myFqr2xYBGIlH34f2JB59UJ8ZZNvLPu9slcvw Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea52cef4ca497b904c97ab9e5b8500", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea52cef4ca497b904c97ab9e5b8500"}]}] Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 28b5bdf9d4904401b5c1cdd35c290e11 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1704101404", "metadata": {"Type": "work"}}} Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1704101404', 'metadata': {'Type': 'work'}}}} Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '0' Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:29.507239 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 15:51:29.513118 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.531783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e0f5516-6457-433a-a674-0d514011da8e tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:29.538391 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e0f5516-6457-433a-a674-0d514011da8e tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.069650 Aug 29 15:51:29.542550 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1752/3491] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 15:51:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:29.566216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cd58feec-f60a-490f-95ef-fdaf3ebf7bbc tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Action: 'create', calling method: .version_select at 0x7f32edc0fca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-516427963", "metadata": {"Type": "work"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cd58feec-f60a-490f-95ef-fdaf3ebf7bbc tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Request method failure captured: Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 118 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOCBhy4jYJUtFVijXu55XLO7G9bgwnxDX3zJzYci2Z3LbGgC45cUyTFrcVMQ1nBYIzS_5z4NrICi6JeNc6usaWqUMW-H5Xf-l6e2wBrlI4ONQ9oVh-3PVMRPgyGy295FdYXDDM5sC-myFqr2xYBGIlH34f2JB59UJ8ZZNvLPu9slcvw Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea52cef4ca497b904c97ab9e5b8500", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea52cef4ca497b904c97ab9e5b8500"}]}] Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 28b5bdf9d4904401b5c1cdd35c290e11 Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-516427963", "metadata": {"Type": "work"}}} Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-516427963', 'metadata': {'Type': 'work'}}}} Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '' Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:51:29.578997 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 15:51:29.584738 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.597475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cd58feec-f60a-490f-95ef-fdaf3ebf7bbc tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:29.599726 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cd58feec-f60a-490f-95ef-fdaf3ebf7bbc tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.051564 Aug 29 15:51:29.604687 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1753/3492] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 15:51:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:29.621682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.622620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.638761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.640267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.641295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.644061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.644731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.645327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.707850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:29.716555 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f2df1dc9-6be7-43fc-b525-07822f77e2b7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.274869 Aug 29 15:51:29.717701 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1740/3493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:29 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:29.726526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-eb80a8ee-7b06-4d93-9637-9c399fba0c68 req-84574301-b483-44ff-9997-51a902b29571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b64abb5-ddcc-41db-8e94-aafadbc5bad8", "name": "network-vif-plugged", "status": "completed", "tag": "19c65448-4185-4334-b94b-0352f0c971a3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:29.753504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eb80a8ee-7b06-4d93-9637-9c399fba0c68 req-84574301-b483-44ff-9997-51a902b29571 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.753991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eb80a8ee-7b06-4d93-9637-9c399fba0c68 req-84574301-b483-44ff-9997-51a902b29571 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.754478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eb80a8ee-7b06-4d93-9637-9c399fba0c68 req-84574301-b483-44ff-9997-51a902b29571 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.772032 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-eb80a8ee-7b06-4d93-9637-9c399fba0c68 req-84574301-b483-44ff-9997-51a902b29571 service nova] Creating event network-vif-plugged:19c65448-4185-4334-b94b-0352f0c971a3 for instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 on n-h1-836830-13 Aug 29 15:51:29.778366 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-eb80a8ee-7b06-4d93-9637-9c399fba0c68 req-84574301-b483-44ff-9997-51a902b29571 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059046 Aug 29 15:51:29.780136 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1741/3494] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:29.801476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07332cd6-d50c-4925-a719-00090b96861c tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Calling method '.version_select at 0x7f32edcaaf70>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.876157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-07332cd6-d50c-4925-a719-00090b96861c tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] HTTP exception thrown: Volume tempest-invalid-1342906674 could not be found. Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07332cd6-d50c-4925-a719-00090b96861c tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Request method failure captured: Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1342906674 HTTP/1.1 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOCBhy4jYJUtFVijXu55XLO7G9bgwnxDX3zJzYci2Z3LbGgC45cUyTFrcVMQ1nBYIzS_5z4NrICi6JeNc6usaWqUMW-H5Xf-l6e2wBrlI4ONQ9oVh-3PVMRPgyGy295FdYXDDM5sC-myFqr2xYBGIlH34f2JB59UJ8ZZNvLPu9slcvw Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea52cef4ca497b904c97ab9e5b8500", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea52cef4ca497b904c97ab9e5b8500"}]}] Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 28b5bdf9d4904401b5c1cdd35c290e11 Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: exception: Volume tempest-invalid-1342906674 could not be found. Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'tempest-invalid-1342906674'} Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1342906674 could not be found. (HTTP 404) (Request-ID: req-385435ec-5158-486b-b583-42cdefbdb626) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:51:29.878998 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1342906674 could not be found. Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1342906674 could not be found. Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1342906674 could not be found. Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07332cd6-d50c-4925-a719-00090b96861c tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Returning 404 to user: Volume tempest-invalid-1342906674 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-07332cd6-d50c-4925-a719-00090b96861c tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1342906674" status: 404 len: 99 microversion: 2.1 time: 0.097351 Aug 29 15:51:29.886157 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1742/3495] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:51:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1342906674 => generated 99 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:51:29.907957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:29.908721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:29.926819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.927336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.927984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:29.928843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:29.929458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:29.930042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.133791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.141070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:30.147060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a90a0305-1730-4f31-aeca-97135ee24055 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.261465 Aug 29 15:51:30.150802 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1743/3496] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:29 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:30.158534 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f52562da-7172-4553-a4b9-c9b73fd3bb77 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006565 Aug 29 15:51:30.161494 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1744/3497] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 15:51:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:51:30.173448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.174076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.183873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.184640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.185236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.186456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.187112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.188135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.345885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.372690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.374175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.375554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:30.387825 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d465883-0911-4998-a195-82b4a07974d5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1313 microversion: 2.26 time: 0.212773 Aug 29 15:51:30.388839 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1745/3498] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:30.402798 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97f907ff-0dab-492b-b954-45a12bede6d6 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012467 Aug 29 15:51:30.405749 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2577bae2-ee5e-4f31-a7ec-0f1e773ac2ab tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.782578 Aug 29 15:51:30.407482 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1754/3499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:29 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:30.419980 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1746/3500] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 15:51:30.423148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7238465e-4fd4-4407-8cf2-9cd0722eaae5 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Calling method '.version_select at 0x7f32edcaa550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.468386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.472868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.485123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.485625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.487006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7238465e-4fd4-4407-8cf2-9cd0722eaae5 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] HTTP exception thrown: Volume f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 could not be found. Aug 29 15:51:30.487269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.487995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.488839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.489454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7238465e-4fd4-4407-8cf2-9cd0722eaae5 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Request method failure captured: Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-volumes/f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 HTTP/1.1 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOCBhy4jYJUtFVijXu55XLO7G9bgwnxDX3zJzYci2Z3LbGgC45cUyTFrcVMQ1nBYIzS_5z4NrICi6JeNc6usaWqUMW-H5Xf-l6e2wBrlI4ONQ9oVh-3PVMRPgyGy295FdYXDDM5sC-myFqr2xYBGIlH34f2JB59UJ8ZZNvLPu9slcvw Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea52cef4ca497b904c97ab9e5b8500", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea52cef4ca497b904c97ab9e5b8500"}]}] Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 28b5bdf9d4904401b5c1cdd35c290e11 Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: exception: Volume f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 could not be found. Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1'} Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 could not be found. (HTTP 404) (Request-ID: req-c06bd579-e3b3-41a5-b0cc-35df434d9987) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:51:30.490063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 could not be found. Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 could not be found. Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 could not be found. Aug 29 15:51:30.495844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.498974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7238465e-4fd4-4407-8cf2-9cd0722eaae5 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Returning 404 to user: Volume f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:30.501689 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7238465e-4fd4-4407-8cf2-9cd0722eaae5 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1" status: 404 len: 109 microversion: 2.1 time: 0.082340 Aug 29 15:51:30.505584 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1747/3501] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:51:30 2022] DELETE /compute/v2.1/os-volumes/f1e3f7f6-2b88-4144-a0e1-f5ae04d61ea1 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:30.512377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c7f26d6-52ca-40d4-b681-e51e8b519736 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Calling method '.version_select at 0x7f32f291b040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.608114 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2c7f26d6-52ca-40d4-b681-e51e8b519736 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] HTTP exception thrown: Volume 08c32e58-5902-4990-b987-5c4c4f80e441 could not be found. Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c7f26d6-52ca-40d4-b681-e51e8b519736 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Request method failure captured: Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-volumes/08c32e58-5902-4990-b987-5c4c4f80e441 HTTP/1.1 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOCBhy4jYJUtFVijXu55XLO7G9bgwnxDX3zJzYci2Z3LbGgC45cUyTFrcVMQ1nBYIzS_5z4NrICi6JeNc6usaWqUMW-H5Xf-l6e2wBrlI4ONQ9oVh-3PVMRPgyGy295FdYXDDM5sC-myFqr2xYBGIlH34f2JB59UJ8ZZNvLPu9slcvw Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ecea52cef4ca497b904c97ab9e5b8500", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ecea52cef4ca497b904c97ab9e5b8500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ecea52cef4ca497b904c97ab9e5b8500"}]}] Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: ecea52cef4ca497b904c97ab9e5b8500 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesNegativeTest-1965417751 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 28b5bdf9d4904401b5c1cdd35c290e11 Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesNegativeTest-1965417751-project Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: exception: Volume 08c32e58-5902-4990-b987-5c4c4f80e441 could not be found. Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '08c32e58-5902-4990-b987-5c4c4f80e441'} Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08c32e58-5902-4990-b987-5c4c4f80e441 could not be found. (HTTP 404) (Request-ID: req-474ab16c-13cc-42fc-a81f-13ae22fc8459) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:51:30.611306 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08c32e58-5902-4990-b987-5c4c4f80e441 could not be found. Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08c32e58-5902-4990-b987-5c4c4f80e441 could not be found. Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08c32e58-5902-4990-b987-5c4c4f80e441 could not be found. Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:30.616308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c7f26d6-52ca-40d4-b681-e51e8b519736 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] Returning 404 to user: Volume 08c32e58-5902-4990-b987-5c4c4f80e441 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:30.620542 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c7f26d6-52ca-40d4-b681-e51e8b519736 tempest-VolumesNegativeTest-1965417751 tempest-VolumesNegativeTest-1965417751-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/08c32e58-5902-4990-b987-5c4c4f80e441" status: 404 len: 109 microversion: 2.1 time: 0.112030 Aug 29 15:51:30.626828 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1748/3502] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/os-volumes/08c32e58-5902-4990-b987-5c4c4f80e441 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:51:30.746000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:30.747335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:30.757888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.760777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.762214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:30.767402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:30.768078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:30.768759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.096625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.108757 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed202757-6f39-42a2-a744-aabb66f76301 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1396 microversion: 2.1 time: 0.699996 Aug 29 15:51:31.111942 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1755/3503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1396 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:31.168059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.168923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.178555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.179424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.180186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.181199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.181843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.182450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.246893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.265264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5287a007-e828-4420-9ea4-9dfb90eb87e4 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.525985 Aug 29 15:51:31.289089 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1749/3504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:30 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:31.413274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.414001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.421413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.422043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.422591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.428161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.430136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.431299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.431955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.439654 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-24c57976-ee85-4dd4-bb57-eff4706e1813 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.275592 Aug 29 15:51:31.440846 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1756/3505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:31.449051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:31.449936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.464099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.465103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.465792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.466796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.467452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.468030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.584629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.594251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.595811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.596971 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a06e014f-717a-402b-aa41-0517f8a4622f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1319 microversion: 2.26 time: 0.188188 Aug 29 15:51:31.609406 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1750/3506] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:51:31.694653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41416e10-33a6-4fbe-b7af-a6b4d2fa593c", "device": "/dev/xvdb"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:31.697771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:31.708451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.712611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.713281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.714227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:31.715475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:31.716127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:31.797460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:31.807409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4588ab9d-13bf-4021-9235-0c9ea49a02c8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.365272 Aug 29 15:51:31.820479 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1757/3507] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:31 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:32.134073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:32.134841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.143043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.143686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.144364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.145266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.145735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.146166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.220621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1890f739-5783-482b-9a3d-b3148e79ea8b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "POST /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536345 Aug 29 15:51:32.222250 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1751/3508] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:51:31 2022] POST /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 194 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:32.293668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:32.294381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.312985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.313485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.313919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.314641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.315130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.315561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.318772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:32.329314 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-977a95c1-d729-4f1b-b381-8adadf62ac6a tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1577 microversion: 2.1 time: 0.200435 Aug 29 15:51:32.333848 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1758/3509] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:32 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:32.355861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:32.356618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.366457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.366957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.367422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.377209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.377716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.378255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.536607 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8bc5fbab-7b0f-44e7-ad62-07188116616e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185185 Aug 29 15:51:32.537927 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1759/3510] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:51:32 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:32.556097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:32.559337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:32.576270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.576859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.577276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:32.577991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:32.578460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:32.578919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.018265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.034975 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-50c5b0a4-fb8a-47cc-bf35-955b9dbbc0cf tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.745484 Aug 29 15:51:33.049566 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1752/3511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:32 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:33.063539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:33.066393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:33.078236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.080717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.081786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.083820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.084495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.085164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.183255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.198542 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1cd7c03b-fbf8-47eb-b61e-0e491b798649 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.659281 Aug 29 15:51:33.205421 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1760/3512] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:32 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:33.210941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:33.216094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:33.231220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.235905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.236949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.237944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:33.238644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:33.243530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:33.407188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.424897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.426635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:33.429909 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d152984-6cc8-4171-8286-25a180fb9b19 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1319 microversion: 2.26 time: 0.371722 Aug 29 15:51:33.431721 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1753/3513] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:33 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:34.062312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.062930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.084596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.085600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.089744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.091868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.095126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.095750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.171788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:34.181923 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce495788-adcc-4e99-8a31-31cc62347b56 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.974777 Aug 29 15:51:34.188128 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1761/3514] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:33 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:34.225897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.226540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.228680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:34.247158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.247935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.248531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.249422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.250037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.250622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.536107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:34.559557 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30b84160-80e1-4e79-a189-301dfbfa2504 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.500526 Aug 29 15:51:34.565722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:34.568330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:34.579771 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1754/3515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:34.583834 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d687a1b1-8719-4805-88ee-5ae2eace0ecb tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.361700 Aug 29 15:51:34.584854 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1762/3516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:34.586862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:34.588188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:34.595487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.596233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.596831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.597741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.598538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.599566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.795113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-153bdc87-3415-44d4-863a-10ccc7f68e3f req-f029cddb-132b-4429-aa84-eaee07c26db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1abcaf-4116-4b73-886a-4de875916884", "tag": "c98bfbdb-3b19-411e-b8b6-e0a7936e93bc"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:34.835260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-153bdc87-3415-44d4-863a-10ccc7f68e3f req-f029cddb-132b-4429-aa84-eaee07c26db8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:34.835767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-153bdc87-3415-44d4-863a-10ccc7f68e3f req-f029cddb-132b-4429-aa84-eaee07c26db8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:34.836193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-153bdc87-3415-44d4-863a-10ccc7f68e3f req-f029cddb-132b-4429-aa84-eaee07c26db8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:34.872304 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-153bdc87-3415-44d4-863a-10ccc7f68e3f req-f029cddb-132b-4429-aa84-eaee07c26db8 service nova] Creating event network-changed:c98bfbdb-3b19-411e-b8b6-e0a7936e93bc for instance 6a1abcaf-4116-4b73-886a-4de875916884 on n-h1-836830-13 Aug 29 15:51:34.883804 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-153bdc87-3415-44d4-863a-10ccc7f68e3f req-f029cddb-132b-4429-aa84-eaee07c26db8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089706 Aug 29 15:51:34.891421 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1763/3517] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:35.062216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.084336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.092023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.097502 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7ba40f3-7b9d-419d-89a2-bcf6544e0b0c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1361 microversion: 2.26 time: 0.516275 Aug 29 15:51:35.099187 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1755/3518] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:34 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:35.223298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.224108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.254918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.255726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.257153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.259352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.269936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.270388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.589719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.592254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.613881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.614384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.614819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.615556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.616014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.618470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.626186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.636264 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6512f31a-768a-401d-92dd-f093421da4b3 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.427908 Aug 29 15:51:35.647000 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1764/3519] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.665372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.666264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.680754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.681678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.682436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.684002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.684671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.685309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.909020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:35.918791 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ae02841-ecf3-41f9-bcc9-604a91c16fee tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.337916 Aug 29 15:51:35.937073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1756/3520] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:35.942834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:35.944523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:35.953391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.954269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.955016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:35.956050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:35.956798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:35.957431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.045718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:36.068696 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-018056a7-e150-42f8-a3d6-4f4fab5eaed9 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.420130 Aug 29 15:51:36.069547 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1765/3521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:36.086823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1d912251-5821-4bc3-a92a-755841f4df6d req-9f476724-ee32-4993-bf4a-4289f9a27d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b64abb5-ddcc-41db-8e94-aafadbc5bad8", "tag": "19c65448-4185-4334-b94b-0352f0c971a3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:36.108853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d912251-5821-4bc3-a92a-755841f4df6d req-9f476724-ee32-4993-bf4a-4289f9a27d2f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.110484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d912251-5821-4bc3-a92a-755841f4df6d req-9f476724-ee32-4993-bf4a-4289f9a27d2f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.110948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d912251-5821-4bc3-a92a-755841f4df6d req-9f476724-ee32-4993-bf4a-4289f9a27d2f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.128303 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1d912251-5821-4bc3-a92a-755841f4df6d req-9f476724-ee32-4993-bf4a-4289f9a27d2f service nova] Creating event network-changed:19c65448-4185-4334-b94b-0352f0c971a3 for instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 on n-h1-836830-13 Aug 29 15:51:36.138943 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1d912251-5821-4bc3-a92a-755841f4df6d req-9f476724-ee32-4993-bf4a-4289f9a27d2f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068024 Aug 29 15:51:36.144225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1766/3522] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:36.161153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.163492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.177784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.179940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.183309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.185927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.186705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.187570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.235427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:36.262276 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-35fe7af0-b9c6-42b8-bbb3-de8ea66ab8ed tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1577 microversion: 2.1 time: 0.317225 Aug 29 15:51:36.262936 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1757/3523] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:35 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1577 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:36.479460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:36.491592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:36.493693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:36.500538 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99b3379d-b952-4241-a33e-fe83d90e938d tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1361 microversion: 2.26 time: 0.351164 Aug 29 15:51:36.501075 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1767/3524] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:36.672974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.674293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.693064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.694062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.695116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.695975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.696434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.699898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.944690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:36.945318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:36.958984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.959519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.959959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:36.960677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:36.961139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:36.969083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.341924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.358294 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-89c97c7c-5060-43d8-b45c-709ccaa07486 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.418371 Aug 29 15:51:37.360002 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1768/3525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:37.369374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.371058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.391205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.392087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.393143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.393549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.396008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.397176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.399144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.408060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78926d2e-fbb4-40d1-90f3-25346144e939 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.742360 Aug 29 15:51:37.412068 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1758/3526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:36 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:37.526339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:37.527760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:37.539237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.540423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.541461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.542922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:37.546803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:37.547384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:37.785636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:37.797191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1336586-774d-4cf6-9d98-e0170e473e08 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.434600 Aug 29 15:51:37.798715 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1769/3527] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:38.161754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.170953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.181584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.182796 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c11a34f2-4529-442e-99a3-f920e142f1ff tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1361 microversion: 2.26 time: 0.662145 Aug 29 15:51:38.198365 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1759/3528] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:37 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1361 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:38.390493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:38.391556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.401711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:38.404028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.404749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.405367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.406462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.407249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.407873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.449167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:38.451169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.472842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.473554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.474140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.475390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.476004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.476586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.624348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=18 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:38.731361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.741853 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c9208ab-bdd2-4632-ba27-569801a222e1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.360216 Aug 29 15:51:38.742449 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1770/3529] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:38 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:38.823685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:38.824368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:38.845668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.846389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.846851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.847634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:38.848096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:38.848528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:38.861761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=20 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:38.950074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:38.957723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:38.959827 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6606d7db-1e2b-4d80-a9e8-14c25b487549 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.517429 Aug 29 15:51:38.971505 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1760/3530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:38 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:39.122663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.135458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82373ff7-0b9c-4069-8cbc-06daf5f6cc29 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.315863 Aug 29 15:51:39.136360 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1771/3531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:38 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:39.205575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.206200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:39.212828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.213638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.214319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.215307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.216050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.216733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.518748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.530154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.532872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:39.534071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a4f026a-d659-4a6d-b140-82220012aa79 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1361 microversion: 2.26 time: 0.332525 Aug 29 15:51:39.534639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1761/3532] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:39 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:39.768283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.769397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:39.790346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.791232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.791897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.792871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:39.793589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:39.794352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:39.981804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:39.982951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:40.004909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.005703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.006623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.007835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.009095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.009686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.084168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.095549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-83057b7c-b7ca-456a-b8e5-a88956e707d7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1521 microversion: 2.1 time: 0.328465 Aug 29 15:51:40.096193 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1772/3533] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:39 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:40.161054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:40.161730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:40.188620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.189301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.189770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.195373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.196559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.197093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.473745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.489389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-014fcabd-8e6e-4746-b57a-d9f10c625224 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.336321 Aug 29 15:51:40.505414 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1773/3534] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:40 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:40.566195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:40.567364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:40.584114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.585271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.585928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.588099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:40.589187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:40.589805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:40.764766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.775979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.777543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.779342 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5dfdef89-7b19-40e4-832d-f904db91594a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1361 microversion: 2.26 time: 0.224531 Aug 29 15:51:40.780616 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1774/3535] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:40 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:40.799333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:40.813397 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37d4734a-c90a-488a-af40-054cb609c820 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.835459 Aug 29 15:51:40.815136 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1762/3536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:39 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:41.118579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:41.119271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:41.127750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.128256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.128692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.129397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.129846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.130271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.405722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-64240dc2-d484-42d7-a872-4dc2846484b8 req-5756c287-083e-495b-931f-8526b798e787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1abcaf-4116-4b73-886a-4de875916884", "name": "network-vif-plugged", "status": "completed", "tag": "c98bfbdb-3b19-411e-b8b6-e0a7936e93bc"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:41.422097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-64240dc2-d484-42d7-a872-4dc2846484b8 req-5756c287-083e-495b-931f-8526b798e787 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.423682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-64240dc2-d484-42d7-a872-4dc2846484b8 req-5756c287-083e-495b-931f-8526b798e787 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.424679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-64240dc2-d484-42d7-a872-4dc2846484b8 req-5756c287-083e-495b-931f-8526b798e787 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.428714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.434011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:41.443418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e027739-7010-4ed8-ae15-30789032a59a tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1498 microversion: 2.1 time: 0.328102 Aug 29 15:51:41.444023 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1775/3537] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:41 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1498 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:41.449262 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-64240dc2-d484-42d7-a872-4dc2846484b8 req-5756c287-083e-495b-931f-8526b798e787 service nova] Creating event network-vif-plugged:c98bfbdb-3b19-411e-b8b6-e0a7936e93bc for instance 6a1abcaf-4116-4b73-886a-4de875916884 on n-h1-836830-13 Aug 29 15:51:41.464927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-64240dc2-d484-42d7-a872-4dc2846484b8 req-5756c287-083e-495b-931f-8526b798e787 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062478 Aug 29 15:51:41.467436 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1763/3538] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:41.471106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:41.476707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.483137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:41.496705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.498344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.499460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.500447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.501137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.502200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.532613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:41.534873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:41.550918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.552971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.553690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.555541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.557186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.557852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.559866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:41.595239 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-430848bc-470c-4a3e-be80-2031bd55b05c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.128009 Aug 29 15:51:41.603365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1776/3539] 10.222.0.83 () {58 vars in 1154 bytes} [Mon Aug 29 15:51:41 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:41.611897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46015ada-7b68-4365-a750-165b2fba6aeb tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:41.626789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46015ada-7b68-4365-a750-165b2fba6aeb tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.628796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46015ada-7b68-4365-a750-165b2fba6aeb tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.629919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46015ada-7b68-4365-a750-165b2fba6aeb tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.835068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-46015ada-7b68-4365-a750-165b2fba6aeb tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Going to try to start instance {{(pid=129132) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:51:41.913807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:41.926234 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46015ada-7b68-4365-a750-165b2fba6aeb tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "POST /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12/action" status: 202 len: 0 microversion: 2.1 time: 0.319579 Aug 29 15:51:41.926816 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d74fabea-9add-4036-96e7-d947e3f6083d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.416792 Aug 29 15:51:41.928875 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1777/3540] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:41 2022] POST /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:41.931296 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1764/3541] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:41 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:41.937277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:41.938227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:41.948529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.949443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.950384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.951436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:41.952139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:41.952806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:41.960760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:41.964919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:41.997366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.007810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.009929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.010701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.011373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.012627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.201578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.209756 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53318614-7455-433e-87aa-11fa6a277e51 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.277440 Aug 29 15:51:42.210354 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1765/3542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:41 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:42.216625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.217587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.224686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.225462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.225903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.226611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.227270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.227955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.451694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.474653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e303ca2-2028-4365-af3b-68357547565c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1507 microversion: 2.1 time: 0.248581 Aug 29 15:51:42.475924 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1766/3543] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:42.640531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.653939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.661677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:42.664442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab1e405c-f040-4751-a271-3001c58a038f tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1361 microversion: 2.26 time: 0.716427 Aug 29 15:51:42.679471 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1778/3544] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:41 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1361 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:42.957619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:42.958791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:42.971069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.975377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.975993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:42.978979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:42.979611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:42.980116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.233217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:43.234611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:43.244562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.245689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.246360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.247467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.250597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.251226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.282266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:43.342969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:43.361755 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b6ee3ae5-d28d-48a0-b2ce-95a65b8563cf tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.408633 Aug 29 15:51:43.362914 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1767/3545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:42 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:43.440729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:43.451129 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1119308f-a7e5-4728-8356-07a4815ec860 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.224607 Aug 29 15:51:43.463643 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1779/3546] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:43 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:43.500650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-27211d3d-e70b-4133-8ad2-a7960f9b105d req-203f7580-2d9d-4294-8b5c-e8a575791ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b28d1d0-b6c2-4164-b006-4a3bcac6274c", "name": "network-vif-plugged", "status": "completed", "tag": "80fb79a2-3f36-4e29-bf67-fd13b72df86e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:43.512742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:43.518186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:43.519690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-27211d3d-e70b-4133-8ad2-a7960f9b105d req-203f7580-2d9d-4294-8b5c-e8a575791ee5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.520173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-27211d3d-e70b-4133-8ad2-a7960f9b105d req-203f7580-2d9d-4294-8b5c-e8a575791ee5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.524499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-27211d3d-e70b-4133-8ad2-a7960f9b105d req-203f7580-2d9d-4294-8b5c-e8a575791ee5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.538045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-27211d3d-e70b-4133-8ad2-a7960f9b105d req-203f7580-2d9d-4294-8b5c-e8a575791ee5 service nova] Creating event network-vif-plugged:80fb79a2-3f36-4e29-bf67-fd13b72df86e for instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c on n-h2-836830-13 Aug 29 15:51:43.549516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.551049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.551753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.553713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.557165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.557372 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-27211d3d-e70b-4133-8ad2-a7960f9b105d req-203f7580-2d9d-4294-8b5c-e8a575791ee5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060549 Aug 29 15:51:43.558002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1768/3547] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:43.558365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.691938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:43.693796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:43.708680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.709438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.710226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.711834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:43.712860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:43.713494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:43.942749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:43.957078 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f955c4b-9a9c-467a-b823-ae7e44baf463 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1507 microversion: 2.1 time: 0.458396 Aug 29 15:51:43.962047 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1780/3548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:43 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:44.059239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.073675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.079110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.083402 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5bdf95a3-61d1-41b8-8359-6c00a78dd2b9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1545 microversion: 2.26 time: 0.397176 Aug 29 15:51:44.084260 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1769/3549] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:43 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1545 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:51:44.113509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee4249d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.140617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.141084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.141663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.142230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.148725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.149833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.150690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.151643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.152130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.152632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.192082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.192577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.193021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.208169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.208911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.209347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.255669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:44.322471 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4557813a-f8a9-479a-a970-3b0b2ad18c7e tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-1518881921" status: 201 len: 0 microversion: 2.26 time: 0.212746 Aug 29 15:51:44.327249 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1781/3550] 10.222.0.83 () {62 vars in 1380 bytes} [Mon Aug 29 15:51:44 2022] PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-1518881921 => generated 0 bytes in 217 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 15:51:44.346897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae584fa9-c446-4208-9a83-77d3ba3926df tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32edc44ca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.362801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae584fa9-c446-4208-9a83-77d3ba3926df tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.363317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae584fa9-c446-4208-9a83-77d3ba3926df tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.363744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae584fa9-c446-4208-9a83-77d3ba3926df tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.381891 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae584fa9-c446-4208-9a83-77d3ba3926df tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-1518881921" status: 204 len: 0 microversion: 2.26 time: 0.049617 Aug 29 15:51:44.384488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.385297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.387447 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1770/3551] 10.222.0.83 () {60 vars in 1361 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-1518881921 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:44.392646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32edc44040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.393164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.393875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.394522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.395822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.396617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.397051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.401234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.401949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.402585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.403277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.409851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.410343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.410775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.411673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.412154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.412591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.437589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.438066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.438829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.457049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:44.482111 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0dccb413-7e5f-4698-a1e4-569fc504c2fc tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 204 len: 0 microversion: 2.26 time: 0.093511 Aug 29 15:51:44.488711 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1771/3552] 10.222.0.83 () {60 vars in 1295 bytes} [Mon Aug 29 15:51:44 2022] DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:44.498927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.499645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.509008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.516068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.518042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.518770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.519273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.519696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.720447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.731893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f264fb73-51f1-4073-aeb1-322e9f410c00 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.351891 Aug 29 15:51:44.743966 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1782/3553] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:44.759406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cbd11983-f97d-4d1c-9b07-4a774c2edb76 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee8e4430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.768673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbd11983-f97d-4d1c-9b07-4a774c2edb76 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.771342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbd11983-f97d-4d1c-9b07-4a774c2edb76 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.771792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbd11983-f97d-4d1c-9b07-4a774c2edb76 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.786552 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cbd11983-f97d-4d1c-9b07-4a774c2edb76 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 200 len: 12 microversion: 2.26 time: 0.037354 Aug 29 15:51:44.787366 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1783/3554] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 12 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:44.798278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee751ca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.821392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.821929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.822380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.822873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.840024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.840764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.841367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.842262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.842723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.843189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.891973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:44.905969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf8e2608-cfeb-4b55-be36-7131f1354883 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1293 microversion: 2.1 time: 0.412018 Aug 29 15:51:44.906331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.907196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.907893 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1772/3555] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1293 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:44.908137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.921391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:44.922139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:44.922740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:44.963378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:44.984758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:44.985609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:44.991975 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc189f10-3d6b-4586-8287-4b7d0b4df583 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-212816778" status: 201 len: 0 microversion: 2.26 time: 0.198045 Aug 29 15:51:44.993385 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1784/3556] 10.222.0.83 () {62 vars in 1377 bytes} [Mon Aug 29 15:51:44 2022] PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-212816778 => generated 0 bytes in 200 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:51:45.006906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.007395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.011784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.012751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.015623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.016085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.017121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73445de2-4ec8-480e-b05d-ea61790465c5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee751430>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.053470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73445de2-4ec8-480e-b05d-ea61790465c5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.054294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73445de2-4ec8-480e-b05d-ea61790465c5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.056921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73445de2-4ec8-480e-b05d-ea61790465c5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.094694 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73445de2-4ec8-480e-b05d-ea61790465c5 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 200 len: 35 microversion: 2.26 time: 0.094443 Aug 29 15:51:45.101007 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1785/3557] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 35 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:45.117279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee8df3a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.126407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.127853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.130336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.131104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.160096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.161125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.161808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.163403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.164224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.166125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.196721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.198693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.199435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.259219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:45.299411 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-61b95ae6-1e3c-4998-89c6-ba3e6d2ec7f3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-212816778" status: 204 len: 0 microversion: 2.26 time: 0.191364 Aug 29 15:51:45.301585 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1786/3558] 10.222.0.83 () {60 vars in 1361 bytes} [Mon Aug 29 15:51:45 2022] DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-212816778 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:45.312968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c06a08de-70df-4cc0-958b-19f9aec4ab7c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee7c7280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.331952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06a08de-70df-4cc0-958b-19f9aec4ab7c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.332991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06a08de-70df-4cc0-958b-19f9aec4ab7c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.335369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06a08de-70df-4cc0-958b-19f9aec4ab7c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.355718 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c06a08de-70df-4cc0-958b-19f9aec4ab7c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 200 len: 12 microversion: 2.26 time: 0.046953 Aug 29 15:51:45.358960 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1787/3559] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:51:45 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:45.372658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee7f6b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.394304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.396546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.397095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.397671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.415483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.416087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.416616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.417419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.417952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.418451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.464664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.471200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.471878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.495832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:45.533321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0adc6ccb-408e-4169-8f03-affb52001b8a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 204 len: 0 microversion: 2.26 time: 0.165357 Aug 29 15:51:45.538040 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1788/3560] 10.222.0.83 () {60 vars in 1295 bytes} [Mon Aug 29 15:51:45 2022] DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:51:45.555986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee7515e0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.572037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.572568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.579975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.583384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.597837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.598594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.600730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.601859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.604219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.604839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.661695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.662186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.662628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.699260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.699751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.701009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.763856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:45.776372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:45.794809 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a0ff085-c5a7-4d0d-8834-503c39affc50 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1511 microversion: 2.1 time: 0.810972 Aug 29 15:51:45.796079 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1773/3561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:44 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1511 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:45.801468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.808521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:45.831456 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e0648190-a9d4-4548-90bb-540e34b4f6a4 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-357855288" status: 201 len: 0 microversion: 2.26 time: 0.280150 Aug 29 15:51:45.833331 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1789/3562] 10.222.0.83 () {62 vars in 1377 bytes} [Mon Aug 29 15:51:45 2022] PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-357855288 => generated 0 bytes in 283 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 29 15:51:45.834975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.836299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.836747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.837455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.839817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.841381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.853379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.871516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:45.875331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.servers [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Removing options 'limit' from query {{(pid=129132) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 15:51:45.877341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:45.880727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.885632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.887583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.889100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.898650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:45.900885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:45.906950 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4333a77-8106-4fa8-89c3-f1e493f677e5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.053975 Aug 29 15:51:45.910433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1790/3563] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 15:51:45 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:51:45.916408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee8e41f0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:45.990001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:45.993162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.008264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.011670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.041345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.046526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.047474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.050832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.051785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.052666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.118338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:46.154229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.155565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.156496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.178091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.179190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.180394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.258854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:46.269960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:46.286517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b507b0e-f867-4637-9eef-22b449dc0491 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.489139 Aug 29 15:51:46.299155 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1774/3564] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:45 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:46.299658 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab59d1ed-5991-43f7-8d90-346ff1cb8326 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-662145826" status: 201 len: 0 microversion: 2.26 time: 0.387841 Aug 29 15:51:46.300618 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1791/3565] 10.222.0.83 () {62 vars in 1377 bytes} [Mon Aug 29 15:51:45 2022] PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-662145826 => generated 0 bytes in 389 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:51:46.305935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.307200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.314482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.315698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.316518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.317891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.318499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.319367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.324701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.325344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.346714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.347531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.348123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.348977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.351471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.352674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.584579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:46.593226 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d112ebd-f912-4ff4-ab85-71fb1fae7dc8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1485 microversion: 2.1 time: 0.291580 Aug 29 15:51:46.593812 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1792/3566] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:46 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1485 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:46.607353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee8c5ca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.607353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.607594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.607895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.608610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.614949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.615785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.616415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.617303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.618521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.619154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.644368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.645049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.645645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.651987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:46.662124 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9236e50c-61a7-4620-8382-2ccb9b507f1b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1511 microversion: 2.1 time: 0.361307 Aug 29 15:51:46.666475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:46.667114 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1775/3567] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:46 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:46.673224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.674031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.687547 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18aa9d99-ce38-4ca9-8150-2a23b88b78f9 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 204 len: 0 microversion: 2.26 time: 0.092499 Aug 29 15:51:46.688177 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1793/3568] 10.222.0.83 () {60 vars in 1295 bytes} [Mon Aug 29 15:51:46 2022] DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:46.693160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.693782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.699399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.700359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.701954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.702456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.702895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.703782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.704847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.706068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.706514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.707254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.708817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.710423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.946455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:46.949743 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8911fc8a-54be-410c-8019-45ecb00d6f1b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.281254 Aug 29 15:51:46.952479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1776/3569] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:51:46 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c/os-interface => generated 285 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:46.957742 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08e11217-d2ad-4e97-8561-9b1f07b983f7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1510 microversion: 2.1 time: 0.268479 Aug 29 15:51:46.958881 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1794/3570] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:46 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:46.959409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-231795d5-8ade-4f79-9d5c-965baa818ce7 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32edca6940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.974860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-231795d5-8ade-4f79-9d5c-965baa818ce7 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.976160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-231795d5-8ade-4f79-9d5c-965baa818ce7 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.976996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-231795d5-8ade-4f79-9d5c-965baa818ce7 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.980213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:46.981144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:46.991468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.992817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.993574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.994305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:46.994767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:46.995228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:46.999078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-231795d5-8ade-4f79-9d5c-965baa818ce7 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 200 len: 12 microversion: 2.26 time: 0.045083 Aug 29 15:51:47.006451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1777/3571] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:51:46 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 12 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:47.012417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32edc44ca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:47.021120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.021663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.022362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.023090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:47.032355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.033395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.034118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.035137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.035866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.037276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.068416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.069243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.070032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.083445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:47.108771 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da2c4b1c-6f4f-4b2a-8edc-cbf01dc7b6d3 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 204 len: 0 microversion: 2.26 time: 0.100900 Aug 29 15:51:47.109404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1778/3572] 10.222.0.83 () {60 vars in 1295 bytes} [Mon Aug 29 15:51:47 2022] DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:47.119512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:47.120155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:47.128640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.129132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.129568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.130327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.130788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.131237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.323686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:47.347134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0049a5ec-acf5-493b-b81c-ba09cc7de6c5 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1512 microversion: 2.1 time: 0.370693 Aug 29 15:51:47.347738 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1795/3573] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:46 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1512 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:47.367190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee7f6ee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:47.381492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.386252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.386902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.389681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:47.403984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.404986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.408516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.410148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.418155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.418705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.426391 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68584fa6-aac9-46cf-8303-922f6281723f tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1860 microversion: 2.1 time: 0.315763 Aug 29 15:51:47.427851 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1779/3574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:47 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1860 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:47.435620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:47.436642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:47.449941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.449941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.449941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.450462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.451737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.451737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.490503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.491323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.491951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.505657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.506491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.507324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.550073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:47.584690 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29f0513b-92c1-4aec-9961-0161dff25d9c tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-1992240312" status: 201 len: 0 microversion: 2.26 time: 0.235537 Aug 29 15:51:47.591680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1796/3575] 10.222.0.83 () {62 vars in 1380 bytes} [Mon Aug 29 15:51:47 2022] PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-1992240312 => generated 0 bytes in 243 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 29 15:51:47.597674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:47.606690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:47.607533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:47.815835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:47.825841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-752d442a-7b77-4412-b67d-2cae8af6c456 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.396632 Aug 29 15:51:47.839147 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1780/3576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:47 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:47.839147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-13", "block_migration": true, "disk_over_commit": false}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:47.845386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:47.853248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.853751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.854194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.854972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.855445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.855872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.857146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.858015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.862103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.864809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:47.865541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:47.866150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:47.888179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:DELETE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:47.909892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lazy-loading 'flavor' on Instance uuid 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:47.935112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Going to try to live migrate instance to n-h2-836830-13 {{(pid=129133) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:51:48.035079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:48.123634 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84fa888e-4d0e-418a-bba3-14c990351a62 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.530426 Aug 29 15:51:48.131306 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1797/3577] 10.222.0.83 () {58 vars in 1154 bytes} [Mon Aug 29 15:51:47 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:48.131306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32f01a1790>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.141398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.142463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.142979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.144445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.153364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.172439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.173100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.173971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.174540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.175093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.213709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.214394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.214934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.225826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.226457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.227721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.272099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:48.314045 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bdb182f6-2c3f-4290-b1ce-452a04d2b1d2 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-456595520" status: 201 len: 0 microversion: 2.26 time: 0.188315 Aug 29 15:51:48.317697 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1798/3578] 10.222.0.83 () {62 vars in 1377 bytes} [Mon Aug 29 15:51:48 2022] PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags/tempest-tag-456595520 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 29 15:51:48.331385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.332238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.346876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.350168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.350786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.353797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.357069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.357897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.667644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:48.677041 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4df4d4a9-2135-4046-a3e0-7508567a3c49 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1511 microversion: 2.1 time: 0.356881 Aug 29 15:51:48.678345 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1799/3579] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:48 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:48.684790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Action: 'update_all', calling method: .version_select at 0x7f32ee925e50>, body: {"tags": ["tempest-tag-667291295", "tempest-tag-599213575"]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:48.715261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.715839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.716474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.716963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.732980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.733496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.733936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.734647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.735320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.736024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.818111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.821403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.824446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.864690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:48.872487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:48.896860 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-000af6b4-4694-4a1c-a616-bfd3bb7910ac tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 200 len: 60 microversion: 2.26 time: 0.217107 Aug 29 15:51:48.897880 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1800/3580] 10.222.0.83 () {62 vars in 1312 bytes} [Mon Aug 29 15:51:48 2022] PUT /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 60 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:48.906934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:48.909353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:48.918238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.922417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.922417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:48.922417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:48.922417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:48.922417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.314778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:49.324536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c9457c3-b1fc-4df8-b454-c73bef08656f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1510 microversion: 2.1 time: 0.425525 Aug 29 15:51:49.343060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1801/3581] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:48 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:49.343060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:49.343060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:49.346820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.347377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.349569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.350361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.352466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.368793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.793543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:49.804508 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b47a3806-7ca4-4081-8649-82623a950de6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.471166 Aug 29 15:51:49.823254 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1802/3582] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:49 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:49.831276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-37a5221e-6ce5-4250-a212-6fdf43555130 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32ee72b550>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:49.840309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37a5221e-6ce5-4250-a212-6fdf43555130 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.841681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37a5221e-6ce5-4250-a212-6fdf43555130 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.842297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37a5221e-6ce5-4250-a212-6fdf43555130 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.858037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-37a5221e-6ce5-4250-a212-6fdf43555130 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 200 len: 60 microversion: 2.26 time: 0.033250 Aug 29 15:51:49.858647 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1803/3583] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 15:51:49 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 60 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:49.865141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:49.866022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:49.876076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:49.876989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.877985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.878950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:49.880027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:49.880657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:49.881245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.227431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:50.243244 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-549e33a3-65ac-43cb-b73d-534721ba46c1 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1512 microversion: 2.1 time: 0.382381 Aug 29 15:51:50.245217 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1804/3584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:49 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1512 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:50.266236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.267278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:50.278277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.278890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.282006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.283406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.284198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.284997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.354591 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b91e887a-7aae-4a84-872e-59a5410a5be3 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/action" status: 202 len: 0 microversion: 2.1 time: 2.521115 Aug 29 15:51:50.355860 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1781/3585] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:51:47 2022] POST /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/action => generated 0 bytes in 2524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:51:50.361989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3c5d98b8-cb72-462b-a296-d45b518d709f req-8eb9bca1-b393-4686-8e20-bf5311795131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b28d1d0-b6c2-4164-b006-4a3bcac6274c", "tag": "80fb79a2-3f36-4e29-bf67-fd13b72df86e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:50.382551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3c5d98b8-cb72-462b-a296-d45b518d709f req-8eb9bca1-b393-4686-8e20-bf5311795131 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.385679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3c5d98b8-cb72-462b-a296-d45b518d709f req-8eb9bca1-b393-4686-8e20-bf5311795131 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.386417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3c5d98b8-cb72-462b-a296-d45b518d709f req-8eb9bca1-b393-4686-8e20-bf5311795131 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.405911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3c5d98b8-cb72-462b-a296-d45b518d709f req-8eb9bca1-b393-4686-8e20-bf5311795131 service nova] Creating event network-changed:80fb79a2-3f36-4e29-bf67-fd13b72df86e for instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c on n-h2-836830-13 Aug 29 15:51:50.412654 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3c5d98b8-cb72-462b-a296-d45b518d709f req-8eb9bca1-b393-4686-8e20-bf5311795131 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055211 Aug 29 15:51:50.413539 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1782/3586] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:50.425154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '.version_select at 0x7f32edb1f0d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.433485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:50.439268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.440064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.440697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.441586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:50.454540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.455350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.455955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.456885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.458090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.458965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.491791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.494166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.495404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.520486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'flavor' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:50.576666 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-58437410-fd6a-4ac8-a643-0171139534bf tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags" status: 204 len: 0 microversion: 2.26 time: 0.161324 Aug 29 15:51:50.577330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1783/3587] 10.222.0.83 () {60 vars in 1295 bytes} [Mon Aug 29 15:51:50 2022] DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:50.587799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.592775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:50.594030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:50.604283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.607200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.607646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.608819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.609907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.610374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.653762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:50.708814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:50.711930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:50.720050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.720561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.721002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.728496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b2a461f-c578-4cc2-8cd5-faa5c6bf4ac5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1485 microversion: 2.1 time: 0.481346 Aug 29 15:51:50.729767 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1805/3588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:50 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1485 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:50.741567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.742603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:50.760081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.760771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.761323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.762152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:50.762710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:50.763355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:50.947776 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-86743f13-7c04-47f0-9196-8ff8d990d656 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.365314 Aug 29 15:51:50.975736 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1784/3589] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:51:50 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:50.984940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:50.985462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:51.004754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.005270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.006022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.006443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.006901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.009363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.059643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:51.193475 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b80cb9b6-57fc-4788-93b8-ea370ae548d1 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 204 len: 0 microversion: 2.26 time: 0.216202 Aug 29 15:51:51.194354 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1785/3590] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:51:50 2022] DELETE /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:51:51.203851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.204643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:51.211921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.212924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.213433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.214216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.214802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.215300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.373322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.381644 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7fe9f7cf-3dfc-46ff-bb5e-ef6b192998e5 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.182365 Aug 29 15:51:51.382309 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1786/3591] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:51.387747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.393056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.394027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:51.537642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.538871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.540383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.541461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.542257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.543171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.614357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.625751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-244849f9-4a82-4da7-97b6-9d730499fb12 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.894213 Aug 29 15:51:51.626931 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1806/3592] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:50 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:51.632134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.633063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:51.640690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.641455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.642196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.643309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.643969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.645225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.646680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:51.720242 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e025565-cdde-4364-979b-0d9f337a8300 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.335971 Aug 29 15:51:51.720832 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1787/3593] 10.222.0.83 () {58 vars in 1150 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:51.736479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.743326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.743326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:51.748941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.749462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.749895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.750666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.751084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.751510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.853857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:51.934957 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-170cc41b-7a3c-4fee-bcd3-22a485c33615 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.202564 Aug 29 15:51:51.942228 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1788/3594] 10.222.0.83 () {58 vars in 1212 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:51.957079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:51.966321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:51.967253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:51.972744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.973318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.973767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.975151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:51.976155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:51.976278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:51.989280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.020650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.023829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.027322 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b682fc4d-f2c7-4740-9e92-0ca3693e6c64 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1551 microversion: 2.26 time: 0.399131 Aug 29 15:51:52.030536 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1807/3595] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1551 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:52.107784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:52.219750 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e7ad5df-e5ff-4d71-b6c9-549f01a1e1a9 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.275623 Aug 29 15:51:52.221242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1789/3596] 10.222.0.83 () {58 vars in 1196 bytes} [Mon Aug 29 15:51:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:52.233535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.238890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.252197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'name': '1363174631', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:52.267729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.272968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.273938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.275169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.276155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.276867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.403056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.403698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.420372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.420871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.421300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.421995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.422722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.423391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.451077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:52.540464 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f6a4350-cf60-4095-8712-8283be5ca97c tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?name=1363174631" status: 200 len: 346 microversion: 2.1 time: 0.310485 Aug 29 15:51:52.541617 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1808/3597] 10.222.0.83 () {58 vars in 1156 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers?name=1363174631 => generated 346 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:52.555352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.575346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:52.576022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:52.594856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.595645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.596078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.596795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.597246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.597663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.704929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:52.811054 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8893de83-1ba9-4dae-b26b-219424cfe80e tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.258979 Aug 29 15:51:52.818477 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1809/3598] 10.222.0.83 () {58 vars in 1154 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:52.833572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:52.833849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:52.843898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.844442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.844886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:52.846563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:52.846908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:52.847373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.030777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.041280 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33317055-c060-416b-b6e1-12cf6ca15656 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.642696 Aug 29 15:51:53.041874 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1790/3599] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:53.059331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:53.064836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.066368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.071262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-136317463', 'deleted': False, 'project_id': '65947505462641c1ac004cdacaa8317b'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:51:53.078537 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-68a8fa3f-dba1-4a07-af1e-be35d20d560d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.258841 Aug 29 15:51:53.085146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.085713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.086464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.087475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.088007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.088544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.091702 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1810/3600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:52 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:53.103337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:53.103971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:53.114862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.117116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.118292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.120482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.124032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.124925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.310651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:51:53.397829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.408150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.410085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:53.411677 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-310f636f-0841-42d1-99a7-137cc9f2a581 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1551 microversion: 2.26 time: 0.318927 Aug 29 15:51:53.412804 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1811/3601] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:53 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1551 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:53.779588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1fdce01b-9ffc-4ba2-bf9f-6cd3c057fe57 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-136317463" status: 200 len: 346 microversion: 2.1 time: 0.731557 Aug 29 15:51:53.780804 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1791/3602] 10.222.0.83 () {58 vars in 1228 bytes} [Mon Aug 29 15:51:53 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-136317463 => generated 346 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:53.796433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:53.797209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:53.806583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.807553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.808291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.809470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:53.810409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:53.811104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:53.848858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:51:54.014754 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-714ac370-b179-4184-b808-8105cc1a8588 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 204 len: 0 microversion: 2.1 time: 0.224277 Aug 29 15:51:54.016289 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1812/3603] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:51:53 2022] DELETE /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:51:54.026006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9644c4fc-ffb6-49d5-9724-7251f73191e9 req-3ec9095e-a2f2-4d04-bb2d-1abaa5c6c99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1abcaf-4116-4b73-886a-4de875916884", "name": "network-vif-deleted", "tag": "c98bfbdb-3b19-411e-b8b6-e0a7936e93bc"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:54.041507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.043562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.051542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9644c4fc-ffb6-49d5-9724-7251f73191e9 req-3ec9095e-a2f2-4d04-bb2d-1abaa5c6c99b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.054541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9644c4fc-ffb6-49d5-9724-7251f73191e9 req-3ec9095e-a2f2-4d04-bb2d-1abaa5c6c99b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.055490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9644c4fc-ffb6-49d5-9724-7251f73191e9 req-3ec9095e-a2f2-4d04-bb2d-1abaa5c6c99b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.057874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.062126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.063269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.066713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.069088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.069691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.088307 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9644c4fc-ffb6-49d5-9724-7251f73191e9 req-3ec9095e-a2f2-4d04-bb2d-1abaa5c6c99b service nova] Creating event network-vif-deleted:c98bfbdb-3b19-411e-b8b6-e0a7936e93bc for instance 6a1abcaf-4116-4b73-886a-4de875916884 on n-h1-836830-13 Aug 29 15:51:54.105191 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9644c4fc-ffb6-49d5-9724-7251f73191e9 req-3ec9095e-a2f2-4d04-bb2d-1abaa5c6c99b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085493 Aug 29 15:51:54.111957 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1792/3604] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:51:54.128682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.131083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.144259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.148292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.151677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.152608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.156099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.157352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.169584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:54.475264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.484803 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b01238e-135a-4b21-9858-f54c648cabb0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1518 microversion: 2.1 time: 0.455623 Aug 29 15:51:54.485390 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1813/3605] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:54 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1518 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:54.491785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.493318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.508562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.510516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.510516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.511158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.511650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.512083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.515131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.531940 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1a81bdcb-3d37-4172-a0b0-cde1deedbc7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.416232 Aug 29 15:51:54.534892 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1793/3606] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:54 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:54.547058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:54.548988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:54.593263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.593932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.594367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.595158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.598400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.598930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.655969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:54.656841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:54.657496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:54.658111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lazy-loading 'fault' on Instance uuid 6a1abcaf-4116-4b73-886a-4de875916884 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:51:54.771908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.782970 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25faa8db-f08f-469d-b2bd-44bc06dee2cd tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.294868 Aug 29 15:51:54.784850 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1814/3607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:54 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:54.795514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.819930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.828106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00dee611719b433284d4258833021ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befd8f594a954a1ea3ea172fafed14a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:54.829843 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6d9dc9d-fbfd-4d4e-b244-8b4ff8033343 tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 200 len: 1351 microversion: 2.26 time: 0.293833 Aug 29 15:51:54.832220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1794/3608] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:54 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 1351 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:51:55.506469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:55.508619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:55.522727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.523546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.526622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.527557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.529275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.530214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.558695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:55.559604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:55.573271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.574049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.574744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.576609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.577229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.577826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.800835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:55.804624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:51:55.815588 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-415fa88c-c49a-410b-bce9-f062456a87be tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1518 microversion: 2.1 time: 0.313417 Aug 29 15:51:55.817284 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1815/3609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1518 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:55.824930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:55.826069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:55.834876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.835741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.836786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.837682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.838346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.838890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.955402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:55.976541 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b9eb1de2-7743-4ea0-a017-c6fdb5aabdde tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.422148 Aug 29 15:51:55.978265 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1795/3610] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:55.983438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:55.983990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] [instance: 6a1abcaf-4116-4b73-886a-4de875916884] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:55.996883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:55.997386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:55.997832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:55.998551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.005733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.006205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.040237 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] HTTP exception thrown: Instance 6a1abcaf-4116-4b73-886a-4de875916884 could not be found. Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Request method failure captured: Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 HTTP/1.1 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOB7WTyLxqwGHw-CF_1YHQGq_41061lkUM99t1nENrXDss3nl04DRNOae6qeJ2wu1E8RTt6rFdhhKxh6PxdTRyNAyzv3yTO6MNC14BqYlqR1y_oDjI0Mg6CrC1xxM6kU1Gg8MsPR4yByGxpSTzqabGd5uQkQAq-66YHAlKHUidx8e0o Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.26 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: befd8f594a954a1ea3ea172fafed14a3 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerTagsTestJSON-796953522 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/befd8f594a954a1ea3ea172fafed14a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_befd8f594a954a1ea3ea172fafed14a3", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/befd8f594a954a1ea3ea172fafed14a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/befd8f594a954a1ea3ea172fafed14a3"}]}] Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerTagsTestJSON-796953522 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: befd8f594a954a1ea3ea172fafed14a3 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerTagsTestJSON-796953522 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerTagsTestJSON-796953522-project Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 00dee611719b433284d4258833021ec6 Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerTagsTestJSON-796953522-project Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 6a1abcaf-4116-4b73-886a-4de875916884 could not be found. Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '6a1abcaf-4116-4b73-886a-4de875916884'} Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1abcaf-4116-4b73-886a-4de875916884 could not be found. Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1abcaf-4116-4b73-886a-4de875916884 could not be found. Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:51:56.042910 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:56.048994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:51:56.048994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:51:56.048994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:51:56.048994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:51:56.048994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:51:56.048994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1abcaf-4116-4b73-886a-4de875916884 could not be found. Aug 29 15:51:56.048994 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:51:56.051108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] Returning 404 to user: Instance 6a1abcaf-4116-4b73-886a-4de875916884 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:51:56.052491 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ce29059-cf83-476d-b39d-af735b06544a tempest-ServerTagsTestJSON-796953522 tempest-ServerTagsTestJSON-796953522-project] 10.222.0.83 "GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884" status: 404 len: 111 microversion: 2.26 time: 0.072799 Aug 29 15:51:56.057584 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1796/3611] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/6a1abcaf-4116-4b73-886a-4de875916884 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:51:56.185129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:56.194258 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d34a4df-b7a7-4826-b80a-f6bbd038f9f7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.375674 Aug 29 15:51:56.194848 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1816/3612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:55 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:56.846176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:56.847492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:56.870194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.880240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.881023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:56.885227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:56.888423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:56.890770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.004345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.005725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.028496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.031615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.033753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.040121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.041309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.042028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.393613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:57.407456 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eaf00e42-7b46-490a-b444-5f665be2be41 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1518 microversion: 2.1 time: 0.570663 Aug 29 15:51:57.408037 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1797/3613] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:56 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1518 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:57.436712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:57.437443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:57.453513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.454016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.454447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.455184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:57.455637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:57.456053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:57.749567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:57.761845 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6de65ce1-ca14-4d6f-9e80-6b3ccd6bb8a2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.326751 Aug 29 15:51:57.763629 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1798/3614] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:57 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:58.407087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:58.428759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:58.429382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:58.448632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.449129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.449560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.450268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.450716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.451168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.479212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4c19ca09-ec98-4da1-9903-7b9875150e57 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 1.479053 Aug 29 15:51:58.481968 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1817/3615] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:56 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:58.711389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6690a6fb-44df-4d2c-8b0e-56bb3d3bf1be req-aa6b3144-a563-48f6-8977-fca4c3807cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb734f6-bc3c-45ac-af35-5e727217dcdd", "name": "network-vif-deleted", "tag": "11d44c95-4c88-4a86-b86c-c30b1845fa2f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:51:58.766775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6690a6fb-44df-4d2c-8b0e-56bb3d3bf1be req-aa6b3144-a563-48f6-8977-fca4c3807cd8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.769397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6690a6fb-44df-4d2c-8b0e-56bb3d3bf1be req-aa6b3144-a563-48f6-8977-fca4c3807cd8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.770191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6690a6fb-44df-4d2c-8b0e-56bb3d3bf1be req-aa6b3144-a563-48f6-8977-fca4c3807cd8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.792019 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6690a6fb-44df-4d2c-8b0e-56bb3d3bf1be req-aa6b3144-a563-48f6-8977-fca4c3807cd8 service nova] Creating event network-vif-deleted:11d44c95-4c88-4a86-b86c-c30b1845fa2f for instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd on n-h2-836830-13 Aug 29 15:51:58.802079 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6690a6fb-44df-4d2c-8b0e-56bb3d3bf1be req-aa6b3144-a563-48f6-8977-fca4c3807cd8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110578 Aug 29 15:51:58.803512 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1818/3616] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:51:58.803833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:58.814413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:58.815831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:58.815954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f46f06b7-486a-4089-a640-2191c19e0a91 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1476 microversion: 2.1 time: 0.391243 Aug 29 15:51:58.826458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.827243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.828036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.828965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:58.830246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:58.831042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:58.839452 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1799/3617] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:58 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1476 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:51:59.492209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:51:59.509276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:59.510298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:59.511504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36a27541-b8e2-461a-bb79-4b5280d162ef tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.706110 Aug 29 15:51:59.514569 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1819/3618] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:58 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:51:59.535263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.536085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.542916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.546866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.560283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.561300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.838605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:51:59.839361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:51:59.855663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.856167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.861214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.864898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.865521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.871193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.924591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:51:59.925094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:51:59.926334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:51:59.926806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lazy-loading 'fault' on Instance uuid 5bb734f6-bc3c-45ac-af35-5e727217dcdd {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:00.281931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:00.306962 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7aa486c5-eb68-46df-a498-108b0ca24002 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 200 len: 1311 microversion: 2.1 time: 0.473016 Aug 29 15:52:00.307611 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1820/3619] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:59 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 1311 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:00.381257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:00.401087 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f91d475-d534-4e93-8df9-a7c4e13e1c7e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.901354 Aug 29 15:52:00.412363 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1800/3620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:51:59 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:00.534272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:00.535128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:00.545963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.546321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.546829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:00.547573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:00.549851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:00.550297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.060519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:01.072963 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3b14b13b-bf10-4eb4-9935-58601bd1259d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.543197 Aug 29 15:52:01.073840 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1821/3621] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:00 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:01.343888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.345135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 5bb734f6-bc3c-45ac-af35-5e727217dcdd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.354030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:01.359615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.366436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.367059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.367852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.369730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.371400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.411863 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] HTTP exception thrown: Instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd could not be found. Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Request method failure captured: Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd HTTP/1.1 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOBFwU1eAz6_ucN99xlpsMzOlK4ePJbUkavlmAscqlFju2_GWRMNAPcytUpznEffDIW-LGQxZiyPSM1MwwNjb1TPbAUSb__IntdyZfK74FHMSHrluwt5uIM3LTpEFxjg0L51ulbOg3P93efwXqWGilG0TPUlOFb1VfXAhJ5brwo6s18 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 65947505462641c1ac004cdacaa8317b Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/65947505462641c1ac004cdacaa8317b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_65947505462641c1ac004cdacaa8317b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/65947505462641c1ac004cdacaa8317b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/65947505462641c1ac004cdacaa8317b"}]}] Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 65947505462641c1ac004cdacaa8317b Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListServerFiltersTestJSON-2048864113-project Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f5aa55b1030d49a7abf035fd56d8b9c2 Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListServerFiltersTestJSON-2048864113-project Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd could not be found. Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5bb734f6-bc3c-45ac-af35-5e727217dcdd'} Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd could not be found. Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd could not be found. Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:01.413455 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd could not be found. Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Returning 404 to user: Instance 5bb734f6-bc3c-45ac-af35-5e727217dcdd could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:01.420412 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3eff5944-e7c7-474a-ab34-37ece61e3a88 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd" status: 404 len: 111 microversion: 2.1 time: 0.075003 Aug 29 15:52:01.436504 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1801/3622] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:01 2022] GET /compute/v2.1/servers/5bb734f6-bc3c-45ac-af35-5e727217dcdd => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:01.441762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.442270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.454156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.456510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.458161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.458666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.459131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.462767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.467358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.468268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.476559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.480359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.481225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.482156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.484681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.486846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.556340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:52:01.775478 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19fab557-b23e-4c93-81fe-72c1196bdf6b tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 204 len: 0 microversion: 2.1 time: 0.337309 Aug 29 15:52:01.785737 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1822/3623] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:01 2022] DELETE /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:52:01.792138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:01.797271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:01.811257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.812049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.812493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:01.813223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:01.813670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:01.817292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.139238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.153116 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7411b57-f4b1-4402-bc28-ce8bcd40507e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.710558 Aug 29 15:52:02.154580 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1802/3624] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:01 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:02.165446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:02.171207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:02.183925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.185823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.186332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.186773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.187511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:02.188034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:02.193768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:02.197366 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7b192837-7b9a-4623-887e-0754f455a5b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1516 microversion: 2.1 time: 0.410218 Aug 29 15:52:02.212331 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1823/3625] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:01 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1516 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:02.710949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:02.725212 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8bd1065a-91b8-4f8f-96f5-dba9cf8c2f30 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.566452 Aug 29 15:52:02.735361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1803/3626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:02 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:03.183440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:03.184715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:03.189792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:03.209264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.210059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.211104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.214708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.216499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.216499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.222778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:03.225867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:03.232795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:03.239809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.240318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.242991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.245393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.245881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.246313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.647667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:03.656546 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-304e024a-ca70-4a6a-b619-59e19a61b411 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1516 microversion: 2.1 time: 0.438266 Aug 29 15:52:03.663719 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1804/3627] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:03 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1516 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:03.667541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:03.678679 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa32cca9-a920-42a4-967e-88cdd9a8cbe7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.506619 Aug 29 15:52:03.679307 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1824/3628] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:03 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:03.755473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:03.756723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:03.772089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.772812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.781307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:03.782137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:03.782611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:03.783248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.215327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:04.252462 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b4b7dde-2174-41ab-bcc4-b4edd04a45fa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.499288 Aug 29 15:52:04.254813 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1805/3629] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:03 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:04.682167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:04.682849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:04.694409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.694727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.695440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.699989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.709259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:04.709878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:04.710329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.711994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.730212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.730809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.731285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:04.731995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:04.732449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:04.732871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.078296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:05.090874 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-de7fe460-0a89-4b7e-be58-0e8f249c8049 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.385544 Aug 29 15:52:05.093000 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1806/3630] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:04 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:05.101553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:05.117217 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aea773cc-4e1d-4b32-848f-d3a4ffd48798 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1516 microversion: 2.1 time: 0.441754 Aug 29 15:52:05.118838 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1825/3631] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:04 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:05.279675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:05.280518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:05.298094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.298926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.301990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.303140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:05.304501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:05.305941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:05.535386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:05.550035 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-93e8b3de-236b-4d0d-b435-1028542a88bb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.276519 Aug 29 15:52:05.566921 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1807/3632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:05 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:06.151418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:06.153015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:06.158449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:06.162717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:06.178292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.184921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.187575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.193920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.197335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.198597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.200311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.201645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.202249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.206010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.211094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.211678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.366755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:06.379884 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-added03b-74c6-4da5-b2f5-15c3fd7f3079 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1474 microversion: 2.1 time: 0.238693 Aug 29 15:52:06.381055 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1808/3633] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:06 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1474 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:06.415448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-31b66fe8-7998-424f-8071-5b3703500052 req-66b110f0-a503-4f12-8eb4-13b240a4676d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b", "name": "network-vif-deleted", "tag": "3d0a03d9-e8af-47f8-b07a-46fe4a9ff6cd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:06.447557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31b66fe8-7998-424f-8071-5b3703500052 req-66b110f0-a503-4f12-8eb4-13b240a4676d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.448573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31b66fe8-7998-424f-8071-5b3703500052 req-66b110f0-a503-4f12-8eb4-13b240a4676d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.451578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31b66fe8-7998-424f-8071-5b3703500052 req-66b110f0-a503-4f12-8eb4-13b240a4676d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.478677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-31b66fe8-7998-424f-8071-5b3703500052 req-66b110f0-a503-4f12-8eb4-13b240a4676d service nova] Creating event network-vif-deleted:3d0a03d9-e8af-47f8-b07a-46fe4a9ff6cd for instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b on n-h2-836830-13 Aug 29 15:52:06.489788 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-31b66fe8-7998-424f-8071-5b3703500052 req-66b110f0-a503-4f12-8eb4-13b240a4676d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083513 Aug 29 15:52:06.498044 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1809/3634] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:06.510134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:06.522959 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6fae3992-4b7c-4eed-b8b4-316f0d7c4f36 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1505 microversion: 2.1 time: 0.406430 Aug 29 15:52:06.527596 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1826/3635] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:06 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:06.581457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:06.582605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:06.591938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.592738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.595601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:06.597843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:06.599001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:06.599693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.041520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:07.054390 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17a091e3-268c-4ce0-9a12-422b7914c83b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.482723 Aug 29 15:52:07.059597 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1810/3636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:06 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:07.408305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.411015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.434507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.435039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.435477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.436181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.437325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.437863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.501458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.501893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.502390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.502907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lazy-loading 'fault' on Instance uuid ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:07.548262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:07.549702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:07.566581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.567418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.568276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.570487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:07.571597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:07.572977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:07.600984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:07.611632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9378029-d1e0-4ba3-9740-b757b0f65357 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 200 len: 1310 microversion: 2.1 time: 0.211239 Aug 29 15:52:07.626680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1827/3637] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 1310 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:07.628219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:07.919847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:07.933310 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-953a80e7-1d13-4ace-850c-88c016eff08f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1485 microversion: 2.1 time: 0.389462 Aug 29 15:52:07.934611 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1811/3638] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:07 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1485 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:08.078207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.079005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:08.094866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.096530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.096976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.097682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.098135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.098558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.140005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-203939138", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:08.273388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] validate_networks() for [('994d135c-3561-4f23-85b8-7576200126f4', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:52:08.563454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:08.575550 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d993cee4-e359-485e-a029-0443f71e8841 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.502808 Aug 29 15:52:08.594157 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1828/3639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:08 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:08.643464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.644288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:08.652801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.660876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.661535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.662456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.663234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.664039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.699955 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] HTTP exception thrown: Instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b could not be found. Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Request method failure captured: Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b HTTP/1.1 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOBFwU1eAz6_ucN99xlpsMzOlK4ePJbUkavlmAscqlFju2_GWRMNAPcytUpznEffDIW-LGQxZiyPSM1MwwNjb1TPbAUSb__IntdyZfK74FHMSHrluwt5uIM3LTpEFxjg0L51ulbOg3P93efwXqWGilG0TPUlOFb1VfXAhJ5brwo6s18 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 65947505462641c1ac004cdacaa8317b Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/65947505462641c1ac004cdacaa8317b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_65947505462641c1ac004cdacaa8317b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/65947505462641c1ac004cdacaa8317b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/65947505462641c1ac004cdacaa8317b"}]}] Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 65947505462641c1ac004cdacaa8317b Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ListServerFiltersTestJSON-2048864113-project Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f5aa55b1030d49a7abf035fd56d8b9c2 Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ListServerFiltersTestJSON-2048864113-project Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b could not be found. Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b'} Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b could not be found. Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b could not be found. Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:08.701938 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:08.708846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:08.708846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:08.708846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:08.708846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:08.708846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:08.708846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b could not be found. Aug 29 15:52:08.708846 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:08.716984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Returning 404 to user: Instance ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:08.718132 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e81c3787-f19f-4de7-8d6d-0f87b0654428 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b" status: 404 len: 111 microversion: 2.1 time: 0.078830 Aug 29 15:52:08.719092 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1829/3640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:08 2022] GET /compute/v2.1/servers/ad2db79e-48d9-4a36-bb4d-0cfb6132fc3b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:52:08.728736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:08.729578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:08.736229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.736935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.738313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.739250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:08.739865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:08.740699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:08.834483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:52:08.905596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:09.054351 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-febd359a-c0e7-4cd0-993d-c97c53079af7 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "DELETE /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 204 len: 0 microversion: 2.1 time: 0.331053 Aug 29 15:52:09.058898 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1830/3641] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:08 2022] DELETE /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:52:09.078349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:09.088429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:09.098778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.099673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.100306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.101422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.102166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.102791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.466946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:09.475239 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1fe7898f-98da-4664-8ba7-bc7df9cfd7b0 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1517 microversion: 2.1 time: 0.404594 Aug 29 15:52:09.475746 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1831/3642] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:09 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1517 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:09.598492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:09.599219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:09.615691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.616197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.616874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:09.617815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:09.622065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:09.622540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.049157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:10.063173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fff188ee-7c02-4682-afa5-43498df42df7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.468915 Aug 29 15:52:10.077689 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1832/3643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:09 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:10.195311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:52:10.196582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:52:10.197244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:52:10.197826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:52:10.198412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:52:10.217185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:10.217971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:10.218586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.221764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:10.222519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:10.223190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.259747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Getting quotas for project bae88ae162c54e0f90d1465cb17cfbe1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:52:10.268183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Getting quotas for user 8ab128ff99e24153960e42b8897ac4f1 and project bae88ae162c54e0f90d1465cb17cfbe1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:52:10.286579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:52:10.289756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:52:10.354663 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-baa20cd1-769e-4cc1-871e-c7bee45fb824 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.219912 Aug 29 15:52:10.361690 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1812/3644] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:52:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:52:10.366649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28a5042a-bd30-4b55-957c-54066a7e726f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:10.367656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28a5042a-bd30-4b55-957c-54066a7e726f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:10.497892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:10.499132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:10.516471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:10.516967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:10.517407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.518118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:10.518626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:10.525323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:10.599949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28a5042a-bd30-4b55-957c-54066a7e726f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:10.608845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28a5042a-bd30-4b55-957c-54066a7e726f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1213 microversion: 2.1 time: 0.246189 Aug 29 15:52:10.610212 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1833/3645] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:10 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:11.088848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:11.090705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:11.105327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.106932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.109471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.111671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.112414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.115261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.326292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:11.337491 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e096ffe-3b1f-4db1-8299-8478d4bd5d70 tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1517 microversion: 2.1 time: 0.843466 Aug 29 15:52:11.340733 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1813/3646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:10 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1517 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:11.580423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:11.602255 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba3c4b1f-6ec1-47b1-97f9-e66b6e0787aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.517570 Aug 29 15:52:11.602255 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1834/3647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:11 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:11.636790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:11.638643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:11.650298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.650595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:11.655741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.656601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.658862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.660628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.662552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:11.662948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.666231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Searching by: {'deleted': False, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:52:11.691493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.693651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.696039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.699326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.702357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.710563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.765486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:52:11.812390 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3f86b280-d7c7-426c-bee8-b10f4289b3ca tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.169513 Aug 29 15:52:11.813671 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1835/3648] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:52:11 2022] GET /compute/v2.1/servers => generated 334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:11.845644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:11.857357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:11.858292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Searching by: {'deleted': False, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:52:11.864004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.864974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.865905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.867942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:11.869215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:11.869915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:11.889346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:11.901703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c68ef925-eace-47d7-9709-9ec76e8315bc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1265 microversion: 2.1 time: 0.266970 Aug 29 15:52:11.923479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1814/3649] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:11 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:11.956525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:52:12.135697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:12.153278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.153779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.154222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:12.365257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:12.365960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:12.391878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.393717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.394593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:12.402140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.402878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.403535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:12.670029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa55b1030d49a7abf035fd56d8b9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65947505462641c1ac004cdacaa8317b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:12.681878 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-48aebd50-c7ad-4dff-825f-cdb05ed2df4f tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 200 len: 1475 microversion: 2.1 time: 0.319763 Aug 29 15:52:12.687168 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1815/3650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:12 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 1475 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:12.701886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:12.702974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:12.718005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.719537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.720078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:12.722779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.723665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.725663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:12.829553 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32cc2dc1-2bef-4c45-b83d-caf175bb7a0c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.995936 Aug 29 15:52:12.831412 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1836/3651] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:52:11 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:12.854962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc063709-f098-49d8-9f4e-3cbdaf72dcf8 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:12.890408 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc063709-f098-49d8-9f4e-3cbdaf72dcf8 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036917 Aug 29 15:52:12.891551 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1837/3652] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:52:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:12.926723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:12.927581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:12.944863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.946586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.948895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:12.952512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:12.954033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:12.954781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.507661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:13.522204 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6576a29a-45f5-4173-8a81-bc24e3ed396a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.833596 Aug 29 15:52:13.541683 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1816/3653] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:12 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:13.549381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1a09e171-a0cc-4d32-a3db-801051d1a3ba req-599bb868-d3b8-4687-904c-6b7c2cc0145b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248979b1-292e-4d51-95e3-c40715fa7c12", "name": "network-vif-deleted", "tag": "1809ec2c-b326-4672-a875-72cd6b6089d8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:13.579497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1a09e171-a0cc-4d32-a3db-801051d1a3ba req-599bb868-d3b8-4687-904c-6b7c2cc0145b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.581138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1a09e171-a0cc-4d32-a3db-801051d1a3ba req-599bb868-d3b8-4687-904c-6b7c2cc0145b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.581901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1a09e171-a0cc-4d32-a3db-801051d1a3ba req-599bb868-d3b8-4687-904c-6b7c2cc0145b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.629635 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1a09e171-a0cc-4d32-a3db-801051d1a3ba req-599bb868-d3b8-4687-904c-6b7c2cc0145b service nova] Creating event network-vif-deleted:1809ec2c-b326-4672-a875-72cd6b6089d8 for instance 248979b1-292e-4d51-95e3-c40715fa7c12 on n-h1-836830-13 Aug 29 15:52:13.653210 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1a09e171-a0cc-4d32-a3db-801051d1a3ba req-599bb868-d3b8-4687-904c-6b7c2cc0145b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106003 Aug 29 15:52:13.655693 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1817/3654] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:13.668176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:13.673320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:13.708619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.709112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.713166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.713957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.714421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.714855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:13.771302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:52:13.950847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:13.960162 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-df102c70-85ae-40fd-9aa0-a0bc6bad8bff tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 204 len: 0 microversion: 2.1 time: 0.299556 Aug 29 15:52:13.961382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1818/3655] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:13 2022] DELETE /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:52:13.978131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:13.979670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] [instance: 248979b1-292e-4d51-95e3-c40715fa7c12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:13.997691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:13.998584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:13.999584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.002704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.004550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.008049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.026946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:14.059229 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7b903cde-fcd8-445d-a667-e78e85538389 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1271 microversion: 2.1 time: 1.136118 Aug 29 15:52:14.060429 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1838/3656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:12 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1271 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:14.065938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:14.067179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:14.082978 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] HTTP exception thrown: Instance 248979b1-292e-4d51-95e3-c40715fa7c12 could not be found. Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Request method failure captured: Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 HTTP/1.1 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOBFwU1eAz6_ucN99xlpsMzOlK4ePJbUkavlmAscqlFju2_GWRMNAPcytUpznEffDIW-LGQxZiyPSM1MwwNjb1TPbAUSb__IntdyZfK74FHMSHrluwt5uIM3LTpEFxjg0L51ulbOg3P93efwXqWGilG0TPUlOFb1VfXAhJ5brwo6s18 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 65947505462641c1ac004cdacaa8317b Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/65947505462641c1ac004cdacaa8317b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_65947505462641c1ac004cdacaa8317b", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/65947505462641c1ac004cdacaa8317b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/65947505462641c1ac004cdacaa8317b"}]}] Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 65947505462641c1ac004cdacaa8317b Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2048864113 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListServerFiltersTestJSON-2048864113-project Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f5aa55b1030d49a7abf035fd56d8b9c2 Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListServerFiltersTestJSON-2048864113-project Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 248979b1-292e-4d51-95e3-c40715fa7c12 could not be found. Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '248979b1-292e-4d51-95e3-c40715fa7c12'} Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248979b1-292e-4d51-95e3-c40715fa7c12 could not be found. Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248979b1-292e-4d51-95e3-c40715fa7c12 could not be found. Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:14.085959 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:14.090618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:14.090618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:14.090618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:14.090618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:14.090618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:14.090618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248979b1-292e-4d51-95e3-c40715fa7c12 could not be found. Aug 29 15:52:14.090618 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:14.093942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] Returning 404 to user: Instance 248979b1-292e-4d51-95e3-c40715fa7c12 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:14.094943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b7bd08c-7838-464a-8bfc-3db2c1e7ed6d tempest-ListServerFiltersTestJSON-2048864113 tempest-ListServerFiltersTestJSON-2048864113-project] 10.222.0.83 "GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12" status: 404 len: 111 microversion: 2.1 time: 0.130709 Aug 29 15:52:14.099070 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1819/3657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:13 2022] GET /compute/v2.1/servers/248979b1-292e-4d51-95e3-c40715fa7c12 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:14.099232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.099232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.099923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.103368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.105545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.108402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.551708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:14.553722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:14.575254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.575839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.576487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.577431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:14.577986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:14.578421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:14.918703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:14.960434 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b2bb5e8-c797-4fbb-bf9e-7671ec9c5406 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1702 microversion: 2.1 time: 0.897848 Aug 29 15:52:14.964268 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1839/3658] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:14 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1702 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:14.980290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2a812c8d-d223-418b-9ead-708bf0cf996f req-8f591e3b-cd84-4ae0-933a-5b8f3b16bfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b35c5d-d1f2-4b6a-9a6d-1b7db062a933", "name": "network-vif-unplugged", "status": "completed", "tag": "512e1130-3666-4949-b9f1-618b6b254336"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:14.999537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:15.003647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a812c8d-d223-418b-9ead-708bf0cf996f req-8f591e3b-cd84-4ae0-933a-5b8f3b16bfbc service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:15.005125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a812c8d-d223-418b-9ead-708bf0cf996f req-8f591e3b-cd84-4ae0-933a-5b8f3b16bfbc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:15.005650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a812c8d-d223-418b-9ead-708bf0cf996f req-8f591e3b-cd84-4ae0-933a-5b8f3b16bfbc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:15.016657 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-efd38212-1bb5-4c69-833d-8b55509df5b8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.471197 Aug 29 15:52:15.021510 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1820/3659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:14 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:15.022525 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2a812c8d-d223-418b-9ead-708bf0cf996f req-8f591e3b-cd84-4ae0-933a-5b8f3b16bfbc service nova] Creating event network-vif-unplugged:512e1130-3666-4949-b9f1-618b6b254336 for instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 on n-h1-836830-13 Aug 29 15:52:15.033866 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2a812c8d-d223-418b-9ead-708bf0cf996f req-8f591e3b-cd84-4ae0-933a-5b8f3b16bfbc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065508 Aug 29 15:52:15.040052 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1840/3660] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:15.087494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:15.088384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:15.103481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:15.104279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:15.104909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:15.105854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:15.106466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:15.107513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:15.832152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:15.841851 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11ead21d-e6d0-4a3b-b7f6-abe5d617b83b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1271 microversion: 2.1 time: 0.759575 Aug 29 15:52:15.843170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1821/3661] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:15 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1271 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:15.985891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:15.986894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:15.993771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:15.995839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:15.996603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:15.997263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:15.998704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:15.999423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:16.000083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:16.050789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:16.051836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:16.060840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:16.064058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:16.064729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:16.065655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:16.073283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:16.073972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:16.971469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:17.015458 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-622532bf-ed5e-49b3-91c7-ac3b8598cd2e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.969136 Aug 29 15:52:17.040806 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1822/3662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:16 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:17.079686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:17.081325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:17.107691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:17.109419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:17.110089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:17.110704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:17.111679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:17.113650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:17.114375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:17.126309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b92421e-a4ff-4bc9-91b9-468a8ba365cf tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1702 microversion: 2.1 time: 1.145222 Aug 29 15:52:17.126981 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1841/3663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:15 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1702 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:17.171187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-61be93b4-9caa-4e75-bf51-6eee77831d40 req-86db2d77-da3a-46be-b8e2-e480e2a085bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b35c5d-d1f2-4b6a-9a6d-1b7db062a933", "tag": "512e1130-3666-4949-b9f1-618b6b254336"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:17.189116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61be93b4-9caa-4e75-bf51-6eee77831d40 req-86db2d77-da3a-46be-b8e2-e480e2a085bf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:17.190563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61be93b4-9caa-4e75-bf51-6eee77831d40 req-86db2d77-da3a-46be-b8e2-e480e2a085bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:17.249635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61be93b4-9caa-4e75-bf51-6eee77831d40 req-86db2d77-da3a-46be-b8e2-e480e2a085bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.058s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:17.276866 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-61be93b4-9caa-4e75-bf51-6eee77831d40 req-86db2d77-da3a-46be-b8e2-e480e2a085bf service nova] Creating event network-changed:512e1130-3666-4949-b9f1-618b6b254336 for instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 on n-h1-836830-13 Aug 29 15:52:17.284022 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-61be93b4-9caa-4e75-bf51-6eee77831d40 req-86db2d77-da3a-46be-b8e2-e480e2a085bf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116698 Aug 29 15:52:17.286559 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1842/3664] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:17.919041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:17.933395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88827ae1-1538-4e87-a232-6b09f5a7e23c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.867698 Aug 29 15:52:17.935067 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1823/3665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:17 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:18.067264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:18.068393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:18.083635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.088453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.089019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:18.089879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.090537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.091057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:18.157459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:18.160438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:18.185602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.188308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.189848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:18.197665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.199170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.201027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:18.440688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:18.449366 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4aff6044-5f55-46a1-ac33-309fca413e1e tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1634 microversion: 2.1 time: 0.301994 Aug 29 15:52:18.449978 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1824/3666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:18 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1634 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:18.960003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:18.960680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:18.980528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.980970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.981417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:18.982143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:18.982630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:18.983082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.386841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:19.397570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2acb2666-2c40-4f1d-b9ad-e3a0353c1699 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.447381 Aug 29 15:52:19.416027 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1825/3667] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:18 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:19.424294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6c8a49ca-34fc-4336-a2d0-56cb03b19eb7 req-ce2e0b95-4a43-4cac-9b90-3b8b2cbe9fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b64abb5-ddcc-41db-8e94-aafadbc5bad8", "name": "network-vif-deleted", "tag": "19c65448-4185-4334-b94b-0352f0c971a3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:19.445698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6c8a49ca-34fc-4336-a2d0-56cb03b19eb7 req-ce2e0b95-4a43-4cac-9b90-3b8b2cbe9fb0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.447009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6c8a49ca-34fc-4336-a2d0-56cb03b19eb7 req-ce2e0b95-4a43-4cac-9b90-3b8b2cbe9fb0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.447757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6c8a49ca-34fc-4336-a2d0-56cb03b19eb7 req-ce2e0b95-4a43-4cac-9b90-3b8b2cbe9fb0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.470251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6c8a49ca-34fc-4336-a2d0-56cb03b19eb7 req-ce2e0b95-4a43-4cac-9b90-3b8b2cbe9fb0 service nova] Creating event network-vif-deleted:19c65448-4185-4334-b94b-0352f0c971a3 for instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 on n-h1-836830-13 Aug 29 15:52:19.484971 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6c8a49ca-34fc-4336-a2d0-56cb03b19eb7 req-ce2e0b95-4a43-4cac-9b90-3b8b2cbe9fb0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066063 Aug 29 15:52:19.490079 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1826/3668] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:19.498877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:19.504183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:19.535734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.536242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.536682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.537395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.537849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.538276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.578662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:19.621166 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c22e22ef-599f-49f0-9ab8-a9c2820f57c3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 1.578547 Aug 29 15:52:19.624613 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1843/3669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:18 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:19.640646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:19.640844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:19.641286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:19.641869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lazy-loading 'fault' on Instance uuid 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:19.807541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e14fd42e5942199e28335124d59c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8591065e9fa421b8e44767aa38fd84f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:19.821752 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da82ff19-7cd5-47ef-8fab-66dcea5b1b16 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 200 len: 1360 microversion: 2.1 time: 0.330017 Aug 29 15:52:19.822437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1827/3670] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:19 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 1360 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:20.422728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:20.424645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:20.442713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.443260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.443705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.444437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.444892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.451654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.645700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:20.650747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:20.659851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:20.660823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:20.681502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.682030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.682483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:20.683237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:20.694354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:20.694944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.155664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:21.171795 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cdd8be92-a233-43b1-a4b8-60bcdc04b722 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.753084 Aug 29 15:52:21.172564 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1844/3671] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:20 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:21.178340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:21.181727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] [instance: 6b64abb5-ddcc-41db-8e94-aafadbc5bad8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:21.199287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.199921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.200397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.201222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.202800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.203343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.242194 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] HTTP exception thrown: Instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 could not be found. Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Request method failure captured: Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 HTTP/1.1 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOBgjAEeYl-JJ4DuMjnf5nLcarLtebLUJ_T7ywgj-e0hwPtyHWIGuRai3PZtBp5GddseuqY5ujhxw-JNepIgE_BrgcN-C8D49jKtJe4510BeGkm_PY4rB2VCEV2dTOP3asvlGmQcO0iZF_ydqbuYrDlCZC9WFuFbOjBPGKMKFk1SQgc Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a8591065e9fa421b8e44767aa38fd84f Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-197661001 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a8591065e9fa421b8e44767aa38fd84f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a8591065e9fa421b8e44767aa38fd84f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a8591065e9fa421b8e44767aa38fd84f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a8591065e9fa421b8e44767aa38fd84f"}]}] Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-197661001 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a8591065e9fa421b8e44767aa38fd84f Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-197661001 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-197661001-project Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a3e14fd42e5942199e28335124d59c75 Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-197661001-project Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 could not be found. Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6b64abb5-ddcc-41db-8e94-aafadbc5bad8'} Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 could not be found. Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 could not be found. Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:21.245293 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:21.251707 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:21.251707 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:21.251707 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:21.251707 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:21.251707 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 could not be found. Aug 29 15:52:21.251707 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:52:21.255430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Returning 404 to user: Instance 6b64abb5-ddcc-41db-8e94-aafadbc5bad8 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:21.256904 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82c40aca-8e2e-457f-afe1-8f5a3fe0428c tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8" status: 404 len: 111 microversion: 2.1 time: 0.082196 Aug 29 15:52:21.259927 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1845/3672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:21 2022] GET /compute/v2.1/servers/6b64abb5-ddcc-41db-8e94-aafadbc5bad8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:52:21.275301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f5fcef27-406c-44cd-bb47-9c6f08e9116c req-93949a74-e4f8-4216-bd49-7958794ef8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a3214d2-b4b8-473c-8c0b-2872398ac42a", "tag": "dde4f00f-0c2e-4281-8d64-94759d72583e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:21.324140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f5fcef27-406c-44cd-bb47-9c6f08e9116c req-93949a74-e4f8-4216-bd49-7958794ef8b8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:21.324568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f5fcef27-406c-44cd-bb47-9c6f08e9116c req-93949a74-e4f8-4216-bd49-7958794ef8b8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:21.324980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f5fcef27-406c-44cd-bb47-9c6f08e9116c req-93949a74-e4f8-4216-bd49-7958794ef8b8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:21.351938 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f5fcef27-406c-44cd-bb47-9c6f08e9116c req-93949a74-e4f8-4216-bd49-7958794ef8b8 service nova] Creating event network-changed:dde4f00f-0c2e-4281-8d64-94759d72583e for instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a on n-h1-836830-13 Aug 29 15:52:21.364046 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f5fcef27-406c-44cd-bb47-9c6f08e9116c req-93949a74-e4f8-4216-bd49-7958794ef8b8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101579 Aug 29 15:52:21.365251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1846/3673] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:21.378579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ced9566-3391-4287-8631-3fdb4d61e300 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '.version_select at 0x7f32edcaa040>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:21.416821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2ced9566-3391-4287-8631-3fdb4d61e300 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412321609" status: 202 len: 0 microversion: 2.1 time: 0.049874 Aug 29 15:52:21.420241 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1847/3674] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:52:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412321609 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:21.556290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:21.560269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:21.584702 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77ee264d-3ca0-424c-8586-aab17c054db3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.939751 Aug 29 15:52:21.604898 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1828/3675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:20 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:21.658434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ced9566-3391-4287-8631-3fdb4d61e300 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:21.659738 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2ced9566-3391-4287-8631-3fdb4d61e300 tempest-ServersTestJSON-197661001 tempest-ServersTestJSON-197661001-project] 10.222.0.83 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001683 Aug 29 15:52:21.660251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1848/3676] 10.222.0.83 () {56 vars in 886 bytes} [Mon Aug 29 15:52:21 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:52:22.197084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:22.197842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:22.214115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:22.214889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:22.248252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.251530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.252070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.252907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.254284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.256032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.452052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1158137182", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": "none"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:22.541555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:52:22.542008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:52:22.542746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:52:22.543390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:52:22.543957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:52:22.556222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.557543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.558165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.560227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.560901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.561499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.586691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Getting quotas for project 1d3e63fe33a948479fef57a282a550a4. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:52:22.592523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Getting quotas for user fcd83e325cca4e2f86fcb3010138ace6 and project 1d3e63fe33a948479fef57a282a550a4. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:52:22.616794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:52:22.619455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:52:22.674863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-497dbd11-38cd-405e-9630-8b2c3d12f82e tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.467898 Aug 29 15:52:22.676305 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1849/3677] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:52:22.682247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:22.683775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:22.692740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.693774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.694507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:22.697175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:22.697863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:22.698547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:23.021643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.034927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7551f58b-1815-40c3-98c3-4651dc62d128 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.843078 Aug 29 15:52:23.040844 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1829/3678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:22 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:23.046168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-66a2f25a-d487-440c-9539-cacff0333ca7 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:23.060896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-66a2f25a-d487-440c-9539-cacff0333ca7 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:23.194198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.208381 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2822fca-c5e0-4dcc-812a-ab9d871c4c35 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.530823 Aug 29 15:52:23.208983 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1850/3679] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:22 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:23.334153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-66a2f25a-d487-440c-9539-cacff0333ca7 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.360514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-66a2f25a-d487-440c-9539-cacff0333ca7 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.371300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-66a2f25a-d487-440c-9539-cacff0333ca7 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:23.378128 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-66a2f25a-d487-440c-9539-cacff0333ca7 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1281 microversion: 2.47 time: 0.332074 Aug 29 15:52:23.381557 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1830/3680] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:23 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:24.063441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:24.064093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:24.088549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.089059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.089575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.090224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.098805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.099346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.232461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:24.233097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:24.255705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.256207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.256651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.261520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.261959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.262408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.780340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:24.802417 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45147827-35ec-46aa-a594-3ddafff77966 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.576186 Aug 29 15:52:24.803601 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1831/3681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:24 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:24.818509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:24.821360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:24.840208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.841055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.841650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:24.842569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:24.843247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:24.843857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.090028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.120177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.122213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.123997 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-420990b5-c6e6-47fa-b585-6df88a078765 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1351 microversion: 2.47 time: 0.319085 Aug 29 15:52:25.124949 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1832/3682] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:24 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1351 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:25.130730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:25.141831 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0b15b26-12a1-4c37-975b-5af898bdef99 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 1.084286 Aug 29 15:52:25.163607 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1851/3683] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:24 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:25.830280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:25.830893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:25.840892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.841387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.841824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:25.842535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:25.842992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:25.849095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.153386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.154015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.165910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.168703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.169320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.174159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.174834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.181287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.235153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.257337 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-61ccdfa2-35bb-4fdb-9850-7a9f22d9b79c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.431099 Aug 29 15:52:26.260750 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1833/3684] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:25 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:26.277811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:26.279089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:26.291358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.292292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.292891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.295540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:26.297009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:26.297798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:26.647562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.661877 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-867b0dbf-e907-47c1-b2ad-f0e0a12e593e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.399563 Aug 29 15:52:26.665887 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1834/3685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:26.723055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.730633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:26.738509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.742850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:26.745148 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81b5712a-351a-4112-bf29-d62b96be94b3 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1339 microversion: 2.47 time: 0.597280 Aug 29 15:52:26.746589 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1852/3686] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:26 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1339 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:27.283542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.284577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.307778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.308634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.309749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.311872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.314086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.316261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.687167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:27.687999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:27.711223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.716441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.717235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:27.720693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:27.722438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:27.725696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.100502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.119999 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3ed1311c-8a7e-48df-942e-149eeaa8145d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.841681 Aug 29 15:52:28.121374 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1835/3687] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:28.132955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:28.134336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:28.149292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.150090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.153415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.154344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.155733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.156337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.343281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.353545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.362689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.364246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a2dea93-4ed8-4922-bef0-61eaca05a19b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1360 microversion: 2.47 time: 0.241656 Aug 29 15:52:28.368846 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1836/3688] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:28 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1360 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:28.402738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-603968830"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:28.408460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:28.427474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.428452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.429176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.430954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.431610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.437152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.641216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:28.650908 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8416f73b-9b25-4c3e-8353-cfea15eb8286 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.967612 Aug 29 15:52:28.655120 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1853/3689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:27 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:28.822076 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-297ab098-5de0-41db-9bbd-14da01fbcb59 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "POST /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be/action" status: 202 len: 52 microversion: 2.47 time: 0.425459 Aug 29 15:52:28.832118 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1837/3690] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:52:28 2022] POST /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be/action => generated 52 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 29 15:52:28.837052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:28.838141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:28.858398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.859390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.860005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.861645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:28.871453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:28.875915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:28.915909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:52:29.083310 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b77066f2-f2fc-442e-aa1f-e6f8f8faa31a tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "DELETE /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 204 len: 0 microversion: 2.47 time: 0.250561 Aug 29 15:52:29.084958 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1854/3691] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:52:28 2022] DELETE /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:52:29.098879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.099768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.134451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.135683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.136241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.137088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.137818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.139896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.146316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.147063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.164762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.165412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.166024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.166777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.167542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.168450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.416579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.448090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.450600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:29.452056 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45188678-fc60-44dc-8acf-ac7777237911 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1366 microversion: 2.47 time: 0.361626 Aug 29 15:52:29.453947 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1838/3692] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:29.459111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fbfff0c3-7e23-44b6-b05f-c54c27a37f02 req-034a883c-2347-4456-a997-0d0f979c0ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3214d2-b4b8-473c-8c0b-2872398ac42a", "name": "network-vif-plugged", "status": "completed", "tag": "dde4f00f-0c2e-4281-8d64-94759d72583e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:29.484953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbfff0c3-7e23-44b6-b05f-c54c27a37f02 req-034a883c-2347-4456-a997-0d0f979c0ab1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.485439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbfff0c3-7e23-44b6-b05f-c54c27a37f02 req-034a883c-2347-4456-a997-0d0f979c0ab1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.485864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbfff0c3-7e23-44b6-b05f-c54c27a37f02 req-034a883c-2347-4456-a997-0d0f979c0ab1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.519208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fbfff0c3-7e23-44b6-b05f-c54c27a37f02 req-034a883c-2347-4456-a997-0d0f979c0ab1 service nova] Creating event network-vif-plugged:dde4f00f-0c2e-4281-8d64-94759d72583e for instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a on n-h1-836830-13 Aug 29 15:52:29.529020 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fbfff0c3-7e23-44b6-b05f-c54c27a37f02 req-034a883c-2347-4456-a997-0d0f979c0ab1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073389 Aug 29 15:52:29.534781 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1839/3693] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:29.679489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:29.680814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:29.699936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.700492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.700945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:29.701665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:29.702130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:29.702826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.082148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.096116 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e50026a2-c215-4f6d-aa69-554f6ab9e8ce tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.422345 Aug 29 15:52:30.100822 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1840/3694] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:30.479536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:30.480201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:30.494443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.494957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.495528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.496358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:30.496818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:30.502158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:30.670699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.687487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.689035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.690256 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59ca757c-cde5-443a-8185-1e87d7368c06 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1366 microversion: 2.47 time: 0.215594 Aug 29 15:52:30.690859 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1841/3695] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:30 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:30.715524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:30.732390 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-265537ff-45d0-46a8-b12b-5c0d7989bee5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 1.591265 Aug 29 15:52:30.736185 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1855/3696] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:29 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:31.125294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.126057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.139751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.141240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.142035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.145386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.145963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.146630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.555548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.566748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29c3dcd8-d1f8-46ff-ad2b-f4e92691c32a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 0.446577 Aug 29 15:52:31.567848 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1842/3697] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:31 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:31.717737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.719111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.736580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.745463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.747591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.749955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.750983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.751832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.765261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:31.765942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:31.778550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.779901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.780519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.781805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:31.782506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:31.783325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:31.964132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.979222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.983754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:31.985202 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-854f2c2d-2a8d-48fa-8d35-f11a6d1d045b tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1366 microversion: 2.47 time: 0.275332 Aug 29 15:52:31.988008 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1856/3698] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:31 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:52:32.271480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:32.296042 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-48f8a90b-fc64-4996-a714-6e23cd57d726 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.537559 Aug 29 15:52:32.301057 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1843/3699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:31 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:32.590530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:32.591217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:32.600306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:32.604852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.608994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.609698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.610619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:32.611324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:32.611950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:32.615111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:33.010868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:33.012143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:33.028362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.028851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.029501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.030380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.032416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.040686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.212035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.229340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.231217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fcd83e325cca4e2f86fcb3010138ace6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3e63fe33a948479fef57a282a550a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.238695 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc3a9323-4fdf-434e-b3a7-d19d82ff2613 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 200 len: 1366 microversion: 2.47 time: 0.226049 Aug 29 15:52:33.240136 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1844/3700] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:33 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:52:33.331666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:33.333081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:33.353869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:33.356118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.357072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.358864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.360029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:33.361254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:33.362590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:33.630803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.647630 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6851168d-0d15-416f-8501-189a64aee0aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1313 microversion: 2.1 time: 1.061048 Aug 29 15:52:33.649698 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1857/3701] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:32 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1313 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:33.839738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:33.852683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:33.860518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f195a86-a66b-425c-be96-e11feda0b56e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.537235 Aug 29 15:52:33.864722 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1845/3702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:33 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:34.263900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:34.267698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:34.268421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] [instance: 82c95edb-e157-4179-a000-2462126f15be] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:34.274673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.275652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Searching by: {'deleted': False, 'project_id': '6d1b9fcde555493f86ea437619efbea9'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:52:34.286748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.287102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.287781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.288625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.289847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.290688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.291449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.292443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.294269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.295150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.300222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.301090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.319687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:52:34.341177 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] HTTP exception thrown: Instance 82c95edb-e157-4179-a000-2462126f15be could not be found. Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Request method failure captured: Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be HTTP/1.1 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOC1YCrY04bP03VJFjjhT61fhG8MWZTwk9msuSUYJqr6mUGK0A2as_fxtJ01XeTz7e8uWvVV8YPDE9fWqv0VSRPABpZp1d-Zd7EnIfiq8QQrHLbvKz5L3-zZXFJcdz3-orvNaqm-HoYn2GYadTUtN7N-TPzYdaZbYr72kDLS1lSRyDk Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 1d3e63fe33a948479fef57a282a550a4 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAaction247Test-1929113112 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1d3e63fe33a948479fef57a282a550a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1d3e63fe33a948479fef57a282a550a4", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1d3e63fe33a948479fef57a282a550a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1d3e63fe33a948479fef57a282a550a4"}]}] Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAaction247Test-1929113112 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 1d3e63fe33a948479fef57a282a550a4 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAaction247Test-1929113112 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAaction247Test-1929113112-project Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: fcd83e325cca4e2f86fcb3010138ace6 Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAaction247Test-1929113112-project Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 82c95edb-e157-4179-a000-2462126f15be could not be found. Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '82c95edb-e157-4179-a000-2462126f15be'} Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c95edb-e157-4179-a000-2462126f15be could not be found. Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c95edb-e157-4179-a000-2462126f15be could not be found. Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:34.343361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c95edb-e157-4179-a000-2462126f15be could not be found. Aug 29 15:52:34.348421 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:52:34.352443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] Returning 404 to user: Instance 82c95edb-e157-4179-a000-2462126f15be could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:52:34.353926 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6a8082b-d468-4946-b81e-df5f47edef54 tempest-ServersAaction247Test-1929113112 tempest-ServersAaction247Test-1929113112-project] 10.222.0.83 "GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be" status: 404 len: 111 microversion: 2.47 time: 0.090275 Aug 29 15:52:34.354525 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1846/3703] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:52:34 2022] GET /compute/v2.1/servers/82c95edb-e157-4179-a000-2462126f15be => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:52:34.372873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8501249a-07d2-4d3d-bbc7-fddcda5050d6 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.118318 Aug 29 15:52:34.374095 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1858/3704] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:52:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:34.388397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:34.393915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.394988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Searching by: {'deleted': False, 'project_id': '6d1b9fcde555493f86ea437619efbea9'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:52:34.401364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.402190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.402722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.403676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.404222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.404713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.441191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:52:34.499519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:34.508192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.509218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.509817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.672698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:34.674390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:34.690707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.691291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.691736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.694768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.698461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.698943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.936940 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a91ca09a-97e5-4303-827b-856134d4fa60 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.551482 Aug 29 15:52:34.937946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1847/3705] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:52:34 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:34.957373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:34.959806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:34.991442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.993000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.993752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:34.995095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:34.996537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:34.997726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.599627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.656953 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c6d7e055-3790-4d9c-b4bc-cffee916632e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1500 microversion: 2.1 time: 0.990145 Aug 29 15:52:35.660270 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1859/3706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:34 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1500 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:35.675363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6c21a6da-b986-4641-8fa6-98d5fc2f8779 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:35.686564 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6c21a6da-b986-4641-8fa6-98d5fc2f8779 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023742 Aug 29 15:52:35.687772 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1860/3707] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:52:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:35.694422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:35.699616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:35.740140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.741278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.742985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.744259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.746413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.750905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.751422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:35.770422 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd2ae2d2-7842-4c70-b425-204d0cfcdde3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.831142 Aug 29 15:52:35.775359 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1848/3708] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:34 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:35.812542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lazy-loading 'flavor' on Instance uuid 9a3214d2-b4b8-473c-8c0b-2872398ac42a {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:35.944072 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee5ae8c9-114b-490d-9cf9-04f0a26b793d tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "POST /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a/action" status: 200 len: 32 microversion: 2.1 time: 0.254129 Aug 29 15:52:35.948792 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1861/3709] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:52:35 2022] POST /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:52:35.955724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:35.956602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:35.973394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.974640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.976049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:35.979198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:35.980241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:35.980903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.027670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.028710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:36.052273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.053100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.053919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.055213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.055679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.056109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.118228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:52:36.293693 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38ee512d-e39d-42d5-a94a-6641374e40a8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 204 len: 0 microversion: 2.1 time: 0.272526 Aug 29 15:52:36.300721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1862/3710] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:52:36 2022] DELETE /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:52:36.310097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.311219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:36.320088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.322033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.322656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.324142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.324961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.336733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.687853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:36.696717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd7939b7-e029-426c-b669-8f7e6d8919d2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.745471 Aug 29 15:52:36.706425 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1849/3711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:35 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:36.710306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:36.719724 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1995fc38-7d74-423e-a590-0b08c3ead7a5 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1610 microversion: 2.1 time: 0.416943 Aug 29 15:52:36.736902 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1863/3712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:36 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1610 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:36.800627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:36.801137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:36.814804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.815336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.815944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:36.816485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:36.817123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:36.819697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.486171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:37.506860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c1c0f86f-161a-4d84-bbc9-df2d958f892d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1717 microversion: 2.1 time: 0.709697 Aug 29 15:52:37.517929 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1850/3713] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:36 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1717 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:37.727561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:37.728178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:37.746571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:37.746951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:37.752866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.753354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.753789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.762854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.763382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.763823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.767414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.767916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.768355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:37.772444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:37.772938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:37.773545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.265195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:38.279774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b9512929-e443-4fc5-a6c2-0c2c7d661243 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1610 microversion: 2.1 time: 0.538392 Aug 29 15:52:38.280453 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1851/3714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:37 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1610 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:38.531252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:38.531885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:38.549054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.549823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.550824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:38.551643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:38.552105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:38.552539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.041127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:39.043756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:39.065138 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-967d7dda-fbc4-4b10-bf5f-6120c54721d3 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 1.341786 Aug 29 15:52:39.065742 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1864/3715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:37 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:39.306412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.307492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:39.315643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.324096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.324909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.326092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.327471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.328130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.694708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:39.719677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d887956-3f3e-4ba3-b343-ece51e38cc38 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1707 microversion: 2.1 time: 1.193932 Aug 29 15:52:39.721215 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1852/3716] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:38 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1707 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:39.762515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7435327-9fde-40b2-98d4-d13facfa8296 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '.version_select at 0x7f32edcaae50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.792127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7435327-9fde-40b2-98d4-d13facfa8296 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.794046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7435327-9fde-40b2-98d4-d13facfa8296 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.796244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7435327-9fde-40b2-98d4-d13facfa8296 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.815212 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7435327-9fde-40b2-98d4-d13facfa8296 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 1180 microversion: 2.1 time: 0.076879 Aug 29 15:52:39.815844 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1853/3717] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/os-migrations => generated 1180 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:39.832679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:39.833299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:39.842153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.843167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.843768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.844954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:39.845897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:39.846500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:39.989971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:40.008106 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-31322d29-adf4-4863-b387-9e473ba1010a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1610 microversion: 2.1 time: 0.705974 Aug 29 15:52:40.011445 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1865/3718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1610 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:40.107439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:40.108093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:40.158150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.161252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.162265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.172243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.174361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.175609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.323872 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e026ee1c-4df3-4df4-b1e1-70a11bb23389 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1860 microversion: 2.1 time: 0.496040 Aug 29 15:52:40.324727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1854/3719] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:39 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1860 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:40.345737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:40.346628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:40.354348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.354882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.355434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.356267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.356989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.357664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.856497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ada4fbe-290c-47e6-a817-9c6bd4e70c55 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1860 microversion: 2.1 time: 0.514481 Aug 29 15:52:40.859791 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1855/3720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:40 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1860 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:40.952545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:40.953046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:40.963677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.965335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.965798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:40.967486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:40.968159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:40.968862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.104695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lazy-loading 'services' on Instance uuid 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:52:41.216874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:41.249733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4ca6188-0935-4605-9eab-859bb6db3b94 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 1.157821 Aug 29 15:52:41.250918 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fcddd6ea-63b5-43b6-a8c7-a5f5b58ada96 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "DELETE /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments/41416e10-33a6-4fbe-b7af-a6b4d2fa593c" status: 202 len: 0 microversion: 2.1 time: 0.303110 Aug 29 15:52:41.251422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1866/3721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:40 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:41.255075 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1856/3722] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 15:52:40 2022] DELETE /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments/41416e10-33a6-4fbe-b7af-a6b4d2fa593c => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:52:41.272904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:41.274218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:41.276203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:41.278943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:41.291732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.292801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.299489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.302958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.305867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.308105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.308497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.309196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:41.309386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.309558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:41.310682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.311127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:41.408426 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7cf9ed8-497c-4153-8162-3153362f9984 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151749 Aug 29 15:52:41.413246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1857/3723] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:41 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:41.604279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:41.618787 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28b276bd-7edc-4cd2-bd28-dbf36c928e02 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1542 microversion: 2.1 time: 0.364952 Aug 29 15:52:41.620446 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1867/3724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:41 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1542 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:42.171352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-282cf453-3ede-487d-bd39-8a0e03c50fae req-4c7c8d26-7caa-4008-a694-e93c4ecd8e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b28d1d0-b6c2-4164-b006-4a3bcac6274c", "name": "network-vif-deleted", "tag": "80fb79a2-3f36-4e29-bf67-fd13b72df86e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:52:42.202840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-282cf453-3ede-487d-bd39-8a0e03c50fae req-4c7c8d26-7caa-4008-a694-e93c4ecd8e47 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.203632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-282cf453-3ede-487d-bd39-8a0e03c50fae req-4c7c8d26-7caa-4008-a694-e93c4ecd8e47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.210942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-282cf453-3ede-487d-bd39-8a0e03c50fae req-4c7c8d26-7caa-4008-a694-e93c4ecd8e47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.241364 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-282cf453-3ede-487d-bd39-8a0e03c50fae req-4c7c8d26-7caa-4008-a694-e93c4ecd8e47 service nova] Creating event network-vif-deleted:80fb79a2-3f36-4e29-bf67-fd13b72df86e for instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c on n-h2-836830-13 Aug 29 15:52:42.254414 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-282cf453-3ede-487d-bd39-8a0e03c50fae req-4c7c8d26-7caa-4008-a694-e93c4ecd8e47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086982 Aug 29 15:52:42.255083 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1858/3725] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:42.272678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.273641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:42.308081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.311499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.311873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.312626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.313089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.313525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.425707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.428408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:42.448133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.448821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.450427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.451614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.452257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.452857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.549065 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-62e5832c-5c3f-4b0c-92fe-08dd7daf36b3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130762 Aug 29 15:52:42.550278 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1859/3726] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:42.644435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:42.646243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:42.657770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:42.666636 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ae7865c-0b9b-4e30-9990-ea7245b45748 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.397460 Aug 29 15:52:42.672247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.673490 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1868/3727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:42.675472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.676093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:42.676829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:42.679734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:42.680178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.093366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:43.110045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-262425ca-733b-4bba-a506-36524a38b86b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.470238 Aug 29 15:52:43.111591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1860/3728] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:42 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:43.562017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:43.565667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:43.589012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.589504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.589943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.590712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.599230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.599820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.694590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:43.695965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:43.709624 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a395c6c-e090-401e-aa72-288fedcd022c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151481 Aug 29 15:52:43.713103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.715221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.717676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:43.719166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:43.725503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:43.725726 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1869/3729] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:43 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:43.726370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.131169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:44.132003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:44.147614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.148770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.149530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.150254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.150713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.151183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.305952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:44.417698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:44.421127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:44.433154 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3f0b4947-1c45-43ed-a314-132d09db66f8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.306124 Aug 29 15:52:44.434061 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1870/3730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:44 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:44.497736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:44.724295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:44.727383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:44.735788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.736921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.737590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.738555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:44.739330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:44.739986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:44.802422 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-93089e28-e674-43dc-abb7-23e7f96f9b83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084056 Aug 29 15:52:44.803485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1871/3731] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:44 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:45.103062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:45.113260 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-433a76d4-9f8c-49a5-a0d2-58b82f7c2439 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 1.423029 Aug 29 15:52:45.131477 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1861/3732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:43 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:45.465656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:45.466769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:45.483154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:45.484131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:45.486491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:45.487767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:45.493473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:45.494249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:45.629035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:45.639225 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69914194-872a-4c00-a83f-9e6356c0ca4b tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.187540 Aug 29 15:52:45.640778 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1872/3733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:45 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:45.816064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:45.818671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:45.821701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=92 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:45.827558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:45.828371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:45.829047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:45.830016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:45.831047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:45.831742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:45.866083 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5c29b835-078b-4a95-983f-abc5069599cb tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053946 Aug 29 15:52:45.879978 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1862/3734] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:45 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:46.141831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:46.143191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:46.157445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:46.159398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.160215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.161489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.168064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.168901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.169565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.487887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:46.506187 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6a485bc-7e89-4f8f-88b6-92bb6f4d60aa tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.361707 Aug 29 15:52:46.508058 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1873/3735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:46.665548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:46.666929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:46.684624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.685620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.687697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.692530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.696225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.697941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.715924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:46.891380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:46.894409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:46.909624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.914846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.915339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.916091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:46.916558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:46.917393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:46.995328 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f531845d-7f3b-45c7-91ac-d50904a1731a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107890 Aug 29 15:52:46.997834 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1874/3736] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:47.155236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:47.169380 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0fe9b61c-4447-4e4f-a227-6eed0370b81d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.511471 Aug 29 15:52:47.174769 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1863/3737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:46 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:47.531609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:47.532229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:47.547610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:47.548383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:47.548977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:47.549847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:47.550468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:47.561495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:48.009526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:48.012136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:48.040136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:48.040754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:48.041211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:48.052133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:48.053041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:48.053827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:48.123677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-847a3390-f032-4310-a070-3b2ac4a051b1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118595 Aug 29 15:52:48.125004 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1864/3738] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:48 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:48.199960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:48.200913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:48.215901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:48.216700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:48.218665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:48.221392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:48.223809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:48.224797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:48.364292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:48.374309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cbeee03c-98b3-4797-96d2-100aed63e862 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.846596 Aug 29 15:52:48.378138 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1875/3739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:47 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:48.511353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:48.525257 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88cc66c2-7d9e-48c5-aa4f-dde1fcb978de tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.334507 Aug 29 15:52:48.528758 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1865/3740] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:48 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:49.138261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:49.140964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:49.161742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.170316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.170808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.171599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.172096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.172529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.272094 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7db470eb-ad8d-409b-b88c-6dfa1c32a477 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139382 Aug 29 15:52:49.272979 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1876/3741] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:49 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:52:49.400729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:49.403250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:49.421004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.427036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.430170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.431402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.432267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.433001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.570553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:49.572079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:49.582729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.583657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.584377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.586950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:49.587762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:49.588444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:49.910416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:49.943604 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6904e5f5-46f5-407a-9aee-298a61e0022c tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.391032 Aug 29 15:52:49.962260 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1877/3742] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:49 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:50.287163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:50.291149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:50.309357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:50.323574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:50.324568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:50.325353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:50.325839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:50.326274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:50.418955 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7c30bbbf-c46d-458b-a6bd-6b1e75af2871 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138422 Aug 29 15:52:50.419768 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1878/3743] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:50 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:52:50.974359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:50.975339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:50.991595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.007084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.007958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:51.008672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.016247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.017135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:51.465908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:51.484130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1bc91db9-1957-4ced-b28e-1c3046527971 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 2.086948 Aug 29 15:52:51.489746 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1866/3744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:49 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:51.519703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:51.533414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:51.557813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.558321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.558766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:51.559513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:51.579737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:51.580299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:51.681881 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d6d7be45-d170-444d-a9c4-dde6816d3818 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.190913 Aug 29 15:52:51.710140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1867/3745] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:52:51 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933/os-volume_attachments => generated 25 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:52:51.916014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:51.935831 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9c42a206-7363-4b11-957c-a52f2a5f7975 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.966473 Aug 29 15:52:51.940144 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1879/3746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:50 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:52.508354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.508998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:52.540223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.540886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.542353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.543414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:52.543697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:52.544375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:52.966441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:52.967349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:53.012398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.029234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.029965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.030919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:53.035955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:53.036671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:53.728506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:53.737207 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0dd52a3e-b505-4fb5-872a-bd7958b14b7b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 1.234539 Aug 29 15:52:53.752244 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1868/3747] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:52 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:53.906913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:53.922092 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-98b67673-3d1d-4558-ad5c-403208cbba31 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.956958 Aug 29 15:52:53.925347 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1880/3748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:52 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:54.772808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:54.773673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:54.789212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.790039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.790733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.791886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.792605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.798499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.948120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:54.948744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:54.961097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.989199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:54.990470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:54.994856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:54.997536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:55.001069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:55.093903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:52:55.269438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:55.288279 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d14a0da8-ee90-4a8c-9170-dbb3324fd843 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.345596 Aug 29 15:52:55.310639 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1881/3749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:54 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:56.320943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:56.321620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:56.331460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:56.331871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:56.332308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:56.339352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:56.339980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:56.347061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:56.408049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:56.433138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28af5f52-2b10-46a9-ac72-5a6aefde3d86 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 1.651150 Aug 29 15:52:56.434025 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1869/3750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:54 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:56.720264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:56.776880 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fc5e991-e56b-4411-a120-27c37e87588d tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.450135 Aug 29 15:52:56.782278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1882/3751] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:56 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:57.456736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:57.458219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:57.478825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.480109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.487924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:57.489041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.489904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.491468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:57.800340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:57.803205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:57.819459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.820958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.822018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:57.822939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:57.823588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:57.824370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:58.171400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:58.197833 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7e7d7575-81a9-4920-978f-a43fbca97ba4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.744408 Aug 29 15:52:58.201793 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1870/3752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:57 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:52:58.422474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:58.442473 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a86a7feb-795c-4595-a196-b99b35a23336 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.646567 Aug 29 15:52:58.444068 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1883/3753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:57 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:52:59.225115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:59.225678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:59.242284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.243466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.244117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.245303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.260952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.261954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.466828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:52:59.480521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:52:59.511997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.521857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.522708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.524504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:52:59.530099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:52:59.531523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:52:59.744312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:52:59.764030 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49bc832e-fd19-4488-8951-73bdc6a04bd9 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.301251 Aug 29 15:52:59.766763 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1884/3754] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:59 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:00.790007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:00.790676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:00.810518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:00.811046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:00.811483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:00.812196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:00.813016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:00.813122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:00.956430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:00.972854 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6027856b-abb2-4d60-a317-5125f8b1b5e8 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1252 microversion: 2.1 time: 0.187216 Aug 29 15:53:00.986871 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1885/3755] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:00 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1252 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:01.236669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:01.248872 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9fa5c4c9-1dda-44a4-a813-309f9259c400 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 2.028235 Aug 29 15:53:01.256639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1871/3756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:52:59 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:01.994867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:01.998881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:02.022528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.023139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.023596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.024331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.024808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.025220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.143064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.143887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.144495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.145121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lazy-loading 'fault' on Instance uuid 2b28d1d0-b6c2-4164-b006-4a3bcac6274c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:02.244229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd008ed466820477197b94d0c18f7eb1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b9fcde555493f86ea437619efbea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:02.273522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:02.276979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:02.282043 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40477617-182b-42af-a4fa-93eff8fbbf64 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 200 len: 1257 microversion: 2.1 time: 0.292002 Aug 29 15:53:02.284378 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1886/3757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:01 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 1257 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:02.298068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.298918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.299717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:02.303483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:02.306565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:02.307523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:03.312487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:03.315615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] [instance: 2b28d1d0-b6c2-4164-b006-4a3bcac6274c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:03.326789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:03.328495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:03.329778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:03.331354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:03.332628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:03.334744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:03.350627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:03.372716 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ce3f603-32bc-42d3-a25b-28465107e50f tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 1.096598 Aug 29 15:53:03.378375 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1872/3758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:02 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:03.389930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] HTTP exception thrown: Instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c could not be found. Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Request method failure captured: Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c HTTP/1.1 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOBDWiIdUjMC-X3YVAo5ig0X6-S5LoziWtivOsrn1sC2QKTxG1WNLGBtHPWEKvuJTYVpFnnYmXdUvz3sufx8CQJsuHlMEJEMbJAZa4pR0HvhnExr_LGJil5v_SKHWWCjQQ9cszs5MpKQub-X5nPT_gVwO1TvjlNOucOEt9zdkJAEwSk Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d1b9fcde555493f86ea437619efbea9 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestBootFromVolume-809576161 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d1b9fcde555493f86ea437619efbea9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d1b9fcde555493f86ea437619efbea9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d1b9fcde555493f86ea437619efbea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d1b9fcde555493f86ea437619efbea9"}]}] Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestBootFromVolume-809576161 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d1b9fcde555493f86ea437619efbea9 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestBootFromVolume-809576161 Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestBootFromVolume-809576161-project Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: d008ed466820477197b94d0c18f7eb1c Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestBootFromVolume-809576161-project Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c could not be found. Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '2b28d1d0-b6c2-4164-b006-4a3bcac6274c'} Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c could not be found. Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c could not be found. Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:03.395178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:03.401143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:03.401143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:03.401143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:03.401143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:03.401143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:03.401143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c could not be found. Aug 29 15:53:03.401143 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:03.408027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Returning 404 to user: Instance 2b28d1d0-b6c2-4164-b006-4a3bcac6274c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:03.411826 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1662c299-770e-4fbc-852e-1b70b6ffe764 tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c" status: 404 len: 111 microversion: 2.1 time: 0.109120 Aug 29 15:53:03.414066 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1887/3759] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:03 2022] GET /compute/v2.1/servers/2b28d1d0-b6c2-4164-b006-4a3bcac6274c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:53:03.423311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-406e7f43-c415-4b1d-baee-edbf00112e8a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] Calling method '.version_select at 0x7f32f2ab90d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:03.465479 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-406e7f43-c415-4b1d-baee-edbf00112e8a tempest-ServersTestBootFromVolume-809576161 tempest-ServersTestBootFromVolume-809576161-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940067481" status: 202 len: 0 microversion: 2.1 time: 0.046799 Aug 29 15:53:03.466394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1873/3760] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:53:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940067481 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:53:04.397170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:04.397793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:04.410241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:04.410738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:04.414916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:04.422027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:04.424657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:04.426033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:04.647510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-614675296", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "6ae90032-6ff2-4121-9c65-8721d2da0f47"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:04.755717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] validate_networks() for [('6ae90032-6ff2-4121-9c65-8721d2da0f47', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:53:05.012213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:05.024417 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-886acfab-5e24-41c4-83af-31a07004bf98 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.631160 Aug 29 15:53:05.028554 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1888/3761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:04 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:05.176373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-840bbc85-8d52-4117-9b01-8200f6d44812 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'create', calling method: .version_select at 0x7f32ed7121f0>, body: {"keypair": {"name": "tempest-keypair-299896968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLemdFFqz55AFPZjJLmeWQnrSijuiUeXm9roXaDvy8I29xGpPeSM79RXM+BRMR7K2PEZdoF3eIzG45uGMW+b5SeoKjghReVM51iUTupc8bK0AqFq0zegCTyI5DiE+xUdjA=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:05.215966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-840bbc85-8d52-4117-9b01-8200f6d44812 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for project c7ad457701f641bd963da9221fb04094. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:05.228335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-840bbc85-8d52-4117-9b01-8200f6d44812 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for user f554eb660c324a759d70b3b974e78db5 and project c7ad457701f641bd963da9221fb04094. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:05.280902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-840bbc85-8d52-4117-9b01-8200f6d44812 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.249997 Aug 29 15:53:05.289537 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1889/3762] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:53:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:06.064075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:06.067257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:06.092430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:06.092927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:06.093366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.102248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:06.109390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:06.110022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.481346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:53:06.481912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:53:06.482228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:53:06.482640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:53:06.483352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:53:06.514738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:06.515412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:06.515878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.518649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:06.519181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:06.519625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:06.572525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Getting quotas for project 04c4fb2330864b258b2e919220393bef. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:06.586800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Getting quotas for user f7baa9210bfb4895a247d55cdfcf98a5 and project 04c4fb2330864b258b2e919220393bef. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:06.654224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:53:06.658136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:53:06.794116 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d084394-0bbe-4aa8-a33f-34d1191a5649 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.307817 Aug 29 15:53:06.796434 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1874/3763] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:53:06.817575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ca890a2-37a9-467b-a063-6a508788bad5 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:06.818536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ca890a2-37a9-467b-a063-6a508788bad5 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:07.256584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ca890a2-37a9-467b-a063-6a508788bad5 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:07.274583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ca890a2-37a9-467b-a063-6a508788bad5 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1216 microversion: 2.1 time: 0.467047 Aug 29 15:53:07.277504 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1875/3764] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:06 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1216 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:07.329167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:07.348352 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6dd76293-03c7-4d54-aaf5-feb18189c50b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1486 microversion: 2.1 time: 1.297552 Aug 29 15:53:07.354836 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1890/3765] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:06 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1486 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:07.378950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:07.379791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:07.409452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:07.409948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:07.410388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:07.418401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:07.418818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:07.419289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:07.635294 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68466578-f72e-460f-81c0-08c7bd49a27c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "POST /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a/action" status: 202 len: 0 microversion: 2.1 time: 0.261257 Aug 29 15:53:07.635959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1876/3766] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:53:07 2022] POST /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:53:07.644579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:07.645353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:07.657593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:07.662522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:07.666895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:07.668777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:07.671469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:07.673769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:08.303637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:08.305799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:08.313390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:08.327705 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e51e9f48-adf4-4456-97a0-cd7079dcd6f4 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1494 microversion: 2.1 time: 0.687046 Aug 29 15:53:08.328340 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1891/3767] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:07 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1494 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:08.334908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:08.336983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:08.339175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:08.341433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:08.342987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:08.346437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:08.910762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:08.926075 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04523f75-d489-4a00-a197-c02e1e8c2cdc tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1268 microversion: 2.1 time: 0.629635 Aug 29 15:53:08.932325 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1877/3768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:08 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1268 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:09.348603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:09.349520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:09.376804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.377311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.377920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.378658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.379174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.379613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.954597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:09.957407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:09.958687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:09.974071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9d36b42-6607-405a-a99a-a2223a9b23b0 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1494 microversion: 2.1 time: 0.625273 Aug 29 15:53:09.975109 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1892/3769] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:09 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1494 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:09.975828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.977466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.979361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:09.981311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:09.983305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:09.985568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:10.292813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:10.305542 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc7f8f4d-2f23-4bb4-a61f-f8af1720ee1d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1274 microversion: 2.1 time: 0.350815 Aug 29 15:53:10.308246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1878/3770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:09 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1274 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:11.010569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:11.011776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:11.053472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.054442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.055097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.056048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.056674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.061180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.333337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:11.335164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:11.345896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.347540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.349059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.350103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:11.350871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:11.352270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:11.550554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:11.580076 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b4f96b2-9bbf-4a45-8685-617f22961724 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1274 microversion: 2.1 time: 0.251067 Aug 29 15:53:11.584328 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1879/3771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:11 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:12.614288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:12.614954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:12.637554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.641154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.641691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.644646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:12.645977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:12.647731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:12.860142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:12.889448 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b262ea6e-8bd3-4944-8e67-adf835eb56d1 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1494 microversion: 2.1 time: 1.896504 Aug 29 15:53:12.897120 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1893/3772] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:10 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1494 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:13.615100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:13.631723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4589d950-3004-46d3-a972-6fea17f529f1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 1.027037 Aug 29 15:53:13.640312 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1880/3773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:12 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:13.740973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1122391170", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "af62ca65-b034-43c4-891b-62db8bcf8fcf"}, {"uuid": "c9408597-34c6-4b8c-b796-d82c8b51d72f"}, {"uuid": "af62ca65-b034-43c4-891b-62db8bcf8fcf"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:13.891445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] validate_networks() for [('af62ca65-b034-43c4-891b-62db8bcf8fcf', None, None, None, None, None), ('c9408597-34c6-4b8c-b796-d82c8b51d72f', None, None, None, None, None), ('af62ca65-b034-43c4-891b-62db8bcf8fcf', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:53:13.922363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:13.923953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:14.007944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:14.013518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:14.013518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.013518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:14.013518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:14.013518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:14.068514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:15.255705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:15.359129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:15.379546 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83d5fc53-87e3-46cc-9bc4-68b261561d78 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1500 microversion: 2.1 time: 1.461131 Aug 29 15:53:15.382425 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1881/3774] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:13 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1500 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:15.399467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:15.409506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:15.436740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.440849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.441533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:15.444207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:15.445475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:15.450221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.038108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:16.049880 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b2999b5b-c5ff-4a3b-bb28-3b4ce883f20f tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 0.665915 Aug 29 15:53:16.059062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1882/3775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:15 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:16.076015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:16.079393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:16.086449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:16.099611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.103450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.105332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.106594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.111795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.112705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.233265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:16.414881 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e78fbd2-a638-4722-9039-efa1dd59619a tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 204 len: 0 microversion: 2.1 time: 0.354159 Aug 29 15:53:16.415633 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1883/3776] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:16 2022] DELETE /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:53:16.428744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:16.429546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:16.445671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.447490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.448538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.450350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:16.451078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:16.451718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:16.545719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:16.997112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:17.015936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52feb105-0474-49e5-906e-ec9fbf51250b tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.593731 Aug 29 15:53:17.031607 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1884/3777] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:16 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:17.074843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:17.075436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:17.089844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:17.094590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:17.098997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:17.099903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:17.100399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:17.100847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:17.273456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:17.445450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:17.453723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3935d456-11a5-4433-a905-35af7c23781c tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 0.383685 Aug 29 15:53:17.467406 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1885/3778] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:17 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:17.954468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1643128316", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a79fbfe2-b068-471e-b661-deb071b6d2f6"}], "security_groups": [{"name": "tempest-securitygroup--1975035363"}], "key_name": "tempest-keypair-299896968", "user_data": "}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:18.415433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] validate_networks() for [('a79fbfe2-b068-471e-b661-deb071b6d2f6', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:53:20.005943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:53:20.006431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:53:20.006825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:53:20.011314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:53:20.011817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:53:20.017098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:20.020673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:53:20.021798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:53:20.022551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:53:20.023311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:53:20.023975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:53:20.041340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.042426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.051992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.052738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.053689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.054676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.056047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.056364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.056505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.056908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.060534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.061010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.096591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for project c7ad457701f641bd963da9221fb04094. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:20.108210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for user f554eb660c324a759d70b3b974e78db5 and project c7ad457701f641bd963da9221fb04094. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:20.125916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:53:20.129232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:53:20.201052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Getting quotas for project d3085a72d4a644a2bfcc0109f0743127. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:20.229181 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c05e79f7-4c1f-4360-b802-42c86aa9409f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.276825 Aug 29 15:53:20.230492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Getting quotas for user 9dda72ff55b246cea4bf5bc5e1e87c5f and project d3085a72d4a644a2bfcc0109f0743127. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:20.231283 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1886/3779] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:53:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:53:20.241182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:20.247221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:20.247915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:53:20.266737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:53:20.273793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.274327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.277852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.278690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.279213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.281669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.401126 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7a62bd5-532f-44c2-a869-b91bb4c48c8a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.665593 Aug 29 15:53:20.403332 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1894/3780] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 6669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:53:20.416105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:20.418063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:20.434587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.438437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.439410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:20.440412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:20.441189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:20.444082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.053618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.066211 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f120d0a9-992c-43b0-bee6-bc23e957a19c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1506 microversion: 2.1 time: 0.833461 Aug 29 15:53:21.098377 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1887/3781] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:20 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1506 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:21.104268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7b15f03d-0dfc-4443-8b22-a40526f162da req-3e6ecfbd-f937-4d18-9863-309cddaa80c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63f332b7-c1b7-4b62-968b-b17fad173aba", "tag": "baad82af-88e4-471b-b2a7-5f2f80456497"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:21.137634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b15f03d-0dfc-4443-8b22-a40526f162da req-3e6ecfbd-f937-4d18-9863-309cddaa80c5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.138122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b15f03d-0dfc-4443-8b22-a40526f162da req-3e6ecfbd-f937-4d18-9863-309cddaa80c5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.138552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b15f03d-0dfc-4443-8b22-a40526f162da req-3e6ecfbd-f937-4d18-9863-309cddaa80c5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.169978 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7b15f03d-0dfc-4443-8b22-a40526f162da req-3e6ecfbd-f937-4d18-9863-309cddaa80c5 service nova] Creating event network-changed:baad82af-88e4-471b-b2a7-5f2f80456497 for instance 63f332b7-c1b7-4b62-968b-b17fad173aba on n-h2-836830-13 Aug 29 15:53:21.182205 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7b15f03d-0dfc-4443-8b22-a40526f162da req-3e6ecfbd-f937-4d18-9863-309cddaa80c5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082703 Aug 29 15:53:21.183164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1888/3782] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:21.189977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c5f5f17-4e3d-4873-b3ed-352b169e0ad2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:21.190748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c5f5f17-4e3d-4873-b3ed-352b169e0ad2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:21.305583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c5f5f17-4e3d-4873-b3ed-352b169e0ad2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.317193 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c5f5f17-4e3d-4873-b3ed-352b169e0ad2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1237 microversion: 2.1 time: 0.132673 Aug 29 15:53:21.317799 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1889/3783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:21 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1237 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:21.340663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8165c79f-e7f8-49c9-977d-1ff29d03fb12 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:21.341457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8165c79f-e7f8-49c9-977d-1ff29d03fb12 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:21.477784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8165c79f-e7f8-49c9-977d-1ff29d03fb12 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.493828 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8165c79f-e7f8-49c9-977d-1ff29d03fb12 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1213 microversion: 2.1 time: 0.168454 Aug 29 15:53:21.494569 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1890/3784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:21 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:21.556700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:21.569643 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bfe45779-bf6b-4189-bdaf-df6ab034d7a0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 1.162441 Aug 29 15:53:21.573735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1895/3785] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:20 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:21.834741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5937e10b-0105-44c4-b93e-58226316894a req-4ace32f1-65ca-4108-9303-c20ff1525c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3214d2-b4b8-473c-8c0b-2872398ac42a", "name": "network-vif-deleted", "tag": "dde4f00f-0c2e-4281-8d64-94759d72583e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:21.857198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5937e10b-0105-44c4-b93e-58226316894a req-4ace32f1-65ca-4108-9303-c20ff1525c09 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:21.860617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5937e10b-0105-44c4-b93e-58226316894a req-4ace32f1-65ca-4108-9303-c20ff1525c09 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:21.862029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5937e10b-0105-44c4-b93e-58226316894a req-4ace32f1-65ca-4108-9303-c20ff1525c09 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:21.914467 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5937e10b-0105-44c4-b93e-58226316894a req-4ace32f1-65ca-4108-9303-c20ff1525c09 service nova] Creating event network-vif-deleted:dde4f00f-0c2e-4281-8d64-94759d72583e for instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a on n-h1-836830-13 Aug 29 15:53:21.929583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5937e10b-0105-44c4-b93e-58226316894a req-4ace32f1-65ca-4108-9303-c20ff1525c09 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099617 Aug 29 15:53:21.932337 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1891/3786] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:22.091005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.091704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.103396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.103905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.114904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.117479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.118268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.121244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.198493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.202299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.203123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.203845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lazy-loading 'fault' on Instance uuid 9a3214d2-b4b8-473c-8c0b-2872398ac42a {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:22.341587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.342312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.356448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.359796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.360272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.361002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.361473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.361900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.603293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:22.615912 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0805a1b4-fe0e-414a-bf5c-7a13c8fd2172 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1289 microversion: 2.1 time: 0.281622 Aug 29 15:53:22.647505 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1892/3787] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:22 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1289 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:22.670374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.674410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.720980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.723201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.723675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.724814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.725719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.727834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.759910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:22.770196 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40767d6e-e785-492d-b27a-b9a4b34e84d6 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 200 len: 1303 microversion: 2.1 time: 0.685877 Aug 29 15:53:22.778020 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1896/3788] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:22 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 1303 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:22.807872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:22.808490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:22.836959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.837463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.837943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.848248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:22.849587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:22.852973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:22.909694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:22.921182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bee5026c-a439-4d2d-b65e-75d5ca60af4b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1265 microversion: 2.1 time: 0.269870 Aug 29 15:53:22.922428 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1893/3789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:22 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:23.296521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:23.308485 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe7fd138-5ee6-4180-b628-50912d811e79 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 0.504463 Aug 29 15:53:23.313372 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1897/3790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:22 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:23.638904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:23.640202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:23.654581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.655574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.656292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.657348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.662021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.662689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.804312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:23.805269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 9a3214d2-b4b8-473c-8c0b-2872398ac42a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:23.815503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.816029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.823953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.825006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.825499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.826288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.865383 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] HTTP exception thrown: Instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a could not be found. Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Request method failure captured: Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a HTTP/1.1 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOBUpVlzKiub5eYun41UYbg4FuPDcqrP7ZE3ws8mKDxzg640TV-UYpoDdRBAvhZmN0NmutL-349FiCe21FRD1xOkDUSQtpN6ZPewx3xeMC55aPwlFXYTruqkHoZrx5fh-pt7fKFijIJ2Ak6AaPrLOtAaDu2AIy1YN2xo4nzO636wlaY Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: bae88ae162c54e0f90d1465cb17cfbe1 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerRescueTestJSON-1967899432 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bae88ae162c54e0f90d1465cb17cfbe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bae88ae162c54e0f90d1465cb17cfbe1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bae88ae162c54e0f90d1465cb17cfbe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bae88ae162c54e0f90d1465cb17cfbe1"}]}] Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerRescueTestJSON-1967899432 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: bae88ae162c54e0f90d1465cb17cfbe1 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerRescueTestJSON-1967899432 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerRescueTestJSON-1967899432-project Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8ab128ff99e24153960e42b8897ac4f1 Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerRescueTestJSON-1967899432-project Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a could not be found. Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9a3214d2-b4b8-473c-8c0b-2872398ac42a'} Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a could not be found. Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a could not be found. Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:23.868653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.874194 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:23.874194 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:23.874194 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:23.874194 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:23.874194 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:23.874194 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a could not be found. Aug 29 15:53:23.874194 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:23.876888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Returning 404 to user: Instance 9a3214d2-b4b8-473c-8c0b-2872398ac42a could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:23.886377 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1405ed83-929e-4eda-b46c-bddeebd023cc tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a" status: 404 len: 111 microversion: 2.1 time: 0.086147 Aug 29 15:53:23.887286 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1898/3791] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:23 2022] GET /compute/v2.1/servers/9a3214d2-b4b8-473c-8c0b-2872398ac42a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:53:23.903978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:23.904743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:23.915696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.919992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.920761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.921657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:23.922293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:23.922938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:23.980321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:23.989154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:23.990132 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02d4a2e8-12e1-4b27-8e3a-9f52390732d0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1295 microversion: 2.1 time: 0.355621 Aug 29 15:53:23.991266 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1894/3792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:23 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1295 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:23.998351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:24.000483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:24.061811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:24.071230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.075506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.077142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.078182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.078876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.079548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.173017 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e4830556-947d-4138-a1f8-52f118ff5e1e tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 204 len: 0 microversion: 2.1 time: 0.281373 Aug 29 15:53:24.174635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1899/3793] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:23 2022] DELETE /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:53:24.186454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:24.187632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:24.197327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.198334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.199189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.200249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.201026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.201632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.396652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:24.445494 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-522e5f1a-9013-493d-9498-d9054fddba62 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1271 microversion: 2.1 time: 0.447715 Aug 29 15:53:24.451505 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1895/3794] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:23 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1271 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:24.466523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:24.467628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:24.478586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.479054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.480413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.481410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:24.482079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:24.482747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:24.856804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:24.883390 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-734df660-4879-426f-ba76-05de8274524c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1491 microversion: 2.1 time: 0.701463 Aug 29 15:53:24.884327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1900/3795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:24 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1491 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:25.013703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:25.014769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:25.023695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.024603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.025210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.026138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.028007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.028964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.118750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:25.148326 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39c2dc19-98b3-4c15-816b-87ee40c9c453 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1295 microversion: 2.1 time: 0.133577 Aug 29 15:53:25.151137 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1901/3796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:25 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:25.198601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:25.224108 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83e02d46-5632-4bc4-b3aa-276329bdbb56 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 0.768517 Aug 29 15:53:25.228177 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1896/3797] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:24 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:25.473321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:25.474307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:25.494223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.495710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.496171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.496979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.505764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.506356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.905641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:25.906528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:25.924059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.924818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.925605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:25.926543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:25.927266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:25.928938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.094288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:26.108934 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bffefd79-63aa-453f-8713-f4add7d7e5ad tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1271 microversion: 2.1 time: 0.643162 Aug 29 15:53:26.115389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1902/3798] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:25 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1271 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:26.177061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:26.178192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:26.192341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.195698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.196526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.201268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.201977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.202605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.415906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:26.428403 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18cd0dc6-3178-41ce-8125-246da5c241b2 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1491 microversion: 2.1 time: 0.526759 Aug 29 15:53:26.444275 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1897/3799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:25 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1491 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:26.457607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:26.459731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:26.473970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.474714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.475402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.477177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:26.477973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:26.478620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:26.735129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:26.746020 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-64384c4c-e8d0-4bce-af77-d1dd3fe89131 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1363 microversion: 2.1 time: 0.574705 Aug 29 15:53:26.751353 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1903/3800] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:26 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1363 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:27.142746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:27.144242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:27.160667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.162521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.164761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.167559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.169479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.170312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.420828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:27.438233 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e73d24d8-a249-4218-92eb-1b22baa0f7dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 0.991387 Aug 29 15:53:27.439230 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1898/3801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:26 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:27.449889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-820894225", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f0a6211c-15a9-4651-919e-885c3d0e4778"}], "block_device_mapping_v2": [{"uuid": "a5557ea5-2f9e-44f5-8f85-09a32b7f7b90", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:27.591287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] validate_networks() for [('f0a6211c-15a9-4651-919e-885c3d0e4778', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:53:27.911319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:27.923797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e6ab5ae-eaf1-451a-9f00-98d90beafa64 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1313 microversion: 2.1 time: 0.785538 Aug 29 15:53:27.925092 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1904/3802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:27 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:27.934361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:27.937249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:27.952115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.953032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.954200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:27.956589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:27.963960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:27.965099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.349785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:28.358623 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1ffa60f-f592-4395-bda8-f5d41c24b67c tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1491 microversion: 2.1 time: 0.432324 Aug 29 15:53:28.361412 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1905/3803] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:27 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1491 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:28.376413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:28.377144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:28.392895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.393554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.394110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:28.395246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:28.395983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:28.397188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.071733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:29.084953 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcc626c0-2ca5-4205-bfca-2e13839d161c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1363 microversion: 2.1 time: 0.721267 Aug 29 15:53:29.086021 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1906/3804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:28 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1363 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:29.092593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-51116b99-39d6-40ba-b4d3-8f30df132b58 req-69c6a2c4-5aaf-4e73-bc15-41ad0b98a8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7d43fd-6072-4fe5-ba70-357fa11e2c25", "tag": "8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:29.105865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-51116b99-39d6-40ba-b4d3-8f30df132b58 req-69c6a2c4-5aaf-4e73-bc15-41ad0b98a8da service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.106355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-51116b99-39d6-40ba-b4d3-8f30df132b58 req-69c6a2c4-5aaf-4e73-bc15-41ad0b98a8da service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.107082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-51116b99-39d6-40ba-b4d3-8f30df132b58 req-69c6a2c4-5aaf-4e73-bc15-41ad0b98a8da service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.122683 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-51116b99-39d6-40ba-b4d3-8f30df132b58 req-69c6a2c4-5aaf-4e73-bc15-41ad0b98a8da service nova] Creating event network-changed:8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6 for instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 on n-h1-836830-13 Aug 29 15:53:29.128042 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-51116b99-39d6-40ba-b4d3-8f30df132b58 req-69c6a2c4-5aaf-4e73-bc15-41ad0b98a8da service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040607 Aug 29 15:53:29.128939 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1907/3805] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:29.135586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:29.136283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:29.143113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.143803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.144545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.145409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.146023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.146606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.321130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:53:29.321681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:53:29.322019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:53:29.322430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:53:29.322843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:53:29.341529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.342015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.342431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.352048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.352694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.353152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.397641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:29.404209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Getting quotas for user 71e0809663664b319388bcc890b6fdec and project bb7c04ac8b544f4c89e51cf927bf6e25. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:29.550593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:53:29.552932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a5557ea5-2f9e-44f5-8f85-09a32b7f7b90',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:53:29.810984 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fae0bfa8-7e09-4fe7-8eb1-0083392ff31a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.370392 Aug 29 15:53:29.811694 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1899/3806] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:53:29.823643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2e12eab8-bde5-4f17-b03f-79a8457b3daa req-8af008c0-5230-4aea-a993-b580029c7bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f332b7-c1b7-4b62-968b-b17fad173aba", "name": "network-vif-plugged", "status": "completed", "tag": "baad82af-88e4-471b-b2a7-5f2f80456497"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:29.841631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2e12eab8-bde5-4f17-b03f-79a8457b3daa req-8af008c0-5230-4aea-a993-b580029c7bc2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.842126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2e12eab8-bde5-4f17-b03f-79a8457b3daa req-8af008c0-5230-4aea-a993-b580029c7bc2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.842564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2e12eab8-bde5-4f17-b03f-79a8457b3daa req-8af008c0-5230-4aea-a993-b580029c7bc2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.900032 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2e12eab8-bde5-4f17-b03f-79a8457b3daa req-8af008c0-5230-4aea-a993-b580029c7bc2 service nova] Creating event network-vif-plugged:baad82af-88e4-471b-b2a7-5f2f80456497 for instance 63f332b7-c1b7-4b62-968b-b17fad173aba on n-h2-836830-13 Aug 29 15:53:29.915348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2e12eab8-bde5-4f17-b03f-79a8457b3daa req-8af008c0-5230-4aea-a993-b580029c7bc2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095726 Aug 29 15:53:29.917273 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1900/3807] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:29.924563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:29.926414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:29.936052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.937489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.938228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:29.939249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:29.940125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:29.941406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.158840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:30.241944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:30.433644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.438385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:30.443305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c6af021c-34f4-438a-8a09-4537e9826770 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1334 microversion: 2.1 time: 0.524634 Aug 29 15:53:30.453019 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1901/3808] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:29 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1334 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:30.468809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:30.469600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:30.479301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.484300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.485274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.486390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.487087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.488595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.737656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.749721 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d5af198-3a74-4718-937b-c45a05600ed0 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 1.619255 Aug 29 15:53:30.751151 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1908/3809] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:29 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:30.758899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:30.759938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:30.768219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.768973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.769640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.770505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.771315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.771921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.919815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:30.928183 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-667c4b57-5b0a-4e6b-ac16-ff0b3085ea05 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1491 microversion: 2.1 time: 0.473856 Aug 29 15:53:30.943593 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1902/3810] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:30 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1491 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:30.950029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:30.950828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:30.965437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.966165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.966814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.967777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:30.968609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:30.969280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:30.986589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:31.000450 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ab10435-f102-4278-af35-9ae069221622 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1102 microversion: 2.1 time: 0.247028 Aug 29 15:53:31.001049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1909/3811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:30 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1102 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:31.424200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-31aec203-4b37-490a-aaf9-dc2b2be26181 req-1cd61850-d171-46e5-9e6a-a50582b97d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8846f9-fc4d-4589-959f-51730b4a1924", "name": "network-vif-deleted", "tag": "86097462-00f9-434b-9742-3d5d64dbf7f2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:31.452856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31aec203-4b37-490a-aaf9-dc2b2be26181 req-1cd61850-d171-46e5-9e6a-a50582b97d4b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.453361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31aec203-4b37-490a-aaf9-dc2b2be26181 req-1cd61850-d171-46e5-9e6a-a50582b97d4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.454955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31aec203-4b37-490a-aaf9-dc2b2be26181 req-1cd61850-d171-46e5-9e6a-a50582b97d4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.482571 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-31aec203-4b37-490a-aaf9-dc2b2be26181 req-1cd61850-d171-46e5-9e6a-a50582b97d4b service nova] Creating event network-vif-deleted:86097462-00f9-434b-9742-3d5d64dbf7f2 for instance 7e8846f9-fc4d-4589-959f-51730b4a1924 on n-h2-836830-13 Aug 29 15:53:31.494700 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-31aec203-4b37-490a-aaf9-dc2b2be26181 req-1cd61850-d171-46e5-9e6a-a50582b97d4b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313585 Aug 29 15:53:31.496144 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1910/3812] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:31.502735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:31.503730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:31.511292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.512250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.512887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.513810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.514478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.515093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.583185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:31.601086 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-edfe6e7d-4192-4e31-ae84-28c0dfd99778 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1363 microversion: 2.1 time: 0.652607 Aug 29 15:53:31.615279 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1903/3813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:30 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1363 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:31.779342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:31.780841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:31.788886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.791068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.791743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.792641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.793261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.794101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.893431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:31.907696 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7581ec18-dc0a-4239-859e-b530aaba6af6 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1334 microversion: 2.1 time: 0.410167 Aug 29 15:53:31.908286 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1911/3814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:31 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1334 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:31.949750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:31.950372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:31.959845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.960826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.961514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:31.962578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:31.963293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:31.965020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.302068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.302554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.307424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.307906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lazy-loading 'fault' on Instance uuid 7e8846f9-fc4d-4589-959f-51730b4a1924 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:32.418688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab128ff99e24153960e42b8897ac4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae88ae162c54e0f90d1465cb17cfbe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:32.454620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62c37a03-aafd-49c1-85cf-2a9be0a33ff7 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 200 len: 1303 microversion: 2.1 time: 0.508691 Aug 29 15:53:32.456199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1912/3815] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:31 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 1303 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:32.463381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:32.464269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:32.474551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.475062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.476832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.477881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.478332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.478753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.565078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:32.580852 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5efdca24-e3c5-4faa-93de-a102aedf67aa tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1168 microversion: 2.1 time: 0.123368 Aug 29 15:53:32.603993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1913/3816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:32 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1168 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:32.625051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:32.626987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:32.636672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.638685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.641245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.643760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.645183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.645858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.920441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:32.935911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bf449bbe-9ed3-4864-8603-aaa42e05d4b7 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1316 microversion: 2.1 time: 1.164611 Aug 29 15:53:32.936514 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1904/3817] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:31 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1316 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:32.941405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:32.943741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:32.962284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.963123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.963733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:32.964610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:32.965236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:32.965829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.050560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:33.070204 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5034684-e069-4602-bc2a-4e4f96c8fc5a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1363 microversion: 2.1 time: 0.450395 Aug 29 15:53:33.072373 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1914/3818] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:32 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:33.448260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:33.464266 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0c52e656-2bfa-4b8c-af9a-ec042eb5ff79 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.526365 Aug 29 15:53:33.466264 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1905/3819] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:32 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:33.485866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:33.486537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] [instance: 7e8846f9-fc4d-4589-959f-51730b4a1924] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:33.497136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.497630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.501038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.501802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.502277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.502710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.543931 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] HTTP exception thrown: Instance 7e8846f9-fc4d-4589-959f-51730b4a1924 could not be found. Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Request method failure captured: Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 HTTP/1.1 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOBUpVlzKiub5eYun41UYbg4FuPDcqrP7ZE3ws8mKDxzg640TV-UYpoDdRBAvhZmN0NmutL-349FiCe21FRD1xOkDUSQtpN6ZPewx3xeMC55aPwlFXYTruqkHoZrx5fh-pt7fKFijIJ2Ak6AaPrLOtAaDu2AIy1YN2xo4nzO636wlaY Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: bae88ae162c54e0f90d1465cb17cfbe1 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerRescueTestJSON-1967899432 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bae88ae162c54e0f90d1465cb17cfbe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bae88ae162c54e0f90d1465cb17cfbe1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bae88ae162c54e0f90d1465cb17cfbe1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bae88ae162c54e0f90d1465cb17cfbe1"}]}] Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerRescueTestJSON-1967899432 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: bae88ae162c54e0f90d1465cb17cfbe1 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerRescueTestJSON-1967899432 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerRescueTestJSON-1967899432-project Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8ab128ff99e24153960e42b8897ac4f1 Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerRescueTestJSON-1967899432-project Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 7e8846f9-fc4d-4589-959f-51730b4a1924 could not be found. Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7e8846f9-fc4d-4589-959f-51730b4a1924'} Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8846f9-fc4d-4589-959f-51730b4a1924 could not be found. Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8846f9-fc4d-4589-959f-51730b4a1924 could not be found. Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:33.547609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8846f9-fc4d-4589-959f-51730b4a1924 could not be found. Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] Returning 404 to user: Instance 7e8846f9-fc4d-4589-959f-51730b4a1924 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c5bbd13-585d-4415-9c99-6101181dbd03 tempest-ServerRescueTestJSON-1967899432 tempest-ServerRescueTestJSON-1967899432-project] 10.222.0.83 "GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924" status: 404 len: 111 microversion: 2.1 time: 0.068423 Aug 29 15:53:33.552806 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1915/3820] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:33 2022] GET /compute/v2.1/servers/7e8846f9-fc4d-4589-959f-51730b4a1924 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:53:33.608433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:33.609487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:33.627107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.627627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.628077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.628801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.637892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.638359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.762434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:33.776060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4486fbe0-ac12-4a01-858d-3de3f6285e8f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1168 microversion: 2.1 time: 0.171707 Aug 29 15:53:33.787859 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1906/3821] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:33 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:33.962678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:33.963262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:33.981917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.982435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.983972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:33.987708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:33.989184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:33.994219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.095961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:34.097276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:34.114099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.115413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.117565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.119605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.120260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.120859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.607344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:34.617707 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d2128a0-f358-4c3f-9346-581ca58299ec tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1363 microversion: 2.1 time: 0.527554 Aug 29 15:53:34.622326 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1907/3822] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:34 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1363 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:34.627544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:34.632421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:34.643454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.644168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.644788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:34.645750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:34.646373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:34.648069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.089763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:35.105935 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c55bfbf-d666-44fc-be4d-e5ae85b7c0a9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.481739 Aug 29 15:53:35.107207 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1908/3823] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:34 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:35.114820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.122011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.134532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.137296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.139635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.141809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.144076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.144694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.386307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:35.396337 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-47e0dcbc-e972-45ec-9c75-d16ac32755b2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1168 microversion: 2.1 time: 0.287835 Aug 29 15:53:35.400189 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1909/3824] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1168 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:35.412338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:35.441916 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3c1e2d4d-9143-47a2-a88c-92f4080e1587 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1506 microversion: 2.1 time: 1.484319 Aug 29 15:53:35.447484 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1916/3825] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:33 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1506 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:35.468984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.469873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.493491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.494360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.495058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.496239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.496957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.497613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.547871 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c25582bd-0d87-4a82-b636-29b767971aa1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba/ips" status: 200 len: 110 microversion: 2.1 time: 0.083093 Aug 29 15:53:35.549141 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1910/3826] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba/ips => generated 110 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:35.562792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.563898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.578368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.578966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.579681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.580631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.581900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.583004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.588083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:35.642117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.643133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.650908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.656419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8dce56a1-2098-4f51-9a0b-94ae696cfc93 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba/ips" status: 200 len: 110 microversion: 2.1 time: 0.096999 Aug 29 15:53:35.666830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.667335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1917/3827] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba/ips => generated 110 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:35.672498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.673402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.674373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.675107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.675789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.680912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.709895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.714656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.715446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.716413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.719690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.720450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.808286 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-88e51fcc-cc87-4147-8770-f5faa65ee511 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba/ips/tempest-ServerAddressesTestJSON-1524730701-network" status: 200 len: 95 microversion: 2.1 time: 0.139515 Aug 29 15:53:35.809033 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1918/3828] 10.222.0.83 () {58 vars in 1401 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba/ips/tempest-ServerAddressesTestJSON-1524730701-network => generated 95 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:53:35.822716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:35.823616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:35.836552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.837403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.841308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.842492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:35.843343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:35.844250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:35.915255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:53:36.072483 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c520707-8691-492d-8503-f999ae0a5b95 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "DELETE /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 204 len: 0 microversion: 2.1 time: 0.254564 Aug 29 15:53:36.077738 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1919/3829] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:53:35 2022] DELETE /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:53:36.083006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:36.095249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:36.102219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.102708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.104002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.104725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.105188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.105622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.254121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:36.273429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8022cf83-4ee9-497e-b24d-10df27604058 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1363 microversion: 2.1 time: 0.632476 Aug 29 15:53:36.276134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1911/3830] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:35 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1363 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:36.288795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:36.290674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:36.303017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.304659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.305609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.307824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.308635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.309245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.588422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:36.598585 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a36480b0-191b-43e3-bbf2-73984a2bd7d9 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.317769 Aug 29 15:53:36.599578 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1912/3831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:36 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:36.605908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7b67892d-d861-4fb4-9237-57ee2c6774ea req-a38c9111-b1b6-48b1-84e4-ec7785cab9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "tag": "f1242095-dc0e-46fe-89b3-c51decad707d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:36.615267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:36.618979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b67892d-d861-4fb4-9237-57ee2c6774ea req-a38c9111-b1b6-48b1-84e4-ec7785cab9d4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.619691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b67892d-d861-4fb4-9237-57ee2c6774ea req-a38c9111-b1b6-48b1-84e4-ec7785cab9d4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.620361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7b67892d-d861-4fb4-9237-57ee2c6774ea req-a38c9111-b1b6-48b1-84e4-ec7785cab9d4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.637873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7b67892d-d861-4fb4-9237-57ee2c6774ea req-a38c9111-b1b6-48b1-84e4-ec7785cab9d4 service nova] Creating event network-changed:f1242095-dc0e-46fe-89b3-c51decad707d for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:53:36.644999 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7b67892d-d861-4fb4-9237-57ee2c6774ea req-a38c9111-b1b6-48b1-84e4-ec7785cab9d4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043846 Aug 29 15:53:36.646465 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1913/3832] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:36.654961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:36.655930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:36.669691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.670438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.671065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:36.671949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:36.672952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:36.673540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.003110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:37.013586 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b92569b-bb77-4882-82d5-d18b951f6628 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1210 microversion: 2.1 time: 0.364820 Aug 29 15:53:37.014755 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1914/3833] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:36 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1210 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:37.040669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:37.049332 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-93a14df7-248f-4b73-b5ca-ecedc955747d tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1512 microversion: 2.1 time: 0.970524 Aug 29 15:53:37.049908 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1920/3834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:36 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1512 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:37.105751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8c413198-8832-4afe-bdc7-b5494c8f9606 req-586978d9-9dbb-469a-9520-ef1dc732e2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7d43fd-6072-4fe5-ba70-357fa11e2c25", "name": "network-vif-plugged", "status": "completed", "tag": "8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:37.121044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8c413198-8832-4afe-bdc7-b5494c8f9606 req-586978d9-9dbb-469a-9520-ef1dc732e2c0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.121684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8c413198-8832-4afe-bdc7-b5494c8f9606 req-586978d9-9dbb-469a-9520-ef1dc732e2c0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.122416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8c413198-8832-4afe-bdc7-b5494c8f9606 req-586978d9-9dbb-469a-9520-ef1dc732e2c0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.140481 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8c413198-8832-4afe-bdc7-b5494c8f9606 req-586978d9-9dbb-469a-9520-ef1dc732e2c0 service nova] Creating event network-vif-plugged:8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6 for instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 on n-h1-836830-13 Aug 29 15:53:37.146761 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8c413198-8832-4afe-bdc7-b5494c8f9606 req-586978d9-9dbb-469a-9520-ef1dc732e2c0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130495 Aug 29 15:53:37.147595 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1915/3835] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:37.297309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:37.297945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:37.315063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.315923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.316575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.317462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.318101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.318923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.628002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:37.629661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:37.649213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.650474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.651441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:37.655529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:37.656183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:37.656818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:38.171871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:38.184320 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2596b6d-8751-4e54-baa7-f1d4c4648258 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.561688 Aug 29 15:53:38.185856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1916/3836] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:37 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:38.191883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:38.192677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:38.203801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:38.204731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:38.206273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:38.207196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:38.208466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:38.209563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:38.470842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:38.487406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-356595f0-d5b6-41c0-a0d1-c0003747f406 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1210 microversion: 2.1 time: 0.300162 Aug 29 15:53:38.500794 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1917/3837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:38 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1210 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:38.506215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:38.508360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:38.515813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:38.516498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:38.517098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:38.518007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:38.518632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:38.519276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:38.584879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:38.602972 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a74e4545-74b2-4ebd-8427-becf0cebe64e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1363 microversion: 2.1 time: 1.309404 Aug 29 15:53:38.605017 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1921/3838] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:37 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1363 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:38.814073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:38.826328 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-00e69e8d-aae2-44d8-bff6-02053c3852c1 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1512 microversion: 2.1 time: 0.323609 Aug 29 15:53:38.827224 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1918/3839] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:38 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:39.206958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:39.208095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:39.251131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.253172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.253684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.257893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.259469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.260877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.513839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:39.515140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=16 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:39.665073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:39.665767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:39.676614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.677568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.678427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:39.679449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:39.680406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:39.681536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.049939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:40.066842 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36f5e752-a633-4806-838a-f36ddef81d75 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.862313 Aug 29 15:53:40.068019 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1922/3840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:39 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:40.075440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:40.077683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:40.090856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.091781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.092470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.093426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.093985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.094516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.308951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:40.322450 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef6e9fa4-2b7c-454e-a5e5-5ee138fbec34 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.813211 Aug 29 15:53:40.336303 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1919/3841] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:39 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:40.344781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:40.345675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:40.352945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.355568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.359217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.360368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.360984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:40.361535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:40.367037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:40.757933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:40.766371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba2858a9-53cf-4a04-a30c-f472e50e429a tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1512 microversion: 2.1 time: 0.426040 Aug 29 15:53:40.767306 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1920/3842] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:40 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1512 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:40.988989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-78423043-8b8e-4a2a-8096-ea1fb9c115a3 req-2eeda2dd-f824-4eec-aa5f-8d67c7cfea44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "tag": "509a91eb-a807-444b-b4e1-1171833c340a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:40.999197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78423043-8b8e-4a2a-8096-ea1fb9c115a3 req-2eeda2dd-f824-4eec-aa5f-8d67c7cfea44 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:40.999928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78423043-8b8e-4a2a-8096-ea1fb9c115a3 req-2eeda2dd-f824-4eec-aa5f-8d67c7cfea44 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.000703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78423043-8b8e-4a2a-8096-ea1fb9c115a3 req-2eeda2dd-f824-4eec-aa5f-8d67c7cfea44 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.012779 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-78423043-8b8e-4a2a-8096-ea1fb9c115a3 req-2eeda2dd-f824-4eec-aa5f-8d67c7cfea44 service nova] Creating event network-changed:509a91eb-a807-444b-b4e1-1171833c340a for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:53:41.020274 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-78423043-8b8e-4a2a-8096-ea1fb9c115a3 req-2eeda2dd-f824-4eec-aa5f-8d67c7cfea44 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034905 Aug 29 15:53:41.021211 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1921/3843] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:41.031146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:41.048125 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b615b6a8-c117-4f85-83a1-9f0aaead7eff tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1548 microversion: 2.1 time: 0.978870 Aug 29 15:53:41.063443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1923/3844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:40 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1548 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:41.070229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:41.071316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.077975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.078774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.079461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.080470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.081193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.082063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.092623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:41.093602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.102062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.111852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.112306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.113060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.113525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.113954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.568909 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ea29273-fed5-46d2-902c-567113b5dbf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.503237 Aug 29 15:53:41.570389 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1922/3845] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:53:41 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-interface => generated 284 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:41.575414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:41.576258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:41.602441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.603324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.604234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:41.607515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:41.609390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:41.609737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.098998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:42.111389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-978b3aeb-6151-40d3-9818-c1d710f7a3d8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.539034 Aug 29 15:53:42.111993 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1923/3846] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:41 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:42.118247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:42.119240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:42.126658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.128995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.129630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.130542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.131227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.131852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.184922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:42.185917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:42.186552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:42.187359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lazy-loading 'fault' on Instance uuid 63f332b7-c1b7-4b62-968b-b17fad173aba {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:53:42.291833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7baa9210bfb4895a247d55cdfcf98a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04c4fb2330864b258b2e919220393bef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:42.302889 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5f8eb5b-bdc6-4a32-a6ae-59a822f7e6dd tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 200 len: 1306 microversion: 2.1 time: 0.189631 Aug 29 15:53:42.315896 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1924/3847] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:42 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 1306 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:42.474422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:42.493592 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a459fd4-47ef-4de1-867a-0b3d2f44b5c4 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 1.404641 Aug 29 15:53:42.495886 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1924/3848] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:41 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:43.094234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-558fc861-706e-46e1-891f-d22957d19af7 req-a8be63cb-d369-4267-9f9c-494ccc9f8eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63f332b7-c1b7-4b62-968b-b17fad173aba", "name": "network-vif-deleted", "tag": "baad82af-88e4-471b-b2a7-5f2f80456497"}, {"name": "network-changed", "server_uuid": "80660c8c-9614-43a9-8efb-0a24ab2c815e", "tag": "877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:43.118511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-558fc861-706e-46e1-891f-d22957d19af7 req-a8be63cb-d369-4267-9f9c-494ccc9f8eba service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.119497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-558fc861-706e-46e1-891f-d22957d19af7 req-a8be63cb-d369-4267-9f9c-494ccc9f8eba service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.120627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-558fc861-706e-46e1-891f-d22957d19af7 req-a8be63cb-d369-4267-9f9c-494ccc9f8eba service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.137588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:43.138481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:43.160329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.161350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.163256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.164558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.166872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.167595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.175072 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-558fc861-706e-46e1-891f-d22957d19af7 req-a8be63cb-d369-4267-9f9c-494ccc9f8eba service nova] Creating event network-vif-deleted:baad82af-88e4-471b-b2a7-5f2f80456497 for instance 63f332b7-c1b7-4b62-968b-b17fad173aba on n-h2-836830-13 Aug 29 15:53:43.175953 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-558fc861-706e-46e1-891f-d22957d19af7 req-a8be63cb-d369-4267-9f9c-494ccc9f8eba service nova] Creating event network-changed:877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9 for instance 80660c8c-9614-43a9-8efb-0a24ab2c815e on n-h1-836830-13 Aug 29 15:53:43.191431 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-558fc861-706e-46e1-891f-d22957d19af7 req-a8be63cb-d369-4267-9f9c-494ccc9f8eba service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108232 Aug 29 15:53:43.194131 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1925/3849] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:43.328196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:43.328911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] [instance: 63f332b7-c1b7-4b62-968b-b17fad173aba] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:43.341296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.344045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.344692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.345731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.347563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.350378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.374750 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] HTTP exception thrown: Instance 63f332b7-c1b7-4b62-968b-b17fad173aba could not be found. Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Request method failure captured: Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba HTTP/1.1 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDODgRLML-LufUzcoNBcW_MiN9eOrFGneOd8Ddd_nqRnBS5hSOfprLd2ueaEt-S6BDQSC-V9AOHabc7qtMU8CfMgHbqaQiBfhHyj8_Evhyu_1vw_ypSu6vn4v7Bzh4sp4bXaBUGodlBVYwY79ulIb33VKkqyDi1wbBy0GT99wtyOf2p4 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 04c4fb2330864b258b2e919220393bef Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerAddressesTestJSON-1738427410 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/04c4fb2330864b258b2e919220393bef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_04c4fb2330864b258b2e919220393bef", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/04c4fb2330864b258b2e919220393bef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/04c4fb2330864b258b2e919220393bef"}]}] Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerAddressesTestJSON-1738427410 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 04c4fb2330864b258b2e919220393bef Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1738427410 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerAddressesTestJSON-1738427410-project Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f7baa9210bfb4895a247d55cdfcf98a5 Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerAddressesTestJSON-1738427410-project Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 63f332b7-c1b7-4b62-968b-b17fad173aba could not be found. Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '63f332b7-c1b7-4b62-968b-b17fad173aba'} Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63f332b7-c1b7-4b62-968b-b17fad173aba could not be found. Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63f332b7-c1b7-4b62-968b-b17fad173aba could not be found. Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:53:43.376997 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:53:43.383530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:53:43.383530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:53:43.383530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:53:43.383530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:53:43.383530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:53:43.383530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63f332b7-c1b7-4b62-968b-b17fad173aba could not be found. Aug 29 15:53:43.383530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:53:43.387083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] Returning 404 to user: Instance 63f332b7-c1b7-4b62-968b-b17fad173aba could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:53:43.388490 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b035ed58-6f6c-40c3-821a-24740af3bf20 tempest-ServerAddressesTestJSON-1738427410 tempest-ServerAddressesTestJSON-1738427410-project] 10.222.0.83 "GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba" status: 404 len: 111 microversion: 2.1 time: 0.065063 Aug 29 15:53:43.389656 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1926/3850] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:43 2022] GET /compute/v2.1/servers/63f332b7-c1b7-4b62-968b-b17fad173aba => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:53:43.520876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:43.521501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:43.539926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.540434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.544890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.547178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:43.547868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:43.548403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:43.975934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:43.985553 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ba51304-743c-4ceb-b0c9-7a9b8d622f31 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.856572 Aug 29 15:53:43.986847 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1925/3851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:43 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:44.618864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:44.642188 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f828d0b-bfb8-4b8b-af83-8858ce1ebb6f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 1.125602 Aug 29 15:53:44.642862 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1927/3852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:43 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:45.006713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:45.008599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:45.015529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.020763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.021442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.023549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.031248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.031901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.604729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:45.637224 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-452d8d44-a4e2-40ab-9963-d4039f9b9507 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.631771 Aug 29 15:53:45.640660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1926/3853] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:45 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:45.670795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:45.671534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:45.690114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.690904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.692401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.693471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:45.694227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:45.695482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:45.996670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9aa8d22d-8352-4c3e-91cf-e33edaf9a15b req-08b8e7fb-7e00-401c-bbff-d70d2c7f1abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "tag": "5cc0f6f0-34d3-4e74-8866-b3ae208579d6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:46.008584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9aa8d22d-8352-4c3e-91cf-e33edaf9a15b req-08b8e7fb-7e00-401c-bbff-d70d2c7f1abd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.009985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9aa8d22d-8352-4c3e-91cf-e33edaf9a15b req-08b8e7fb-7e00-401c-bbff-d70d2c7f1abd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.010735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9aa8d22d-8352-4c3e-91cf-e33edaf9a15b req-08b8e7fb-7e00-401c-bbff-d70d2c7f1abd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.031636 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9aa8d22d-8352-4c3e-91cf-e33edaf9a15b req-08b8e7fb-7e00-401c-bbff-d70d2c7f1abd service nova] Creating event network-changed:5cc0f6f0-34d3-4e74-8866-b3ae208579d6 for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:53:46.037207 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9aa8d22d-8352-4c3e-91cf-e33edaf9a15b req-08b8e7fb-7e00-401c-bbff-d70d2c7f1abd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044355 Aug 29 15:53:46.038234 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1927/3854] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:46.640137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:46.656006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8ead8436-989a-425f-8985-5145f7e1fa04 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.995112 Aug 29 15:53:46.656591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1928/3855] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:45 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:46.663147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:46.664765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:46.673127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.673645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.674573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:46.675323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:46.675781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:46.676419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.679767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:47.681590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:47.693217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.693619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.694056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.706867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:47.707411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:47.707856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:47.778326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:47.809786 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-924ba1b5-a96e-4118-8a90-ab5924966f86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 1.151732 Aug 29 15:53:47.816507 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1928/3856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:46 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:48.152164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e2270f70-0fc7-4d96-9b05-7891d329013a req-f2d4c58c-632f-4477-af51-871082808d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7d43fd-6072-4fe5-ba70-357fa11e2c25", "tag": "8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:48.166066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2270f70-0fc7-4d96-9b05-7891d329013a req-f2d4c58c-632f-4477-af51-871082808d72 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:48.167102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2270f70-0fc7-4d96-9b05-7891d329013a req-f2d4c58c-632f-4477-af51-871082808d72 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:48.167734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e2270f70-0fc7-4d96-9b05-7891d329013a req-f2d4c58c-632f-4477-af51-871082808d72 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.195752 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e2270f70-0fc7-4d96-9b05-7891d329013a req-f2d4c58c-632f-4477-af51-871082808d72 service nova] Creating event network-changed:8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6 for instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 on n-h1-836830-13 Aug 29 15:53:48.202960 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e2270f70-0fc7-4d96-9b05-7891d329013a req-f2d4c58c-632f-4477-af51-871082808d72 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059935 Aug 29 15:53:48.204225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1929/3857] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:48.838925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:48.840623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:48.850962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:48.862116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:48.863057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:48.863612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.866390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:48.867863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:48.869140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:48.925620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:48.936637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67fa0d1d-d37d-40ef-8639-128bce6bf56f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 1.262549 Aug 29 15:53:48.937913 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1929/3858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:47 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:49.664914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:49.679664 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c9f3aaca-9229-4cfa-b61b-0ed9d0720fa5 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.844669 Aug 29 15:53:49.681000 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1930/3859] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:48 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:49.959292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:49.959902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:49.967973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.968469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.968910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:49.969900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:49.970432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:49.970947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.578653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:50.605549 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a27df28-8dd0-491d-8484-306b0c5e9498 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.649179 Aug 29 15:53:50.619880 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1930/3860] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:49 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:50.700438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:50.705072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:50.719377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.719794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.720445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:50.721326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:50.722269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:50.722707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.286447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:51.310640 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3bddcde0-d192-4b19-a4c8-ad8618a46478 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.613908 Aug 29 15:53:51.313443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1931/3861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:50 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:51.639684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:51.642684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:51.661278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.663849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.665087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:51.666544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:51.668397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:51.669261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.102598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:52.115448 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-237f74be-883f-4238-8e0c-537aeabbcd82 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.492699 Aug 29 15:53:52.123446 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1931/3862] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:51 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:52.342886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:52.344099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:52.358547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.360008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.360901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.364514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:52.365734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:52.367135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:52.452735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8daabc9-cc3f-4cc8-99df-eee66b61d5d1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Action: 'create', calling method: .version_select at 0x7f32eef1f820>, body: {"keypair": {"name": "tempest-keypair-1065740250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDunwXoegsKeE8IZh3nnICixg3uk4I7cgqnbNpcPx4bJEZr1rGzPdMJrq5mafD6UE9P1rihLw5tjIWFpYTfQBEYHFY7PFa49nh/6u+YAOAKx87TO50089zZCe+hloofDzw=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:52.527056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a8daabc9-cc3f-4cc8-99df-eee66b61d5d1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Getting quotas for project 773bdb58320742cd91d977a2dff19613. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:53:52.533995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a8daabc9-cc3f-4cc8-99df-eee66b61d5d1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Getting quotas for user 38624ce9529441aba32a3cb68205209f and project 773bdb58320742cd91d977a2dff19613. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:53:52.614053 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8daabc9-cc3f-4cc8-99df-eee66b61d5d1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.466656 Aug 29 15:53:52.617135 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1932/3863] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:53:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:52.722851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:52.733467 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f2f4f76b-608e-4063-8332-791017999050 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.400308 Aug 29 15:53:52.734055 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1932/3864] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:52 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:53.153825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:53.155300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:53.169640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.169936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.170612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.171445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.172224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.172944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.754784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:53.755626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:53.767929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.768426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.772143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:53.773618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:53.774114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:53.774553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.299838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:54.324384 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c7c848e1-e79d-4fb5-be95-eea2877b1166 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 1.178465 Aug 29 15:53:54.325023 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1933/3865] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:53 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:54.338692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d5b84baf-33a7-45ca-bd36-2bab8dbd0bcb req-55087997-7f58-49fb-b7e4-88fc77787636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80660c8c-9614-43a9-8efb-0a24ab2c815e", "name": "network-vif-plugged", "status": "completed", "tag": "877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:54.374264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d5b84baf-33a7-45ca-bd36-2bab8dbd0bcb req-55087997-7f58-49fb-b7e4-88fc77787636 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:54.377413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d5b84baf-33a7-45ca-bd36-2bab8dbd0bcb req-55087997-7f58-49fb-b7e4-88fc77787636 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:54.378093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d5b84baf-33a7-45ca-bd36-2bab8dbd0bcb req-55087997-7f58-49fb-b7e4-88fc77787636 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:54.420399 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d5b84baf-33a7-45ca-bd36-2bab8dbd0bcb req-55087997-7f58-49fb-b7e4-88fc77787636 service nova] Creating event network-vif-plugged:877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9 for instance 80660c8c-9614-43a9-8efb-0a24ab2c815e on n-h1-836830-13 Aug 29 15:53:54.436308 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d5b84baf-33a7-45ca-bd36-2bab8dbd0bcb req-55087997-7f58-49fb-b7e4-88fc77787636 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106014 Aug 29 15:53:54.437276 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1934/3866] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:53:54.512626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:54.520804 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d9da0ec0-9cd0-40b5-90d2-e2be5d5920ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 0.769819 Aug 29 15:53:54.534520 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1933/3867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:53 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:55.360765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:55.360765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.375144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.376014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.379309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.388043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.388643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.389163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.550473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:55.552113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:55.560967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.561846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.562535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.563623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:55.564346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:55.565128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:55.931817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:55.940938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:53:55.945345 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a6b4a98-b2d5-43be-9f26-74c13ab5803d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.596027 Aug 29 15:53:55.946770 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1935/3868] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:55 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:56.722246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:56.731012 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e967f2c6-c50e-4d94-88b0-82b811e4b516 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1198 microversion: 2.1 time: 1.191549 Aug 29 15:53:56.734217 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1934/3869] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:55 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1198 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:56.971588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:56.972863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:56.983963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.984719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.985351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:56.986244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:56.986857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:56.987478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.267504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:57.295209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5341c1f7-ee68-4717-8aa6-cdea54ce2eee tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.327259 Aug 29 15:53:57.317342 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1936/3870] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:56 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:57.760611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:57.760611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:57.767561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.768196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.769143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:57.769664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:57.770224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:57.770823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.233535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.253623 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98a2f388-d1b4-4376-a73f-6c9ede39ff86 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1381 microversion: 2.1 time: 0.501830 Aug 29 15:53:58.259914 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1935/3871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:57 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1381 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:53:58.285968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:58.286696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:58.309675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.310959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.313441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.315397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.317414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.318034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.320667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:58.321763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:58.329773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.330627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.331723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.332905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:58.333738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:58.334566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:58.748244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:53:58.758915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49e24edc-449a-406a-8c52-35b42bd1bf81 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.443938 Aug 29 15:53:58.762076 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1936/3872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:58 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:59.067317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-95396016-5fd2-4d20-bf40-695bb735857e req-f56805ef-3d16-4c6a-ac3e-b773b08fdf81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "name": "network-vif-plugged", "status": "completed", "tag": "509a91eb-a807-444b-b4e1-1171833c340a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:59.112712 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3fe50f23-ceea-4ebc-a198-cd421328c543 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1534 microversion: 2.1 time: 0.834495 Aug 29 15:53:59.117584 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1937/3873] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:58 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1534 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:53:59.125892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-95396016-5fd2-4d20-bf40-695bb735857e req-f56805ef-3d16-4c6a-ac3e-b773b08fdf81 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.127477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-95396016-5fd2-4d20-bf40-695bb735857e req-f56805ef-3d16-4c6a-ac3e-b773b08fdf81 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.142038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:53:59.142509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-95396016-5fd2-4d20-bf40-695bb735857e req-f56805ef-3d16-4c6a-ac3e-b773b08fdf81 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.143856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:53:59.159405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.172264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.173188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.174192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:53:59.174896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:53:59.176440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:53:59.189310 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-95396016-5fd2-4d20-bf40-695bb735857e req-f56805ef-3d16-4c6a-ac3e-b773b08fdf81 service nova] Creating event network-vif-plugged:509a91eb-a807-444b-b4e1-1171833c340a for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:53:59.233405 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-95396016-5fd2-4d20-bf40-695bb735857e req-f56805ef-3d16-4c6a-ac3e-b773b08fdf81 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170095 Aug 29 15:53:59.234681 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1937/3874] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:53:59.278160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-840957812", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "cabb3e49-93c9-4379-b804-c3cdf89713d0"}], "security_groups": [{"name": "tempest-securitygroup--1272058811"}], "key_name": "tempest-keypair-1065740250", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:53:59.687796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] validate_networks() for [('cabb3e49-93c9-4379-b804-c3cdf89713d0', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:00.245822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d88e503f-4b24-409d-a80b-ca94e8089513 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1534 microversion: 2.1 time: 1.107611 Aug 29 15:54:00.247657 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1938/3875] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:53:59 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1534 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:00.280165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:00.282466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:00.312090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:00.313232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:00.314030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:00.317120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:00.317912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:00.318587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:00.889585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:00.903627 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36ccdc5d-048b-4c41-aad8-7e9b448c579b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.652007 Aug 29 15:54:00.905372 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1939/3876] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:00 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:00.919434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Getting quotas for project 773bdb58320742cd91d977a2dff19613. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:00.932544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Getting quotas for user 38624ce9529441aba32a3cb68205209f and project 773bdb58320742cd91d977a2dff19613. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:00.938023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:00.946446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:00.950458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:00.952995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:00.954008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:00.958402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:00.963944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:00.968449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:00.968884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:00.969369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:00.969785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:00.970207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:00.993629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:00.994409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:00.995341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.006071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.007467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.008110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.041888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ee3f2ad-1d63-4f3d-85d5-f259b3d44072 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.118512 Aug 29 15:54:01.043822 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1940/3877] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 15:54:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:01.049594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Getting quotas for project 773bdb58320742cd91d977a2dff19613. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:01.064745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Getting quotas for user 38624ce9529441aba32a3cb68205209f and project 773bdb58320742cd91d977a2dff19613. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:01.072867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-836830-13", "block_migration": false, "disk_over_commit": false}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:01.077166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:01.090008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.090871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.091702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.094118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.094835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.095493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.119705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:01.122273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:01.145788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lazy-loading 'flavor' on Instance uuid 80660c8c-9614-43a9-8efb-0a24ab2c815e {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:54:01.179717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Going to try to live migrate instance to n-h2-836830-13 {{(pid=129132) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 15:54:01.245708 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05f17b62-7a3e-4b33-ae0a-a84468cc1ac3 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.974307 Aug 29 15:54:01.252625 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1938/3878] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:53:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:54:01.573061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-715544319", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": "none"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:01.716188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:01.716655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:01.717396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:01.717876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:01.719564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:01.770349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.770908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.775611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.785478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:01.787281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:01.789592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:01.839396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Getting quotas for project 816e80fa0569433fbcaab1bc651d85ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:01.846245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Getting quotas for user ecab6c31850d45dca4708740f8640024 and project 816e80fa0569433fbcaab1bc651d85ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:01.864292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:01.867240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:01.942371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-356b4387-7df1-481e-a338-7a02732b39b8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.688542 Aug 29 15:54:01.944309 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1939/3879] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:54:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:54:01.950479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7ab13b2-93dd-4a6f-95a9-164417313b78 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:01.951449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7ab13b2-93dd-4a6f-95a9-164417313b78 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:02.107569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7ab13b2-93dd-4a6f-95a9-164417313b78 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:02.119632 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7ab13b2-93dd-4a6f-95a9-164417313b78 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1277 microversion: 2.1 time: 0.172378 Aug 29 15:54:02.120354 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1940/3880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:01 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:02.127304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-abaea50c-c9cb-42bb-af6c-a0085b150d0d req-4f434b91-fdab-4883-9d65-2d443bd5f2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "name": "network-vif-plugged", "status": "completed", "tag": "f1242095-dc0e-46fe-89b3-c51decad707d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:02.146748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-abaea50c-c9cb-42bb-af6c-a0085b150d0d req-4f434b91-fdab-4883-9d65-2d443bd5f2b5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.148232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-abaea50c-c9cb-42bb-af6c-a0085b150d0d req-4f434b91-fdab-4883-9d65-2d443bd5f2b5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.160924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-abaea50c-c9cb-42bb-af6c-a0085b150d0d req-4f434b91-fdab-4883-9d65-2d443bd5f2b5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.208882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-abaea50c-c9cb-42bb-af6c-a0085b150d0d req-4f434b91-fdab-4883-9d65-2d443bd5f2b5 service nova] Creating event network-vif-plugged:f1242095-dc0e-46fe-89b3-c51decad707d for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:54:02.221077 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-abaea50c-c9cb-42bb-af6c-a0085b150d0d req-4f434b91-fdab-4883-9d65-2d443bd5f2b5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098360 Aug 29 15:54:02.221705 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1941/3881] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:02.246834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:02.251377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:02.253641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:02.274748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.276737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.278684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.280452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:02.282497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:02.284205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:02.362660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:02.575132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:03.303299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.317518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73cf44d4-c787-480f-b24c-36e43c683170 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 1.089564 Aug 29 15:54:03.318128 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1942/3882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:02 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:03.322993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:03.327777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:03.356670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.358109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.361582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.363190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.363854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.364466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.544123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.552921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.560163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.561366 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b27131ca-e19f-4d96-8690-e2e6794dbdcd tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb" status: 200 len: 1281 microversion: 2.47 time: 0.242135 Aug 29 15:54:03.594712 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1943/3883] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:03 2022] GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb => generated 1281 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:03.609450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:03.610258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:03.632206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.643444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.643933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.649885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:03.650395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:03.650844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:03.822672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:03.835836 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb3e9e5d-c366-4a82-95a4-01eb0dbbee53 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1329 microversion: 2.1 time: 0.239081 Aug 29 15:54:03.851427 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1944/3884] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:03 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1329 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:03.861885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-749698310", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": "none"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:03.978804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:03.979837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:03.981686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:03.982338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:03.982995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:04.017332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:04.018134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:04.018764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:04.019721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:04.021165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:04.021785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:04.079473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Getting quotas for project 816e80fa0569433fbcaab1bc651d85ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:04.114462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Getting quotas for user ecab6c31850d45dca4708740f8640024 and project 816e80fa0569433fbcaab1bc651d85ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:04.141220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:04.144538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:04.224003 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c7ef1c7-4f5e-4f87-9c2a-ea4e86e0f9a3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.369211 Aug 29 15:54:04.226279 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1945/3885] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 15:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:54:04.242438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1fc4593f-100c-4a3d-8b60-9ecf2af0fbde tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:04.245862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1fc4593f-100c-4a3d-8b60-9ecf2af0fbde tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:04.316331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1fc4593f-100c-4a3d-8b60-9ecf2af0fbde tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "PUT /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 991 microversion: 2.47 time: 0.081953 Aug 29 15:54:04.318693 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1946/3886] 10.222.0.83 () {62 vars in 1297 bytes} [Mon Aug 29 15:54:04 2022] PUT /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 15:54:04.340648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:04.341931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:04.350295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:04.351650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:04.353130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:04.354120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:04.355064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:04.355743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:04.507666 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-099e6503-17f3-4e83-8ad0-4f938d5fb7c8 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e/action" status: 202 len: 0 microversion: 2.1 time: 3.455074 Aug 29 15:54:04.511179 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1941/3887] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:54:01 2022] POST /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e/action => generated 0 bytes in 3457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:54:04.515851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ccafbf8-1e9e-4961-aa29-b3f6fc9ac773 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:04.518084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ccafbf8-1e9e-4961-aa29-b3f6fc9ac773 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:04.820171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ccafbf8-1e9e-4961-aa29-b3f6fc9ac773 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:04.828002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ccafbf8-1e9e-4961-aa29-b3f6fc9ac773 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:04.849699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ccafbf8-1e9e-4961-aa29-b3f6fc9ac773 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:04.856730 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ccafbf8-1e9e-4961-aa29-b3f6fc9ac773 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1277 microversion: 2.47 time: 0.346581 Aug 29 15:54:04.857346 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1942/3888] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:04 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:04.885850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2756b9ad-1d47-46dc-aab1-8da907a95512 req-dc6e04ac-6b90-4896-833f-17366e757305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "name": "network-vif-plugged", "status": "completed", "tag": "5cc0f6f0-34d3-4e74-8866-b3ae208579d6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:04.929671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2756b9ad-1d47-46dc-aab1-8da907a95512 req-dc6e04ac-6b90-4896-833f-17366e757305 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:04.935885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2756b9ad-1d47-46dc-aab1-8da907a95512 req-dc6e04ac-6b90-4896-833f-17366e757305 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:04.936359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2756b9ad-1d47-46dc-aab1-8da907a95512 req-dc6e04ac-6b90-4896-833f-17366e757305 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:04.979366 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2756b9ad-1d47-46dc-aab1-8da907a95512 req-dc6e04ac-6b90-4896-833f-17366e757305 service nova] Creating event network-vif-plugged:5cc0f6f0-34d3-4e74-8866-b3ae208579d6 for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:54:04.990518 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2756b9ad-1d47-46dc-aab1-8da907a95512 req-dc6e04ac-6b90-4896-833f-17366e757305 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131921 Aug 29 15:54:04.994288 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1943/3889] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:05.014596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:05.015627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:05.036086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.036829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.039520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.040783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.044950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.045616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.315189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.330699 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a6ca5ad4-8694-4ad1-a8d3-9398031a05fb tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.996758 Aug 29 15:54:05.334212 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1947/3890] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:04 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:05.341148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:05.342234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:05.367056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.370199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.373018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.374050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.374805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.376171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.553042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.565537 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-35b1762b-3256-4851-8edd-ebb091809cbf tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1335 microversion: 2.1 time: 0.228852 Aug 29 15:54:05.566976 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1948/3891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:05 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1335 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:05.800993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:05.821602 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e4ba1b3-73a3-419d-a4a3-dc2c7bb77515 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.825104 Aug 29 15:54:05.826012 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1944/3892] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:04 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:05.886072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:05.887710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:05.899383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.902735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.903218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:05.904216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:05.904713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:05.908242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.099145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.119828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.121738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.122937 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d12e842-72b4-4067-8b6f-d0486d67472f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1329 microversion: 2.47 time: 0.241888 Aug 29 15:54:06.123537 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1949/3893] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:05 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1329 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:06.354520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:06.355608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:06.372759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.374570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.376836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.378952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.383908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.384529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.598962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:06.603754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:06.612293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.612801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.613328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.615519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.616268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.616938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.821099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:06.832200 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a80df96f-8583-44df-b07c-b6bce95faa94 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1355 microversion: 2.1 time: 0.482177 Aug 29 15:54:06.840810 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1945/3894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:06 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1355 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:06.851705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:06.852496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:06.874621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.875761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.876417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:06.877407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:06.884418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:06.885072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.156470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.166316 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-726f61bf-5d9c-4970-bc08-799d16c4f512 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.324221 Aug 29 15:54:07.180325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1946/3895] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:06 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:07.195236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:07.196031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:07.209156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.210445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.211114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.213631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.214530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.215189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.301880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.316155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.317776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.318961 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7b99c485-ac28-490d-8615-6e694760bb16 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1329 microversion: 2.47 time: 0.137556 Aug 29 15:54:07.338862 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1947/3896] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:07 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1329 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:07.343661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:07.357287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f03edf9-741e-4926-9ad8-d3b307c78bb2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.772574 Aug 29 15:54:07.358250 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1950/3897] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:06 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:07.859490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:07.860724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:07.869685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.870436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.871103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:07.871825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:07.872290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:07.872745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.172677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.199481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.204177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.227253 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a8bd349-6f6f-4dbe-8904-aab86ea091b7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1806 microversion: 2.1 time: 0.369359 Aug 29 15:54:08.228040 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1948/3898] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:07 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1806 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:08.232708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.234582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.235618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.238473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.240866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.243147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.255488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.256486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.287453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.290617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.292701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.295470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.296090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.297223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.363635 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc854b7f-1c85-4fdf-99f7-825dd435a419 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c/ips" status: 200 len: 219 microversion: 2.1 time: 0.111499 Aug 29 15:54:08.375405 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1949/3899] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:54:08 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c/ips => generated 219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:08.380480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.381299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.391492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.392847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.398373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.404852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.405919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.407219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.660373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.675244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.677241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.679654 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d4e60d0f-1885-4750-b60f-8c9dc948da95 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1329 microversion: 2.47 time: 0.302058 Aug 29 15:54:08.680756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1950/3900] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:08 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1329 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:08.713522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.714686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.734920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.735719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.736668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.737615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.739417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.740199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.855295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:08.870907 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3b08a12-99de-42c2-9d56-6ce30f79f247 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.682076 Aug 29 15:54:08.878817 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1951/3901] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:08 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:08.901250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:08.902016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:08.912666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.915407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.916461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.917650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:08.918296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:08.918966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:08.961810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:09.162568 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53d01cb2-44c5-49bc-89d0-9fd90a55b4c1 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 204 len: 0 microversion: 2.1 time: 0.270801 Aug 29 15:54:09.163373 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1952/3902] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:54:08 2022] DELETE /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:09.175881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:09.176750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:09.185975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:09.186861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:09.187608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:09.188650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:09.189530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:09.190863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:09.493119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:09.502242 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d2b0659-cb04-45f8-9aa8-b0a8f0abe464 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1812 microversion: 2.1 time: 0.332573 Aug 29 15:54:09.503305 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1953/3903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:09 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1812 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:09.661280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-226922196", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:09.732409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:09.758885 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7da9c13c-b66a-453b-8629-ea1848473c4a tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 1.074068 Aug 29 15:54:09.760611 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1951/3904] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:08 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:09.769399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:09.770894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:09.825757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] validate_networks() for [('e896cd33-82d8-4f1e-822e-7e54068fdc15', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:09.832613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:09.839783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:09.840238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:09.840980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:09.841437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:09.841857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.008345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.019916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.024274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.032279 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3429020-c595-45d6-b44e-63a8f33f4b65 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1329 microversion: 2.47 time: 0.269842 Aug 29 15:54:10.033558 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1952/3905] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:09 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1329 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:10.039041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:10.043006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:10.062755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.063606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.064237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.065136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.065807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.066426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.074478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:10.639284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:10.654946 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f7dea10-9ab3-44aa-a50f-adfb5128563a tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.620004 Aug 29 15:54:10.655912 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1953/3906] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:10 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:10.664791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:10.665431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:10.680051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.680848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.682334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.685795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:10.686481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:10.687358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:10.986424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:11.215551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:11.216133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:11.216428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:11.216849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:11.217237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:11.233736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.239718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.240339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.241880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.242747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.243423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.260754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.272908 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6a40885e-77b7-4cb5-a81c-bbafc2f158b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1812 microversion: 2.1 time: 0.615661 Aug 29 15:54:11.273839 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1954/3907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:10 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1812 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:11.281900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:11.285205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:11.294998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Getting quotas for project 6d953872c1bd443aa26ee4f47626bdc9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:11.305801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.306689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.307417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Getting quotas for user 8efa4be1bf974daf84fc5f64b4ca3155 and project 6d953872c1bd443aa26ee4f47626bdc9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:11.307654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.308930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.311098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.312092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.332657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:11.336333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:11.418295 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-440d257d-c904-4df8-8f6b-1d786fe8703c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.913643 Aug 29 15:54:11.424703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1954/3908] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:54:11.442981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:11.443828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:11.462098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.465586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.469264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.470424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.471166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.471777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.627937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.645729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.651729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.658616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e42406a-7fc4-430f-8598-79525a6c5731 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1335 microversion: 2.47 time: 0.232402 Aug 29 15:54:11.659589 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1955/3909] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:11 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1335 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:11.670668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c28d7939-9c11-4d2e-962d-81207c725a25 req-07e35224-a6aa-429e-a64a-fdb8b599c62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2314b1b-80a5-4182-be30-e8bf25242168", "tag": "f3e76890-aaf4-4c4f-b78b-5ccce60144f5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:11.704251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c28d7939-9c11-4d2e-962d-81207c725a25 req-07e35224-a6aa-429e-a64a-fdb8b599c62a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.705025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c28d7939-9c11-4d2e-962d-81207c725a25 req-07e35224-a6aa-429e-a64a-fdb8b599c62a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.706583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c28d7939-9c11-4d2e-962d-81207c725a25 req-07e35224-a6aa-429e-a64a-fdb8b599c62a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.740774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c28d7939-9c11-4d2e-962d-81207c725a25 req-07e35224-a6aa-429e-a64a-fdb8b599c62a service nova] Creating event network-changed:f3e76890-aaf4-4c4f-b78b-5ccce60144f5 for instance c2314b1b-80a5-4182-be30-e8bf25242168 on n-h2-836830-13 Aug 29 15:54:11.753740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c28d7939-9c11-4d2e-962d-81207c725a25 req-07e35224-a6aa-429e-a64a-fdb8b599c62a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092339 Aug 29 15:54:11.756246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1956/3910] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:11.786535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4b63c486-275c-454d-a784-a33d0614b95f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:11.787344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4b63c486-275c-454d-a784-a33d0614b95f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:11.854360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.868893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9315d436-7373-42bc-9c18-7a149cbe59fd tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.587722 Aug 29 15:54:11.870099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1955/3911] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:11 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:11.895742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:11.896372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:11.906746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4b63c486-275c-454d-a784-a33d0614b95f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:11.917078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4b63c486-275c-454d-a784-a33d0614b95f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1216 microversion: 2.1 time: 0.159010 Aug 29 15:54:11.917566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.917703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1957/3912] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:11 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:11.939875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.942470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:11.945507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:11.946086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:11.946526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.299718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:12.300932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:12.326623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.330465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.331247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.334280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.338953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.339633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.496715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.513347 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e871d95c-e96b-4768-bdf5-74c15f21fa72 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.640739 Aug 29 15:54:12.517377 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1956/3913] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:11 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:12.690001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:12.691211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:12.717192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.720807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.721785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.726122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.729040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.730942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.794894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:12.811168 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11fcb95e-87aa-4633-b2d2-bac82947c084 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1791 microversion: 2.1 time: 0.515135 Aug 29 15:54:12.815382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1958/3914] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:12 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1791 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:12.891407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:12.892595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:12.908986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.909903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.910564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:12.912131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:12.914109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:12.914803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.231226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.244060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.250022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.252818 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee6b8034-bc9b-4c9e-affc-6fea7f14ebf6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1335 microversion: 2.47 time: 0.565943 Aug 29 15:54:13.253969 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1957/3915] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:12 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1335 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:13.286750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:13.294029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:13.354527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.355430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.356111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.357071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.357750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.358418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.572825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.601238 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b857324a-987e-4a34-96e1-e41522b92375 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1268 microversion: 2.1 time: 0.323699 Aug 29 15:54:13.611719 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1958/3916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:13 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1268 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:13.622413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:13.636026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:13.658398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.662649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.664345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.667220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.672782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.673445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.873890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:13.883037 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0024f90-d261-415e-a435-c62cc43389ed tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.996311 Aug 29 15:54:13.883662 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1959/3917] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:12 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:13.900514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2c971541-5074-4621-963d-845543a25ecf req-6277746f-d981-45f7-9be1-9b8ff7ebd8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "name": "network-vif-deleted", "tag": "509a91eb-a807-444b-b4e1-1171833c340a"}, {"server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "name": "network-vif-deleted", "tag": "5cc0f6f0-34d3-4e74-8866-b3ae208579d6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:13.917358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c971541-5074-4621-963d-845543a25ecf req-6277746f-d981-45f7-9be1-9b8ff7ebd8da service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:13.918106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c971541-5074-4621-963d-845543a25ecf req-6277746f-d981-45f7-9be1-9b8ff7ebd8da service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:13.918708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c971541-5074-4621-963d-845543a25ecf req-6277746f-d981-45f7-9be1-9b8ff7ebd8da service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:13.962835 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2c971541-5074-4621-963d-845543a25ecf req-6277746f-d981-45f7-9be1-9b8ff7ebd8da service nova] Creating event network-vif-deleted:509a91eb-a807-444b-b4e1-1171833c340a for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:54:13.963391 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2c971541-5074-4621-963d-845543a25ecf req-6277746f-d981-45f7-9be1-9b8ff7ebd8da service nova] Creating event network-vif-deleted:5cc0f6f0-34d3-4e74-8866-b3ae208579d6 for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:54:13.979125 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2c971541-5074-4621-963d-845543a25ecf req-6277746f-d981-45f7-9be1-9b8ff7ebd8da service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094148 Aug 29 15:54:13.979760 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1960/3918] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:13.985052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:13.989805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:14.014962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:14.015804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:14.016409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:14.017286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:14.017914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:14.018533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:14.484650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.503759 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e5476e8f-0263-45aa-a44b-ae1df6c3a81f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1612 microversion: 2.1 time: 0.521839 Aug 29 15:54:14.509681 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1961/3919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:13 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1612 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:14.541655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:14.548443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:14.572043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:14.575821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:14.579282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:14.580239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:14.582434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:14.583002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:14.646203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:14.826916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:14.842733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.869292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.877689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:14.879751 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2059b6af-9e02-4d4d-9b9b-10ba7fb504c8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1335 microversion: 2.47 time: 0.367553 Aug 29 15:54:14.882138 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1962/3920] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:14 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1335 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:14.905398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:14.907812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:14.920451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:14.922910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:14.923683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:14.927777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:14.934130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:14.935175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.009528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-25d738d9-3b12-4f2b-b060-e44dd6b41264 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/ips" status: 200 len: 144 microversion: 2.1 time: 0.123167 Aug 29 15:54:15.013579 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1963/3921] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:54:14 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/ips => generated 144 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:15.033031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:15.034019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:15.050121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.053877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.055576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.060433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.060433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.063897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.281490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.294300 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-244a5c96-16d7-446c-8bcd-f7b663ccf97b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1274 microversion: 2.1 time: 0.279471 Aug 29 15:54:15.295167 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1964/3922] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:15 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1274 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:15.310172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:15.310666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:15.339661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.341853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.345282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.354318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.355106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.355570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.386120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.406595 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-daceb7ab-87b9-4dfb-a983-77d82ea89304 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 1.787558 Aug 29 15:54:15.410720 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1959/3923] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:13 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:15.531932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:15.532925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:15.544477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.549162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.550299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.563847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.566296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.566926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.886751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:15.894967 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-38ef1c05-14db-4b17-b23b-e8a4062f965c tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.598539 Aug 29 15:54:15.895593 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1965/3924] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:15 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:15.923589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:15.929096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:15.947126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.958156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.958950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:15.960892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:15.961918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:15.963102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.141232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:16.157087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:16.158552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:16.165667 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5c684b9f-53ed-40c2-93e8-558b0e37574d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1356 microversion: 2.47 time: 0.263737 Aug 29 15:54:16.167330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1966/3925] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:15 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1356 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:16.192417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:16.199916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:16.219912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.221418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.226540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.229766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.230267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.230720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.422517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:16.425358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:16.426105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:16.426735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:16.428975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:16.568561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:16.588455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.589429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.589429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.594244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.594244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.594751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.670139 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2b65957-1c0e-492c-8eb2-6f53d0556339 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "POST /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea/action" status: 202 len: 1078 microversion: 2.47 time: 0.481847 Aug 29 15:54:16.670762 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1967/3926] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 15:54:16 2022] POST /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea/action => generated 1078 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 29 15:54:16.687380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:16.688201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:16.706994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.708410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.709036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.710583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:16.715965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:16.716715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:16.968638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:16.984812 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b46f058-b802-41bf-a6cf-223405491781 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1274 microversion: 2.1 time: 0.308023 Aug 29 15:54:16.985897 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1968/3927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:16 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1274 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:17.003281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:17.004219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:17.012535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:17.017372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.018661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.020922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.021905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.023609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.024270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.040442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.056137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-011e4ca3-a5e1-4dc5-a811-817811ed0cdc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1497 microversion: 2.1 time: 1.529416 Aug 29 15:54:17.059178 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1960/3928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:15 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1497 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:17.075178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:17.079232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:17.097868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.100039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.100758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.103542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.104844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.109472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.419169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.436496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.446572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.451005 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-332752f0-7aa7-4ad6-a5fd-4d88ba4733a8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.390352 Aug 29 15:54:17.457257 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1961/3929] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:17 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:17.483453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:17.485665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:17.508716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.511135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.511702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.513685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:17.515427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:17.516104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:17.961414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:17.974425 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-972850d4-ec87-4392-9753-158322f191b5 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.509598 Aug 29 15:54:17.981593 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1962/3930] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:17 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:17.996569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-375ba68c-fb37-4b10-add2-9ef5351176b8 req-7ec6c490-a2ac-4d18-ab3b-be075fdf1264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25df1df-1a0f-4ccf-99d7-a3fe59533f2c", "name": "network-vif-deleted", "tag": "f1242095-dc0e-46fe-89b3-c51decad707d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:18.012262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.020520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-375ba68c-fb37-4b10-add2-9ef5351176b8 req-7ec6c490-a2ac-4d18-ab3b-be075fdf1264 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.020915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71039cfb-07cf-429f-9dab-942d436a7d74 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 1.031889 Aug 29 15:54:18.037447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-375ba68c-fb37-4b10-add2-9ef5351176b8 req-7ec6c490-a2ac-4d18-ab3b-be075fdf1264 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.039209 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1969/3931] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:16 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:18.048986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-375ba68c-fb37-4b10-add2-9ef5351176b8 req-7ec6c490-a2ac-4d18-ab3b-be075fdf1264 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.052877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:18.053227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:18.111425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.113240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.113771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.114873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-375ba68c-fb37-4b10-add2-9ef5351176b8 req-7ec6c490-a2ac-4d18-ab3b-be075fdf1264 service nova] Creating event network-vif-deleted:f1242095-dc0e-46fe-89b3-c51decad707d for instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c on n-h1-836830-13 Aug 29 15:54:18.120973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.123566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.125891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.158252 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-375ba68c-fb37-4b10-add2-9ef5351176b8 req-7ec6c490-a2ac-4d18-ab3b-be075fdf1264 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175125 Aug 29 15:54:18.162702 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1963/3932] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:18.197589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:18.202614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:18.230111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.249508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.251419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.254786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.258052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.258475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.354559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.355462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.356104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.357378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lazy-loading 'fault' on Instance uuid a25df1df-1a0f-4ccf-99d7-a3fe59533f2c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:54:18.562672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.598625 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c747002-fc78-4d4d-a9e7-1cef8338df36 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 200 len: 1303 microversion: 2.1 time: 0.428709 Aug 29 15:54:18.604069 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1964/3933] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 1303 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:18.609166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:18.625885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:18.639218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.643115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.643947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.644945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:18.656700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:18.657553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:18.755584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.769627 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b1e89f6-c4b7-43ac-b52c-c9aca71eea5a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1274 microversion: 2.1 time: 0.729102 Aug 29 15:54:18.770234 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1970/3934] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1274 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:18.897344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.914796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.916617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:18.917855 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ee37516-7bb4-4020-9fe7-47ce6b4cb3ad tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.312656 Aug 29 15:54:18.949660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1965/3935] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:19.001455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:19.002189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:19.014894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.016139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.018553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.019501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.020135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.023734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.034247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6143a1fd-ae4e-4cbe-bf3e-58c31dcf257b"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:19.040254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:19.061292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:19.065722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.066341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.067057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.068407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.069226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.070044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.582870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:19.611323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e964049f-11f0-41ff-8c93-2cb72476a86b tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.610560 Aug 29 15:54:19.614057 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1971/3936] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:18 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:19.620876 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29166a2a-6284-431d-b98a-83e3e27413ca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591574 Aug 29 15:54:19.622225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1966/3937] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:54:19 2022] POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:19.631776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:19.632665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:19.662525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.663746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.664006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.664713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.665169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.665598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.666503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:19.671337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:19.693803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.698265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.699801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.701429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.703566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.707447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.773442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] HTTP exception thrown: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Request method failure captured: Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c HTTP/1.1 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODbOv8E_nB8y0n2PHv5FufmqI6d0EmXgE5Al09Tb5C5pwBiY-gYajRiFY_dcrnyJf9xwgQEEcT4AX5wyZE1ppIOEeuDc47p8c_m90y30b6Ou4lckiAGNb6pMTUa7o4z65vxtddZ1mHcnLMt4ej1M43fYTCyi0C8D7PWG5ovb7h3nU8 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d3085a72d4a644a2bfcc0109f0743127", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d3085a72d4a644a2bfcc0109f0743127"}]}] Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestMultiNic-1175821198 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9dda72ff55b246cea4bf5bc5e1e87c5f Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a25df1df-1a0f-4ccf-99d7-a3fe59533f2c'} Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:54:19.779709 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Returning 404 to user: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:54:19.785263 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a666a5f-a8a7-4a6b-b298-54915cb3ca1b tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 404 len: 111 microversion: 2.1 time: 0.136614 Aug 29 15:54:19.791148 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1967/3938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:19 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:54:19.800366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:19.815634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:19.829462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.832294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.834012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:19.836265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:19.841579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:19.842284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.229042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.238521 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6419bf80-da1f-418c-ba27-ae6734c36d71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 0.446046 Aug 29 15:54:20.241747 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1968/3939] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:19 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:20.255147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:20.256022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:20.279439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.279952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.280394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.281110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.281565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.281987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.348157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:20.357563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.377438 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4848f776-a9d1-4611-9d75-0d3b40a911d0 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.755111 Aug 29 15:54:20.378113 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1972/3940] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:19 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:20.490219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.499541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.505215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:20.509481 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9464cacd-f7a3-4970-bb70-dca5f190c573 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.264965 Aug 29 15:54:20.510182 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1969/3941] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:20 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:20.642244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:20.642863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:20.659448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.660050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.660495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:20.661236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:20.661719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:20.666877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.077271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.088124 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11018147-d247-4124-ba6c-7b775300889f tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.449622 Aug 29 15:54:21.088708 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1973/3942] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:20 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:21.265343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:21.267784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:21.302252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.307064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.310246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.312145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.313197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.315856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.398737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:21.399555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:21.401332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:21.434727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.435249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.446176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.454230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.455092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.461126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.864568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.870203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:21.899681 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8909fa7-c1c2-4df4-bbc1-1626daf03b1d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.496834 Aug 29 15:54:21.910338 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1974/3943] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:21 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:21.911678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a100a7c2-728b-4664-afb8-68fc8158ba8c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 0.649107 Aug 29 15:54:21.914636 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1970/3944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:21 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:21.920777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-60a37935-22cf-4aa0-b1ee-7732847454e7 req-82a3d33b-1aa1-4a36-8f0c-cc34875eb103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f04d40-f4f7-49ad-9050-13106f86cf10", "tag": "6ca55786-29ad-4318-99af-5022019c67a1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:21.933308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=32 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:21.936782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-60a37935-22cf-4aa0-b1ee-7732847454e7 req-82a3d33b-1aa1-4a36-8f0c-cc34875eb103 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.941300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-60a37935-22cf-4aa0-b1ee-7732847454e7 req-82a3d33b-1aa1-4a36-8f0c-cc34875eb103 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.944768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-60a37935-22cf-4aa0-b1ee-7732847454e7 req-82a3d33b-1aa1-4a36-8f0c-cc34875eb103 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.963452 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-60a37935-22cf-4aa0-b1ee-7732847454e7 req-82a3d33b-1aa1-4a36-8f0c-cc34875eb103 service nova] Creating event network-changed:6ca55786-29ad-4318-99af-5022019c67a1 for instance 32f04d40-f4f7-49ad-9050-13106f86cf10 on n-h1-836830-13 Aug 29 15:54:21.966840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:21.978525 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-60a37935-22cf-4aa0-b1ee-7732847454e7 req-82a3d33b-1aa1-4a36-8f0c-cc34875eb103 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061905 Aug 29 15:54:21.980392 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1975/3945] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:21.982526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:21.994294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:21.997291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:21.998246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:21.999363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.000003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.000717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.110876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:22.111687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.124906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.125554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.125859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.126591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.131272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.133769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.235757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:22.251870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:22.253451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:22.254887 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8848d42e-0e5c-4379-89d5-2b0ea977fd76 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.316422 Aug 29 15:54:22.258895 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1971/3946] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:21 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:22.724558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:22.744164 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8b778dd-790a-4029-b7bf-bdd670f8c0c9 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.638029 Aug 29 15:54:22.744753 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1976/3947] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:22 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:22.926226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:22.927448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.934827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:22.935487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:22.940786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.941458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.941901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.942656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.947855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.949697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.950858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.951784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.952461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:22.953402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:22.956542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:22.957175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.369492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:23.390584 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-662aceb0-9bf4-494c-adbc-6c7e91a2d409 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.465508 Aug 29 15:54:23.392198 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1972/3948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:22 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:23.406687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:23.407959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:23.420839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.422500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.424475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.425542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.428297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.428955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.619358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:23.632712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:23.634711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:23.637733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a5d1c4c5-34ac-44b0-b591-0f7dc9313ddc tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.242958 Aug 29 15:54:23.639049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1973/3949] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:23 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:23.766551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:23.767380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:23.816645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.820501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.826129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:23.827075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:23.828031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:23.828717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.107073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.111223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:24.128215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c87f0a1c-dd30-43c0-98b2-d8ba5298b89b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 1.199560 Aug 29 15:54:24.144429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1977/3950] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:22 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:24.417827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:24.418512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:24.440308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.447077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.447861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.448844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.451498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.452086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.673116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.690997 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a96e1b1a-fc23-42bb-9a9f-2d0bbccb1199 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.928523 Aug 29 15:54:24.691809 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1974/3951] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:23 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:24.707998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:24.709183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:24.720572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.721481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.722163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.723386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:24.727872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:24.729371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:24.848568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.860938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.863863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:24.868668 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5ccfa055-5683-45b6-979c-dd22f216491b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.173339 Aug 29 15:54:24.870577 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1975/3952] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:24 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:25.098850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.124099 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8454ffea-8e38-4a49-92ac-99e7f057f96b tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.711939 Aug 29 15:54:25.131418 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1978/3953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:24 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:25.167988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:25.167988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:25.192620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.193123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.193567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.194915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.195598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.196191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.668011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:25.681901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca6fb6e6-ab07-4169-83e1-7a8925beefb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 0.520931 Aug 29 15:54:25.682580 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1976/3954] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:25 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:25.716169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:25.716801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:25.731239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.732625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.735891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.737448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.738116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.741762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.896413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:25.899504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:25.909190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.911731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.912538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:25.914753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:25.915620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:25.916306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.171192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.190570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05154cfc-133e-4184-97cb-c906049fdfb8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.475276 Aug 29 15:54:26.191732 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1979/3955] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:25 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:26.198268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:26.199263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:26.211856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.213722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.218097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.219115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.219794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.220876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.292976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.314606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.318632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.320233 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-454f77c9-c035-4f30-81e6-011e6dbd9ad6 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.428207 Aug 29 15:54:26.323410 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1977/3956] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:25 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:26.705721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:26.707047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:26.720731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.721796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.722533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.727058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:26.734616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:26.735498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:26.807981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:26.822330 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e4230622-893d-4be7-84ac-8fc225bcca83 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.629154 Aug 29 15:54:26.822963 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1980/3957] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:26 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:27.213046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:27.214565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:27.231445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.240668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.241497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.242538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.243255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.244080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.255508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.270465 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a127652-585d-4076-b29d-be3a45312de9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 0.568522 Aug 29 15:54:27.273817 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1978/3958] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:26 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:27.349636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:27.350370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:27.365011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.365511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.365987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.367337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.367826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.368256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.592425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.601892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.612222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.616319 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1bbeec17-f019-4dfc-8e80-e2ebed580d4d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.270192 Aug 29 15:54:27.623259 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1979/3959] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:27 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:27.648756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:27.660935 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3d37450-33cf-4f7e-a13c-b9d4fb60a590 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.452578 Aug 29 15:54:27.664140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1981/3960] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:27 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:27.851196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:27.851839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:27.869082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.869601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.870046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:27.870882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:27.871382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:27.872081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.116821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-bcda1793-e224-43dd-a20f-fa6448a92d42 req-15c2ec69-7b46-48d5-99bb-64f4b87b88db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2314b1b-80a5-4182-be30-e8bf25242168", "name": "network-vif-plugged", "status": "completed", "tag": "f3e76890-aaf4-4c4f-b78b-5ccce60144f5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:28.149903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bcda1793-e224-43dd-a20f-fa6448a92d42 req-15c2ec69-7b46-48d5-99bb-64f4b87b88db service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.158605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bcda1793-e224-43dd-a20f-fa6448a92d42 req-15c2ec69-7b46-48d5-99bb-64f4b87b88db service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.160904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bcda1793-e224-43dd-a20f-fa6448a92d42 req-15c2ec69-7b46-48d5-99bb-64f4b87b88db service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.189836 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-bcda1793-e224-43dd-a20f-fa6448a92d42 req-15c2ec69-7b46-48d5-99bb-64f4b87b88db service nova] Creating event network-vif-plugged:f3e76890-aaf4-4c4f-b78b-5ccce60144f5 for instance c2314b1b-80a5-4182-be30-e8bf25242168 on n-h2-836830-13 Aug 29 15:54:28.221125 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-bcda1793-e224-43dd-a20f-fa6448a92d42 req-15c2ec69-7b46-48d5-99bb-64f4b87b88db service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108681 Aug 29 15:54:28.222500 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1982/3961] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:28.295462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.297119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.318578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.318962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.319953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.333216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.334163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.338057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.358617 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46a4c3df-8720-4a66-ade3-78665bad185e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.512598 Aug 29 15:54:28.360705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.372433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1980/3962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:27 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:28.656053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.657173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.707646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.710833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.714097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.718506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.720986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.723571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.849401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:28.865719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09190f98-1acb-45ad-adbf-b4c97654a8bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 0.574514 Aug 29 15:54:28.880642 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1983/3963] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:28 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:28.894169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:28.914286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:28.935681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.936187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.936683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:28.937628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:28.939081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:28.939974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.113903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.133388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.137155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.170364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.196315 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a48d198-d179-4f85-99a2-2cb9d4f8e394 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.540886 Aug 29 15:54:29.199079 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1981/3964] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:28 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:29.207186 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-090be237-0008-4ce4-87a7-4b81159b6cd8 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.323170 Aug 29 15:54:29.211275 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1984/3965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:28 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:29.401899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:29.402951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:29.411663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.412551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.414306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.415540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.416252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.416916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.768840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:29.789502 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a96ebca8-8d80-4f7e-9294-a952b007399c tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.392139 Aug 29 15:54:29.792305 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1982/3966] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:29 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:29.874721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b2ef9891-92e6-40fa-80fc-c12afcd702b1 req-66080180-4a1c-4188-ba2d-403862ed10de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80660c8c-9614-43a9-8efb-0a24ab2c815e", "name": "network-vif-unplugged", "status": "completed", "tag": "877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:29.890789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:29.891905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:29.914370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.918847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.919969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.933083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.939646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.943570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.944361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b2ef9891-92e6-40fa-80fc-c12afcd702b1 req-66080180-4a1c-4188-ba2d-403862ed10de service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:29.946037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b2ef9891-92e6-40fa-80fc-c12afcd702b1 req-66080180-4a1c-4188-ba2d-403862ed10de service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:29.947274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b2ef9891-92e6-40fa-80fc-c12afcd702b1 req-66080180-4a1c-4188-ba2d-403862ed10de service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:29.985075 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b2ef9891-92e6-40fa-80fc-c12afcd702b1 req-66080180-4a1c-4188-ba2d-403862ed10de service nova] Creating event network-vif-unplugged:877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9 for instance 80660c8c-9614-43a9-8efb-0a24ab2c815e on n-h1-836830-13 Aug 29 15:54:29.992757 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b2ef9891-92e6-40fa-80fc-c12afcd702b1 req-66080180-4a1c-4188-ba2d-403862ed10de service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127744 Aug 29 15:54:29.993411 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1985/3967] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:30.238523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:30.239430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:30.246707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.247628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.248322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.249373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.250066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.250720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.579645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.612201 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23a6ec25-ff36-4ef8-9810-3557c9dd5905 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1403 microversion: 2.1 time: 0.379570 Aug 29 15:54:30.612867 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1986/3968] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:30 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1403 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:30.635369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:30.639911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:30.655515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.656314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.657146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.658134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.658833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.659544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.800568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.814023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.816297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:30.820077 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d23bd97-305b-4983-8098-e872aa669733 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.190107 Aug 29 15:54:30.835676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1987/3969] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:30 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:30.849519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:30.849990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:30.857369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.857861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.858681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:30.859602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:30.860226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:30.860819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.209333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.220047 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e5088f98-b0de-45ba-8e49-109f375e01b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 1.334180 Aug 29 15:54:31.225394 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1983/3970] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:29 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:31.322572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1de6eec4-3b97-4cef-a3c1-29dfbd229ff2 req-caae02fb-0732-4cdf-af70-228458cf517f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f04d40-f4f7-49ad-9050-13106f86cf10", "name": "network-vif-plugged", "status": "completed", "tag": "6ca55786-29ad-4318-99af-5022019c67a1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:31.332016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.341179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1de6eec4-3b97-4cef-a3c1-29dfbd229ff2 req-caae02fb-0732-4cdf-af70-228458cf517f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.341651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1de6eec4-3b97-4cef-a3c1-29dfbd229ff2 req-caae02fb-0732-4cdf-af70-228458cf517f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.342084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1de6eec4-3b97-4cef-a3c1-29dfbd229ff2 req-caae02fb-0732-4cdf-af70-228458cf517f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.370524 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33eef8e6-1b68-4238-92eb-152df9ecd73e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.531847 Aug 29 15:54:31.371454 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1988/3971] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:30 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:31.385669 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1de6eec4-3b97-4cef-a3c1-29dfbd229ff2 req-caae02fb-0732-4cdf-af70-228458cf517f service nova] Creating event network-vif-plugged:6ca55786-29ad-4318-99af-5022019c67a1 for instance 32f04d40-f4f7-49ad-9050-13106f86cf10 on n-h1-836830-13 Aug 29 15:54:31.390064 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1de6eec4-3b97-4cef-a3c1-29dfbd229ff2 req-caae02fb-0732-4cdf-af70-228458cf517f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071791 Aug 29 15:54:31.395180 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1984/3972] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:31.636339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:31.637432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:31.646465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.650690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.651203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.651965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.652433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.652873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.852490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:31.853388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:31.870364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.872181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.873540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.875860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.876854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.877845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:31.931634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:31.951018 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9582d840-d4f1-41b5-b6b2-7be698a10b04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1589 microversion: 2.1 time: 0.318315 Aug 29 15:54:31.952990 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1989/3973] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:31 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1589 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:31.988934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:31.989595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:31.997352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:31.998184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:31.998882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.000260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.001005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.001685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.090162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.119650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.124205 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e3172ce-f132-4589-b4cc-7a653b0f7481 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148999 Aug 29 15:54:32.125641 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1990/3974] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:54:31 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:32.127653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.128908 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce217b36-d7ee-4d97-9d85-2e3024c7a52a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.282839 Aug 29 15:54:32.141815 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1985/3975] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:31 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:32.154341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0f11e7ca-68ef-4605-a77c-d509109744e8 req-40e36d76-9324-4f70-a4a0-b9c242f1a432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80660c8c-9614-43a9-8efb-0a24ab2c815e", "tag": "877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:32.170122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0f11e7ca-68ef-4605-a77c-d509109744e8 req-40e36d76-9324-4f70-a4a0-b9c242f1a432 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.170965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0f11e7ca-68ef-4605-a77c-d509109744e8 req-40e36d76-9324-4f70-a4a0-b9c242f1a432 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.172024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0f11e7ca-68ef-4605-a77c-d509109744e8 req-40e36d76-9324-4f70-a4a0-b9c242f1a432 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.212112 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0f11e7ca-68ef-4605-a77c-d509109744e8 req-40e36d76-9324-4f70-a4a0-b9c242f1a432 service nova] Creating event network-changed:877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9 for instance 80660c8c-9614-43a9-8efb-0a24ab2c815e on n-h1-836830-13 Aug 29 15:54:32.220838 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0f11e7ca-68ef-4605-a77c-d509109744e8 req-40e36d76-9324-4f70-a4a0-b9c242f1a432 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093338 Aug 29 15:54:32.221821 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1991/3976] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:32.246110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:32.246918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:32.253408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.254385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.255097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.256196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.257631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.258325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.393150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:32.394778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:32.407193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.408068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.408765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.409723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:32.410582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:32.411274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:32.633736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:32.642425 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b58c498-f7eb-456f-9e89-931f8031c3a6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.253427 Aug 29 15:54:32.643414 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1992/3977] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:32 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:33.103750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.148013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:33.157943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:33.159519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:33.166892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e584d0c-8cba-4145-9ab0-daa57dd6070f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1316 microversion: 2.1 time: 0.925575 Aug 29 15:54:33.167544 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1986/3978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:32 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1316 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:33.171389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.172078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.172695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.173544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.174140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.174708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.362169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.402178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.405908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:33.409674 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e89a743b-98aa-4490-8d32-4f628b673fa2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.254538 Aug 29 15:54:33.410531 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1993/3979] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:33 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:33.668313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:33.669627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:33.684419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.687118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.687849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.688788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:33.691396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:33.692024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:33.729606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1421072006", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "73f4746f-fc74-4997-a22d-514681e348b9"}, {"uuid": "a406e9bd-9ecf-41f3-b605-13403eb8dde8"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:33.810501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] validate_networks() for [('73f4746f-fc74-4997-a22d-514681e348b9', None, None, None, None, None), ('a406e9bd-9ecf-41f3-b605-13403eb8dde8', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:34.877459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:34.879526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:34.880774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:34.883065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:34.884508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:34.904355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.905750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.906464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:34.907737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:34.908464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:34.909456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:34.935673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Getting quotas for project d3085a72d4a644a2bfcc0109f0743127. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:34.942396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Getting quotas for user 9dda72ff55b246cea4bf5bc5e1e87c5f and project d3085a72d4a644a2bfcc0109f0743127. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:34.958153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:34.961610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:35.053983 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-569d82d8-329d-495c-9c7b-87a4d71ab44c tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328521 Aug 29 15:54:35.063085 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1994/3980] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:54:35.068526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:35.072479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:35.086086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:35.091842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:35.092714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.093669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:35.094377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:35.095072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.121951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.130589 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8166db61-b7ad-46a8-b9bc-3d38bb9d63a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 1.468834 Aug 29 15:54:35.149700 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1987/3981] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:33 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:35.154539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:35.155523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:35.165303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:35.165811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:35.166256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.166979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:35.167474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:35.167910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:35.382052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.410024 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f24b096-f813-495a-941b-fda2ff109167 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.344629 Aug 29 15:54:35.412489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.415385 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1995/3982] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:35 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:35.425545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8952d617-6d89-4954-bdaf-6d074df4264e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:35.426587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8952d617-6d89-4954-bdaf-6d074df4264e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:35.455277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.457152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.459373 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8edfc1f-1064-4bdf-a44c-9cce4e469159 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.320534 Aug 29 15:54:35.478521 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1988/3983] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:35 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:35.596803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8952d617-6d89-4954-bdaf-6d074df4264e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:35.614394 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8952d617-6d89-4954-bdaf-6d074df4264e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1213 microversion: 2.1 time: 0.197553 Aug 29 15:54:35.622190 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1996/3984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:35 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1213 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:35.735550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-205625487", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:35.899061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] validate_networks() for [('e896cd33-82d8-4f1e-822e-7e54068fdc15', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:54:36.166350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:36.166922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:36.186090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.186917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.187612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:36.188622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:36.189690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:36.190460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.076135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.090356 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c36d5260-e822-4c29-adce-7073d855b187 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.929580 Aug 29 15:54:37.096961 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1997/3985] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:36 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:37.105822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:37.106604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:37.149596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.150111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.150561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.151422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.151767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.158766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.226645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:37.434934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.448137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.449596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.450805 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2f2a9d43-7c4a-498f-9d86-36d8bac44d19 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.351951 Aug 29 15:54:37.456361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1998/3986] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:37 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:37.481352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:37.482090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:37.503353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.504266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.505308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.509597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.510467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.513755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.771267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:37.787302 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ca3deed-195c-47fe-942b-9cc15e0abddf tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1283 microversion: 2.1 time: 0.329678 Aug 29 15:54:37.790154 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 1999/3987] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:37 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1283 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:37.824964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a812ac29-3088-4fe3-8b18-2348ffea41b4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:37.839038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a812ac29-3088-4fe3-8b18-2348ffea41b4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:37.839671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a812ac29-3088-4fe3-8b18-2348ffea41b4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:37.840207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a812ac29-3088-4fe3-8b18-2348ffea41b4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:37.896705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a812ac29-3088-4fe3-8b18-2348ffea41b4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Going to try to stop instance {{(pid=129133) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:54:37.998039 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a812ac29-3088-4fe3-8b18-2348ffea41b4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action" status: 202 len: 0 microversion: 2.1 time: 0.188622 Aug 29 15:54:38.004843 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2000/3988] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:54:37 2022] POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:54:38.010691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:38.011684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:38.020939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.022832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.023497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.025472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.026186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.027545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.220917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:54:38.222204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:54:38.223007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:54:38.223825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:54:38.224502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:54:38.243591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.244537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.245157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.246125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.246761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.247453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.276287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Getting quotas for project 6d953872c1bd443aa26ee4f47626bdc9. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:54:38.283515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Getting quotas for user 8efa4be1bf974daf84fc5f64b4ca3155 and project 6d953872c1bd443aa26ee4f47626bdc9. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:54:38.308138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:54:38.310523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:54:38.374863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77c51ba5-7f72-48cf-b2bb-eb478031e7fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.649558 Aug 29 15:54:38.376061 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1989/3989] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:54:38.382038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7edf452c-835d-4c07-b5e5-a196bab3b001 req-567044f9-c56b-4121-a68c-4b5f71265efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2314b1b-80a5-4182-be30-e8bf25242168", "tag": "f3e76890-aaf4-4c4f-b78b-5ccce60144f5"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:38.398337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7edf452c-835d-4c07-b5e5-a196bab3b001 req-567044f9-c56b-4121-a68c-4b5f71265efc service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.399139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7edf452c-835d-4c07-b5e5-a196bab3b001 req-567044f9-c56b-4121-a68c-4b5f71265efc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.399762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7edf452c-835d-4c07-b5e5-a196bab3b001 req-567044f9-c56b-4121-a68c-4b5f71265efc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.419315 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7edf452c-835d-4c07-b5e5-a196bab3b001 req-567044f9-c56b-4121-a68c-4b5f71265efc service nova] Creating event network-changed:f3e76890-aaf4-4c4f-b78b-5ccce60144f5 for instance c2314b1b-80a5-4182-be30-e8bf25242168 on n-h2-836830-13 Aug 29 15:54:38.437282 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7edf452c-835d-4c07-b5e5-a196bab3b001 req-567044f9-c56b-4121-a68c-4b5f71265efc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059827 Aug 29 15:54:38.438211 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1990/3990] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:38.489317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:38.490207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:38.529417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.529924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.530900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.531778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.535241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.536092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.825964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:38.840025 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ac2a4a7-6f78-42f4-81f6-a0902ca0a4d0 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1589 microversion: 2.1 time: 0.833771 Aug 29 15:54:38.841090 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2001/3991] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:38 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1589 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:38.846390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:38.847007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:38.856265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.856381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.856764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:38.859293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:38.860836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:38.861862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.053643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.068569 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-13552a98-c938-412e-abfc-3f2f123b1921 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.225920 Aug 29 15:54:39.070288 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2002/3992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:38 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:39.076822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d08f9472-5c07-4c69-a181-e150415b298b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:39.078006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d08f9472-5c07-4c69-a181-e150415b298b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:39.149943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d08f9472-5c07-4c69-a181-e150415b298b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.159521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d08f9472-5c07-4c69-a181-e150415b298b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1216 microversion: 2.1 time: 0.087548 Aug 29 15:54:39.160373 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2003/3993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:39 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1216 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:39.183958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:39.186047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:39.193405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:39.194426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:39.195182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.196552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:39.197533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:39.198152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.283147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.298006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.299900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.301129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8b477b8-a2dc-4449-b0f6-2133e3ff1583 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.129693 Aug 29 15:54:39.312433 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2004/3994] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:39 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:39.319656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:39.326718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:39.339822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:39.340680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:39.341315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.343873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:39.344783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:39.345450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:39.431380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.441905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c96dc32-401f-427e-9c5c-d93855ff7001 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1271 microversion: 2.1 time: 0.126923 Aug 29 15:54:39.443618 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2005/3995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:39 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:39.564206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:39.575332 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2173c26e-b569-4c94-821b-e545c6ab235c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 1.121186 Aug 29 15:54:39.590399 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1991/3996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:38 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:40.100399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:40.105589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:40.124548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.128170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.129031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.130592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.134236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.134970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.188877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:40.189813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:40.214353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.215284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.216084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.217016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.217645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.218283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.524865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.560098 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-74917e43-1c53-4bd0-a0f6-211c075f1fc8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.469823 Aug 29 15:54:40.561206 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2006/3997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:40.567203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:40.568070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:40.579887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.580645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.581618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.585653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.586425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.587093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.753072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.789517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.805497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.809696 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7b56866-e4df-48c4-91e3-1d7e46a0debe tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.246843 Aug 29 15:54:40.811885 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2007/3998] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:40.822939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:40.829305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:40.840556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.842151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.842699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.844174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.846839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.847486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.937930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.950973 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54665fa7-addb-4045-8223-4c8694557e48 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1268 microversion: 2.1 time: 0.769932 Aug 29 15:54:40.952415 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1992/3999] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1268 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:40.957931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:40.959493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:40.969444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.970215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.970897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.971799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:40.973148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:40.973369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:40.973962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:40.993142 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f694b222-e474-46ad-a545-dc2111335740 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1271 microversion: 2.1 time: 0.179988 Aug 29 15:54:40.995217 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2008/4000] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:41.587067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.587746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:41.595442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.596160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.596763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.597643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.598279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.598601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:41.599221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.612593 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17740ae7-4fb2-46be-8c26-8ec43a327469 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.658791 Aug 29 15:54:41.613189 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1993/4001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:40 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:41.818475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:41.828404 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92d5bd0a-220f-4838-a2b1-1521565549a8 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.246199 Aug 29 15:54:41.829456 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2009/4002] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:41.858275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.859254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:41.873648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.886518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.887573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.888735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:41.889507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:41.890436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:41.974494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:41.987299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:42.008860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:42.021183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.027149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.027908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.028841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.035197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.036114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.111965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:42.123394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:42.125575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:42.127608 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80887138-5570-4d8c-bd76-4fab8c864f34 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.273299 Aug 29 15:54:42.129074 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1994/4003] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:42.137962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:42.138864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:42.146084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.146864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.148345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.149389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.150151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.150829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.228968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:42.241796 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1dae25ca-e976-469d-8143-0c7f3b55c83a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1274 microversion: 2.1 time: 0.271200 Aug 29 15:54:42.242837 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2010/4004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:41 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1274 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:42.643117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:42.644154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:42.655907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.656372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.656995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.657700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.658768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.659620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.754776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:42.773877 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-92a0d4e6-5c35-4ed3-afc2-0f5c8791464d tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1313 microversion: 2.1 time: 0.640487 Aug 29 15:54:42.778918 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1995/4005] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:42 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:42.859325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:42.860592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:42.870512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.871455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.872255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:42.873387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:42.874883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:42.875695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.230233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:43.245581 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5fbbdf98-9382-4a59-bff6-209c800cf6aa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.607984 Aug 29 15:54:43.249833 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2011/4006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:42 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:43.256157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:43.267995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:43.276001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:43.278018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:43.278018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.278244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:43.278694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:43.279496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.416363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:43.436343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:43.448317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:43.460122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:43.466653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-db1fc75b-66fe-4cc6-b93f-786c81c36ac4 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.213433 Aug 29 15:54:43.467877 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2012/4007] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:43 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:43.468811 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26f38d79-de55-404f-b777-1067f9983f57 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.614895 Aug 29 15:54:43.475274 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1996/4008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:42 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:43.486988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:43.487970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:43.495379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:43.496179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:43.496783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.497679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:43.498288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:43.498862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.605416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:43.622957 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-becd8ff5-2c85-45f3-bd00-68de09904195 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1274 microversion: 2.1 time: 0.147633 Aug 29 15:54:43.624360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2013/4009] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:43 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:43.823412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:43.824480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:43.858820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:43.859483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:43.860007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:43.863668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:43.866379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:43.868812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.287450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:44.289599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:44.309167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.309952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.310638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.311563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.312197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.312799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.608519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:44.617682 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0621369b-25fb-4c04-be50-a7cb3e037ca5 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.351643 Aug 29 15:54:44.625824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2014/4010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:44 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:44.630624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:44.631268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:44.641679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.643624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.645036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.646521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:44.649489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:44.650495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:44.656602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:44.925175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:44.954228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:44.974684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-56481f57-63bb-4dc0-b253-b77dd5f7defd tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1313 microversion: 2.1 time: 1.164582 Aug 29 15:54:44.978157 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1997/4011] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:43 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1313 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:44.987876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:44.988890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:45.005396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.007784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.009167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.011065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.012868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.016485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.033927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.063617 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a62b1cc-66dc-458d-97ec-5ddc5a5afbf3 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.436586 Aug 29 15:54:45.068959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2015/4012] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:44 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:45.084217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:45.085310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:45.104461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.104962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.117304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.118386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.119052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.119651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.221615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.234631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.240383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.243953 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-959fcfab-c42f-491d-af86-b3f8f6e1876f tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.262301 Aug 29 15:54:45.245180 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1998/4013] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:44 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:45.401123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:45.417756 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a55a678-abe5-4de2-b23a-b80632991ccc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.347471 Aug 29 15:54:45.419231 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2016/4014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:45 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:45.641753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:45.642377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:45.653230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.653731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.654415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:45.655164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:45.655816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:45.656414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.004614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:46.008088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:46.020705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.021134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.025409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.026185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.026666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.027153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.317426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.328717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ad2661b6-ed1b-4960-93d7-73875f6ef9b5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.326533 Aug 29 15:54:46.344679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2017/4015] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:45 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:46.353940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:46.354570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:46.371660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.372161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.372601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.377660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.378809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.382061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.422259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.440472 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7fb2937d-928f-4ba8-b5fc-b932844c1bc1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.802507 Aug 29 15:54:46.443521 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 1999/4016] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:45 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:46.452510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:46.453627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:46.483811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.485542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.486201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.487181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.488090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.489948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.671995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.686097 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-df6a82c8-71f8-4926-ba47-aea3ffde154d tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1391 microversion: 2.1 time: 0.340176 Aug 29 15:54:46.687110 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2018/4017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:46 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1391 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:46.693459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:46.695910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:46.710885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.712222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.712887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.714627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:46.715337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:46.717618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:46.753001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.777950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.780039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.781266 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6df81ddf-49af-408f-babd-1eb7ce40e7a9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.336054 Aug 29 15:54:46.781845 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2000/4018] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:46 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:46.983713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:46.992818 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa970f45-efd1-4314-a696-dab7f0ef3a0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.304090 Aug 29 15:54:46.994165 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2019/4019] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:46 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:47.351715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:47.352722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:47.362146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.362875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.363507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.364390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.365028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.365828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.476276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:47.477245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:47.485197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.495922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.496702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.497658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.498313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.499166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.751481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:47.763887 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-313b0f31-2552-4edd-b038-52760e2482cc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.291972 Aug 29 15:54:47.780054 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2020/4020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:47 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:47.789659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:47.790601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:47.797700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.798832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.799965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:47.800869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:47.801565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:47.802150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.193177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:48.202432 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a06e398c-735e-4fc0-af37-4ef08f7bff33 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1381 microversion: 2.1 time: 0.417207 Aug 29 15:54:48.203978 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2021/4021] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:47 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1381 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:48.212010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:48.212882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:48.231470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.233286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.233825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.242803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.243952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.244606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.262786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:48.289064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:48.297821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:48.308388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1b8a8e3-1a6f-490b-8416-1c1bfd781a10 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.961555 Aug 29 15:54:48.309578 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2001/4022] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:47 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:48.318825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:48.320341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:48.335776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.337305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.338076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.338967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.339991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.340612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.419165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:48.430033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:48.430492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:48.431960 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10068932-c223-480e-afaf-f4003522a53b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.226867 Aug 29 15:54:48.432760 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2022/4023] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:48 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:48.454666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d682665c-d22e-40a0-a830-3edd5989fe65 req-2c6538cb-24fd-4e9d-9f96-d2d430284de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "672de70b-9063-4656-82fe-5d6d23d3ba61", "tag": "3247699f-fcc7-4ebd-85a0-0ea62374e6bd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:48.487902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d682665c-d22e-40a0-a830-3edd5989fe65 req-2c6538cb-24fd-4e9d-9f96-d2d430284de3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.488622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d682665c-d22e-40a0-a830-3edd5989fe65 req-2c6538cb-24fd-4e9d-9f96-d2d430284de3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.489429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d682665c-d22e-40a0-a830-3edd5989fe65 req-2c6538cb-24fd-4e9d-9f96-d2d430284de3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.506130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d682665c-d22e-40a0-a830-3edd5989fe65 req-2c6538cb-24fd-4e9d-9f96-d2d430284de3 service nova] Creating event network-changed:3247699f-fcc7-4ebd-85a0-0ea62374e6bd for instance 672de70b-9063-4656-82fe-5d6d23d3ba61 on n-h2-836830-13 Aug 29 15:54:48.515320 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d682665c-d22e-40a0-a830-3edd5989fe65 req-2c6538cb-24fd-4e9d-9f96-d2d430284de3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081119 Aug 29 15:54:48.519202 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2023/4024] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:48.525303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a840288-1f70-4782-a9d5-f8d846519834 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '.version_select at 0x7f32ee4f89d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:48.528783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a840288-1f70-4782-a9d5-f8d846519834 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.530384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a840288-1f70-4782-a9d5-f8d846519834 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.531234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a840288-1f70-4782-a9d5-f8d846519834 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.543781 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a840288-1f70-4782-a9d5-f8d846519834 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/os-migrations" status: 200 len: 1569 microversion: 2.1 time: 0.023384 Aug 29 15:54:48.553077 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2024/4025] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 15:54:48 2022] GET /compute/v2.1/os-migrations => generated 1569 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:48.558582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:48.559427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:48.571372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.571505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.571925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.573802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:48.574408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:48.574782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:48.976017 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-136c893e-280c-4b9f-8a8c-5771204af101 tempest-LiveMigrationTest-1797802955 tempest-LiveMigrationTest-1797802955-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1534 microversion: 2.1 time: 0.420479 Aug 29 15:54:48.992213 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2025/4026] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:48 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1534 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:48.992213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:48.993201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:48.993463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.017828 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-65bfea0e-6022-4426-8d13-ef30ac058fe2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.706779 Aug 29 15:54:49.019569 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2002/4027] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:48 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:49.026278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:49.027600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:49.038761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.039559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.040595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.041910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.042748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.044494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.061798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.064588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.065265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.066401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.068261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.069999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.120996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:54:49.155595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:49.189985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:49.268632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:49.330984 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a711288-9aa2-4952-a0c1-f7d9e3a4aa0e tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "DELETE /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 204 len: 0 microversion: 2.1 time: 0.302752 Aug 29 15:54:49.336084 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2003/4028] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:54:49 2022] DELETE /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:54:49.351841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:49.354356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:49.375707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.376430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.377033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.387103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.387714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.388979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.533574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.546059 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a6acf3b-fd68-472f-bfa8-b305ea1de3a9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.564428 Aug 29 15:54:49.547356 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2026/4029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:48 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:49.552151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:49.553180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:49.566963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.567761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.568422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.569337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.570195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.570782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.760267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.770893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75aae25b-58c5-469f-b73a-91e7e0999f01 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.436075 Aug 29 15:54:49.773931 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2004/4030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:49 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:49.779643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:49.780792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:49.789678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.790485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.791140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.793737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:49.794221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:49.794658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:49.807936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.824708 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-259c46ed-2eba-4987-9d1b-f1654cc71d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1387 microversion: 2.1 time: 0.274759 Aug 29 15:54:49.826950 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2027/4031] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:49 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1387 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:49.972385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.996030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:49.999581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:50.001386 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3291a6d2-fc40-4b92-bb68-dcd8c2b3b4d3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1365 microversion: 2.47 time: 0.226161 Aug 29 15:54:50.002788 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2005/4032] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:49 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:50.046649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:50.047310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:50.062877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.063417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.063862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.067670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.068152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.068708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.327922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:50.346250 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b463ce94-71d9-42e2-80cb-a732008f5e8b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.304693 Aug 29 15:54:50.349030 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2028/4033] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:50 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:50.568478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:50.570295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:50.578687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.579593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.580123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.581269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.581823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.582451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.617962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8d49be20-9b1a-4df2-bb68-faed713fb05b req-a71cea90-d58d-4daf-8ca7-34b264cf6e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0812f482-9b0c-4a55-aea5-117173f6c371", "tag": "5abf4f9d-98e7-4ec8-89d6-5c7e5534941c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:50.628533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8d49be20-9b1a-4df2-bb68-faed713fb05b req-a71cea90-d58d-4daf-8ca7-34b264cf6e0b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.629032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8d49be20-9b1a-4df2-bb68-faed713fb05b req-a71cea90-d58d-4daf-8ca7-34b264cf6e0b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.629466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8d49be20-9b1a-4df2-bb68-faed713fb05b req-a71cea90-d58d-4daf-8ca7-34b264cf6e0b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.645076 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8d49be20-9b1a-4df2-bb68-faed713fb05b req-a71cea90-d58d-4daf-8ca7-34b264cf6e0b service nova] Creating event network-changed:5abf4f9d-98e7-4ec8-89d6-5c7e5534941c for instance 0812f482-9b0c-4a55-aea5-117173f6c371 on n-h1-836830-13 Aug 29 15:54:50.654124 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8d49be20-9b1a-4df2-bb68-faed713fb05b req-a71cea90-d58d-4daf-8ca7-34b264cf6e0b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039706 Aug 29 15:54:50.655380 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2029/4034] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:50.801254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:50.802425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:50.814287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.814932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.815483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:50.816371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:50.818630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:50.819901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.062524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:51.074016 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-086f2348-d297-4e6b-93d2-0656310d2e66 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.283426 Aug 29 15:54:51.075493 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2030/4035] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:50 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:51.083107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:51.084246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:51.093208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.093966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.094932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.096042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.096745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.097401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.385967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:51.394549 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-112f929b-1164-4e8f-9988-b21a49a68892 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1387 microversion: 2.1 time: 0.317790 Aug 29 15:54:51.395364 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2031/4036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:51 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1387 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:51.400737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:51.406781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:51.414933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.419482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.420109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.421129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.421762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.422371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.441442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:51.452898 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-72d503e4-0e69-4ae6-99c2-a75e37668a61 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.888558 Aug 29 15:54:51.453772 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2006/4037] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:50 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:51.459246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:51.460833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:51.470918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.471803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.472508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.473509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:51.474202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:51.474878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:51.508831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:51.521081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:51.526025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:51.527298 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c1fbc330-051c-410d-8bfd-d579a9ed25ff tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1371 microversion: 2.47 time: 0.130626 Aug 29 15:54:51.528086 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2032/4038] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:51 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1371 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:51.893744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:51.908835 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11173d19-29b6-43c8-980f-74e9da7cd367 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.453608 Aug 29 15:54:51.921933 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2007/4039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:51 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:52.097225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:52.098496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:52.106919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.107443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.107898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.108602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.109060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.109738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.416547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:52.417958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:52.424473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.425651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.426360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.427308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.428780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.429547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.430068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:52.430288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.440532 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f1852fd-7fef-474f-a54d-38c4bd4c830a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.348087 Aug 29 15:54:52.454931 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2033/4040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:52 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:52.479756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:52.480707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:52.489394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.490400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.491593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.492960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.493957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.494635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.694450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.703885 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e072a7eb-2cc7-4668-ad00-fdcc79350392 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1387 microversion: 2.1 time: 0.291847 Aug 29 15:54:52.718957 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2008/4041] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:52 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1387 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:52.724245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:52.725378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:52.732685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.733471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.734170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.735408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.735884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.736320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.786101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.795819 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f609deca-3a41-42bf-a799-f882a1774bb8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.321796 Aug 29 15:54:52.796423 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2034/4042] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:52 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:52.801495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-81dc8481-5fc0-4c19-91b7-eb9a973cbb58 req-f4e218bc-4bb4-456e-9db6-38b48e74a23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0812f482-9b0c-4a55-aea5-117173f6c371", "tag": "2a069e61-8c45-45be-90e1-b2e6186755b1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:52.815525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-81dc8481-5fc0-4c19-91b7-eb9a973cbb58 req-f4e218bc-4bb4-456e-9db6-38b48e74a23c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.816844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-81dc8481-5fc0-4c19-91b7-eb9a973cbb58 req-f4e218bc-4bb4-456e-9db6-38b48e74a23c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.817684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-81dc8481-5fc0-4c19-91b7-eb9a973cbb58 req-f4e218bc-4bb4-456e-9db6-38b48e74a23c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.832591 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-81dc8481-5fc0-4c19-91b7-eb9a973cbb58 req-f4e218bc-4bb4-456e-9db6-38b48e74a23c service nova] Creating event network-changed:2a069e61-8c45-45be-90e1-b2e6186755b1 for instance 0812f482-9b0c-4a55-aea5-117173f6c371 on n-h1-836830-13 Aug 29 15:54:52.838774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-81dc8481-5fc0-4c19-91b7-eb9a973cbb58 req-f4e218bc-4bb4-456e-9db6-38b48e74a23c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040853 Aug 29 15:54:52.839652 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2035/4043] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:52.858812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.880013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.886486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:52.889104 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9fac59fa-9975-44f3-b8ee-f0bbf396ca9e tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1371 microversion: 2.47 time: 0.168452 Aug 29 15:54:52.890486 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2009/4044] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:52 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:52.948899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:52.950146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:52.957232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.957731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.958168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:52.959056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:52.960466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:52.960881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.461410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:53.462037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:53.468171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.468541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.468972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.469665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.470113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.470532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.554318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.562947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-81b8d6c2-9f8c-4254-a34a-43b6d45bf7be tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.620481 Aug 29 15:54:53.578930 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2036/4045] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:52 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:53.638185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:53.646437 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d68108ab-2ed2-459c-a701-d6b3ceb3b256 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.188872 Aug 29 15:54:53.647660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2010/4046] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:53 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:53.726550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:53.727749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:53.735349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.735961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.736501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.737509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.739319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.739319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.825100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:53.825717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:53.832235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.832732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.833170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:53.833875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:53.834331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:53.835260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.038934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:54.048244 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-43264d34-6d07-4203-9726-38460c2f2202 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1387 microversion: 2.1 time: 0.325714 Aug 29 15:54:54.049607 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2037/4047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:53 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1387 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:54.054958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:54.056463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:54.063210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.063933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.064371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.065078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.065536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.065967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.153918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:54.185076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:54.186526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:54.187741 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-126319b8-813e-45fe-bd75-bd45f4a71de3 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1371 microversion: 2.47 time: 0.136881 Aug 29 15:54:54.188306 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2038/4048] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:54 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:54.348077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:54.357511 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81c5f283-9459-4bc2-978e-dd0a94ba5346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.536308 Aug 29 15:54:54.358427 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2011/4049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:53 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:54.586401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:54.587298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:54.594533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.595491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.596416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.597184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.597655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.598080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.669764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:54.670404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:54.679267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.679961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.680752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.681282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:54.681738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:54.682342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:54.813089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:54.827938 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ca8fe07-7ee0-41bc-9c58-5c0f4d6caa46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.246784 Aug 29 15:54:54.830475 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2039/4050] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:54 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:55.070799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:55.071640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:55.078886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.080529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.081223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.082062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.082628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.083313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.175074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.189338 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ddb1d818-8233-448b-8e2b-a1cb51777efc tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.523856 Aug 29 15:54:55.190368 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2012/4051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:54 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:55.211874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:55.212668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:55.223937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.225146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.225824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.226737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.227396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.228138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.260674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.269637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a760e65c-2428-4e08-acd8-2ecf98c7f264 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1387 microversion: 2.1 time: 0.203412 Aug 29 15:54:55.276296 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2040/4052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:55 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1387 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:55.381298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:55.383155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:55.389641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.390244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.390751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.391539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.392072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.392717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.420490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.433629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.436129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.437580 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1053f3b-567a-45e5-ad73-1a9ae72b1178 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1371 microversion: 2.47 time: 0.229936 Aug 29 15:54:55.438469 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2013/4053] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:55 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:55.628477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:55.638517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-455d481b-7ece-4859-a411-b9227393e644 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.262300 Aug 29 15:54:55.639375 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2041/4054] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:55 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:55.855912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:55.857097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:55.866179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.866873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.867332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.868031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.868641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.869228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.890814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-74f9834e-0d03-4bee-9a3b-3fb5dee94f06 req-a60b70d3-de1d-4601-b555-bc9ec56389b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80660c8c-9614-43a9-8efb-0a24ab2c815e", "name": "network-vif-deleted", "tag": "877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:55.913525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-74f9834e-0d03-4bee-9a3b-3fb5dee94f06 req-a60b70d3-de1d-4601-b555-bc9ec56389b1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:55.916245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-74f9834e-0d03-4bee-9a3b-3fb5dee94f06 req-a60b70d3-de1d-4601-b555-bc9ec56389b1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:55.917054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-74f9834e-0d03-4bee-9a3b-3fb5dee94f06 req-a60b70d3-de1d-4601-b555-bc9ec56389b1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:55.935527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-74f9834e-0d03-4bee-9a3b-3fb5dee94f06 req-a60b70d3-de1d-4601-b555-bc9ec56389b1 service nova] Creating event network-vif-deleted:877cfd04-b75f-4c02-a0cd-7a0a13ad0dd9 for instance 80660c8c-9614-43a9-8efb-0a24ab2c815e on n-h2-836830-13 Aug 29 15:54:55.941483 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-74f9834e-0d03-4bee-9a3b-3fb5dee94f06 req-a60b70d3-de1d-4601-b555-bc9ec56389b1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058544 Aug 29 15:54:55.942173 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2042/4055] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:54:56.200269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.211893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:56.213598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:56.221510 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f8865315-b955-425a-a451-ad5097b12ebc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.371238 Aug 29 15:54:56.222912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.223351 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2014/4056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:55 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:56.223544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.223889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.224859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.225703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.226420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.291072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:56.291684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:56.301106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.301612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.302049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.302754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.304292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.305079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.385730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.394838 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e8a5edc-0ff8-4113-b283-db2fe6be67d6 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1345 microversion: 2.1 time: 0.108130 Aug 29 15:54:56.403356 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2015/4057] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:56 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:56.462963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:56.463634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:56.470193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.470929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.471418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.472118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.472577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.473049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.491838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.509671 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-43d7e082-801d-49f3-9e08-e926d5b9c7d5 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.298557 Aug 29 15:54:56.510604 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2043/4058] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:56 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:56.574995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.585519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.587179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.591848 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fcef69b1-7910-40ee-873c-50c59a776e2b tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1371 microversion: 2.47 time: 0.134030 Aug 29 15:54:56.592795 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2016/4059] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:56 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:54:56.663543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:56.665048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:56.673906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.674691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.675359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.676239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:56.677295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:56.677901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:56.891834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:56.902040 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-979b9de7-91a4-42d5-9ae0-43a39e2d6faf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.244116 Aug 29 15:54:56.904009 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2044/4060] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:56 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:57.245888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:57.247052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:57.254553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.255339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.255761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.257417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.258246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.258827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.419552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:57.420841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:57.435844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.440819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.442244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.443282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.444541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.445231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.544402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.556552 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-34f17d0e-f37a-412a-9b9e-bf9e8e7d7dac tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1183 microversion: 2.1 time: 0.141249 Aug 29 15:54:57.557379 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2045/4061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:57 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:57.565898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:57.567440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:57.577312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.578087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.578750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.579496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.580136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.580713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.702012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.713508 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c58dddb3-4c04-47d4-9b7b-952f2082443e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.471424 Aug 29 15:54:57.714328 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2017/4062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:57 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:57.731851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:57.732480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:57.744854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.745363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.748125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.749377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.749863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.750307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.846654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.859675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.875707 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e2f2ae2-b89b-4a87-8086-48baca2368f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.314650 Aug 29 15:54:57.876361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.878084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:57.879233 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2046/4063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:57 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:57.880804 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b347afaf-6e7a-412c-bcee-6465c4571cc2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1371 microversion: 2.47 time: 0.165369 Aug 29 15:54:57.896335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2018/4064] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:57 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:57.930829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:57.931698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:57.942538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.943827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.944913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:57.946248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:57.946898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:57.947672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.200877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:58.212711 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92eed728-5005-42e3-bc31-f5ff0d75a042 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.290346 Aug 29 15:54:58.213970 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2047/4065] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:57 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:58.580183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:58.580979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:58.591452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.592232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.592758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.593573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.594120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.594765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.722916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:58.725909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:54:58.738458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18f3a01e-d64d-4da2-b7dc-cc8f45ecf8ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1183 microversion: 2.1 time: 0.164344 Aug 29 15:54:58.740054 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2019/4066] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:58 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:58.751012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:58.751932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:58.768339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.769239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.770007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.770978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.771626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.772768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.913002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:58.913734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:58.923178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.923686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.924129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:58.924836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:58.926732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:58.927215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.185421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.195297 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-38ab0d93-364e-4ae6-bdc4-994a4ba33b44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.459417 Aug 29 15:54:59.198427 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2048/4067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:58 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:54:59.210996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:59.213725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:59.227799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.232469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.233222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.234204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.235082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.235922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.363414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.386959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.389847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.391727 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5accd7fe-97dd-40f8-80e1-543ea80001ca tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1356 microversion: 2.47 time: 0.190284 Aug 29 15:54:59.392886 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2049/4068] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:54:59 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:54:59.399457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:59.400747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:59.408936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.409795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.410657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.411630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.412333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.414054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.606765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.618688 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4e6e14e-7984-4623-86a9-a82aee310f92 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.717035 Aug 29 15:54:59.621486 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2020/4069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:58 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:59.641480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-99ee113f-faf6-4066-a3c7-0e7661926b47 req-28ca66d1-6dcf-4dd1-95ef-51d6215f1c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0812f482-9b0c-4a55-aea5-117173f6c371", "name": "network-vif-plugged", "status": "completed", "tag": "2a069e61-8c45-45be-90e1-b2e6186755b1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:54:59.670451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.670888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-99ee113f-faf6-4066-a3c7-0e7661926b47 req-28ca66d1-6dcf-4dd1-95ef-51d6215f1c85 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.671550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-99ee113f-faf6-4066-a3c7-0e7661926b47 req-28ca66d1-6dcf-4dd1-95ef-51d6215f1c85 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.671998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-99ee113f-faf6-4066-a3c7-0e7661926b47 req-28ca66d1-6dcf-4dd1-95ef-51d6215f1c85 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.681248 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d8c2ed8-6c1a-4e16-ad64-0d6fc0720bd8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.286573 Aug 29 15:54:59.681839 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2050/4070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:59 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:54:59.690081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:59.696942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:54:59.702226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Searching by: {'deleted': False, 'project_id': '816e80fa0569433fbcaab1bc651d85ab'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:54:59.715613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.716925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.717327 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-99ee113f-faf6-4066-a3c7-0e7661926b47 req-28ca66d1-6dcf-4dd1-95ef-51d6215f1c85 service nova] Creating event network-vif-plugged:2a069e61-8c45-45be-90e1-b2e6186755b1 for instance 0812f482-9b0c-4a55-aea5-117173f6c371 on n-h1-836830-13 Aug 29 15:54:59.719595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.720708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.722258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.723881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.726519 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-99ee113f-faf6-4066-a3c7-0e7661926b47 req-28ca66d1-6dcf-4dd1-95ef-51d6215f1c85 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103398 Aug 29 15:54:59.730923 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2021/4071] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:54:59.760710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:54:59.761694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:54:59.778024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.778748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.779411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:54:59.780574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:54:59.781210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:54:59.781813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.030270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:55:00.032894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.050474 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3818eeda-3103-42a2-a2d6-a876e319c869 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1183 microversion: 2.1 time: 0.290506 Aug 29 15:55:00.051117 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2022/4072] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:54:59 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:00.051704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:00.141692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.150109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.150594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.151255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.179135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.180591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.219480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.220536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.228143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.228972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.229644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.230604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.231322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.232000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.256747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-213c8afe-2b10-4051-a66a-a1af6b0a6e67 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.569593 Aug 29 15:55:00.257946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2051/4073] 10.222.0.83 () {60 vars in 1187 bytes} [Mon Aug 29 15:54:59 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:00.291814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.292327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.298579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.299099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.299694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.300405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.300864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.301295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.339095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:00.469405 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-51502d13-29ea-4257-921b-64f0825da79c tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 204 len: 0 microversion: 2.47 time: 0.182744 Aug 29 15:55:00.471167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.472213 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2052/4074] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:55:00 2022] DELETE /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 29 15:55:00.480833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-60fa9323-8f5f-4400-83c5-dc18cfa0e7ca tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.265453 Aug 29 15:55:00.484098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.485306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.485550 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2023/4075] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:00.492848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.493406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.493905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.494711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.495447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.495941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.606789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.618419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.620165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.621593 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ae9461f-165b-4bf5-bb59-1edfe3602190 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1362 microversion: 2.47 time: 0.143717 Aug 29 15:55:00.635058 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2053/4076] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:00.643320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.643954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.661343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.661894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.662349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.663949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.664690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.665855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.708624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:00.709441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:00.720161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.720652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.721081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.721770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:00.722217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:00.722642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:00.972913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:00.984459 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-45bebdef-dbe3-48e2-b589-f8e2bdb766f7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.345083 Aug 29 15:55:00.985395 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2024/4077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:01.072831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:01.073989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:01.082402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.084280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.084949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.086329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.087013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.087673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.170481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.180393 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a0d09ff-beed-454e-9ab9-144698231414 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1183 microversion: 2.1 time: 0.112084 Aug 29 15:55:01.194662 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2025/4078] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:01 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:01.505913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:01.507905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:01.543163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.543163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.543163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.543163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.543570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.549618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.602455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.621445 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d0427d3e-1e5c-423d-987b-726b5e920040 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.921641 Aug 29 15:55:01.622264 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2054/4079] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:00 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:01.649911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:01.650767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:01.672996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.675678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.676623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.677376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.677839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.680064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.863509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.877861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.880031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:01.884261 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c12227c-2909-4c65-b847-4a4c08ad22f1 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1362 microversion: 2.47 time: 0.240074 Aug 29 15:55:01.904191 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2055/4080] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:01 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:01.914629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2e421ed1-4a71-4fdc-aba9-d8ac91115807 req-a33c7b87-e504-4929-8065-7b4ee6e43e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0812f482-9b0c-4a55-aea5-117173f6c371", "name": "network-vif-plugged", "status": "completed", "tag": "5abf4f9d-98e7-4ec8-89d6-5c7e5534941c"}, {"server_uuid": "672de70b-9063-4656-82fe-5d6d23d3ba61", "name": "network-vif-plugged", "status": "completed", "tag": "3247699f-fcc7-4ebd-85a0-0ea62374e6bd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:01.936174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2e421ed1-4a71-4fdc-aba9-d8ac91115807 req-a33c7b87-e504-4929-8065-7b4ee6e43e43 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:01.936696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2e421ed1-4a71-4fdc-aba9-d8ac91115807 req-a33c7b87-e504-4929-8065-7b4ee6e43e43 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:01.938803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2e421ed1-4a71-4fdc-aba9-d8ac91115807 req-a33c7b87-e504-4929-8065-7b4ee6e43e43 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:01.980170 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2e421ed1-4a71-4fdc-aba9-d8ac91115807 req-a33c7b87-e504-4929-8065-7b4ee6e43e43 service nova] Creating event network-vif-plugged:5abf4f9d-98e7-4ec8-89d6-5c7e5534941c for instance 0812f482-9b0c-4a55-aea5-117173f6c371 on n-h1-836830-13 Aug 29 15:55:01.980693 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2e421ed1-4a71-4fdc-aba9-d8ac91115807 req-a33c7b87-e504-4929-8065-7b4ee6e43e43 service nova] Creating event network-vif-plugged:3247699f-fcc7-4ebd-85a0-0ea62374e6bd for instance 672de70b-9063-4656-82fe-5d6d23d3ba61 on n-h2-836830-13 Aug 29 15:55:02.004157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2e421ed1-4a71-4fdc-aba9-d8ac91115807 req-a33c7b87-e504-4929-8065-7b4ee6e43e43 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093294 Aug 29 15:55:02.047387 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2056/4081] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:02.088303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:02.093679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:02.117558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:02.126819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.130312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.130779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.138807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.139379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.139828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.312244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.322032 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b6e2f654-ec03-42c6-8fa4-db53de05e6df tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.820341 Aug 29 15:55:02.322632 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2026/4082] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:01 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:02.334191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:02.337720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:02.344544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.345132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.345800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.346741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.347442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.348074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.472893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.485499 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f30121e-75e6-42b8-99f8-16c02f6f09ec tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1183 microversion: 2.1 time: 0.158656 Aug 29 15:55:02.486824 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2027/4083] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:02 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:02.618108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.627943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-94103186-c6dd-4b56-b171-9507951d5ec2 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.579000 Aug 29 15:55:02.629431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2057/4084] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:02 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:02.644226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:02.644846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:02.652278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.653177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.653177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.653899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.654355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.655093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.916555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:02.917371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:02.918225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:02.933591 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ab79460-87ac-4683-a8d1-9b0d1c7508bd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1722 microversion: 2.1 time: 0.293096 Aug 29 15:55:02.934886 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2028/4085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:02 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:02.946591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.947117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.947564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:02.951602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:02.952120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:02.952556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.078679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.088028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.089666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.090921 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e77e538-6457-4570-bcb7-c0b05add68d9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1362 microversion: 2.47 time: 0.180954 Aug 29 15:55:03.091605 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2058/4086] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:02 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:03.350145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:03.351580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:03.360188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.361641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.362256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.363268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.363916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.364486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.513571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:03.514109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:03.523647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.527237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.531542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.532488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.534225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.534678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.633979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.647899 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54668109-f08e-48cc-80c3-c87f36aab3a9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1183 microversion: 2.1 time: 0.139892 Aug 29 15:55:03.651792 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2059/4087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:03 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:03.661499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:03.662324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:03.681463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.682147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.682717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.683640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.684236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.684792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.734427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.753288 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc04837b-9ca5-44c6-916f-a9ca288c86ec tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.408573 Aug 29 15:55:03.767689 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2029/4088] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:03 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:03.956025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:03.956824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:03.964775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.965605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.969578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.971285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:03.971443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:03.972296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:03.973877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:03.986477 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed284b82-6137-4a84-9f88-5221bae8ef9a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1334 microversion: 2.1 time: 0.333452 Aug 29 15:55:03.987312 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2060/4089] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:03 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:04.113918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:04.114549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:04.122951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.123502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.124199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.124622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.125456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.126051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.174964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.175721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.176331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.177505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lazy-loading 'fault' on Instance uuid 9da71e07-4005-4c3b-ae30-bb6872be5dea {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:04.201315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.215124 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7b528e4c-e421-499f-ade1-e9e83cb66479 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1699 microversion: 2.1 time: 0.263340 Aug 29 15:55:04.215814 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2030/4090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:03 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1699 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:04.237080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3f5a925-7e79-4be9-8752-51e7adabab3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:04.244185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3f5a925-7e79-4be9-8752-51e7adabab3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.245002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3f5a925-7e79-4be9-8752-51e7adabab3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.245893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3f5a925-7e79-4be9-8752-51e7adabab3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.279504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.293720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3f5a925-7e79-4be9-8752-51e7adabab3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Going to try to start instance {{(pid=129132) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:55:04.305812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.307306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.308533 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a739f79-4b7f-4374-8e8f-bf0d3621cbd5 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1367 microversion: 2.47 time: 0.198807 Aug 29 15:55:04.310215 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2061/4091] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:04 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:04.370466 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3f5a925-7e79-4be9-8752-51e7adabab3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action" status: 202 len: 0 microversion: 2.1 time: 0.136597 Aug 29 15:55:04.372230 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2031/4092] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:04 2022] POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:55:04.382018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:04.383703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:04.394631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.395324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.395939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.397456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.398083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.398896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.680506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:04.681744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:04.695784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.697522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.698885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.699934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.700484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.700973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.830958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:04.854913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad666c82-cb29-40c3-ae6d-95a22ea89d39 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1183 microversion: 2.1 time: 0.182128 Aug 29 15:55:04.858073 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2032/4093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:04 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:04.864432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:04.865361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:04.888216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.888938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.891242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.892919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:04.895194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:04.896307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:04.994168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.016164 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a1f61b3-348f-42d9-97f7-56c804e06e18 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1708 microversion: 2.1 time: 0.637857 Aug 29 15:55:05.018802 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2062/4094] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:04 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1708 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:05.032838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:05.035441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:05.065286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.070624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.071261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.077335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.078093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.078677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.408199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.421521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-217b4de9-4833-4168-b3c1-fe3d48d90f59 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1668 microversion: 2.1 time: 0.396511 Aug 29 15:55:05.424150 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2063/4095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:05 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:05.430953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:05.431853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:05.461289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.463177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.465363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.467438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.468208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.468743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.500079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.511438 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-020e81fe-c664-4b22-bce3-05c60b469ba8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1316 microversion: 2.1 time: 0.652128 Aug 29 15:55:05.529397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.530462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.531100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.531726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lazy-loading 'fault' on Instance uuid 9da71e07-4005-4c3b-ae30-bb6872be5dea {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:05.543389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2033/4096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:04 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:05.549728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:05.550514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:05.558068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.558863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.559509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.561062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.561803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.562739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.601264 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95d91c14-8331-4600-9c2d-03acabb0708e tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371/ips" status: 200 len: 178 microversion: 2.1 time: 0.055918 Aug 29 15:55:05.602025 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2034/4097] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:55:05 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371/ips => generated 178 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:05.616135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:05.616621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:05.623569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.624076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.624517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.625240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.625701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.626122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.654546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:05.666676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.684640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:05.691323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.693268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:05.695911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da09474a-22d9-47bd-b259-afeb6c6c59e8 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1367 microversion: 2.47 time: 0.270110 Aug 29 15:55:05.696690 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2064/4098] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:05 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:05.772385 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cd37cd51-ddac-4331-b37d-4104aa3fa8b8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 204 len: 0 microversion: 2.1 time: 0.162334 Aug 29 15:55:05.777548 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2035/4099] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:05 2022] DELETE /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:55:05.785189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:05.785811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:05.793567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.794137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.794662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.795577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.796142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.796652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.880457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:05.881429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:05.889592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.890179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.890721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.892292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.892531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.893069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.941832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:05.942509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:05.943510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:05.945590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lazy-loading 'fault' on Instance uuid 80660c8c-9614-43a9-8efb-0a24ab2c815e {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:06.003587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.017011 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b81686f4-c354-42ee-8de8-9899186a87ee tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 200 len: 1188 microversion: 2.1 time: 0.141815 Aug 29 15:55:06.018263 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2036/4100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:05 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 1188 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:06.053653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:06.060025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:06.071298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.072183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.072765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.085804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.088961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.089575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.237181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.247448 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52a7cacc-826e-4f4e-b973-dd5f863e14b3 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1674 microversion: 2.1 time: 0.468623 Aug 29 15:55:06.248267 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2065/4101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:05 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1674 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:06.264358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.273778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-177811cb-d1da-45e0-b11a-f2adf4476f14 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1708 microversion: 2.1 time: 0.232180 Aug 29 15:55:06.274558 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2037/4102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:06 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1708 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:06.538959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:06.549579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:06.567491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.571463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.572274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.573427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.574053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.576189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.588713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:06.724709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:06.728110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:06.744301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.745684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.746329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.747913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.749197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.751939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.825956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:06.826538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:06.827182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:06.827714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lazy-loading 'fault' on Instance uuid 9da71e07-4005-4c3b-ae30-bb6872be5dea {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:06.894395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.911226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.914334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.915842 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dab3d1d5-ba58-4a9b-aa4f-48756e3e6c50 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 200 len: 1367 microversion: 2.47 time: 0.195335 Aug 29 15:55:06.916937 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2038/4103] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:06 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:06.990340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:06.999525 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-436f6a78-d48f-497f-8403-8ea31c55c0a3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1505 microversion: 2.1 time: 0.466539 Aug 29 15:55:07.000542 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2066/4104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:06 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1505 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:07.029519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.030566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.045565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.048682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 80660c8c-9614-43a9-8efb-0a24ab2c815e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.060052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.065151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.067252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.068220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.069830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.073466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.074348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.078959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.078959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.079470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.083313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.100665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.154501 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] HTTP exception thrown: Instance 80660c8c-9614-43a9-8efb-0a24ab2c815e could not be found. Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Request method failure captured: Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e HTTP/1.1 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN_I0_RK1-pi9tdACfVo-oBkXB957-LLNTW47N9WU2uGTldg_6aR3_pP3FKTwVFQ6DPvVyLP-K59HCYMxjc4h--KWCBGjJrJlULJA3P2E_VIoYIt5sVcX5Hlv04IjbeStdmmG0X9SqBf7FNxQemyI5-BQSz9uGn12YUM1jpX5YoaO9w Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bb7c04ac8b544f4c89e51cf927bf6e25", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bb7c04ac8b544f4c89e51cf927bf6e25"}]}] Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveMigrationTest-396590690 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 71e0809663664b319388bcc890b6fdec Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 80660c8c-9614-43a9-8efb-0a24ab2c815e could not be found. Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '80660c8c-9614-43a9-8efb-0a24ab2c815e'} Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80660c8c-9614-43a9-8efb-0a24ab2c815e could not be found. Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80660c8c-9614-43a9-8efb-0a24ab2c815e could not be found. Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:07.156797 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80660c8c-9614-43a9-8efb-0a24ab2c815e could not be found. Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Returning 404 to user: Instance 80660c8c-9614-43a9-8efb-0a24ab2c815e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:07.160301 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed294357-aca7-46a5-b52e-0f4eb88f2d70 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e" status: 404 len: 111 microversion: 2.1 time: 0.123322 Aug 29 15:55:07.166715 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2067/4105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/80660c8c-9614-43a9-8efb-0a24ab2c815e => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:07.168703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:07.272644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.273667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.300591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.303690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.306494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.309827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.310464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.312585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.381138 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-60787e72-2985-4a55-96f1-eeca2a23544b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "DELETE /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 204 len: 0 microversion: 2.1 time: 0.360000 Aug 29 15:55:07.387436 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2039/4106] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:07 2022] DELETE /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:55:07.404189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.405304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.425165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.425945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.427332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.429360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.430886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.431708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.668050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:07.682305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2269af6f-4582-44cd-bece-640e6ec49ff8 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1674 microversion: 2.1 time: 0.413770 Aug 29 15:55:07.686399 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2068/4107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1674 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:07.703072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.704029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.715412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.716117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.718566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.722269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.722914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.723546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.729329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:07.738704 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a3c9d28-b30a-4ce8-9bba-3ae287611643 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1712 microversion: 2.1 time: 0.346474 Aug 29 15:55:07.743095 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2040/4108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1712 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:07.942585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:07.943253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 9da71e07-4005-4c3b-ae30-bb6872be5dea] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:07.960077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.960613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.961059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.961946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:07.962507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:07.962937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:07.986004 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] HTTP exception thrown: Instance 9da71e07-4005-4c3b-ae30-bb6872be5dea could not be found. Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Request method failure captured: Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea HTTP/1.1 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEYulgSRc_0FWWUERDUvA3S74ZDqJUE9uCGptbz14i_0gIU4KI45UM-fJ9PGT2V2JUcsfkFCM6WKXVOGRR39d-F6fRYtS9Q0a2rRucLYBlNQMjQDpDmT9OMj6mtYAaZ0I4AsJMxD8VV7D3phMzbNofcaphCOZkP9T45nuTJ-OPd_Ik Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 816e80fa0569433fbcaab1bc651d85ab Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerShowV247Test-2068160586 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/816e80fa0569433fbcaab1bc651d85ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_816e80fa0569433fbcaab1bc651d85ab", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/816e80fa0569433fbcaab1bc651d85ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/816e80fa0569433fbcaab1bc651d85ab"}]}] Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerShowV247Test-2068160586 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 816e80fa0569433fbcaab1bc651d85ab Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerShowV247Test-2068160586 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerShowV247Test-2068160586-project Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ecab6c31850d45dca4708740f8640024 Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerShowV247Test-2068160586-project Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 9da71e07-4005-4c3b-ae30-bb6872be5dea could not be found. Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9da71e07-4005-4c3b-ae30-bb6872be5dea'} Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da71e07-4005-4c3b-ae30-bb6872be5dea could not be found. Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da71e07-4005-4c3b-ae30-bb6872be5dea could not be found. Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:07.987980 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.992213 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:07.992213 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:07.992213 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:07.992213 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:07.992213 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:07.992213 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da71e07-4005-4c3b-ae30-bb6872be5dea could not be found. Aug 29 15:55:07.992213 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:07.993606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Returning 404 to user: Instance 9da71e07-4005-4c3b-ae30-bb6872be5dea could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:07.994627 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44bea894-3f58-4509-b6ac-8a71efa54708 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea" status: 404 len: 111 microversion: 2.47 time: 0.057067 Aug 29 15:55:07.995702 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2041/4109] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/9da71e07-4005-4c3b-ae30-bb6872be5dea => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:55:08.004087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:08.004850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:08.015489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.016288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.016979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.017945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.018539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.019259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.059064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:08.174661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:08.218175 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32f0b2c9-b1b1-4e7d-a9fd-4b5a3101b63a tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "DELETE /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb" status: 204 len: 0 microversion: 2.47 time: 0.218005 Aug 29 15:55:08.219420 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2042/4110] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 15:55:07 2022] DELETE /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 15:55:08.232803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:08.235087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:08.246063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.246707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.247394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.248552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.250023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.250597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.393089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.411451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.427254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.437867 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-784e55ff-f8c9-412b-b72a-2575b1424020 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb" status: 200 len: 1362 microversion: 2.47 time: 0.203439 Aug 29 15:55:08.438575 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2043/4111] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:08 2022] GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:55:08.452274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:08.465416 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a5fea15-0209-4f85-bb78-4ee3da7c5547 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1511 microversion: 2.1 time: 0.776818 Aug 29 15:55:08.481243 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2069/4112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:07 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1511 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:08.675220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a8f429b8-2b96-4a42-aa66-9424dcaff57a req-f881805b-44d5-48d7-b1bb-2830b2ac2759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0812f482-9b0c-4a55-aea5-117173f6c371", "name": "network-vif-deleted", "tag": "2a069e61-8c45-45be-90e1-b2e6186755b1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:08.713702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:08.714575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:08.718409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a8f429b8-2b96-4a42-aa66-9424dcaff57a req-f881805b-44d5-48d7-b1bb-2830b2ac2759 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.725307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a8f429b8-2b96-4a42-aa66-9424dcaff57a req-f881805b-44d5-48d7-b1bb-2830b2ac2759 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.727053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a8f429b8-2b96-4a42-aa66-9424dcaff57a req-f881805b-44d5-48d7-b1bb-2830b2ac2759 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.736765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.737500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.738095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.739457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:08.741463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:08.744293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:08.779300 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a8f429b8-2b96-4a42-aa66-9424dcaff57a req-f881805b-44d5-48d7-b1bb-2830b2ac2759 service nova] Creating event network-vif-deleted:2a069e61-8c45-45be-90e1-b2e6186755b1 for instance 0812f482-9b0c-4a55-aea5-117173f6c371 on n-h1-836830-13 Aug 29 15:55:08.795680 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a8f429b8-2b96-4a42-aa66-9424dcaff57a req-f881805b-44d5-48d7-b1bb-2830b2ac2759 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125621 Aug 29 15:55:08.799362 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2044/4113] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:09.039154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.048077 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79b25a27-1e24-4105-9a9f-7dcd66c48c3a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1653 microversion: 2.1 time: 0.339324 Aug 29 15:55:09.064002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2070/4114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:08 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1653 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:09.465700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:09.467052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:09.481110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.486294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:09.487413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:09.493326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.493452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.498374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.499051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.499725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.501084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.503232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.505491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.508521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:09.509103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:09.512341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:09.660664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.681363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.683671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.691801 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e53f8a7-13dd-47be-ae4e-89fe24e5f76d tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb" status: 200 len: 1362 microversion: 2.47 time: 0.231283 Aug 29 15:55:09.692418 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2045/4115] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:09 2022] GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:09.742392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:09.750640 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9dd9de5c-073a-4bbb-91fb-b04a1053cb12 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1511 microversion: 2.1 time: 0.268460 Aug 29 15:55:09.751988 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2071/4116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:09 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:10.073402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:10.075282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:10.095193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.095753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.096246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.097016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.097472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.097896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.214599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dda72ff55b246cea4bf5bc5e1e87c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3085a72d4a644a2bfcc0109f0743127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:10.228821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e3ad36e-789f-4a93-bd62-9b609819bd2a tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 200 len: 1298 microversion: 2.1 time: 0.160748 Aug 29 15:55:10.232611 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2046/4117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:10 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:10.720285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:10.721856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:10.727476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:10.729386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:10.731832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.732562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.733658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.735011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.735700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.736327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.779995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:10.781254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:10.789488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.790318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.790967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.792020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.792895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.793852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:10.911549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:10.915507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:10.930807 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94a36c84-e673-4087-a965-e3c3fdcde732 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1469 microversion: 2.1 time: 0.152838 Aug 29 15:55:10.932035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:10.934642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:10.938513 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c8873da-c0bd-4a46-931b-6a63cac29fe7 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb" status: 200 len: 1362 microversion: 2.47 time: 0.222268 Aug 29 15:55:10.940360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2072/4118] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:10 2022] GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:10.947724 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2047/4119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:10 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:10.964252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-331c3091-deac-4975-9f66-c2c19f33a335 req-fe697a89-6e94-4d51-b17a-d2134c7d99e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0812f482-9b0c-4a55-aea5-117173f6c371", "name": "network-vif-deleted", "tag": "5abf4f9d-98e7-4ec8-89d6-5c7e5534941c"}, {"server_uuid": "672de70b-9063-4656-82fe-5d6d23d3ba61", "name": "network-vif-deleted", "tag": "3247699f-fcc7-4ebd-85a0-0ea62374e6bd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:10.993309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-331c3091-deac-4975-9f66-c2c19f33a335 req-fe697a89-6e94-4d51-b17a-d2134c7d99e4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:10.996075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-331c3091-deac-4975-9f66-c2c19f33a335 req-fe697a89-6e94-4d51-b17a-d2134c7d99e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:10.996658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-331c3091-deac-4975-9f66-c2c19f33a335 req-fe697a89-6e94-4d51-b17a-d2134c7d99e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.014934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-331c3091-deac-4975-9f66-c2c19f33a335 req-fe697a89-6e94-4d51-b17a-d2134c7d99e4 service nova] Creating event network-vif-deleted:5abf4f9d-98e7-4ec8-89d6-5c7e5534941c for instance 0812f482-9b0c-4a55-aea5-117173f6c371 on n-h1-836830-13 Aug 29 15:55:11.015772 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-331c3091-deac-4975-9f66-c2c19f33a335 req-fe697a89-6e94-4d51-b17a-d2134c7d99e4 service nova] Creating event network-vif-deleted:3247699f-fcc7-4ebd-85a0-0ea62374e6bd for instance 672de70b-9063-4656-82fe-5d6d23d3ba61 on n-h2-836830-13 Aug 29 15:55:11.025268 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-331c3091-deac-4975-9f66-c2c19f33a335 req-fe697a89-6e94-4d51-b17a-d2134c7d99e4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083475 Aug 29 15:55:11.026416 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2073/4120] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:11.266607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:11.268820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:11.280422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:11.281101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:11.281687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.282941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:11.283071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:11.283615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.307731 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] HTTP exception thrown: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Request method failure captured: Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 HTTP/1.1 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODbOv8E_nB8y0n2PHv5FufmqI6d0EmXgE5Al09Tb5C5pwBiY-gYajRiFY_dcrnyJf9xwgQEEcT4AX5wyZE1ppIOEeuDc47p8c_m90y30b6Ou4lckiAGNb6pMTUa7o4z65vxtddZ1mHcnLMt4ej1M43fYTCyi0C8D7PWG5ovb7h3nU8 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d3085a72d4a644a2bfcc0109f0743127", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d3085a72d4a644a2bfcc0109f0743127"}]}] Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9dda72ff55b246cea4bf5bc5e1e87c5f Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '0812f482-9b0c-4a55-aea5-117173f6c371'} Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:11.309805 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:11.313744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Returning 404 to user: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:11.314231 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d9bff2d-567e-4546-af68-55ca18829e90 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 404 len: 111 microversion: 2.1 time: 0.058831 Aug 29 15:55:11.316059 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2048/4121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:11 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:11.728383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:11.729640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:11.737076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:11.737846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:11.738459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.747936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:11.748730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:11.749358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:11.811832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:11.959746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:11.960417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:11.990100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.005737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.032474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.033280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.033766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.034202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.057896 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e5169372-c531-4414-907b-bf6dbcefae61 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "DELETE /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 204 len: 0 microversion: 2.1 time: 0.331900 Aug 29 15:55:12.062286 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2074/4122] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:11 2022] DELETE /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:55:12.071905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:12.073291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:12.082197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.082949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.083586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.085412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.086893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.087979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.101566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:12.144520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.145183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.145701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.146306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lazy-loading 'fault' on Instance uuid 880551e3-7bd5-4339-9e8d-af927d6778bb {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:12.171877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.172898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.173884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.174593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lazy-loading 'fault' on Instance uuid 672de70b-9063-4656-82fe-5d6d23d3ba61 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:12.230458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.244808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15319219-d465-423b-9d9c-bf4bc214fc46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 200 len: 1306 microversion: 2.1 time: 0.292889 Aug 29 15:55:12.245768 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2049/4123] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:11 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 1306 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:12.253671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:12.254699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:12.266913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.267814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.268719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.271388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:12.272503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:12.273610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:12.534330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.545879 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-20986ebe-2104-445c-9ec4-501969b96fff tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1667 microversion: 2.1 time: 0.298544 Aug 29 15:55:12.547164 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2050/4124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:12 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1667 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:12.645741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.659533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.661431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecab6c31850d45dca4708740f8640024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '816e80fa0569433fbcaab1bc651d85ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:12.666062 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d62179f2-f83e-4f41-a5e5-245823371ef9 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb" status: 200 len: 1367 microversion: 2.47 time: 0.601787 Aug 29 15:55:12.667221 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2075/4125] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:12 2022] GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb => generated 1367 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:55:13.271272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:13.273253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:13.284384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.284885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.285322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.286031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.286715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.287988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.306421 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 HTTP/1.1 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '672de70b-9063-4656-82fe-5d6d23d3ba61'} Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:13.308428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eeefc4c9-4daa-49b6-968f-ce7634e86b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 404 len: 111 microversion: 2.1 time: 0.044061 Aug 29 15:55:13.312300 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2051/4126] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:13.320304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:13.321608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:13.329260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.330085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.330944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.331679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.332137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.332771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.568542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:13.569438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:13.576922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.577806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.578468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.579425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.580225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.581277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.665852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:13.676873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b158cc82-7111-4f19-85c2-15424ccafea5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.361040 Aug 29 15:55:13.678277 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2076/4127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:13.697603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:13.699309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] [instance: 880551e3-7bd5-4339-9e8d-af927d6778bb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:13.721723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.722504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.723487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.726654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:13.732939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:13.733635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:13.786354 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] HTTP exception thrown: Instance 880551e3-7bd5-4339-9e8d-af927d6778bb could not be found. Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Request method failure captured: Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb HTTP/1.1 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEYulgSRc_0FWWUERDUvA3S74ZDqJUE9uCGptbz14i_0gIU4KI45UM-fJ9PGT2V2JUcsfkFCM6WKXVOGRR39d-F6fRYtS9Q0a2rRucLYBlNQMjQDpDmT9OMj6mtYAaZ0I4AsJMxD8VV7D3phMzbNofcaphCOZkP9T45nuTJ-OPd_Ik Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.47 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 816e80fa0569433fbcaab1bc651d85ab Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerShowV247Test-2068160586 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/816e80fa0569433fbcaab1bc651d85ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_816e80fa0569433fbcaab1bc651d85ab", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/816e80fa0569433fbcaab1bc651d85ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/816e80fa0569433fbcaab1bc651d85ab"}]}] Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerShowV247Test-2068160586 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 816e80fa0569433fbcaab1bc651d85ab Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerShowV247Test-2068160586 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerShowV247Test-2068160586-project Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ecab6c31850d45dca4708740f8640024 Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerShowV247Test-2068160586-project Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 880551e3-7bd5-4339-9e8d-af927d6778bb could not be found. Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '880551e3-7bd5-4339-9e8d-af927d6778bb'} Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880551e3-7bd5-4339-9e8d-af927d6778bb could not be found. Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880551e3-7bd5-4339-9e8d-af927d6778bb could not be found. Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:13.793243 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880551e3-7bd5-4339-9e8d-af927d6778bb could not be found. Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.796661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] Returning 404 to user: Instance 880551e3-7bd5-4339-9e8d-af927d6778bb could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:13.798792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af5665e7-a701-4b82-91b7-bbd670c965c2 tempest-ServerShowV247Test-2068160586 tempest-ServerShowV247Test-2068160586-project] 10.222.0.83 "GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb" status: 404 len: 111 microversion: 2.47 time: 0.102139 Aug 29 15:55:13.799832 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2077/4128] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/880551e3-7bd5-4339-9e8d-af927d6778bb => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:55:13.952557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76419100-406d-404c-9db0-be9228271d0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76419100-406d-404c-9db0-be9228271d0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 163 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": 12345, "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 12345 Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:55:13.963174 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 29 15:55:13.966284 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:13.971243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76419100-406d-404c-9db0-be9228271d0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:13.974200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76419100-406d-404c-9db0-be9228271d0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.033276 Aug 29 15:55:13.977445 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2078/4129] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:13 2022] POST /compute/v2.1/servers => generated 127 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:13.990201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:13.992611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:14.004691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:14.005268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:14.006691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.007834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:14.008375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:14.009518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.016611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.039047 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5daf5d1-6aec-4bab-94fb-3a60152ab7ba tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1667 microversion: 2.1 time: 0.474733 Aug 29 15:55:14.040287 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2052/4130] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1667 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:14.274599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.286916 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ab10c3a-ad03-4d78-a63a-842714bf0ffe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.304475 Aug 29 15:55:14.304242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2079/4131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:13 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:14.323412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:14.324036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:14.341716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:14.341716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:14.344469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.345417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:14.346308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:14.347916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:14.907873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:14.929670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e587045-5c24-4765-bf25-d8011bea11fb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.615470 Aug 29 15:55:14.944754 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2053/4132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:14 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:15.067127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:15.069729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:15.092283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.097890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.100425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.104648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.108384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.110239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.330234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:15.343946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b47b3a0-86d3-4ebe-b9e0-5ec7bdde9dc9 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1599 microversion: 2.1 time: 0.281788 Aug 29 15:55:15.346543 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2080/4133] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:15 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1599 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:15.626590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bf7fdcb8-a10b-4d3b-9b8d-7ed2fef53775 req-b4a096fe-21f6-417c-8d36-cf087ea85466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b35c5d-d1f2-4b6a-9a6d-1b7db062a933", "name": "network-vif-deleted", "tag": "512e1130-3666-4949-b9f1-618b6b254336"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:15.689963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf7fdcb8-a10b-4d3b-9b8d-7ed2fef53775 req-b4a096fe-21f6-417c-8d36-cf087ea85466 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:15.690592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf7fdcb8-a10b-4d3b-9b8d-7ed2fef53775 req-b4a096fe-21f6-417c-8d36-cf087ea85466 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:15.691059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bf7fdcb8-a10b-4d3b-9b8d-7ed2fef53775 req-b4a096fe-21f6-417c-8d36-cf087ea85466 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:15.770274 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bf7fdcb8-a10b-4d3b-9b8d-7ed2fef53775 req-b4a096fe-21f6-417c-8d36-cf087ea85466 service nova] Creating event network-vif-deleted:512e1130-3666-4949-b9f1-618b6b254336 for instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 on n-h2-836830-13 Aug 29 15:55:15.793609 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bf7fdcb8-a10b-4d3b-9b8d-7ed2fef53775 req-b4a096fe-21f6-417c-8d36-cf087ea85466 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170083 Aug 29 15:55:15.796858 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2054/4134] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:16.372790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.374364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.396249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.401155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.401937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.403145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.406454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.407296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.483055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.483636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.492180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.492760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.493300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.493910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lazy-loading 'fault' on Instance uuid 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:16.505587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.506209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.512004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.518470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.519560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.521496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.570448 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] HTTP exception thrown: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Request method failure captured: Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 HTTP/1.1 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODbOv8E_nB8y0n2PHv5FufmqI6d0EmXgE5Al09Tb5C5pwBiY-gYajRiFY_dcrnyJf9xwgQEEcT4AX5wyZE1ppIOEeuDc47p8c_m90y30b6Ou4lckiAGNb6pMTUa7o4z65vxtddZ1mHcnLMt4ej1M43fYTCyi0C8D7PWG5ovb7h3nU8 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d3085a72d4a644a2bfcc0109f0743127", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d3085a72d4a644a2bfcc0109f0743127"}]}] Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9dda72ff55b246cea4bf5bc5e1e87c5f Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '0812f482-9b0c-4a55-aea5-117173f6c371'} Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:16.576462 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.579618 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.580999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Returning 404 to user: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:16.583133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6426274-9f88-4111-8d3c-56eef52842d7 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 404 len: 111 microversion: 2.1 time: 0.112877 Aug 29 15:55:16.585366 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2055/4135] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:16 2022] DELETE /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:55:16.599741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.601342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: 0812f482-9b0c-4a55-aea5-117173f6c371] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.618491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.619966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.620846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.622658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.623207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.623633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.649894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] HTTP exception thrown: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Request method failure captured: Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 HTTP/1.1 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODbOv8E_nB8y0n2PHv5FufmqI6d0EmXgE5Al09Tb5C5pwBiY-gYajRiFY_dcrnyJf9xwgQEEcT4AX5wyZE1ppIOEeuDc47p8c_m90y30b6Ou4lckiAGNb6pMTUa7o4z65vxtddZ1mHcnLMt4ej1M43fYTCyi0C8D7PWG5ovb7h3nU8 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d3085a72d4a644a2bfcc0109f0743127", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d3085a72d4a644a2bfcc0109f0743127"}]}] Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9dda72ff55b246cea4bf5bc5e1e87c5f Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '0812f482-9b0c-4a55-aea5-117173f6c371'} Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.656126 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.659225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Returning 404 to user: Instance 0812f482-9b0c-4a55-aea5-117173f6c371 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:16.662121 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fa6c0d3-47be-4016-b123-a9431fb82f19 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371" status: 404 len: 111 microversion: 2.1 time: 0.071270 Aug 29 15:55:16.663525 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2056/4136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:16 2022] GET /compute/v2.1/servers/0812f482-9b0c-4a55-aea5-117173f6c371 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:16.672564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.673388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.687906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.688697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.689462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.690409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.691067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.691775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.731813 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] HTTP exception thrown: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Request method failure captured: Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c HTTP/1.1 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODbOv8E_nB8y0n2PHv5FufmqI6d0EmXgE5Al09Tb5C5pwBiY-gYajRiFY_dcrnyJf9xwgQEEcT4AX5wyZE1ppIOEeuDc47p8c_m90y30b6Ou4lckiAGNb6pMTUa7o4z65vxtddZ1mHcnLMt4ej1M43fYTCyi0C8D7PWG5ovb7h3nU8 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d3085a72d4a644a2bfcc0109f0743127", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d3085a72d4a644a2bfcc0109f0743127"}]}] Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9dda72ff55b246cea4bf5bc5e1e87c5f Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a25df1df-1a0f-4ccf-99d7-a3fe59533f2c'} Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:16.737122 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.740862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.743884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Returning 404 to user: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:16.745491 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6226f42-e325-4efa-ae5b-cce14204ef3f tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 404 len: 111 microversion: 2.1 time: 0.078140 Aug 29 15:55:16.752207 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2057/4137] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:16 2022] DELETE /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:16.768231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:16.771293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] [instance: a25df1df-1a0f-4ccf-99d7-a3fe59533f2c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:16.788617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.793248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.794882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.796254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:16.801210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:16.801682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:16.880733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] HTTP exception thrown: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Request method failure captured: Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c HTTP/1.1 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODbOv8E_nB8y0n2PHv5FufmqI6d0EmXgE5Al09Tb5C5pwBiY-gYajRiFY_dcrnyJf9xwgQEEcT4AX5wyZE1ppIOEeuDc47p8c_m90y30b6Ou4lckiAGNb6pMTUa7o4z65vxtddZ1mHcnLMt4ej1M43fYTCyi0C8D7PWG5ovb7h3nU8 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d3085a72d4a644a2bfcc0109f0743127", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d3085a72d4a644a2bfcc0109f0743127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d3085a72d4a644a2bfcc0109f0743127"}]}] Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d3085a72d4a644a2bfcc0109f0743127 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestMultiNic-1175821198 Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9dda72ff55b246cea4bf5bc5e1e87c5f Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestMultiNic-1175821198-project Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a25df1df-1a0f-4ccf-99d7-a3fe59533f2c'} Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:16.885961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Returning 404 to user: Instance a25df1df-1a0f-4ccf-99d7-a3fe59533f2c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:16.890283 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c" status: 404 len: 111 microversion: 2.1 time: 0.132779 Aug 29 15:55:16.896494 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2058/4138] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:16 2022] GET /compute/v2.1/servers/a25df1df-1a0f-4ccf-99d7-a3fe59533f2c => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:16.994810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:17.009155 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e1094d0-5ddb-4c12-ba7c-e1ffe7650a17 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 200 len: 1324 microversion: 2.1 time: 0.635789 Aug 29 15:55:17.017461 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2081/4139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:16 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 1324 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:17.603331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:17.604654 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ed91923-a675-4734-8765-dbef3434df97 tempest-ServersTestMultiNic-1175821198 tempest-ServersTestMultiNic-1175821198-project] 10.222.0.83 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001696 Aug 29 15:55:17.605452 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2059/4140] 10.222.0.83 () {56 vars in 886 bytes} [Mon Aug 29 15:55:17 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:55:18.039044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.041832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:18.063290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.063788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.064299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.064918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.065381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.065806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.105365 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] HTTP exception thrown: Instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 could not be found. Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Request method failure captured: Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 HTTP/1.1 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN_I0_RK1-pi9tdACfVo-oBkXB957-LLNTW47N9WU2uGTldg_6aR3_pP3FKTwVFQ6DPvVyLP-K59HCYMxjc4h--KWCBGjJrJlULJA3P2E_VIoYIt5sVcX5Hlv04IjbeStdmmG0X9SqBf7FNxQemyI5-BQSz9uGn12YUM1jpX5YoaO9w Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bb7c04ac8b544f4c89e51cf927bf6e25", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bb7c04ac8b544f4c89e51cf927bf6e25"}]}] Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveMigrationTest-396590690 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 71e0809663664b319388bcc890b6fdec Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 could not be found. Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '95b35c5d-d1f2-4b6a-9a6d-1b7db062a933'} Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 could not be found. Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 could not be found. Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:18.107298 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.110640 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:18.110640 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:18.110640 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:18.110640 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:18.110640 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:18.110640 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 could not be found. Aug 29 15:55:18.110640 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.117557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Returning 404 to user: Instance 95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:18.118601 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c93111e2-27c7-4c98-b901-259e9e7da332 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933" status: 404 len: 111 microversion: 2.1 time: 0.084273 Aug 29 15:55:18.119686 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2082/4141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:18 2022] GET /compute/v2.1/servers/95b35c5d-d1f2-4b6a-9a6d-1b7db062a933 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:18.127773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa1bd6ef-86b9-4afa-a990-9e32b9b6ad98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '.version_select at 0x7f32edbcdee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.172484 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa1bd6ef-86b9-4afa-a990-9e32b9b6ad98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-932442749" status: 202 len: 0 microversion: 2.1 time: 0.048509 Aug 29 15:55:18.173787 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2060/4142] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-932442749 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:55:18.452005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-41e67f1a-e5f8-45c8-becd-60935c9a6d9d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-889282500", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "49816527-5ab6-4096-a094-fa647ee441cf", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:18.598882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-41e67f1a-e5f8-45c8-becd-60935c9a6d9d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Block Device 49816527-5ab6-4096-a094-fa647ee441cf is not bootable. Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-41e67f1a-e5f8-45c8-becd-60935c9a6d9d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 357 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-889282500", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "49816527-5ab6-4096-a094-fa647ee441cf", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: exception: Block Device 49816527-5ab6-4096-a094-fa647ee441cf is not bootable. Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-889282500', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '49816527-5ab6-4096-a094-fa647ee441cf'}], 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 49816527-5ab6-4096-a094-fa647ee441cf is not bootable. Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:18.607111 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 49816527-5ab6-4096-a094-fa647ee441cf is not bootable. Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 49816527-5ab6-4096-a094-fa647ee441cf is not bootable. Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-41e67f1a-e5f8-45c8-becd-60935c9a6d9d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Block Device 49816527-5ab6-4096-a094-fa647ee441cf is not bootable. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:18.610149 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-41e67f1a-e5f8-45c8-becd-60935c9a6d9d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.160894 Aug 29 15:55:18.619450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2083/4143] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:18.620291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:18.621526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:18.638971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.639715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.642050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:18.645637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:18.646512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:18.647884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.165080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:19.177651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e4909033-76ce-4758-a914-147551570d26 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.563223 Aug 29 15:55:19.204527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2061/4144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:18 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:19.218125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:19.219358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:19.227743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.228475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.229089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.230002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:19.230634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:19.231302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:19.769451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:19.778693 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ad723b4-80a6-41d5-b75f-864e722fb6b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.564777 Aug 29 15:55:19.794413 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2084/4145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:19 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:21.292207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:21.293068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:21.314369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.315157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.317653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.320634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.323182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.324191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.401178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:21.538363 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5bd21af0-3e8c-4470-9d7a-ff6103b396e1 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 204 len: 0 microversion: 2.1 time: 0.250113 Aug 29 15:55:21.539530 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2062/4146] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:21 2022] DELETE /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:55:21.548608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:21.549770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:21.558099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.559304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.559884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.560831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.561534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.562137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.574764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f219a36-1aa6-4608-ac9f-543962a7ec0c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1556617160", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "648e7a49-e66c-42cf-859c-64f1df130787", "destination_type": "local"}, {"source_type": "volume", "uuid": "04f7c000-603f-4454-9d8d-a9baf68d653c", "destination_type": "invalid"}], "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f219a36-1aa6-4608-ac9f-543962a7ec0c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 495 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1556617160", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "648e7a49-e66c-42cf-859c-64f1df130787", "destination_type": "local"}, {"source_type": "volume", "uuid": "04f7c000-603f-4454-9d8d-a9baf68d653c", "destination_type": "invalid"}], "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1556617160', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '648e7a49-e66c-42cf-859c-64f1df130787', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '04f7c000-603f-4454-9d8d-a9baf68d653c', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'invalid' Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:21.579483 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f219a36-1aa6-4608-ac9f-543962a7ec0c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:21.582844 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0f219a36-1aa6-4608-ac9f-543962a7ec0c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010816 Aug 29 15:55:21.585660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2063/4147] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:21 2022] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:55:21.591941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:21.592693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:21.600821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.601530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.602115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.602991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.603243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:21.603782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.604442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.838083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:21.864609 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44daffcd-e648-4d8d-9b82-37b92f71ffa7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.274951 Aug 29 15:55:21.868329 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2064/4148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:21 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:21.905392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:21.908493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:21.917773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.919798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.920424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:21.921749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:21.922425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:21.923003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.017260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.026294 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-efb35d60-49ef-4512-b4f0-a0a643e7b5db tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1485 microversion: 2.1 time: 0.482486 Aug 29 15:55:22.032710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2085/4149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:21 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1485 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:22.385724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.410371 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a14caf2b-cc57-44dd-886a-47aa45742b77 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.509342 Aug 29 15:55:22.411532 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2065/4150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:21 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:22.484158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0612ab52-03de-49ec-99a1-4fc0204024e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-206407547", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0612ab52-03de-49ec-99a1-4fc0204024e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 491 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-206407547", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-206407547', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:22.488280 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 29 15:55:22.492102 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:22.494584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0612ab52-03de-49ec-99a1-4fc0204024e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:22.496273 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0612ab52-03de-49ec-99a1-4fc0204024e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016073 Aug 29 15:55:22.497011 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2086/4151] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:22 2022] POST /compute/v2.1/servers => generated 624 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:22.505624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:22.506331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:22.512575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.513084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.513525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.514246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:22.514710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:22.515165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:22.981572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:22.990913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9bcf4ee1-a499-481a-8cb5-398df5be1f5b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.488719 Aug 29 15:55:22.997755 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2066/4152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:22 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:23.019725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:23.020935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:23.029593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.030601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.031238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.032106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.032720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.033322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.054277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:23.055327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:23.065008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.068920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.069646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.070798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.074475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.075231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.554994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:23.564765 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-93a76ca5-9b18-46c4-8073-64e00fddf469 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1485 microversion: 2.1 time: 0.514901 Aug 29 15:55:23.579334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2067/4153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:23 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1485 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:23.804104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2f5c0f82-78ae-445d-a70f-7c8cba00108a req-aad610a1-7203-413f-9498-43c7e0457475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8be59c56-9380-45c5-9fdd-7e361548a44b", "name": "network-vif-deleted", "tag": "1b08f641-6926-4e20-a9d8-b523d8854ed9"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:23.849923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2f5c0f82-78ae-445d-a70f-7c8cba00108a req-aad610a1-7203-413f-9498-43c7e0457475 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:23.852015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2f5c0f82-78ae-445d-a70f-7c8cba00108a req-aad610a1-7203-413f-9498-43c7e0457475 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:23.854461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2f5c0f82-78ae-445d-a70f-7c8cba00108a req-aad610a1-7203-413f-9498-43c7e0457475 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:23.883416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:23.887206 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-044876fb-c5cc-459f-a2bc-63d4fa4bb672 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.872279 Aug 29 15:55:23.889011 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2087/4154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:23 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:23.904238 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2f5c0f82-78ae-445d-a70f-7c8cba00108a req-aad610a1-7203-413f-9498-43c7e0457475 service nova] Creating event network-vif-deleted:1b08f641-6926-4e20-a9d8-b523d8854ed9 for instance 8be59c56-9380-45c5-9fdd-7e361548a44b on n-h1-836830-13 Aug 29 15:55:23.922911 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2f5c0f82-78ae-445d-a70f-7c8cba00108a req-aad610a1-7203-413f-9498-43c7e0457475 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125535 Aug 29 15:55:23.926791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2068/4155] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:23.993382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba923d81-e25c-4ec6-9a51-c9e1ce75cd44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba923d81-e25c-4ec6-9a51-c9e1ce75cd44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 416 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:23.997356 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba923d81-e25c-4ec6-9a51-c9e1ce75cd44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:24.000430 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba923d81-e25c-4ec6-9a51-c9e1ce75cd44 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012290 Aug 29 15:55:24.010861 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2088/4156] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:23 2022] POST /compute/v2.1/servers => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:24.019584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:24.020829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:24.044367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.044875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.045317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.046032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.046485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.046908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.557593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.581323 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b35bab89-15fb-4e12-81fa-3d53b9a7766f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.568497 Aug 29 15:55:24.584862 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2069/4157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:24 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:24.587224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:24.587847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:24.605607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.606266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.606717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.608070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:24.610119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.610951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.611357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:24.613581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.649935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.651368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.653563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.659711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.660126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.660581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.737813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:24.738678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:24.744168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:24.745031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lazy-loading 'fault' on Instance uuid 8be59c56-9380-45c5-9fdd-7e361548a44b {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:24.881642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:24.889487 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f657ee95-d83b-4ffa-a99e-a8d32ccb1f98 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 200 len: 1301 microversion: 2.1 time: 0.307421 Aug 29 15:55:24.890652 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2089/4158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:24 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 1301 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:25.358264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:25.373709 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6a606ab-269d-4cef-a3cb-af98dee67c34 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.773108 Aug 29 15:55:25.374304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2070/4159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:24 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:25.505510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef264af8-90f3-4a5f-997f-62e4d011246c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254859880", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": -1, "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:25.531543 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ef264af8-90f3-4a5f-997f-62e4d011246c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Flavor -1 could not be found. Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef264af8-90f3-4a5f-997f-62e4d011246c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 205 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-254859880", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": -1, "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: exception: Flavor -1 could not be found. Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-254859880', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': -1, 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:25.533800 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 29 15:55:25.538205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.540733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef264af8-90f3-4a5f-997f-62e4d011246c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:25.541795 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef264af8-90f3-4a5f-997f-62e4d011246c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.040509 Aug 29 15:55:25.542909 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2090/4160] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:25 2022] POST /compute/v2.1/servers => generated 73 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:25.552273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:25.554017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:25.564435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.565044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.572166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.573251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.573820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.574337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.911961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:25.913748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 8be59c56-9380-45c5-9fdd-7e361548a44b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:25.939125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.939829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.940504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.942036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:25.943667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:25.945864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:25.981299 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] HTTP exception thrown: Instance 8be59c56-9380-45c5-9fdd-7e361548a44b could not be found. Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Request method failure captured: Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b HTTP/1.1 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDN_I0_RK1-pi9tdACfVo-oBkXB957-LLNTW47N9WU2uGTldg_6aR3_pP3FKTwVFQ6DPvVyLP-K59HCYMxjc4h--KWCBGjJrJlULJA3P2E_VIoYIt5sVcX5Hlv04IjbeStdmmG0X9SqBf7FNxQemyI5-BQSz9uGn12YUM1jpX5YoaO9w Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bb7c04ac8b544f4c89e51cf927bf6e25", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bb7c04ac8b544f4c89e51cf927bf6e25"}]}] Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-LiveMigrationTest-396590690 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 71e0809663664b319388bcc890b6fdec Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 8be59c56-9380-45c5-9fdd-7e361548a44b could not be found. Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '8be59c56-9380-45c5-9fdd-7e361548a44b'} Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be59c56-9380-45c5-9fdd-7e361548a44b could not be found. Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be59c56-9380-45c5-9fdd-7e361548a44b could not be found. Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:25.983053 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.987516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:25.987516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:25.987516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:25.987516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:25.987516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:25.987516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be59c56-9380-45c5-9fdd-7e361548a44b could not be found. Aug 29 15:55:25.987516 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:25.988268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Returning 404 to user: Instance 8be59c56-9380-45c5-9fdd-7e361548a44b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:25.989196 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d44048ce-30ae-496d-b2b0-cdba922ce8b7 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b" status: 404 len: 111 microversion: 2.1 time: 0.082370 Aug 29 15:55:25.995077 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2091/4161] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:25 2022] GET /compute/v2.1/servers/8be59c56-9380-45c5-9fdd-7e361548a44b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:55:26.008167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:26.008691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:26.023636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.024129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.025794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.031011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.032007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.032664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.104471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:26.290239 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd41522a-c231-4f3c-9491-df0a561f56e4 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "DELETE /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 204 len: 0 microversion: 2.1 time: 0.289538 Aug 29 15:55:26.291897 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2092/4162] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:25 2022] DELETE /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:55:26.304432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:26.305151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:26.324060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.324333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.324956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.325797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.326233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.326813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.434375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:26.438137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:26.452118 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf03dffc-9fd8-4688-9ae7-c9586c2bc78e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.902133 Aug 29 15:55:26.468599 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2071/4163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:25 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:26.493602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:26.497591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:26.507909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.517753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.519054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.520533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:26.521138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:26.522256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:26.855152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:26.871921 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9f26413e-e243-4624-afc1-e7ffc1097d6b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.393293 Aug 29 15:55:26.883059 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2072/4164] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:26 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:26.994063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b54c8ba5-3387-434b-a925-5d44a0e0ecfb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-475355618", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b54c8ba5-3387-434b-a925-5d44a0e0ecfb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 172 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-475355618", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-475355618', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi -1 Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:55:27.001642 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:27.005619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b54c8ba5-3387-434b-a925-5d44a0e0ecfb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:27.006862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b54c8ba5-3387-434b-a925-5d44a0e0ecfb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.016299 Aug 29 15:55:27.013453 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2073/4165] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:26 2022] POST /compute/v2.1/servers => generated 145 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:27.024759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:27.025400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:27.043383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.044866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.045320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.046046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.046508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.046938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.451536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.465722 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-84484f8e-4fc1-4811-b656-d6d5b95fcde2 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1499 microversion: 2.1 time: 1.169401 Aug 29 15:55:27.466905 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2093/4166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:26 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1499 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:27.518688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:27.533747 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-159f3b04-44a3-4262-beea-a4b4e28d2442 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.518714 Aug 29 15:55:27.536606 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2074/4167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:27 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:27.561521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:27.562146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:27.580086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.580812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.581396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:27.582342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:27.582946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:27.583539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.206064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bd592beb-6a67-4fd0-b6d4-0869fab4a1a6 req-90da9c2e-6c76-49f8-aaa0-f64c295a78e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e71d3d-5e1a-4a22-8afa-2a402706a1b5", "name": "network-vif-deleted", "tag": "59264794-ffe2-4e30-8861-1ee39b44bd66"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:28.245539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bd592beb-6a67-4fd0-b6d4-0869fab4a1a6 req-90da9c2e-6c76-49f8-aaa0-f64c295a78e7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.246891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bd592beb-6a67-4fd0-b6d4-0869fab4a1a6 req-90da9c2e-6c76-49f8-aaa0-f64c295a78e7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.247914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bd592beb-6a67-4fd0-b6d4-0869fab4a1a6 req-90da9c2e-6c76-49f8-aaa0-f64c295a78e7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.286083 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bd592beb-6a67-4fd0-b6d4-0869fab4a1a6 req-90da9c2e-6c76-49f8-aaa0-f64c295a78e7 service nova] Creating event network-vif-deleted:59264794-ffe2-4e30-8861-1ee39b44bd66 for instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 on n-h2-836830-13 Aug 29 15:55:28.298443 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bd592beb-6a67-4fd0-b6d4-0869fab4a1a6 req-90da9c2e-6c76-49f8-aaa0-f64c295a78e7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096517 Aug 29 15:55:28.304862 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2075/4168] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:28.489998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:28.491453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:28.519642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.520751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.522543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.534947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.543976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.544420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.679870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:28.680370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:28.680812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:28.681273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lazy-loading 'fault' on Instance uuid 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:28.730011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:28.755824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-12cc7ef3-d1f4-436f-893f-6eab1c049808 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 1.197146 Aug 29 15:55:28.760183 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2094/4169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:27 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:28.887221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e0809663664b319388bcc890b6fdec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c04ac8b544f4c89e51cf927bf6e25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:28.908135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-765d8830-9553-4d4f-ad20-d048ccca910f tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 200 len: 1300 microversion: 2.1 time: 0.419447 Aug 29 15:55:28.920454 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2076/4170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:28 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 1300 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:29.003981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03dae247-35a7-454e-b740-121a4502d445 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2066349278", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:29.011793 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-03dae247-35a7-454e-b740-121a4502d445 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03dae247-35a7-454e-b740-121a4502d445 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 216 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2066349278", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2066349278', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:29.017891 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 29 15:55:29.020932 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:29.023894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03dae247-35a7-454e-b740-121a4502d445 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:29.026861 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-03dae247-35a7-454e-b740-121a4502d445 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.028679 Aug 29 15:55:29.029066 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2095/4171] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:28 2022] POST /compute/v2.1/servers => generated 123 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:29.040686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:29.041495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:29.062963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.067619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.072001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.074891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.075419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.075867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.517212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:29.530080 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e5f7cacb-6d92-436b-b962-3a9fb34db01d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.495522 Aug 29 15:55:29.546677 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2077/4172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:29 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:29.552572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:29.554361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:29.573236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.574014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.574589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.575621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.576458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.577085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.934723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:29.935404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] [instance: 69e71d3d-5e1a-4a22-8afa-2a402706a1b5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:29.965695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.969174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.971183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.973609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:29.974388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:29.975710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:29.995403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:29.996591 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] HTTP exception thrown: Instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 could not be found. Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Request method failure captured: Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 HTTP/1.1 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDN_I0_RK1-pi9tdACfVo-oBkXB957-LLNTW47N9WU2uGTldg_6aR3_pP3FKTwVFQ6DPvVyLP-K59HCYMxjc4h--KWCBGjJrJlULJA3P2E_VIoYIt5sVcX5Hlv04IjbeStdmmG0X9SqBf7FNxQemyI5-BQSz9uGn12YUM1jpX5YoaO9w Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bb7c04ac8b544f4c89e51cf927bf6e25", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bb7c04ac8b544f4c89e51cf927bf6e25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bb7c04ac8b544f4c89e51cf927bf6e25"}]}] Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-LiveMigrationTest-396590690 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: bb7c04ac8b544f4c89e51cf927bf6e25 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-LiveMigrationTest-396590690 Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 71e0809663664b319388bcc890b6fdec Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-LiveMigrationTest-396590690-project Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 could not be found. Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '69e71d3d-5e1a-4a22-8afa-2a402706a1b5'} Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 could not be found. Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 could not be found. Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:29.998652 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:30.002300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:30.002300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:30.002300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:30.002300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:30.002300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:30.002300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 could not be found. Aug 29 15:55:30.002300 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:30.003667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] Returning 404 to user: Instance 69e71d3d-5e1a-4a22-8afa-2a402706a1b5 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:30.004671 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8521647-9671-460c-80c9-469466e66474 tempest-LiveMigrationTest-396590690 tempest-LiveMigrationTest-396590690-project] 10.222.0.83 "GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5" status: 404 len: 111 microversion: 2.1 time: 0.076195 Aug 29 15:55:30.005387 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2078/4173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:29 2022] GET /compute/v2.1/servers/69e71d3d-5e1a-4a22-8afa-2a402706a1b5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:30.013101 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5c29805e-5e19-4393-88b2-016a4a729c6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.461485 Aug 29 15:55:30.014331 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2096/4174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:29 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:30.272707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a059dc91-bf01-4e71-b59e-a1cdf065b5fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1337261069", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-key-1913407101", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:30.392640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-a059dc91-bf01-4e71-b59e-a1cdf065b5fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] validate_networks() for [('e896cd33-82d8-4f1e-822e-7e54068fdc15', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:55:31.693268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a059dc91-bf01-4e71-b59e-a1cdf065b5fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Invalid key_name provided. Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a059dc91-bf01-4e71-b59e-a1cdf065b5fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 247 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1337261069", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-key-1913407101", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid key_name provided. Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1337261069', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'key_name': 'tempest-key-1913407101', 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1913407101 not found for user 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:31.696112 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:31.699405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a059dc91-bf01-4e71-b59e-a1cdf065b5fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid key_name provided. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:31.706487 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a059dc91-bf01-4e71-b59e-a1cdf065b5fd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.449246 Aug 29 15:55:31.710990 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2079/4175] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:30 2022] POST /compute/v2.1/servers => generated 70 bytes in 1452 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 29 15:55:31.715958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:31.717116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:31.724433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:31.725151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:31.725801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:31.726727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:31.727443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:31.728073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:32.612535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:32.626026 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-650c78be-652b-44cf-9200-497c65783b71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.909671 Aug 29 15:55:32.640924 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2097/4176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:31 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:32.652042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:32.652666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:32.664258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:32.665139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:32.666454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:32.668150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:32.668838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:32.670069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:32.962449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:32.980356 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-705f64a9-1e69-4979-ba64-b1a2121928f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.332289 Aug 29 15:55:32.981231 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2080/4177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:32 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:33.164829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76fca85a-9b94-4deb-b883-52fa02014883 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1253512752", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:33.271154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24482012-9acf-4d0d-b725-558bddd76a26 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: .version_select at 0x7f32ed2a0d30>, body: {"keypair": {"name": "tempest-keypair-1740707574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZieBQd47Ovom/AJSxPB9pPacJMACSvZ6C3Ta6FCZCwU6kXKJoO/oWiwkrkcmJgg+bp4Hu5mLQdQP0K2V5y1NsfS2tkCurecbWPwXwxWxWiVLRFnzvXoplQNA3AEbTYlQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:33.283745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:33.304879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-24482012-9acf-4d0d-b725-558bddd76a26 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:33.317437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-24482012-9acf-4d0d-b725-558bddd76a26 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:33.334351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.security_group_api [None req-76fca85a-9b94-4deb-b883-52fa02014883 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Neutron security group does_not_exist not found {{(pid=129132) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 29 15:55:33.335250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-76fca85a-9b94-4deb-b883-52fa02014883 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76fca85a-9b94-4deb-b883-52fa02014883 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 258 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1253512752", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1253512752', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 29 15:55:33.345296 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 29 15:55:33.349488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:33.356839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76fca85a-9b94-4deb-b883-52fa02014883 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:33.357818 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76fca85a-9b94-4deb-b883-52fa02014883 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.197707 Aug 29 15:55:33.359171 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2081/4178] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:33 2022] POST /compute/v2.1/servers => generated 106 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:33.366722 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24482012-9acf-4d0d-b725-558bddd76a26 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.384147 Aug 29 15:55:33.373984 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2098/4179] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:55:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:33.378895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:33.379796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:33.391857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.392640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.394084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.395043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.395815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.397760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.619894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:33.630370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4176806f-da86-46dd-9c40-1f3684074187 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.257694 Aug 29 15:55:33.632182 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2082/4180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:33 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:33.654230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:33.655115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:33.666207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.667044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.667678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:33.668544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:33.669582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:33.670147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:34.274668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:34.289996 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8fe3c6c-2121-4839-a490-3ef6f7b6aaf1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.639386 Aug 29 15:55:34.305431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2099/4181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:33 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:34.314217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-957b5c43-d6c7-48f2-beae-a8a0cd974217 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:34.316143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-957b5c43-d6c7-48f2-beae-a8a0cd974217 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 26dfa685-404d-4206-b60e-b79d86beff56] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:34.326050 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-957b5c43-d6c7-48f2-beae-a8a0cd974217 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 26dfa685-404d-4206-b60e-b79d86beff56 could not be found. Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-957b5c43-d6c7-48f2-beae-a8a0cd974217 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/26dfa685-404d-4206-b60e-b79d86beff56 HTTP/1.1 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 26dfa685-404d-4206-b60e-b79d86beff56 could not be found. Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '26dfa685-404d-4206-b60e-b79d86beff56'} Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26dfa685-404d-4206-b60e-b79d86beff56 could not be found. Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26dfa685-404d-4206-b60e-b79d86beff56 could not be found. Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:34.328117 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26dfa685-404d-4206-b60e-b79d86beff56 could not be found. Aug 29 15:55:34.331311 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:34.333003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-957b5c43-d6c7-48f2-beae-a8a0cd974217 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 26dfa685-404d-4206-b60e-b79d86beff56 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:34.334478 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-957b5c43-d6c7-48f2-beae-a8a0cd974217 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "DELETE /compute/v2.1/servers/26dfa685-404d-4206-b60e-b79d86beff56" status: 404 len: 111 microversion: 2.1 time: 0.023806 Aug 29 15:55:34.347465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:34.348333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:34.354159 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2083/4182] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:34 2022] DELETE /compute/v2.1/servers/26dfa685-404d-4206-b60e-b79d86beff56 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:34.356812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:34.357564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:34.358230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:34.359188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:34.360829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:34.362176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:34.768512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:34.778732 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f7fd5957-9352-4fd9-a6aa-6acef5f339db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.437517 Aug 29 15:55:34.779257 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2100/4183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:34 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:34.803005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:34.803745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:34.815579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:34.816087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:34.816533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:34.817253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:34.817713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:34.818141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.377198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:35.386367 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f89c946-63c4-4696-87b2-bc08b685ba70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.587187 Aug 29 15:55:35.389810 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2084/4184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:34 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:35.407397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a38edb5f-70e6-43cb-a03c-9450dd4a3758 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:35.408572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a38edb5f-70e6-43cb-a03c-9450dd4a3758 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Failed to fetch instance by id 9223372036854775808 {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:55:35.409303 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a38edb5f-70e6-43cb-a03c-9450dd4a3758 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a38edb5f-70e6-43cb-a03c-9450dd4a3758 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 9223372036854775808 could not be found. Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '9223372036854775808'} Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:35.410984 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:35.414498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:35.414498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:35.414498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:35.414498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 29 15:55:35.414498 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:35.417110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a38edb5f-70e6-43cb-a03c-9450dd4a3758 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:35.418208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a38edb5f-70e6-43cb-a03c-9450dd4a3758 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015182 Aug 29 15:55:35.418956 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2101/4185] 10.222.0.83 () {58 vars in 1188 bytes} [Mon Aug 29 15:55:35 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:55:35.428405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:35.429039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:35.442914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:35.444320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:35.444874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.445724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:35.448403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:35.448902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:35.957078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:36.004232 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee852cb7-7b4e-4547-a510-6854cd16a63b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.580040 Aug 29 15:55:36.007754 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2085/4186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:35 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:36.029560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:36.031042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:36.043354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.043834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.046946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.047990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.059870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.060649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.488575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:36.507135 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-691b068a-5c0b-415f-9f8d-13886a2057b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.479335 Aug 29 15:55:36.508558 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2102/4187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:36 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:36.534936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e2fab25-0caf-41d8-a7bc-83f94b0b187e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:36.536284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e2fab25-0caf-41d8-a7bc-83f94b0b187e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Failed to fetch instance by id -1 {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 15:55:36.538006 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-8e2fab25-0caf-41d8-a7bc-83f94b0b187e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance -1 could not be found. Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e2fab25-0caf-41d8-a7bc-83f94b0b187e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance -1 could not be found. Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '-1'} Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:36.549080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:36.552471 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:36.552471 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:36.552471 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 29 15:55:36.552471 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:36.557264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e2fab25-0caf-41d8-a7bc-83f94b0b187e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance -1 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:36.566575 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e2fab25-0caf-41d8-a7bc-83f94b0b187e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.034859 Aug 29 15:55:36.571963 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2086/4188] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:55:36 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:55:36.587201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:36.598631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:36.609590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.610816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.611535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:36.613215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:36.615282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:36.616418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:37.165412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1240397390", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d59f56-5b97-48d6-a59a-2e49bdfbf90b"}], "security_groups": [{"name": "tempest-securitygroup--639524925"}], "key_name": "tempest-keypair-1740707574", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:37.176712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:37.190693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:37.210004 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e410e72f-6eed-4b9c-953c-67fb5b5d55d2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.633662 Aug 29 15:55:37.234730 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2103/4189] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:36 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:37.240812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:37.248665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:37.258246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:37.260333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:37.261352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:37.262315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:37.262970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:37.263739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:37.385986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] validate_networks() for [('e9d59f56-5b97-48d6-a59a-2e49bdfbf90b', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:55:37.674768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:37.684259 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d631721-95ec-4b81-9056-5ac531899407 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.448154 Aug 29 15:55:37.685031 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2104/4190] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:37 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:37.711853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c5be6ac-90db-4ce9-972c-6fd5f70b87a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:37.715294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c5be6ac-90db-4ce9-972c-6fd5f70b87a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:37.721423 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-8c5be6ac-90db-4ce9-972c-6fd5f70b87a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5 could not be found. Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c5be6ac-90db-4ce9-972c-6fd5f70b87a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5/action HTTP/1.1 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 19 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: {"forceDelete": {}} Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5 could not be found. Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5', 'body': {'forceDelete': {}}} Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5 could not be found. Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5 could not be found. Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:37.730187 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:37.733467 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:37.733467 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:37.733467 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5 could not be found. Aug 29 15:55:37.733467 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:37.735275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c5be6ac-90db-4ce9-972c-6fd5f70b87a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:37.736371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c5be6ac-90db-4ce9-972c-6fd5f70b87a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5/action" status: 404 len: 111 microversion: 2.1 time: 0.029357 Aug 29 15:55:37.740510 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2105/4191] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:37 2022] POST /compute/v2.1/servers/eaef45ec-22fa-4ce2-9ccb-ba4914aadbb5/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:37.746235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:37.747165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:37.754406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:37.755366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:37.756556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:37.758054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:37.758744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:37.759772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.246534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:38.255816 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b35d31bd-b04c-4ea4-8196-c5a5a04596ef tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.513896 Aug 29 15:55:38.272507 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2106/4192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:37 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:38.309417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:38.311908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:38.328138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.329487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.330629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.332426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.333690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.335423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.388377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:38.634655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:55:38.635256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:55:38.635843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:55:38.636361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:55:38.637241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:55:38.660884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.661384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.661825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.663313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:38.663942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:38.664371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:38.703562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:55:38.716519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:55:38.739335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:55:38.743477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:55:38.833719 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d85c6db7-a04b-4c27-9c8a-d8a70c26b04e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.674370 Aug 29 15:55:38.839275 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2087/4193] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:55:38.851459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57bdbbf1-0300-4f80-b8e6-950cecda339d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:38.852285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57bdbbf1-0300-4f80-b8e6-950cecda339d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:38.968676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57bdbbf1-0300-4f80-b8e6-950cecda339d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:38.980137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57bdbbf1-0300-4f80-b8e6-950cecda339d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1242 microversion: 2.1 time: 0.137047 Aug 29 15:55:38.981455 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2088/4194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:38 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:39.133171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:39.145436 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a0a2318-4bdc-405d-a08c-a483e6811aa8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.847964 Aug 29 15:55:39.146021 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2107/4195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:38 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:39.171906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f0bb7c5-1c52-4323-90e6-aac9b3a5933e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:39.174678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f0bb7c5-1c52-4323-90e6-aac9b3a5933e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 6113c2d7-34d9-48e6-ab6e-ec46bf238667] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:39.195343 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6f0bb7c5-1c52-4323-90e6-aac9b3a5933e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 6113c2d7-34d9-48e6-ab6e-ec46bf238667 could not be found. Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f0bb7c5-1c52-4323-90e6-aac9b3a5933e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/6113c2d7-34d9-48e6-ab6e-ec46bf238667/action HTTP/1.1 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 39 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: {"os-getConsoleOutput": {"length": 10}} Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 6113c2d7-34d9-48e6-ab6e-ec46bf238667 could not be found. Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6113c2d7-34d9-48e6-ab6e-ec46bf238667', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6113c2d7-34d9-48e6-ab6e-ec46bf238667 could not be found. Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6113c2d7-34d9-48e6-ab6e-ec46bf238667 could not be found. Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:39.210872 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6113c2d7-34d9-48e6-ab6e-ec46bf238667 could not be found. Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f0bb7c5-1c52-4323-90e6-aac9b3a5933e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 6113c2d7-34d9-48e6-ab6e-ec46bf238667 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:39.214398 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f0bb7c5-1c52-4323-90e6-aac9b3a5933e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/6113c2d7-34d9-48e6-ab6e-ec46bf238667/action" status: 404 len: 111 microversion: 2.1 time: 0.046207 Aug 29 15:55:39.214913 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2089/4196] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:39 2022] POST /compute/v2.1/servers/6113c2d7-34d9-48e6-ab6e-ec46bf238667/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:55:39.223338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:39.223981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:39.236763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.237260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.237696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.238405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.238854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.239402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.861384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:39.873669 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1aaa60ed-ec82-4088-bafb-823ef5a7985c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.654386 Aug 29 15:55:39.896000 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2108/4197] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:39 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:39.901916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:39.903476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:39.922834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.923693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.924802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:39.927238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:39.929383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:39.930016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.006855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:40.007663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:40.050943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.051462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.051898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.052603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.053240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.053585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.214292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:40.228026 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5817ca5-a10e-4791-b25e-ca1b8a20def0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.327813 Aug 29 15:55:40.229746 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2090/4198] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:39 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:40.245430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:40.246477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:40.270366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.274470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.276864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.277881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.280198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.282059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.481054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lazy-loading 'services' on Instance uuid 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:55:40.586045 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9235c644-5d41-44ed-87ff-ab453301aea7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-volume_attachments/6143a1fd-ae4e-4cbe-bf3e-58c31dcf257b" status: 202 len: 0 microversion: 2.1 time: 0.354827 Aug 29 15:55:40.588199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2091/4199] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 15:55:40 2022] DELETE /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-volume_attachments/6143a1fd-ae4e-4cbe-bf3e-58c31dcf257b => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:55:40.594739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ef4690a-22a1-4adc-a981-01d0b250a2a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:40.596602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ef4690a-22a1-4adc-a981-01d0b250a2a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 39d4b524-1398-414f-ad2f-a88b415a502f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:40.606044 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3ef4690a-22a1-4adc-a981-01d0b250a2a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 39d4b524-1398-414f-ad2f-a88b415a502f could not be found. Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ef4690a-22a1-4adc-a981-01d0b250a2a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/39d4b524-1398-414f-ad2f-a88b415a502f HTTP/1.1 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 39d4b524-1398-414f-ad2f-a88b415a502f could not be found. Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '39d4b524-1398-414f-ad2f-a88b415a502f'} Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d4b524-1398-414f-ad2f-a88b415a502f could not be found. Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d4b524-1398-414f-ad2f-a88b415a502f could not be found. Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:40.609265 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:40.613238 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:40.613238 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:40.613238 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:40.613238 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d4b524-1398-414f-ad2f-a88b415a502f could not be found. Aug 29 15:55:40.613238 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:40.618845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ef4690a-22a1-4adc-a981-01d0b250a2a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 39d4b524-1398-414f-ad2f-a88b415a502f could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:40.620500 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ef4690a-22a1-4adc-a981-01d0b250a2a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/39d4b524-1398-414f-ad2f-a88b415a502f" status: 404 len: 111 microversion: 2.1 time: 0.030761 Aug 29 15:55:40.626128 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2092/4200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:40 2022] GET /compute/v2.1/servers/39d4b524-1398-414f-ad2f-a88b415a502f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:40.670528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:40.682915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:40.734007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.734957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.737545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:40.740031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:40.744991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:40.745516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:41.026929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:41.038484 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-14410897-dfde-4c8b-b15e-e3a365b3b23d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1238 microversion: 2.1 time: 1.038866 Aug 29 15:55:41.052225 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2109/4201] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:39 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1238 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:41.410591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:41.426812 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57f5e4b5-242d-48c4-9e08-dfb478c2321d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.772524 Aug 29 15:55:41.429920 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2093/4202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:40 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:41.453586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:41.455097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:41.463345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:41.464044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:41.465283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:41.466226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:41.466864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:41.467593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.063789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:42.064410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:42.080475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.082346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.083091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.084846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.085511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.086140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.188991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:42.210297 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b7b2701-78e7-4506-bb01-ef3fb3657155 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.759650 Aug 29 15:55:42.215318 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2110/4203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:41 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:42.290681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:42.312698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c16f10d-86ed-4228-ae80-44908865f0b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-161744656", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:42.343650 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd3d9e96-6b20-4904-9848-8359d38ddb3a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1300 microversion: 2.1 time: 0.284302 Aug 29 15:55:42.344247 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2094/4204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:42 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1300 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c16f10d-86ed-4228-ae80-44908865f0b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 237 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-161744656", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-161744656', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.344511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 29 15:55:42.348785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:42.353050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c16f10d-86ed-4228-ae80-44908865f0b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:42.354128 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c16f10d-86ed-4228-ae80-44908865f0b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.046090 Aug 29 15:55:42.362663 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2111/4205] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:55:42.370902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:42.371944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:42.379198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.380038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.380685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.381674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.382352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.383160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.886728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:42.896579 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-86c0d6a8-4914-4206-bf3b-fd9ff9e3e0f3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.532992 Aug 29 15:55:42.922690 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2095/4206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:42 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:42.927737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:42.928561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:42.956884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.957391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.957832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:42.958583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:42.968343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:42.969016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:43.328771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:43.374800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:43.375743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:43.397747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:43.399646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:43.400654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:43.404146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:43.404917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:43.407538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:43.588577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:43.606765 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-044d2cfa-cd0f-45bd-90a0-26fd1102ec14 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.684165 Aug 29 15:55:43.607409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2112/4207] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:42 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:43.793322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:43.806773 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe071c0c-874e-4caf-abd0-ce9134fb2a9e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1367 microversion: 2.1 time: 0.437431 Aug 29 15:55:43.809516 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2096/4208] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:43 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:43.846962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-658031f2-847b-47a8-9a78-5896b3e73291 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-300853981", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-658031f2-847b-47a8-9a78-5896b3e73291 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 234 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-300853981", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-300853981', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.852299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-658031f2-847b-47a8-9a78-5896b3e73291 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:43.859766 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-658031f2-847b-47a8-9a78-5896b3e73291 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011746 Aug 29 15:55:43.863721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:43.865179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:43.868691 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2113/4209] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:55:43 2022] POST /compute/v2.1/servers => generated 133 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:55:43.876140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:43.876565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:43.877001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:43.877709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:43.878159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:43.878577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:43.922091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:44.535959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:44.554504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2ef73ed5-f99b-40cd-9783-f1bc19e3333e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.695412 Aug 29 15:55:44.555346 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2097/4210] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:43 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:44.579662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:44.580892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:44.599264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:44.600646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:44.601238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:44.602128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:44.602731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:44.603338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:44.830433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:44.831463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:44.839538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:44.840379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:44.841044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:44.841969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:44.842654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:44.843318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:45.395982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:45.410598 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84151e21-4049-4cd7-9efa-cc9be2ff2cd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1367 microversion: 2.1 time: 0.583478 Aug 29 15:55:45.427049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2098/4211] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:44 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:45.427484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ea6cc368-be06-4c65-8285-a348f108fc31 req-d56b5c00-eea9-4f2f-8174-09c9c6fc3bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1437eae0-dfed-4046-b2a9-3ac8b9783e9b", "tag": "9ea3ed73-8c83-406d-a7ea-2757956e4f36"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:45.448868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ea6cc368-be06-4c65-8285-a348f108fc31 req-d56b5c00-eea9-4f2f-8174-09c9c6fc3bc3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:45.449641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ea6cc368-be06-4c65-8285-a348f108fc31 req-d56b5c00-eea9-4f2f-8174-09c9c6fc3bc3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:45.450996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ea6cc368-be06-4c65-8285-a348f108fc31 req-d56b5c00-eea9-4f2f-8174-09c9c6fc3bc3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:45.473881 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ea6cc368-be06-4c65-8285-a348f108fc31 req-d56b5c00-eea9-4f2f-8174-09c9c6fc3bc3 service nova] Creating event network-changed:9ea3ed73-8c83-406d-a7ea-2757956e4f36 for instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b on n-h2-836830-13 Aug 29 15:55:45.485148 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ea6cc368-be06-4c65-8285-a348f108fc31 req-d56b5c00-eea9-4f2f-8174-09c9c6fc3bc3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067304 Aug 29 15:55:45.489133 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2099/4212] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:45.631394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:45.644877 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c7e9402-6f0f-47d9-916b-5883874d6af5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 1.071996 Aug 29 15:55:45.645591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2114/4213] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:44 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:45.681208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-87bffba3-918d-419d-ab48-9c52f21bcafc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:45.682262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-87bffba3-918d-419d-ab48-9c52f21bcafc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 3a30e42f-62ec-486f-930b-2affe3a9c37e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:45.696140 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-87bffba3-918d-419d-ab48-9c52f21bcafc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 3a30e42f-62ec-486f-930b-2affe3a9c37e could not be found. Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-87bffba3-918d-419d-ab48-9c52f21bcafc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/3a30e42f-62ec-486f-930b-2affe3a9c37e/action HTTP/1.1 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 13 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: {"pause": {}} Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 3a30e42f-62ec-486f-930b-2affe3a9c37e could not be found. Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '3a30e42f-62ec-486f-930b-2affe3a9c37e', 'body': {'pause': {}}} Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a30e42f-62ec-486f-930b-2affe3a9c37e could not be found. Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a30e42f-62ec-486f-930b-2affe3a9c37e could not be found. Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:45.708690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:45.712762 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:45.712762 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:45.712762 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a30e42f-62ec-486f-930b-2affe3a9c37e could not be found. Aug 29 15:55:45.712762 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:45.715060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-87bffba3-918d-419d-ab48-9c52f21bcafc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 3a30e42f-62ec-486f-930b-2affe3a9c37e could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:45.716730 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-87bffba3-918d-419d-ab48-9c52f21bcafc tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/3a30e42f-62ec-486f-930b-2affe3a9c37e/action" status: 404 len: 111 microversion: 2.1 time: 0.044613 Aug 29 15:55:45.718050 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2100/4214] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:45 2022] POST /compute/v2.1/servers/3a30e42f-62ec-486f-930b-2affe3a9c37e/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:45.726870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:45.729031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:45.742188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:45.742681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:45.743162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:45.743863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:45.744316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:45.744733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:46.408445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:46.432140 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-708d5775-ea95-457d-8065-ca954f8b69db tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.709826 Aug 29 15:55:46.433208 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2115/4215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:45 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:46.454306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:46.454924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:46.469641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:46.474407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:46.483576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:46.484302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:46.484885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:46.485766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:46.486367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:46.486935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:46.489064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:46.489554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:46.489988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:46.494635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:46.495566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:46.496188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:47.085487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:47.107662 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2d58be9c-6afb-4afb-b8f1-88af8656ca3c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.651821 Aug 29 15:55:47.111407 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2116/4216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:46 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:47.133615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:47.134157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:47.153806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:47.154455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:47.154895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:47.156244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:47.156695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:47.160532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:47.350605 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f843ffe-c576-43e6-9979-fcba3249287e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 202 len: 0 microversion: 2.1 time: 0.220427 Aug 29 15:55:47.356432 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2117/4217] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:47 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:55:47.369252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:47.370290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:47.378153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:47.379539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:47.380233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:47.381205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:47.381868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:47.382487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:48.017168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:48.054040 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4e19b1d-087e-4a73-aac1-de74654bdaf8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1510 microversion: 2.1 time: 0.695592 Aug 29 15:55:48.078243 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2118/4218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:47 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1510 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:48.415617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:48.432149 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1b887dcc-1045-41d4-bfb0-9f81dcdd67e4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1367 microversion: 2.1 time: 1.987232 Aug 29 15:55:48.434800 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2101/4219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:46 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1367 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:49.080393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.082451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:49.102448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.103314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.104349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.105576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.106247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.107153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.356585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:49.372500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a20bc27-3b60-445c-920d-9e636871f557 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1490 microversion: 2.1 time: 0.300552 Aug 29 15:55:49.374175 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2119/4220] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1490 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:49.400203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:49.400990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:49.407641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:49.408930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:49.410550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.411532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.412224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.413084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.413691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.414261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.442758 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Cannot 'pause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state paused Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action HTTP/1.1 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 13 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: {"pause": {}} Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'pause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state paused Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'pause': {}}} Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 in vm_state paused. Cannot pause while the instance is in this state. Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state paused Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:49.445868 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:49.449992 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:49.449992 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:49.449992 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:49.449992 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state paused Aug 29 15:55:49.449992 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:49.451109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 409 to user: Cannot 'pause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state paused {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:49.452286 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f695548f-f392-49f1-a87a-6f23d8873009 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 409 len: 143 microversion: 2.1 time: 0.056166 Aug 29 15:55:49.453330 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2102/4221] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:49 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 143 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:55:49.468846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.469545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:49.475311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:49.476125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:49.487988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.488205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.488652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.489099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.493499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.494708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.496051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.496623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.497375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.497860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.498296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.498725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.601374 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-74ee35cf-d143-49fe-85be-c58de8f84e73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 202 len: 0 microversion: 2.1 time: 0.134521 Aug 29 15:55:49.602781 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2103/4222] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:49 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:55:49.618316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:49.620048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:49.634853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.636452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.639910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:49.642364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:49.644751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:49.645235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:50.388959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:50.403564 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bbb8bd75-b8a8-456e-8170-132c498324db tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1367 microversion: 2.1 time: 0.945459 Aug 29 15:55:50.406006 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2120/4223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1367 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:50.412383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6f363199-0789-4988-82ca-ce0d80f98c9f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:50.424805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f363199-0789-4988-82ca-ce0d80f98c9f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:50.425763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f363199-0789-4988-82ca-ce0d80f98c9f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:50.426390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f363199-0789-4988-82ca-ce0d80f98c9f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:50.458531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6f363199-0789-4988-82ca-ce0d80f98c9f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Going to try to stop instance {{(pid=129133) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 15:55:50.526306 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6f363199-0789-4988-82ca-ce0d80f98c9f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action" status: 202 len: 0 microversion: 2.1 time: 0.118708 Aug 29 15:55:50.531097 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2121/4224] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:50 2022] POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:55:50.536615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:50.537524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:50.544952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:50.545703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:50.546269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:50.547112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:50.547784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:50.548316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:50.816697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:50.830567 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7d979c5-6f94-4bd2-ba19-156792f13fc7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1676 microversion: 2.1 time: 0.298033 Aug 29 15:55:50.832102 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2122/4225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:50 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:50.902898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:50.935600 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-01d5be2c-d1fe-4f3e-a502-d50542e0d43d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1497 microversion: 2.1 time: 1.327591 Aug 29 15:55:50.957890 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2104/4226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:49 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1497 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:51.434855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:51.436548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:51.452706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.453626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.454222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.455111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.456018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.456685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.766750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:51.780483 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b2d5b9a3-ac03-4fd7-a991-9112c7dce693 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1367 microversion: 2.1 time: 0.357082 Aug 29 15:55:51.782201 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2123/4227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:51 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:51.852741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:51.855017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:51.866363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.867304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.868679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.871550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.872827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.875214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.961806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:51.962655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:51.972679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.973321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.973986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:51.975555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:51.976047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:51.976483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.019003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:52.250097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:52.266071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e9a7c78-f68a-41dc-8ab4-793e54b61a3b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.309784 Aug 29 15:55:52.267244 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2124/4228] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:51 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:52.291043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:52.291975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:52.300475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.300979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.301408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.304182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.305135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.305683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.353989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:52.375375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bc87401f-3de9-4207-b319-96d4be9b10ad tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1676 microversion: 2.1 time: 0.525448 Aug 29 15:55:52.376023 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2105/4229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:51 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1676 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:52.537637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:52.554314 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ffa1bde3-576d-4200-8cd3-024c8d3aec62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.265403 Aug 29 15:55:52.554952 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2125/4230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:52 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:52.575578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:52.578536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:52.585128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.585912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.586570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.587557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.588134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.588660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.606365 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61/action HTTP/1.1 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 28 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: {"reboot": {"type": "SOFT"}} Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '672de70b-9063-4656-82fe-5d6d23d3ba61', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:52.608435 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:52.612751 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:52.614291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:52.616421 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b7783293-7c4a-4bf9-9830-13cb99ac38b5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61/action" status: 404 len: 111 microversion: 2.1 time: 0.045295 Aug 29 15:55:52.617592 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2106/4231] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:52 2022] POST /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:52.625702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:52.626323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:52.633962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.634822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.636291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.637218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.638268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.639563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.806398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:52.813068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:52.832921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.833436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.833915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:52.835358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:52.836061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:52.836499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.004076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:53.016943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da60c312-07e8-4065-a3e9-375d8c10c48a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.394973 Aug 29 15:55:53.017546 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2126/4232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:52 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:53.044876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:53.045776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:53.053029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.053733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.054427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.055663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.056311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.056970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.223685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:53.235350 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02005626-588a-432a-a801-d9e8b102b554 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1367 microversion: 2.1 time: 0.433819 Aug 29 15:55:53.254149 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2107/4233] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:52 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:53.306009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:53.321029 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ae15d27-2f01-4f84-98af-54d0e4246e0b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.276221 Aug 29 15:55:53.324382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2127/4234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:53 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:53.363898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62ef1a61-32fb-4ffa-8874-84e72ba4587b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:53.375469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62ef1a61-32fb-4ffa-8874-84e72ba4587b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 201c9f26-4669-44ad-b28d-665ae7db5ce1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:53.389563 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-62ef1a61-32fb-4ffa-8874-84e72ba4587b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 201c9f26-4669-44ad-b28d-665ae7db5ce1 could not be found. Aug 29 15:55:53.423502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:53.424235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62ef1a61-32fb-4ffa-8874-84e72ba4587b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/201c9f26-4669-44ad-b28d-665ae7db5ce1/action HTTP/1.1 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 28 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: {"reboot": {"type": "SOFT"}} Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 201c9f26-4669-44ad-b28d-665ae7db5ce1 could not be found. Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '201c9f26-4669-44ad-b28d-665ae7db5ce1', 'body': {'reboot': {'type': 'SOFT'}}} Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201c9f26-4669-44ad-b28d-665ae7db5ce1 could not be found. Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201c9f26-4669-44ad-b28d-665ae7db5ce1 could not be found. Aug 29 15:55:53.430638 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201c9f26-4669-44ad-b28d-665ae7db5ce1 could not be found. Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:53.434464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62ef1a61-32fb-4ffa-8874-84e72ba4587b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 201c9f26-4669-44ad-b28d-665ae7db5ce1 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:53.437784 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62ef1a61-32fb-4ffa-8874-84e72ba4587b tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/201c9f26-4669-44ad-b28d-665ae7db5ce1/action" status: 404 len: 111 microversion: 2.1 time: 0.089523 Aug 29 15:55:53.441834 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2108/4235] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:53 2022] POST /compute/v2.1/servers/201c9f26-4669-44ad-b28d-665ae7db5ce1/action => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:53.448578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.449126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.451180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.452117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.452723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.453655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.460342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:53.461315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:53.490283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.492688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.496471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.497324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.501227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.501851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.918489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:53.939902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05f9782e-192c-4fc0-a0ab-7837b0215558 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1676 microversion: 2.1 time: 0.545897 Aug 29 15:55:53.943078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:53.959707 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2128/4236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:53 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1676 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:53.966086 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6554637-53c1-45ec-b802-2767fffdd780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.522921 Aug 29 15:55:53.967787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8270125d-be87-436d-998d-307a19b3ed13 req-485a484e-dded-4f02-9def-9b9fda8caa87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1437eae0-dfed-4046-b2a9-3ac8b9783e9b", "name": "network-vif-plugged", "status": "completed", "tag": "9ea3ed73-8c83-406d-a7ea-2757956e4f36"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:53.979823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8270125d-be87-436d-998d-307a19b3ed13 req-485a484e-dded-4f02-9def-9b9fda8caa87 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:53.980609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8270125d-be87-436d-998d-307a19b3ed13 req-485a484e-dded-4f02-9def-9b9fda8caa87 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:53.981197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8270125d-be87-436d-998d-307a19b3ed13 req-485a484e-dded-4f02-9def-9b9fda8caa87 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:53.997942 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8270125d-be87-436d-998d-307a19b3ed13 req-485a484e-dded-4f02-9def-9b9fda8caa87 service nova] Creating event network-vif-plugged:9ea3ed73-8c83-406d-a7ea-2757956e4f36 for instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b on n-h2-836830-13 Aug 29 15:55:54.001085 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2109/4237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:53 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:54.005343 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8270125d-be87-436d-998d-307a19b3ed13 req-485a484e-dded-4f02-9def-9b9fda8caa87 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043841 Aug 29 15:55:54.007735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2129/4238] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:54.013769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:54.014389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:54.033634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.039761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.040654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.041579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.042054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.042788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.259715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:54.260783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:54.272681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.274162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.274879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.276541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.278063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.278723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.703529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:54.731574 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e45c18d-534a-4579-b925-71823d8613a4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.728482 Aug 29 15:55:54.735549 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2110/4239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:54 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:54.778071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:54.781848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:54.791211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.791818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.792334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.793621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.796490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.797171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.828198 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61/action HTTP/1.1 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 65 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '672de70b-9063-4656-82fe-5d6d23d3ba61', 'body': {'rebuild': {'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787'}}} Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:55:54.837524 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:55:54.841919 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:55:54.843216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:54.847273 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e0579dab-f409-431a-81c7-aed36f7828f4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61/action" status: 404 len: 111 microversion: 2.1 time: 0.089170 Aug 29 15:55:54.848110 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2111/4240] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:54 2022] POST /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:54.857186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:54.859504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:54.875260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.876064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.878305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:54.879438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:54.886958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:54.887827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.328491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:55.344962 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d389f31-0cd6-4593-b55d-21de5730ecbb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1367 microversion: 2.1 time: 1.091232 Aug 29 15:55:55.360206 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2130/4241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:54 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1367 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:55.382719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:55.383517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:55.400971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.402169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.404048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.405055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.409498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.411018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.575526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:55.595158 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5514d577-8434-4c8a-8e67-4dcea1fcbee7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.729759 Aug 29 15:55:55.595861 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2112/4242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:54 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:55.602275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:55.607360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:55.610619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Searching by: {'deleted': False, 'project_id': '773bdb58320742cd91d977a2dff19613'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:55:55.622827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.623567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.624144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.625220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.625972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.626719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.657069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:55:55.689784 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-493fad20-004d-4efb-96f4-2984ab61fa47 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.092651 Aug 29 15:55:55.704054 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2113/4243] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 15:55:55 2022] GET /compute/v2.1/servers => generated 339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:55.710477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:55.711401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:55.719954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.720729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.721315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.722176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.722781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.723402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.830505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:55.852129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af2bf252-82ce-4e7f-b537-dcd9c82881d4 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1676 microversion: 2.1 time: 0.484383 Aug 29 15:55:55.853048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2131/4244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:55 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1676 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:55.873274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:55.879227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:55.880123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Searching by: {'deleted': False, 'project_id': '773bdb58320742cd91d977a2dff19613'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 15:55:55.889196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.890122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.893875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.894931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:55.895666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:55.898918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:55.997613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 15:55:56.081659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:56.092534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:56.093475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:56.094125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:56.763693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:56.776611 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b3888495-2558-471b-bd40-8e990a2a6d87 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 1.070560 Aug 29 15:55:56.777433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2114/4245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:55 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:56.795096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:56.796123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:56.803304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:56.804764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:56.805422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:56.806422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:56.807168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:56.807833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.125308 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88fe7cd3-05cc-4c58-8ab8-47fc38b681bb tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.256383 Aug 29 15:55:57.128331 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2132/4246] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 15:55:55 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:57.136980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e80fb2c9-4004-4fe3-a139-5fc324513e92 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:57.147505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e80fb2c9-4004-4fe3-a139-5fc324513e92 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 3ef6c080-73cb-42d3-875e-ea799a801604] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:57.147706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:57.158797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c3a48800-3cc0-4cbc-a44a-f6f33912634c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1557 microversion: 2.1 time: 0.378898 Aug 29 15:55:57.159956 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2115/4247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:56 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1557 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:57.165865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:57.167551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:57.184324 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e80fb2c9-4004-4fe3-a139-5fc324513e92 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 3ef6c080-73cb-42d3-875e-ea799a801604 could not be found. Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e80fb2c9-4004-4fe3-a139-5fc324513e92 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/3ef6c080-73cb-42d3-875e-ea799a801604/action HTTP/1.1 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 65 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 3ef6c080-73cb-42d3-875e-ea799a801604 could not be found. Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '3ef6c080-73cb-42d3-875e-ea799a801604', 'body': {'rebuild': {'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787'}}} Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef6c080-73cb-42d3-875e-ea799a801604 could not be found. Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 15:55:57.187647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef6c080-73cb-42d3-875e-ea799a801604 could not be found. Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef6c080-73cb-42d3-875e-ea799a801604 could not be found. Aug 29 15:55:57.190908 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:57.192348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.193062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.193738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e80fb2c9-4004-4fe3-a139-5fc324513e92 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 3ef6c080-73cb-42d3-875e-ea799a801604 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:57.194871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.195502 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e80fb2c9-4004-4fe3-a139-5fc324513e92 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/3ef6c080-73cb-42d3-875e-ea799a801604/action" status: 404 len: 111 microversion: 2.1 time: 0.064571 Aug 29 15:55:57.197488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.198614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.199597 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2133/4248] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:57 2022] POST /compute/v2.1/servers/3ef6c080-73cb-42d3-875e-ea799a801604/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:55:57.199811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.221580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb172801-1e8b-4bd0-918e-693167068bb7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:57.239759 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb172801-1e8b-4bd0-918e-693167068bb7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028565 Aug 29 15:55:57.251180 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2134/4249] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 15:55:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:57.268411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:57.268922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:57.311639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.312355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.312815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.315242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.315744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.316570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.506657 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be5caeb7-6425-4cf6-ae84-9d3c68e5bc86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.254203 Aug 29 15:55:57.508394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2135/4250] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:55:57 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:55:57.520522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:57.521974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:57.536088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.537077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.537517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.538459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.542192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.542806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.883885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:57.893234 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8a29dbd-1f37-4054-8ee8-de9b9b16395d tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1676 microversion: 2.1 time: 0.731973 Aug 29 15:55:57.907622 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2116/4251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:57 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1676 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:57.919562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:57.920396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:57.928256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.929206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.929855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.930801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:57.931736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:57.932374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:57.960436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:55:57.969821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:55:58.114757 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9015f345-b7bc-470c-a84e-ecdab343c084 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 204 len: 0 microversion: 2.1 time: 0.205240 Aug 29 15:55:58.122239 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2117/4252] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:55:57 2022] DELETE /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:55:58.132964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:58.135082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:58.148872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.149718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.150281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:58.151080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.151678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.152122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:58.192128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:58.214855 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01e66bbd-bf86-49c8-a14e-ccf5fa0ccf0f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.705332 Aug 29 15:55:58.227052 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2136/4253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:57 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:58.241527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:58.242251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:58.260395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.260973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.261469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:58.262456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.262640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.263272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:58.594052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:58.605447 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6bcdaed8-0143-44e6-bac6-bdddcf9a1cb4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.368568 Aug 29 15:55:58.606049 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2137/4254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:58 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:58.627292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a40a96b3-f6d2-42f1-b79f-a019bd36d6a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:58.628128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a40a96b3-f6d2-42f1-b79f-a019bd36d6a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: c0bc0745-3789-4111-b464-1d5f8b574594] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:58.637863 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a40a96b3-f6d2-42f1-b79f-a019bd36d6a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance c0bc0745-3789-4111-b464-1d5f8b574594 could not be found. Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a40a96b3-f6d2-42f1-b79f-a019bd36d6a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/c0bc0745-3789-4111-b464-1d5f8b574594/action HTTP/1.1 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 15 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: {"restore": {}} Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance c0bc0745-3789-4111-b464-1d5f8b574594 could not be found. Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'c0bc0745-3789-4111-b464-1d5f8b574594', 'body': {'restore': {}}} Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bc0745-3789-4111-b464-1d5f8b574594 could not be found. Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bc0745-3789-4111-b464-1d5f8b574594 could not be found. Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:58.640123 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:58.644843 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:58.644843 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:58.644843 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bc0745-3789-4111-b464-1d5f8b574594 could not be found. Aug 29 15:55:58.644843 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:58.647050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a40a96b3-f6d2-42f1-b79f-a019bd36d6a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance c0bc0745-3789-4111-b464-1d5f8b574594 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:58.650113 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a40a96b3-f6d2-42f1-b79f-a019bd36d6a8 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/c0bc0745-3789-4111-b464-1d5f8b574594/action" status: 404 len: 111 microversion: 2.1 time: 0.026920 Aug 29 15:55:58.653500 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2138/4255] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:58 2022] POST /compute/v2.1/servers/c0bc0745-3789-4111-b464-1d5f8b574594/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:55:58.670259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:58.671246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:58.679757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.680792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.681426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:58.682342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:58.682996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:58.683623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.048317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:59.059273 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4690e0e2-f8e3-4fd9-8932-99b835ec1fb7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.399759 Aug 29 15:55:59.060418 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2139/4256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:58 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:59.077895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:59.080731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:59.087851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:59.100840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.101739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.102522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.103798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.104729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.105473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.105740 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8499f17-f9cf-454d-9055-3a76452efbd7 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1714 microversion: 2.1 time: 0.980999 Aug 29 15:55:59.111817 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2118/4257] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:58 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1714 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:55:59.129539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:59.132091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:59.158199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.159009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.160129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.161944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.163143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.164173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.427460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:59.437404 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dd1d4b70-3011-41f2-951d-a7717eca34cf tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1676 microversion: 2.1 time: 0.375695 Aug 29 15:55:59.437992 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2140/4258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:59 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1676 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:59.827496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:55:59.836634 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f891200f-044e-4285-bf8c-4e7c5c02cc70 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.716011 Aug 29 15:55:59.837229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2119/4259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:59 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:55:59.858230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:55:59.859379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:59.868272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.870220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.871873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.873976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.875653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.876916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.941091 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Cannot 'restore' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action HTTP/1.1 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 15 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: {"restore": {}} Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: exception: Cannot 'restore' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'restore': {}}} Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 in vm_state active. Cannot restore while the instance is in this state. Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:55:59.945237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 409 to user: Cannot 'restore' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f9bf2e0c-2aec-4201-93cc-92220b79b388 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 409 len: 145 microversion: 2.1 time: 0.092536 Aug 29 15:55:59.952201 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2141/4260] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:55:59 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 145 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:55:59.955630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:55:59.956253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:55:59.972943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.973751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.977024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:55:59.978130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:55:59.979370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:55:59.979951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.130906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:00.131702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:00.141200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.141998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.143594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.144889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.145596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.146234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.373888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:00.383672 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d975b499-fa45-41f8-818f-f85c529a8a88 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1714 microversion: 2.1 time: 0.257160 Aug 29 15:56:00.384836 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2142/4261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:00 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1714 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:00.459674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:00.461990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:00.468297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.468879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.469395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.470205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:00.471057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:00.471830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:00.713439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:00.723048 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da50af14-55a6-41ec-9c73-c9c542272d31 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1676 microversion: 2.1 time: 0.268999 Aug 29 15:56:00.723723 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2143/4262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:00 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:01.081523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:01.092496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d40909c1-844f-4712-8cf4-df6f9197c894 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 1.140646 Aug 29 15:56:01.093481 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2120/4263] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:55:59 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:01.117530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:01.118151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:01.130455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:01.131688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:01.132817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:01.133755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:01.134639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:01.135302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:01.163851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:01.374041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:01.389254 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d4e8af9-51be-43ab-ab1c-93e79710a140 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.270156 Aug 29 15:56:01.389857 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2144/4264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:01 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:01.412039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:01.413081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:01.414032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98c42006-7e2a-4a3e-9b2d-4638bd1e49a1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:01.414582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98c42006-7e2a-4a3e-9b2d-4638bd1e49a1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:01.420138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:01.421808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:01.422208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-98c42006-7e2a-4a3e-9b2d-4638bd1e49a1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9 could not be found. Aug 29 15:56:01.422589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:01.422998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:01.423768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:01.424226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:01.424648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98c42006-7e2a-4a3e-9b2d-4638bd1e49a1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9/action HTTP/1.1 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 14 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: {"resume": {}} Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9 could not be found. Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9', 'body': {'resume': {}}} Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9 could not be found. Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9 could not be found. Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:01.436639 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:01.441013 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:01.441013 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:01.441013 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9 could not be found. Aug 29 15:56:01.441013 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:01.442717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98c42006-7e2a-4a3e-9b2d-4638bd1e49a1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:01.443898 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98c42006-7e2a-4a3e-9b2d-4638bd1e49a1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9/action" status: 404 len: 111 microversion: 2.1 time: 0.034672 Aug 29 15:56:01.445073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2145/4265] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:01 2022] POST /compute/v2.1/servers/75a0e9eb-cd5f-48fc-aab9-f52918fe7ef9/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:01.457818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:01.460949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:01.476209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:01.477303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:01.478193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:01.479670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:01.481680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:01.482962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.169305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:02.180915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ca31f4a-5290-49d9-8d48-3a3555937c04 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1714 microversion: 2.1 time: 0.778696 Aug 29 15:56:02.181156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:02.189079 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2121/4266] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:01 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1714 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:02.193505 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6327f9a-ff0a-4919-8393-e6cbd2c22614 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.740907 Aug 29 15:56:02.194996 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2146/4267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:01 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:02.210389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:02.211041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:02.225122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:02.225837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:02.228502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.229019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.229699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.230747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.231485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.232109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.235851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.246385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.247332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.248229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.248844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.249440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.605077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:02.618915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-023467ef-0564-40d5-a3f5-b45e8389a8b1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.398136 Aug 29 15:56:02.620598 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2147/4268] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:02 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:02.640679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:02.641536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:02.649234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.650199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.650878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.651834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.652513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.653165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.680198 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Cannot 'resume' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action HTTP/1.1 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 14 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: {"resume": {}} Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: exception: Cannot 'resume' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'resume': {}}} Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 in vm_state active. Cannot resume while the instance is in this state. Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:02.682180 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:02.685874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:02.685874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:02.685874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:02.685874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:02.685874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:02.685874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:56:02.685874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:02.689255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 409 to user: Cannot 'resume' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:02.690534 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec99c07e-e7f4-4b46-a651-c0dce0db1467 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 409 len: 144 microversion: 2.1 time: 0.053947 Aug 29 15:56:02.696547 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2148/4269] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:02 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 144 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:56:02.711339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:02.712299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:02.720477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.721272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.721888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:02.722829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:02.723536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:02.724180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.163770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:03.193517 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-10f85b9a-d30d-49ba-9949-d23a80aae7dc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1653 microversion: 2.1 time: 1.002173 Aug 29 15:56:03.201430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:03.203849 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2122/4270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:02 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1653 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:03.219892 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ee93e0d3-80cb-41fa-b012-527b9e32345a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.521712 Aug 29 15:56:03.220803 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2149/4271] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:02 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:03.226365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:03.227269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:03.243889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.244400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6e0d8441-f7a7-4a55-ba75-e5e3a8c238b5 req-57d273b5-5602-410b-9f3a-31f097689193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1437eae0-dfed-4046-b2a9-3ac8b9783e9b", "tag": "9ea3ed73-8c83-406d-a7ea-2757956e4f36"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:03.244873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.245482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.253485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.254471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.255149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.272818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e0d8441-f7a7-4a55-ba75-e5e3a8c238b5 req-57d273b5-5602-410b-9f3a-31f097689193 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.273579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e0d8441-f7a7-4a55-ba75-e5e3a8c238b5 req-57d273b5-5602-410b-9f3a-31f097689193 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.274710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6e0d8441-f7a7-4a55-ba75-e5e3a8c238b5 req-57d273b5-5602-410b-9f3a-31f097689193 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.329195 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6e0d8441-f7a7-4a55-ba75-e5e3a8c238b5 req-57d273b5-5602-410b-9f3a-31f097689193 service nova] Creating event network-changed:9ea3ed73-8c83-406d-a7ea-2757956e4f36 for instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b on n-h2-836830-13 Aug 29 15:56:03.347472 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6e0d8441-f7a7-4a55-ba75-e5e3a8c238b5 req-57d273b5-5602-410b-9f3a-31f097689193 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118788 Aug 29 15:56:03.348203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2123/4272] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:03.355062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-877d9cdd-7fd1-4c75-94e6-02ebbef83c46 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:03.372017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877d9cdd-7fd1-4c75-94e6-02ebbef83c46 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.383839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877d9cdd-7fd1-4c75-94e6-02ebbef83c46 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.384743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-877d9cdd-7fd1-4c75-94e6-02ebbef83c46 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.425650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-877d9cdd-7fd1-4c75-94e6-02ebbef83c46 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Going to try to start instance {{(pid=129132) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 15:56:03.552971 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-877d9cdd-7fd1-4c75-94e6-02ebbef83c46 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action" status: 202 len: 0 microversion: 2.1 time: 0.202863 Aug 29 15:56:03.555163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2124/4273] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:03 2022] POST /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:56:03.570267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:03.573037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:03.587579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:03.591269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.593263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.594843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.596063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.597895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.600114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.696109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:03.711834 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82e32883-649a-4e96-87af-d355c1319676 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1646 microversion: 2.1 time: 0.483868 Aug 29 15:56:03.712983 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2150/4274] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:03 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1646 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:03.732339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:03.733459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:03.762136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.762660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.769190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:03.772619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:03.774130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:03.778707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:04.712044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:04.727218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f385da36-71e4-420c-96d0-0ef593e24416 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1662 microversion: 2.1 time: 1.008791 Aug 29 15:56:04.728284 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2151/4275] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:03 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1662 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:04.740721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:04.757313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:04.758252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:04.761284 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e06fab4-7e69-4cbe-a114-517c1566c495 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 1.204232 Aug 29 15:56:04.768987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:04.769228 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2125/4276] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:03 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:04.770644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:04.774836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:04.776634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:04.777269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:04.777912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.053954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5be3b33a-ae87-4b00-9259-01a6a2796067 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5be3b33a-ae87-4b00-9259-01a6a2796067 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 160 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "e896cd33-82d8-4f1e-822e-7e54068fdc15"}]}} Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'body': {'server': {'name': '', 'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787', 'flavorRef': '452', 'networks': [{'uuid': 'e896cd33-82d8-4f1e-822e-7e54068fdc15'}]}}} Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '' Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:56:05.057902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:56:05.061932 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:05.063340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5be3b33a-ae87-4b00-9259-01a6a2796067 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:05.064305 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5be3b33a-ae87-4b00-9259-01a6a2796067 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.014394 Aug 29 15:56:05.064910 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2126/4277] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:56:05 2022] POST /compute/v2.1/servers => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:56:05.073721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:05.074477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:05.105599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.106110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.106598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.107117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:05.119576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.120154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.120615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.141946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc2f14f0-394f-42d3-9a94-e014d64a616e tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1646 microversion: 2.1 time: 0.380734 Aug 29 15:56:05.157348 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2152/4278] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:04 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1646 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:05.386219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4a532fff-02da-4cc7-820e-6746a5210454 req-feeefb3f-5e91-4ab2-b122-7e9c0508fd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2314b1b-80a5-4182-be30-e8bf25242168", "name": "network-vif-deleted", "tag": "f3e76890-aaf4-4c4f-b78b-5ccce60144f5"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:05.429346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4a532fff-02da-4cc7-820e-6746a5210454 req-feeefb3f-5e91-4ab2-b122-7e9c0508fd93 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.429835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4a532fff-02da-4cc7-820e-6746a5210454 req-feeefb3f-5e91-4ab2-b122-7e9c0508fd93 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.430268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4a532fff-02da-4cc7-820e-6746a5210454 req-feeefb3f-5e91-4ab2-b122-7e9c0508fd93 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.536333 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4a532fff-02da-4cc7-820e-6746a5210454 req-feeefb3f-5e91-4ab2-b122-7e9c0508fd93 service nova] Creating event network-vif-deleted:f3e76890-aaf4-4c4f-b78b-5ccce60144f5 for instance c2314b1b-80a5-4182-be30-e8bf25242168 on n-h2-836830-13 Aug 29 15:56:05.552272 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4a532fff-02da-4cc7-820e-6746a5210454 req-feeefb3f-5e91-4ab2-b122-7e9c0508fd93 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173443 Aug 29 15:56:05.555676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2153/4279] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:05.588930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:05.598884 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a460dddd-be4c-4ff1-a5e0-85be2125896a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.529206 Aug 29 15:56:05.607000 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2127/4280] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:05 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:05.638116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:05.639172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:05.649783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.651505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.652646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.653530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.654142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.654737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.757659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:05.759009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:05.774641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:05.777500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.783148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.785092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.786118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:05.788456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:05.790318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:05.909091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:06.075064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:06.126407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:06.145178 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b2be44bf-1d25-481d-8aed-f11162249252 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.508849 Aug 29 15:56:06.145820 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2154/4281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:05 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:06.184225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:06.187871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:06.226475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:06.229148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:06.230800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:06.234784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:06.236035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:06.237255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:06.391296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:06.391832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:06.395261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:06.397267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lazy-loading 'fault' on Instance uuid c2314b1b-80a5-4182-be30-e8bf25242168 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:56:06.466270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:06.479060 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-412d5f9f-c491-412a-8d40-3689d517ed12 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1662 microversion: 2.1 time: 0.730488 Aug 29 15:56:06.494183 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2128/4282] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:05 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1662 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:06.500028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38bf997d-216a-49f5-9041-256e1c5a4f7c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:06.500915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38bf997d-216a-49f5-9041-256e1c5a4f7c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: f5c75181-12cc-416d-b0d8-8a5be62aae67] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:06.511556 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-38bf997d-216a-49f5-9041-256e1c5a4f7c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance f5c75181-12cc-416d-b0d8-8a5be62aae67 could not be found. Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38bf997d-216a-49f5-9041-256e1c5a4f7c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/f5c75181-12cc-416d-b0d8-8a5be62aae67/action HTTP/1.1 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 14 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: {"shelve": {}} Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance f5c75181-12cc-416d-b0d8-8a5be62aae67 could not be found. Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'f5c75181-12cc-416d-b0d8-8a5be62aae67', 'body': {'shelve': {}}} Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c75181-12cc-416d-b0d8-8a5be62aae67 could not be found. Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c75181-12cc-416d-b0d8-8a5be62aae67 could not be found. Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:06.520826 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:06.525109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:06.525109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:06.525109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c75181-12cc-416d-b0d8-8a5be62aae67 could not be found. Aug 29 15:56:06.525109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:56:06.526934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38bf997d-216a-49f5-9041-256e1c5a4f7c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance f5c75181-12cc-416d-b0d8-8a5be62aae67 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:06.528223 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38bf997d-216a-49f5-9041-256e1c5a4f7c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/f5c75181-12cc-416d-b0d8-8a5be62aae67/action" status: 404 len: 111 microversion: 2.1 time: 0.032205 Aug 29 15:56:06.529669 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2129/4283] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:06 2022] POST /compute/v2.1/servers/f5c75181-12cc-416d-b0d8-8a5be62aae67/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:06.538718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:06.546360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:06.564652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:06.565407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:06.566032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:06.567198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:06.567896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:06.569058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:06.674272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38624ce9529441aba32a3cb68205209f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773bdb58320742cd91d977a2dff19613', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:06.696503 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-62c1f77c-15a7-4759-a1d5-a035b28b2fd2 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 200 len: 1367 microversion: 2.1 time: 0.530545 Aug 29 15:56:06.706371 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2155/4284] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:06 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:07.073396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:07.088726 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d837e6b2-6597-4c75-9452-fc1355c1143c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.554533 Aug 29 15:56:07.091521 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2130/4285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:06 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:07.124777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:07.133305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:07.166996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.178620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.181580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:07.185534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.187942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.189736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:07.502714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:07.503530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:07.519772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.521285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.523074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:07.528015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.529534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.531369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:07.890319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:07.903661 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04fc77ef-21f6-4332-be66-57df5984b55f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.787012 Aug 29 15:56:07.904313 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2156/4286] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:07 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:07.918981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:07.922407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] [instance: c2314b1b-80a5-4182-be30-e8bf25242168] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:07.944645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.945874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.952978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:07.955918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:07.956837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:07.962276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:08.013132 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] HTTP exception thrown: Instance c2314b1b-80a5-4182-be30-e8bf25242168 could not be found. Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Request method failure captured: Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 HTTP/1.1 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEPreabRLrQov3YIzUQXIPDMgAOu0tsKMgcArVPfSBMVzZ4XqHtqHv-pGwO6cMkVo9JN08myv9gVa53Tk-3PvK0XPZumUiOca7Sc1mjz8hqKPKC1UGwb0gpOZcjwOyU7-bxCrlQ93q95RqGe6qc9GFw8ZHkWXdNhiSzCxMP4vv521g Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 773bdb58320742cd91d977a2dff19613 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestManualDisk-135331148 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/773bdb58320742cd91d977a2dff19613"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_773bdb58320742cd91d977a2dff19613", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/773bdb58320742cd91d977a2dff19613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/773bdb58320742cd91d977a2dff19613"}]}] Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestManualDisk-135331148 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 773bdb58320742cd91d977a2dff19613 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestManualDisk-135331148 Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestManualDisk-135331148-project Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 38624ce9529441aba32a3cb68205209f Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestManualDisk-135331148-project Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance c2314b1b-80a5-4182-be30-e8bf25242168 could not be found. Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'c2314b1b-80a5-4182-be30-e8bf25242168'} Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2314b1b-80a5-4182-be30-e8bf25242168 could not be found. Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2314b1b-80a5-4182-be30-e8bf25242168 could not be found. Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:08.014905 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:08.018937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:08.018937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:08.018937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:08.018937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:08.018937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:08.018937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2314b1b-80a5-4182-be30-e8bf25242168 could not be found. Aug 29 15:56:08.018937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:08.025580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Returning 404 to user: Instance c2314b1b-80a5-4182-be30-e8bf25242168 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:08.027842 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8a24c16-da42-44e3-b7ca-318e420bdbc1 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168" status: 404 len: 111 microversion: 2.1 time: 0.118962 Aug 29 15:56:08.032537 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2157/4287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:07 2022] GET /compute/v2.1/servers/c2314b1b-80a5-4182-be30-e8bf25242168 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:56:08.042774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:08.043405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:08.085916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:08.087865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:08.088307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:08.090693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:08.091260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:08.091620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:08.184508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lazy-loading 'flavor' on Instance uuid 32f04d40-f4f7-49ad-9050-13106f86cf10 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:56:08.673963 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d4b7fc6-ce52-465c-a0bb-76d2aaa2b202 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 202 len: 0 microversion: 2.1 time: 0.634995 Aug 29 15:56:08.674691 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2158/4288] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:56:08 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:56:08.693700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d78e993e-175f-4dd1-afcb-95cb578a7708 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] Calling method '.version_select at 0x7f32ed297310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:08.764706 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d78e993e-175f-4dd1-afcb-95cb578a7708 tempest-ServersTestManualDisk-135331148 tempest-ServersTestManualDisk-135331148-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065740250" status: 202 len: 0 microversion: 2.1 time: 0.083513 Aug 29 15:56:08.769561 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2159/4289] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:56:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065740250 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:56:08.783446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:08.784967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:08.809992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:08.810358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:08.810790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:08.811521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:08.817521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:08.818104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:08.858745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:08.900745 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6761883-efc4-48c1-b748-547374c9527b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1666 microversion: 2.1 time: 1.393406 Aug 29 15:56:08.931621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2131/4290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:07 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1666 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:10.598669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:10.630785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0990908b-cdbd-4255-b883-c5ac0f9cdaa3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 1.861402 Aug 29 15:56:10.651639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2160/4291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:08 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:11.660112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:11.661333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:11.676475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:11.678207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:11.680704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:11.683308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:11.685642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:11.686199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:12.626955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:12.645655 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-991d8ef8-76e9-4ece-a2a2-03a4ddeceab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.987372 Aug 29 15:56:12.649812 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2132/4292] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:11 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:13.668838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:13.670085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:13.690213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:13.690973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:13.691579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:13.692439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:13.696520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:13.697193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:14.139110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:14.147657 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f601b8ad-acb8-4697-b9a1-37d71762806d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.482806 Aug 29 15:56:14.151057 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2161/4293] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:13 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:15.208302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:15.210883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:15.233698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.235384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.236194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.237222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:15.240606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:15.248740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:15.838942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:15.841734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:15.855375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5a36b17-b3a9-4c9c-bf5d-3ae7caa029af tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.680718 Aug 29 15:56:15.859311 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2133/4294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:15 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:16.886528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:16.888975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:16.931148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:16.933352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:16.933802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:16.934542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:16.934999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:16.935599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:16.988234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:17.325357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:17.341317 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fbfc79a6-a717-4cde-a90e-9ff586d21061 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.466537 Aug 29 15:56:17.344368 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2162/4295] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:16 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:18.382748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:18.384786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:18.406631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:18.417604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:18.419239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:18.422736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:18.424304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:18.427083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:18.892442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:18.901905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-322248c0-29ff-4446-a407-02b7ebee1bd7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.536583 Aug 29 15:56:18.908054 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2134/4296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:18 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:19.954359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:19.955928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:19.982768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:19.983518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:19.986952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:19.988347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:19.994725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:20.000818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:20.370937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:20.383888 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d416fd6-cf6b-4945-8da4-7fe19a1d1bf9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1532 microversion: 2.1 time: 0.436394 Aug 29 15:56:20.398026 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2163/4297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:19 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1532 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:21.405742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:21.409619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:21.430583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:21.431366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:21.431978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:21.433003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:21.433627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:21.441145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:23.885662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:23.897153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e002aaa-be15-40af-bbd5-85642648d9a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 2.494880 Aug 29 15:56:23.914242 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2135/4298] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:21 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 2513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:24.921848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:24.923655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:24.939937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:24.940734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:24.941337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:24.942213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:24.942821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:24.944218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:25.720152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:25.738176 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b18bc272-0b80-4789-ab18-2f5eb7b235d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 0.820429 Aug 29 15:56:25.738788 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2164/4299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:24 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:26.765116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:26.766759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:26.787310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:26.789115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:26.791275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:26.793017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:26.803876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:26.804318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:27.732495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:27.741490 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95b3fca4-c98b-4212-a7cf-e6a8666cd0e9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 0.982778 Aug 29 15:56:27.746387 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2136/4300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:26 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:28.784373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:28.785428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:28.805276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:28.806549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:28.807637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:28.809661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:28.810767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:28.811856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:29.400987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:29.409749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6dfbb63-45e4-48b6-aa67-bb8aecda6d1d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 0.640193 Aug 29 15:56:29.427736 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2165/4301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:28 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:30.436564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:30.438368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:30.451314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:30.455522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:30.456180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:30.457868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:30.460543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:30.461194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:31.404563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e6f8dc9e-6b90-4027-a7e3-14ed9b50691c req-88feaf4a-0c03-4b71-bcb2-1772430f28af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f04d40-f4f7-49ad-9050-13106f86cf10", "name": "network-vif-plugged", "status": "completed", "tag": "6ca55786-29ad-4318-99af-5022019c67a1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:31.500960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:31.561000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e6f8dc9e-6b90-4027-a7e3-14ed9b50691c req-88feaf4a-0c03-4b71-bcb2-1772430f28af service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:31.572498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e6f8dc9e-6b90-4027-a7e3-14ed9b50691c req-88feaf4a-0c03-4b71-bcb2-1772430f28af service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:31.580209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e6f8dc9e-6b90-4027-a7e3-14ed9b50691c req-88feaf4a-0c03-4b71-bcb2-1772430f28af service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:31.712046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:31.721130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e6f8dc9e-6b90-4027-a7e3-14ed9b50691c req-88feaf4a-0c03-4b71-bcb2-1772430f28af service nova] Creating event network-vif-plugged:6ca55786-29ad-4318-99af-5022019c67a1 for instance 32f04d40-f4f7-49ad-9050-13106f86cf10 on n-h1-836830-13 Aug 29 15:56:31.723989 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69b2af2f-a808-4410-8d46-ebcebb26c719 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 1.291368 Aug 29 15:56:31.727637 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2137/4302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:30 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:31.778946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e6f8dc9e-6b90-4027-a7e3-14ed9b50691c req-88feaf4a-0c03-4b71-bcb2-1772430f28af service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377378 Aug 29 15:56:31.791824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2166/4303] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:32.750188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:32.750817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:32.768693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:32.769594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:32.770759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:32.772779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:32.775201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:32.775829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:33.306669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:33.322679 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e5b61a77-0b35-412b-bc17-d4f537c8f494 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 0.570335 Aug 29 15:56:33.324997 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2138/4304] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:32 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:34.352295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:34.353712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:34.385341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:34.387999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:34.392587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:34.398576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:34.406203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:34.407138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:35.870545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:35.886571 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c172c87-2119-4429-ba72-5b1ec1978766 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 1.541694 Aug 29 15:56:35.925085 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2167/4305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:34 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:36.939789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:36.941379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:36.966580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=26 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:36.977835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:36.980054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:36.981945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:36.990654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:36.991531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:36.992295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:38.562124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:38.585105 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d9629a1-d7e5-4f22-9ab8-6279e07ad094 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 1.649466 Aug 29 15:56:38.590356 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2139/4306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:36 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:39.650131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:39.653727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:39.690677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:39.715638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:39.726049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:39.735167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:39.742248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:39.745105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:40.454358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:40.468112 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-192dfeb9-e39f-42a6-8e20-d476bb6ce1a2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 0.825953 Aug 29 15:56:40.468713 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2168/4307] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:39 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:40.699972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:40.704504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:40.723144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:40.725590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:40.727422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:40.728581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:40.730735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:40.731852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:40.791973 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7c1f9ee-0cfd-44cc-a4c8-c6a76b790765 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096101 Aug 29 15:56:40.793354 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2140/4308] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:56:40 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:56:41.016784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:41.017991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:41.030744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.032096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.036383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:41.037831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.038926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.039633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:41.123311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:56:41.331227 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-27170332-55b9-4abc-868a-d2124b8015c0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 204 len: 0 microversion: 2.1 time: 0.318118 Aug 29 15:56:41.336188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2169/4309] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:56:41 2022] DELETE /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:56:41.350663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:41.360149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:41.401328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.402217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.403011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:41.469922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.473662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.475575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:41.524287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:41.525179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:41.532384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.533245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.533803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:41.534878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:41.541902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:41.541902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:42.182698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:42.196590 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3f8d3d2e-b94d-4f30-98cb-eb1eae0bee43 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1672 microversion: 2.1 time: 0.852944 Aug 29 15:56:42.214272 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2141/4310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:41 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1672 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:43.223387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:43.225915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:43.268324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:43.269171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:43.279054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:43.280670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:43.285394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:43.292455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:43.297461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:43.325932 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-03dc7279-a30e-4bd5-b774-135719e1d410 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 1.813916 Aug 29 15:56:43.344853 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2170/4311] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:41 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:44.134990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:44.158197 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c83c17ca-6031-49e1-a9c6-931f82370d80 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1672 microversion: 2.1 time: 0.936685 Aug 29 15:56:44.159318 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2142/4312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:43 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1672 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:44.368772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:44.369393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:44.393704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:44.394223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:44.394682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:44.395446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:44.395915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:44.410489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:45.189511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:45.190773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:45.205173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:45.219133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:45.222500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:45.234140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:45.243840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:45.244702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:46.379673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:46.391852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-805afc5e-a260-420d-b41b-fa0862f4675f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 2.027937 Aug 29 15:56:46.431246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2171/4313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:44 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:47.434702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:47.436598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:47.465912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.468169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.469695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.475177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:47.475818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:47.478067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:47.493933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:47.926862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:47.937923 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3a78305-5fe1-4e5a-aa82-41fa9b1f1cf6 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1672 microversion: 2.1 time: 2.752439 Aug 29 15:56:47.942482 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2143/4314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:45 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1672 bytes in 2758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:48.454276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:48.467063 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c80cfc7-ebdb-4a67-842a-f9863c93c67f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 1.037240 Aug 29 15:56:48.484123 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2172/4315] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:47 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:48.779447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f470ad8b-2303-4375-a15c-deb3ffa45c24 req-6afeb715-7773-485c-9d57-0d074f1580ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7d43fd-6072-4fe5-ba70-357fa11e2c25", "name": "network-vif-deleted", "tag": "8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:48.800734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f470ad8b-2303-4375-a15c-deb3ffa45c24 req-6afeb715-7773-485c-9d57-0d074f1580ae service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.812647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f470ad8b-2303-4375-a15c-deb3ffa45c24 req-6afeb715-7773-485c-9d57-0d074f1580ae service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.818870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f470ad8b-2303-4375-a15c-deb3ffa45c24 req-6afeb715-7773-485c-9d57-0d074f1580ae service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.827597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=62 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:56:48.865419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f470ad8b-2303-4375-a15c-deb3ffa45c24 req-6afeb715-7773-485c-9d57-0d074f1580ae service nova] Creating event network-vif-deleted:8976a23f-0ac5-48a7-8cc2-9d64b7c83ee6 for instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 on n-h1-836830-13 Aug 29 15:56:48.894978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f470ad8b-2303-4375-a15c-deb3ffa45c24 req-6afeb715-7773-485c-9d57-0d074f1580ae service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121168 Aug 29 15:56:48.896537 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2144/4316] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:56:48.968087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:48.968988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:48.981766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.982846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.983609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:48.984577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:48.986855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:48.987542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.089272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.090253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.090943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.091854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lazy-loading 'fault' on Instance uuid 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:56:49.246290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:49.259225 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-904ebe27-0a33-4146-81d1-5de74e5d473e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 200 len: 1327 microversion: 2.1 time: 0.295178 Aug 29 15:56:49.272065 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2173/4317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:48 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 1327 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:49.508937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:49.510943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:49.531057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.531701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.532505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:49.533338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:49.534865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:49.544037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:50.294482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:50.295534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:50.330121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:50.330703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:50.331192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:50.337649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:50.338202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:50.338658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:50.391350 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] HTTP exception thrown: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Request method failure captured: Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 HTTP/1.1 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDODggQQXOwCsr3V7XCt55ezJC6Qo5bdGD-FKA9qlFCnWnwAv0KlHYRXauOpL2AFGHoiCo8Gl9orxN1eZoejztsMWOiA58ZHMTJdYPNUvIbHnG7i_f1QlwqUtlGEZ0d5Rcqbepxy985b86QkI6KsA1LeRJ6f6-Z1oyHvCum5NAYW6MwQ Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c7ad457701f641bd963da9221fb04094", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c7ad457701f641bd963da9221fb04094"}]}] Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f554eb660c324a759d70b3b974e78db5 Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '2f7d43fd-6072-4fe5-ba70-357fa11e2c25'} Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:56:50.395657 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:50.400659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:56:50.400659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:56:50.400659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:56:50.400659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:56:50.400659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:56:50.400659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:56:50.400659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:56:50.410545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Returning 404 to user: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:56:50.414315 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c4cda04-b53e-4e9d-8a38-b8a2bb749be2 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 404 len: 111 microversion: 2.1 time: 0.124099 Aug 29 15:56:50.418270 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2174/4318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:50 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:56:50.426271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b63ac7ec-0048-4569-b82f-2ac3dcefd581 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '.version_select at 0x7f32ed282550>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:50.514004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:50.525657 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3aaa66cb-d315-4f2e-8fd1-79eef731afbb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 1.022931 Aug 29 15:56:50.536705 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b63ac7ec-0048-4569-b82f-2ac3dcefd581 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299896968" status: 202 len: 0 microversion: 2.1 time: 0.114962 Aug 29 15:56:50.539408 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2175/4319] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:56:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299896968 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:56:50.548884 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2145/4320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:49 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:51.554700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:51.555419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:51.579487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.580009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.580461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:51.586722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:51.591246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:51.591843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:52.964426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:52.988968 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b3b7bef9-a119-4f49-a7cd-8b0bbfeb5338 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 1.433352 Aug 29 15:56:52.993329 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2176/4321] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:51 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:54.012796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:54.014334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:54.042115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.042927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.046527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:54.047623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:54.049774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:54.051624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:54.397469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-565dcbe8-71f9-4d09-aaef-ea3939bb162b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'create', calling method: .version_select at 0x7f32ed1783a0>, body: {"keypair": {"name": "tempest-keypair-1684107866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuRT4BkIuEtcNR8Sr0e55T2GrlOk02RQES48vgQsiWP63eB/nmurJiSxULIEGNZO5MD6GXeZ6GjHajGWnqTuD2jyLb5HvjL6SizhBEWz0+71FnPKseEKE5SqJdCXIFLOA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:56:54.470448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-565dcbe8-71f9-4d09-aaef-ea3939bb162b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for project c7ad457701f641bd963da9221fb04094. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:56:54.498452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-565dcbe8-71f9-4d09-aaef-ea3939bb162b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for user f554eb660c324a759d70b3b974e78db5 and project c7ad457701f641bd963da9221fb04094. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:56:54.567536 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-565dcbe8-71f9-4d09-aaef-ea3939bb162b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172853 Aug 29 15:56:54.569853 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2177/4322] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:56:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:56:54.667387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:54.683428 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-582643df-c4a5-4ea6-b03f-737b434aac21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 0.674968 Aug 29 15:56:54.704508 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2146/4323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:54 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:56:55.776990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:55.780206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:55.790646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:55.795671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:55.796319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:55.798249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:55.798891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:55.799529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:56.396345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:56.416409 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c010e43e-caa6-4332-ba63-24e62e5d4ab3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1527 microversion: 2.1 time: 0.652932 Aug 29 15:56:56.417349 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2178/4324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:55 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1527 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:57.438243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:57.438873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:57.456709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:57.457203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:57.457653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:57.458960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:57.459648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:57.460081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:57.929450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:57.954402 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6c0cebcb-c7b6-43dc-874a-476f5c4fdc21 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1509 microversion: 2.1 time: 0.506845 Aug 29 15:56:57.957686 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2147/4325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:57 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1509 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:56:58.980662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:56:58.981308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:56:59.004166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.012136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.013333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.013333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:56:59.013797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:56:59.014228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:56:59.665788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:56:59.674553 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b173e80-b362-4b0f-81ef-00250d308d52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1509 microversion: 2.1 time: 0.699096 Aug 29 15:56:59.680255 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2179/4326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:56:58 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1509 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:00.706327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:00.707193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:00.733751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.734501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.736471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:00.738560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:00.742382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:00.746008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:00.814723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2109630589", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "aca4efcc-32bf-4c7c-8bb1-34d4484e26bc"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:00.902291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] validate_networks() for [('aca4efcc-32bf-4c7c-8bb1-34d4484e26bc', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:57:01.624638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:01.640438 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e41d2aa1-9e24-43f4-b7ff-c615be058280 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1452 microversion: 2.1 time: 0.941303 Aug 29 15:57:01.656547 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2180/4327] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:00 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1452 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:01.671457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:01.678214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:01.683460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:01.702150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:01.702900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:01.707922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:01.709627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:01.713294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:01.713917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:02.288712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:02.307698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-625deebb-adae-4853-b350-5101030e9bfe tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1452 microversion: 2.1 time: 0.640022 Aug 29 15:57:02.324476 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2181/4328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:01 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1452 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:02.338396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-384332912", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a79fbfe2-b068-471e-b661-deb071b6d2f6"}], "security_groups": [{"name": "tempest-securitygroup--310758164"}], "key_name": "tempest-keypair-1684107866", "user_data": "}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:02.600690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] validate_networks() for [('a79fbfe2-b068-471e-b661-deb071b6d2f6', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:57:02.668360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:57:02.668846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:57:02.669253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:57:02.669674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:57:02.670092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:57:02.689279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:02.689782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:02.690226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:02.695385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:02.696028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:02.696481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:02.769577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Getting quotas for project d4283ccfd2a54553896677a670e675f9. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:02.787846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Getting quotas for user 58ddd1273ce749e29578db36d61ca07a and project d4283ccfd2a54553896677a670e675f9. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:02.816072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:57:02.827052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:57:02.934083 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26e58758-e3e2-443c-9cf4-0dfee47b149b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.448286 Aug 29 15:57:02.940142 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2148/4329] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:57:02.958152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:02.964944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:02.985927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:02.996286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:02.997121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.000075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:03.003741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:03.004429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.063750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lazy-loading 'flavor' on Instance uuid 32f04d40-f4f7-49ad-9050-13106f86cf10 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:57:03.089182 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Cannot 'shelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state shelved_offloaded Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action HTTP/1.1 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 14 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: {"shelve": {}} Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'shelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state shelved_offloaded Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'shelve': {}}} Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:57:03.105970 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state shelved_offloaded Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state shelved_offloaded Aug 29 15:57:03.110602 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:03.113401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 409 to user: Cannot 'shelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state shelved_offloaded {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:03.114634 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c982909c-7484-40e5-999f-d707518e8b75 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 409 len: 155 microversion: 2.1 time: 0.173082 Aug 29 15:57:03.115455 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2149/4330] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:02 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 155 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:57:03.124566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-cb033fb8-9884-43a0-9d64-f643f42098b9 req-8d943b45-ecfb-4942-8750-3ff068235346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f04d40-f4f7-49ad-9050-13106f86cf10", "name": "network-vif-unplugged", "status": "completed", "tag": "6ca55786-29ad-4318-99af-5022019c67a1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:03.140341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cb033fb8-9884-43a0-9d64-f643f42098b9 req-8d943b45-ecfb-4942-8750-3ff068235346 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:03.141103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cb033fb8-9884-43a0-9d64-f643f42098b9 req-8d943b45-ecfb-4942-8750-3ff068235346 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:03.141710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cb033fb8-9884-43a0-9d64-f643f42098b9 req-8d943b45-ecfb-4942-8750-3ff068235346 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.247984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.server_external_events [req-cb033fb8-9884-43a0-9d64-f643f42098b9 req-8d943b45-ecfb-4942-8750-3ff068235346 service nova] Unable to find a host for instance 32f04d40-f4f7-49ad-9050-13106f86cf10. Dropping event network-vif-unplugged {{(pid=129132) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 15:57:03.249553 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-cb033fb8-9884-43a0-9d64-f643f42098b9 req-8d943b45-ecfb-4942-8750-3ff068235346 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.132897 Aug 29 15:57:03.251860 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2150/4331] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 136 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 15:57:03.275189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be98b474-427a-4ccf-827b-bb22a6eda84b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:03.280560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be98b474-427a-4ccf-827b-bb22a6eda84b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:03.691691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be98b474-427a-4ccf-827b-bb22a6eda84b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:03.701491 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be98b474-427a-4ccf-827b-bb22a6eda84b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1218 microversion: 2.1 time: 0.448318 Aug 29 15:57:03.725952 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2151/4332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:03 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1218 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:03.748956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:03.749573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:03.774273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:03.775696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:03.777793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.778875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:03.782542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:03.782644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:03.899137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129132) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 15:57:04.177887 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb394432-9f9d-4104-b3f0-f6c51fa95bc1 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 202 len: 0 microversion: 2.1 time: 0.449515 Aug 29 15:57:04.193912 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2152/4333] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:03 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:57:04.216916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:04.217909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:04.231511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.232501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.233162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.241107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:57:04.242070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:57:04.243000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:57:04.243615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:57:04.244908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:57:04.247809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.248499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.252159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.289715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.291322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.291794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.292611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:04.293082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:04.293517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:04.437173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for project c7ad457701f641bd963da9221fb04094. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:04.457084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Getting quotas for user f554eb660c324a759d70b3b974e78db5 and project c7ad457701f641bd963da9221fb04094. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:04.546646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:57:04.568704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:57:04.684794 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89aa866a-f0d1-466d-ac32-b378460f8d7a tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.357464 Aug 29 15:57:04.686370 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2182/4334] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:57:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:57:04.711512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-69723499-4822-458b-ab6c-b5c00ade20d9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:04.713452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-69723499-4822-458b-ab6c-b5c00ade20d9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:05.342209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:05.360457 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0bcb4a29-4fa5-44f6-bc30-e5323ee236d4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1460 microversion: 2.1 time: 1.164113 Aug 29 15:57:05.361062 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2153/4335] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:04 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1460 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:05.380087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:05.381269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:05.413145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:05.413644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:05.414084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:05.414805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:05.426450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:05.427336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:05.691321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-69723499-4822-458b-ab6c-b5c00ade20d9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:05.708036 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-69723499-4822-458b-ab6c-b5c00ade20d9 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1237 microversion: 2.1 time: 1.010359 Aug 29 15:57:05.711470 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2183/4336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:04 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1237 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:05.809179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:05.822231 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a4b8706-4fca-4749-91b8-9c52a7c5fa62 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1222 microversion: 2.1 time: 0.455876 Aug 29 15:57:05.829325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2154/4337] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:05 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1222 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:06.389048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:06.390953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:06.430692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:06.432237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:06.432863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:06.436290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:06.437803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:06.438430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:06.732455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:06.733616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:06.751388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:06.754687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:06.756568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:06.758613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:06.760685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:06.762463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:07.056332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:07.074266 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b632a43-1295-41d3-bc4c-6f22733de88f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1460 microversion: 2.1 time: 0.690769 Aug 29 15:57:07.078459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2184/4338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:06 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1460 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:07.090570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:07.095561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:07.114515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:07.117325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:07.119402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:07.120307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:07.124075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:07.127419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:07.283962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:07.295558 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-566350ab-a941-4866-b712-404387851a6c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1289 microversion: 2.1 time: 0.567886 Aug 29 15:57:07.332352 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2155/4339] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:06 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1289 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:07.493092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:07.520348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dec70dba-aed0-4e6b-863f-d2fb7548feab tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1270 microversion: 2.1 time: 0.439453 Aug 29 15:57:07.531905 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2185/4340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:07 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1270 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:08.102539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:08.103856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:08.111383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:08.136429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.137216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.137816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.143332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.144020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.144601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.321669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:08.322301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:08.333337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.343582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.345297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.355192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.356739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.357393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.549790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:08.567712 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d348207-4aa6-4dfb-acdb-8cd7a6135fb7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1295 microversion: 2.1 time: 0.243903 Aug 29 15:57:08.580513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2186/4341] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:08 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1295 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:08.599424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:08.602888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:08.612133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.617413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.618018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.619014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:08.621545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:08.622571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:08.948092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:08.963719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-333458b3-300b-4291-8603-1a58aa4f1833 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1276 microversion: 2.1 time: 0.381668 Aug 29 15:57:08.975679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2187/4342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:08 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1276 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:09.596818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:09.597444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:09.609931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:09.612199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:09.613850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:09.617877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:09.618613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:09.619255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:09.814768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:09.831759 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-38c1bee1-13b8-4732-b087-ede278046d17 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1295 microversion: 2.1 time: 0.240518 Aug 29 15:57:09.849683 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2188/4343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:09 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1295 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:09.876200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:09.898523 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0464db29-4c44-4549-8c6f-454bc3a8aab2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 1.794097 Aug 29 15:57:09.899595 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2156/4344] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:08 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:10.000724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:10.001656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:10.013478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.014688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.016955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.017940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.020565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.021942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.477960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:10.506942 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3cb4e6ea-c41f-4d51-9fa9-2903cee77e09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1276 microversion: 2.1 time: 0.510242 Aug 29 15:57:10.508519 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2189/4345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:09 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1276 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:10.866380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:10.866992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:10.883080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.886506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.887212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.890183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.890838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.891448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.925532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:10.926179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:10.934573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.935102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.935597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:10.936389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:10.936758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:10.947435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:11.284462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:11.298997 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bae5a50c-a812-4a5f-a942-070f168e9d3b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1295 microversion: 2.1 time: 0.438263 Aug 29 15:57:11.301643 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2157/4346] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:10 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1295 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:11.413277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:11.422093 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-382de5a0-66d7-4270-841f-bd6e1abf88bb tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.500540 Aug 29 15:57:11.426827 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2190/4347] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:10 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:11.530450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:11.531594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:11.550265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:11.551185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:11.552623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:11.554568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:11.555377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:11.556027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:11.831798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e35e1bc-45b5-44d7-84f6-00a8e10034e7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Action: 'create', calling method: .version_select at 0x7f32ed1d1940>, body: {"keypair": {"name": "tempest-keypair-697449914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOs7rbnLeh/F1Wb717rMaOv8430QWtnWPTpcneUoEIT6AOu8TBJA0PdetOtGBUNjbfwnJzVf96k5w2/cE/OsAP2cVa2PAt5eHB8M2AeO/krbJ0HUiypgife9mXvebdN/bg=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:11.873671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4e35e1bc-45b5-44d7-84f6-00a8e10034e7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Getting quotas for project 32dcc4d8d4a44d24bce81642e49a84ab. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:11.884761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4e35e1bc-45b5-44d7-84f6-00a8e10034e7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Getting quotas for user 2cd0536429dd4c47b296b9645b6e0c48 and project 32dcc4d8d4a44d24bce81642e49a84ab. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:11.944367 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e35e1bc-45b5-44d7-84f6-00a8e10034e7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.116437 Aug 29 15:57:11.945422 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2191/4348] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 15:57:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 15:57:12.109302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:12.127325 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2aca0b1f-6845-4709-b116-e3701f66f061 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1276 microversion: 2.1 time: 0.601936 Aug 29 15:57:12.128263 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2158/4349] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:11 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1276 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:12.326204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:12.327043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:12.346536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.350721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.351340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:12.354806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.358203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.359774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:12.453415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:12.454026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:12.464426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.464921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.465350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:12.474696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:12.481688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:12.482391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:12.732312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:12.737721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:12.747820 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a2f7b8a-4d4b-4612-b004-05542e358e82 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.429754 Aug 29 15:57:12.764366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2192/4350] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:12 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:13.155820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:13.157160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:13.175696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.178370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.179069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.179983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.184783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.185709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.644290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.653706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:13.658231 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-980f4641-877a-4840-80e5-e262e4a9e71c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 0.506835 Aug 29 15:57:13.659832 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2193/4351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:13 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:13.666095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a4a83179-02eb-4fbe-982c-cd4be0655500 req-72231714-01b0-40c9-9df9-a1b58f2793c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f04d40-f4f7-49ad-9050-13106f86cf10", "tag": "6ca55786-29ad-4318-99af-5022019c67a1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:13.684135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a4a83179-02eb-4fbe-982c-cd4be0655500 req-72231714-01b0-40c9-9df9-a1b58f2793c4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.685085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a4a83179-02eb-4fbe-982c-cd4be0655500 req-72231714-01b0-40c9-9df9-a1b58f2793c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.687883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a4a83179-02eb-4fbe-982c-cd4be0655500 req-72231714-01b0-40c9-9df9-a1b58f2793c4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.698428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:13.751180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:13.770400 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a4a83179-02eb-4fbe-982c-cd4be0655500 req-72231714-01b0-40c9-9df9-a1b58f2793c4 service nova] Creating event network-changed:6ca55786-29ad-4318-99af-5022019c67a1 for instance 32f04d40-f4f7-49ad-9050-13106f86cf10 on n-h2-836830-13 Aug 29 15:57:13.772996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5248015a-cdd3-43f0-95e4-83f6ddf8e707 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 1.328543 Aug 29 15:57:13.783230 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2159/4352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:12 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:13.789895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:13.795176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:13.797704 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a4a83179-02eb-4fbe-982c-cd4be0655500 req-72231714-01b0-40c9-9df9-a1b58f2793c4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136404 Aug 29 15:57:13.798546 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2194/4353] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:13.815903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.816893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.824076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:13.827736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:13.828416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:13.829044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.424992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:14.602055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8435278-2aaf-406a-8a49-a73d953b4299 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Action: 'create', calling method: .version_select at 0x7f32ed1293a0>, body: {"keypair": {"name": "tempest-keypair-32096509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5oluNsEeSII0sxiq4cGV0Al1HbJQeekt3ryRShvgjcfF6PgsV78C0ywUd3TW8hHDZpPjaGvbnx+GkX3MRmK9aiFR5hEKvsdJvbU1Won+Nm/lL4HmZVcz4s0AfRckkpLA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:14.620380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e8435278-2aaf-406a-8a49-a73d953b4299 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Getting quotas for project 127d2af276e74dad8b3f7cd93027954f. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:14.626482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e8435278-2aaf-406a-8a49-a73d953b4299 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Getting quotas for user ef76ec0a3c064d1eba53fbdb4feaf889 and project 127d2af276e74dad8b3f7cd93027954f. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:14.653409 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8435278-2aaf-406a-8a49-a73d953b4299 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.231527 Aug 29 15:57:14.654404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2195/4354] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:57:14 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:57:14.683718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:14.684498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:14.692049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.692568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.693583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.695302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.695798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.696219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.802093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:14.815867 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0bc9ba70-bae2-4e1a-b606-85c23f4deaca tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 1.029969 Aug 29 15:57:14.816705 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2160/4355] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:13 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:14.823303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:14.824460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:14.831228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.831719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.832155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:14.833037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:14.834096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:14.834633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:15.054087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:15.084986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd704054-a42b-4cc1-a60c-e8c88d6cb582 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 0.404483 Aug 29 15:57:15.087162 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2196/4356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:14 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:15.577449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:15.593620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-418b60a4-7d37-4555-82e6-7d85f6cb48b7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.775545 Aug 29 15:57:15.594807 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2161/4357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:14 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:15.838787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:15.840200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:15.847434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:15.848178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:15.849735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:15.850668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:15.852340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:15.853516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.113799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:16.115646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:16.123861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.124355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.126667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.127925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.129209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.129878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.201513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:16.212753 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e71c1624-7be6-4177-b10b-3fa078981b75 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.378834 Aug 29 15:57:16.227050 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2197/4358] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:15 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:16.416503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-425629556", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a3fff22d-b40f-474c-9534-fbe241cd39ac"}, {"port": "3da879d5-255a-43b9-89f5-e8743644a9d4", "tag": "port-1"}, {"port": "3d8f7eec-7c7b-463a-aa32-edc8ac2a0179", "tag": "port-2"}, {"uuid": "ae2d1def-904e-482d-bf12-98c368a83e79", "tag": "net-1"}, {"uuid": "ae2d1def-904e-482d-bf12-98c368a83e79"}, {"uuid": "9a30fcb7-7677-4aa1-a49b-2920fd2bbd99", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9a30fcb7-7677-4aa1-a49b-2920fd2bbd99", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "54239041-1990-4e9f-8162-96790e2678d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1556431b-812b-4333-a12f-81d98cdc5013", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "027ca566-d204-46be-b3b1-f7bdee3f92b9", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1431290663"}], "key_name": "tempest-keypair-697449914", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:16.603932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] validate_networks() for [('a3fff22d-b40f-474c-9534-fbe241cd39ac', None, None, None, None, None), (None, None, '3da879d5-255a-43b9-89f5-e8743644a9d4', None, None, None), (None, None, '3d8f7eec-7c7b-463a-aa32-edc8ac2a0179', None, None, None), ('ae2d1def-904e-482d-bf12-98c368a83e79', None, None, None, None, None), ('ae2d1def-904e-482d-bf12-98c368a83e79', None, None, None, None, None), ('9a30fcb7-7677-4aa1-a49b-2920fd2bbd99', '10.2.2.100', None, None, None, None), ('9a30fcb7-7677-4aa1-a49b-2920fd2bbd99', '10.2.2.200', None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:57:16.850312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:16.854713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:16.869256 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1b328f9e-fc02-4622-b678-6fa2c75d9281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 0.761944 Aug 29 15:57:16.883052 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2162/4359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:16 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:16.883052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:16.890584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:16.901133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.901691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.902141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:16.902916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:16.903407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:16.903980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:18.392676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:18.407340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-37428354-54d8-4b23-a90e-4f1cf7f8eb71 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 1.532339 Aug 29 15:57:18.408233 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2163/4360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:16 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:18.426907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:18.434717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:18.441420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:18.442157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:18.442792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:18.444050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:18.444740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:18.445510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:19.262406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:19.273231 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9c26f54-e9e1-4231-b82a-5263ea9dc2a7 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.860739 Aug 29 15:57:19.276946 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2164/4361] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:18 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:19.295788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-103658345", "imageRef": "56fe0e43-d3c0-4e6d-a761-752600b9cc00", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "1127ffa6-9d64-48fc-aae2-85f90c190cc1"}], "security_groups": [{"name": "tempest-securitygroup--1801640594"}], "key_name": "tempest-keypair-32096509", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:19.658825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] validate_networks() for [('1127ffa6-9d64-48fc-aae2-85f90c190cc1', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:57:20.713302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:57:20.713874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:57:20.714207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:57:20.714621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:57:20.715059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:57:20.730975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.731764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.732372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.733265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.735576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.736197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.787744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Getting quotas for project 127d2af276e74dad8b3f7cd93027954f. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:20.794498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Getting quotas for user ef76ec0a3c064d1eba53fbdb4feaf889 and project 127d2af276e74dad8b3f7cd93027954f. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:20.808873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:57:20.811512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56fe0e43-d3c0-4e6d-a761-752600b9cc00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:57:20.952282 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca83281f-39c1-40e4-af08-64c04b670d3f tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.674065 Aug 29 15:57:20.953726 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2165/4362] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:57:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:57:20.963352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:20.963975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:20.983040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.983624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.984124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:20.984976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:20.985434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:20.985938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.537040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:21.568188 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a2206c60-cea2-407d-8b5b-ba30eecec2a2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 0.595304 Aug 29 15:57:21.568955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2166/4363] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:20 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:21.582687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b1f9a977-67a8-401b-a5aa-ebe1d24bfb8b req-7bd44582-1959-46ac-a4cd-772fc53c3515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feeb1ea1-65d9-4a46-93e4-298b1a4a4406", "tag": "0cd9b44c-8cfe-44c1-b8ca-c71560a475b1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:21.654432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b1f9a977-67a8-401b-a5aa-ebe1d24bfb8b req-7bd44582-1959-46ac-a4cd-772fc53c3515 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.655336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b1f9a977-67a8-401b-a5aa-ebe1d24bfb8b req-7bd44582-1959-46ac-a4cd-772fc53c3515 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.657016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b1f9a977-67a8-401b-a5aa-ebe1d24bfb8b req-7bd44582-1959-46ac-a4cd-772fc53c3515 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.704545 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b1f9a977-67a8-401b-a5aa-ebe1d24bfb8b req-7bd44582-1959-46ac-a4cd-772fc53c3515 service nova] Creating event network-changed:0cd9b44c-8cfe-44c1-b8ca-c71560a475b1 for instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 on n-h1-836830-13 Aug 29 15:57:21.708879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:57:21.709576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:57:21.709846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:57:21.710342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:57:21.710986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:57:21.711296 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b1f9a977-67a8-401b-a5aa-ebe1d24bfb8b req-7bd44582-1959-46ac-a4cd-772fc53c3515 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136418 Aug 29 15:57:21.712227 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2167/4364] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:21.718400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:21.720722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:21.745452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=21 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:21.758365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.758933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.760753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.761503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.761798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.761974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.762417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.763460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.765997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.769703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.776821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.777687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.891736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Getting quotas for project 32dcc4d8d4a44d24bce81642e49a84ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:21.895204 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-65448a10-1a63-45e6-b415-245b69c917a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/ips" status: 200 len: 149 microversion: 2.1 time: 0.178064 Aug 29 15:57:21.907046 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2168/4365] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:57:21 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/ips => generated 149 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:21.910390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Getting quotas for user 2cd0536429dd4c47b296b9645b6e0c48 and project 32dcc4d8d4a44d24bce81642e49a84ab. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:21.919850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:21.921114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:21.952056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.952556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.953197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:21.954200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:21.963649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:21.967781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:22.260598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:57:22.275275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='54239041-1990-4e9f-8162-96790e2678d0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1556431b-812b-4333-a12f-81d98cdc5013',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='027ca566-d204-46be-b3b1-f7bdee3f92b9',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:57:23.222395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e79c7948-d6a2-44b6-ac07-331b9ecaf768 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.810936 Aug 29 15:57:23.224147 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2198/4366] 10.222.0.83 () {62 vars in 1189 bytes} [Mon Aug 29 15:57:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 6813 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 15:57:23.237364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:23.238370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:23.275068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.277722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.278358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:23.279486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.283359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.285211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:23.660877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:23.678296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a06d144d-f38b-4154-8742-0b52405c56ce tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.451778 Aug 29 15:57:23.681004 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2199/4367] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:23 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:23.704981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:23.706959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:23.734094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.734595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.741876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:23.743174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:23.745654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:23.748078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.095695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:24.110017 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d5f0a25-7bc6-4e53-9894-8bdce033bb27 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 2.201025 Aug 29 15:57:24.112749 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2169/4368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:21 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:24.132621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:24.134165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:24.142410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.143393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.144017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.145064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.148109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.148763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.253120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:24.276035 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf595667-14e4-4826-823f-05246f9c9946 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1303 microversion: 2.1 time: 0.592230 Aug 29 15:57:24.282225 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2200/4369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:23 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1303 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:24.293976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75160024-2116-44c9-a545-83516838879d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:24.294691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75160024-2116-44c9-a545-83516838879d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:24.497695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75160024-2116-44c9-a545-83516838879d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:24.512238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75160024-2116-44c9-a545-83516838879d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:24.515932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75160024-2116-44c9-a545-83516838879d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:24.517221 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75160024-2116-44c9-a545-83516838879d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1284 microversion: 2.32 time: 0.234549 Aug 29 15:57:24.517747 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2201/4370] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:24 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:24.532455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a78f43ce-e431-40b6-8bfb-f031535f3afb req-bd299599-f66f-4c4b-b93a-7a042c0d6326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb45ee9b-9f30-4555-be78-f8f6899b2d79", "tag": "e5ac2864-da7e-406b-bcf3-729730c994e1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:24.595428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a78f43ce-e431-40b6-8bfb-f031535f3afb req-bd299599-f66f-4c4b-b93a-7a042c0d6326 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.595919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a78f43ce-e431-40b6-8bfb-f031535f3afb req-bd299599-f66f-4c4b-b93a-7a042c0d6326 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.596357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a78f43ce-e431-40b6-8bfb-f031535f3afb req-bd299599-f66f-4c4b-b93a-7a042c0d6326 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.638762 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a78f43ce-e431-40b6-8bfb-f031535f3afb req-bd299599-f66f-4c4b-b93a-7a042c0d6326 service nova] Creating event network-changed:e5ac2864-da7e-406b-bcf3-729730c994e1 for instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 on n-h1-836830-13 Aug 29 15:57:24.657613 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a78f43ce-e431-40b6-8bfb-f031535f3afb req-bd299599-f66f-4c4b-b93a-7a042c0d6326 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138621 Aug 29 15:57:24.658569 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2202/4371] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:24.702742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:24.703911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:24.713596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:24.731131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.731638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.742941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:24.744064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:24.745586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:24.748486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.522185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.531516 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f3109a8-df3a-4c2d-93eb-cf9739526221 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 1.417469 Aug 29 15:57:25.543153 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2170/4372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:24 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:25.575978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:25.581695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:25.626117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.633129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.634403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.634863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.635655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.648197 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79535ab0-b52a-4287-b4c0-922e3d9ff1a8 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.950019 Aug 29 15:57:25.657613 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2203/4373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:24 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:25.662958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.663601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.671886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:25.672825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:25.718891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.719903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.720571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.721570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.722235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.722877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.895464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:25.911107 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4dbd211e-d586-435f-ac68-e8947b5f1637 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1301 microversion: 2.1 time: 0.251813 Aug 29 15:57:25.913450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2204/4374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:25 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1301 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:25.932970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:25.935347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:25.957522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.958028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.958896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:25.967901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:25.968392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:25.968826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.184348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.234554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.239951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.244190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a958a637-cb16-4b19-a909-67e44863a1fa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1518 microversion: 2.32 time: 0.329351 Aug 29 15:57:26.248473 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2205/4375] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:25 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1518 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:26.268267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bca1f62f-ef19-46ab-aa63-2cb8f76be586"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:26.283285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:26.314437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.324450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.326824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.327814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.331869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.332511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.684270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:26.720440 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-221fe5ac-1c4b-46a8-8927-b1d2b3211709 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 1.175498 Aug 29 15:57:26.743414 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2171/4376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:25 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:26.754019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:26.766845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:26.785279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.785857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.788584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:26.789779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:26.790502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:26.791127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.120534 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a07bb0c0-ca48-4577-9f27-0e7c12aacc68 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870622 Aug 29 15:57:27.121305 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2206/4377] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:57:26 2022] POST /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:27.151668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:27.152419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:27.176510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.177730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.178282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.179001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.199523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.199982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.541020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:27.555655 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-013c013a-80e4-47af-8c20-540a51163a78 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 0.810022 Aug 29 15:57:27.558545 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2172/4378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:26 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:27.572448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:27.573108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:27.603594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.607064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.608846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.613274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.615592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.617300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.809753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:27.823579 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a1dbdcd-2b19-4d80-8047-326a18c7adcc tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.699959 Aug 29 15:57:27.826396 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2207/4379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:27 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:27.844075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:27.845268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:27.865345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.866825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.868717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:27.870484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:27.871593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:27.873247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.035883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.052830 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c7fa1f7-9da2-4383-bf4c-dd51f119e860 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1301 microversion: 2.1 time: 0.491571 Aug 29 15:57:28.053660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2173/4380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:27 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1301 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:28.074620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:28.087000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:28.146592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.147137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.147586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.148302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.157064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.159925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.249504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.272802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.275519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:28.283566 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09d397fb-3105-4d43-a81d-89c38b7f5c6c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1582 microversion: 2.32 time: 0.454212 Aug 29 15:57:28.285531 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2208/4381] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:27 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1582 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:28.304674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e37aa4b1-398c-434e-af51-4f710d23a5b8 req-86475d03-4f17-4cbd-873c-0ba10cc0af0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb45ee9b-9f30-4555-be78-f8f6899b2d79", "name": "network-vif-plugged", "status": "completed", "tag": "e5ac2864-da7e-406b-bcf3-729730c994e1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:28.332224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e37aa4b1-398c-434e-af51-4f710d23a5b8 req-86475d03-4f17-4cbd-873c-0ba10cc0af0a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.333900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e37aa4b1-398c-434e-af51-4f710d23a5b8 req-86475d03-4f17-4cbd-873c-0ba10cc0af0a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.335975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e37aa4b1-398c-434e-af51-4f710d23a5b8 req-86475d03-4f17-4cbd-873c-0ba10cc0af0a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.385005 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e37aa4b1-398c-434e-af51-4f710d23a5b8 req-86475d03-4f17-4cbd-873c-0ba10cc0af0a service nova] Creating event network-vif-plugged:e5ac2864-da7e-406b-bcf3-729730c994e1 for instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 on n-h1-836830-13 Aug 29 15:57:28.399717 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e37aa4b1-398c-434e-af51-4f710d23a5b8 req-86475d03-4f17-4cbd-873c-0ba10cc0af0a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110774 Aug 29 15:57:28.402959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2209/4382] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:28.579520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:28.580493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:28.600137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.602430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.603150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:28.604614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:28.605098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:28.605556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.348310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:29.362616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2cb81ba-89c8-4cee-b84a-86fa75b65443 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 0.788324 Aug 29 15:57:29.367396 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2210/4383] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:28 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:29.374864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:29.375506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:29.386442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.386945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.387410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.388184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.388653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.389061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.649380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:29.672978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17205e27-6c29-4427-9e52-e4fc4daed80e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 1.599106 Aug 29 15:57:29.674014 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2174/4384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:28 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:29.685436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:29.689662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:29.720025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.721803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.726487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:29.728140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:29.733627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:29.735096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.046226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.079966 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3efac5b-8feb-42ac-8dec-6d54d22b2b91 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.705604 Aug 29 15:57:30.080674 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2211/4385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:29 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:30.125632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:30.129371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:30.182305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:30.186097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:30.186833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.193957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:30.196122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:30.199689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.398381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.431647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.433137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:30.434354 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75ec2fc8-e321-4340-8b1d-e8d066fd44e6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1592 microversion: 2.32 time: 0.348394 Aug 29 15:57:30.447689 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2212/4386] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:30 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1592 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:30.457715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:30.468432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:30.481665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:30.491328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:30.492986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.496296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:30.498971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:30.499684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:30.756590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:30.803803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:31.144494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.160325 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd862296-756c-4193-ba77-e78adf533d38 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 1.484934 Aug 29 15:57:31.163090 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2175/4387] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:29 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:31.174916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-20438dae-f98e-4901-bfbf-bde348acf4c5 req-b4fc62b1-2f05-4e08-8b33-5d1d11d859ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feeb1ea1-65d9-4a46-93e4-298b1a4a4406", "name": "network-vif-plugged", "status": "completed", "tag": "0cd9b44c-8cfe-44c1-b8ca-c71560a475b1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:31.202592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-20438dae-f98e-4901-bfbf-bde348acf4c5 req-b4fc62b1-2f05-4e08-8b33-5d1d11d859ff service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.205717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-20438dae-f98e-4901-bfbf-bde348acf4c5 req-b4fc62b1-2f05-4e08-8b33-5d1d11d859ff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.206508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-20438dae-f98e-4901-bfbf-bde348acf4c5 req-b4fc62b1-2f05-4e08-8b33-5d1d11d859ff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.239860 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-20438dae-f98e-4901-bfbf-bde348acf4c5 req-b4fc62b1-2f05-4e08-8b33-5d1d11d859ff service nova] Creating event network-vif-plugged:0cd9b44c-8cfe-44c1-b8ca-c71560a475b1 for instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 on n-h1-836830-13 Aug 29 15:57:31.252668 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-20438dae-f98e-4901-bfbf-bde348acf4c5 req-b4fc62b1-2f05-4e08-8b33-5d1d11d859ff service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087780 Aug 29 15:57:31.257908 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2176/4388] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:31.288422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:31.291144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.291674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:31.303207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:31.306824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.307751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.308485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.310401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.311464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.312612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.328801 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb51d3b5-591e-43b5-8390-452cfae65626 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1318 microversion: 2.1 time: 0.879865 Aug 29 15:57:31.344647 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2213/4389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:30 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:31.369102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:31.381440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:31.410195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.410855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.412891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.414118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.414118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.414118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.717466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.729115 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b55d720a-ffad-4d2e-af28-00fa02c7b01e tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.382457 Aug 29 15:57:31.733704 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2214/4390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:31 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:31.758033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:31.759951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:31.770168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.778604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.781813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.782711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:31.785527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:31.785981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:31.846528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:31.954207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.976326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.978223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:31.979518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a25bce76-7296-4911-983d-a6782139dfc2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1592 microversion: 2.32 time: 0.230088 Aug 29 15:57:31.984102 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2215/4391] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:31 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1592 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:32.187220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:32.188247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:32.200250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.201123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.201760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.202662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.203336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.203940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.211959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:32.230578 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99558387-58da-49df-9fab-513efc3fc8e4 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.954112 Aug 29 15:57:32.232609 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2177/4392] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:31 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:32.356458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:32.357208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:32.376576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.377068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.385655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.389378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.389998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.391719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.490970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:32.504744 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9016df96-a3c1-446b-b3ba-8349b5aff29d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.321988 Aug 29 15:57:32.507427 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2216/4393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:32 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:32.756924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:32.757455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:32.780818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.781369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.782714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:32.787914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:32.787914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:32.788260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.113792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.126626 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17e8f559-6a91-4c7d-bc23-e267cd21ba37 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1362 microversion: 2.1 time: 0.376163 Aug 29 15:57:33.141087 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2217/4394] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:32 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:33.149539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:33.150120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.152027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:33.160132 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e657eda6-ebfe-402a-82c2-ab348258e748 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1507 microversion: 2.1 time: 0.807857 Aug 29 15:57:33.163146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.163751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.164192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.165084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.165568 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2178/4395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:32 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1507 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:33.165700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.166142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.191175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:33.192181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:33.201300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.202296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.202988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.204227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.206013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.206754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.409724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.420391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.427945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.429491 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-43071b6e-a387-4bf1-a599-96e01fc50829 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1660 microversion: 2.32 time: 0.286686 Aug 29 15:57:33.446930 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2218/4396] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:33 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1660 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:33.446930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:33.446930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:33.446930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.446930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.446930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.446930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.453911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.457546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.843289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.873725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ecb88c3-224b-4853-a929-5b0a57c726f5 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.440230 Aug 29 15:57:33.874836 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2219/4397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:33 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:33.894126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:33.897269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:33.897416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:33.914998 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5aa750f5-c34a-4132-b40d-e5a4f8a55785 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1507 microversion: 2.1 time: 0.728786 Aug 29 15:57:33.916035 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2179/4398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:33 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1507 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:33.927918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.928651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.929260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.932018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:33.932018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:33.932018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:33.964942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:33.972853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:33.999929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.000428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.000868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.012090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.012742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.013196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.497410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:34.519301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:34.524084 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b13c4618-ee31-4183-b3c0-ee2b205acd6d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.646846 Aug 29 15:57:34.529041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2220/4399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:33 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:34.538093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e871761e-98e0-48ea-95dd-0253a4782596 req-fa652bf1-c9a9-4a44-96f0-e16bf635494a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7b492f-2974-4873-98c0-0425fce2aeb1", "tag": "2a30f220-ec72-4c4b-a016-4ce7eee826ed"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:34.556421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e871761e-98e0-48ea-95dd-0253a4782596 req-fa652bf1-c9a9-4a44-96f0-e16bf635494a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.557215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e871761e-98e0-48ea-95dd-0253a4782596 req-fa652bf1-c9a9-4a44-96f0-e16bf635494a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.558111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e871761e-98e0-48ea-95dd-0253a4782596 req-fa652bf1-c9a9-4a44-96f0-e16bf635494a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.574485 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e871761e-98e0-48ea-95dd-0253a4782596 req-fa652bf1-c9a9-4a44-96f0-e16bf635494a service nova] Creating event network-changed:2a30f220-ec72-4c4b-a016-4ce7eee826ed for instance bd7b492f-2974-4873-98c0-0425fce2aeb1 on n-h2-836830-13 Aug 29 15:57:34.590138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e871761e-98e0-48ea-95dd-0253a4782596 req-fa652bf1-c9a9-4a44-96f0-e16bf635494a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058187 Aug 29 15:57:34.590761 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2221/4400] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:34.608758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:34.613548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:34.625792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.627648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.632484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.634368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:34.636305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:34.637149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:34.981084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:35.012895 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b3eb71d-3899-40c9-b2de-c224c4029aeb tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1548 microversion: 2.1 time: 0.415366 Aug 29 15:57:35.020467 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2222/4401] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:34 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1548 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:35.046914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.049141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.070883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.072185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.075167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.075942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.076422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.076862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.931369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:35.952326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:35.955406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:35.958319 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f80aeb1c-8d9c-46d8-b460-7a4e6c1ec481 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1660 microversion: 2.32 time: 0.933971 Aug 29 15:57:35.978985 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2223/4402] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1660 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:35.986761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:35.987530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:35.996113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.997203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:35.997868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:35.998899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:35.999992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.000712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.256376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:36.272677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91e2bc04-b0b4-423f-a9c9-aab8f3e73af0 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.291042 Aug 29 15:57:36.275316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2224/4403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:35 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:36.293372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.294746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.299930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:57:36.302310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:57:36.304462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:57:36.304894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:57:36.305321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:57:36.306317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.307184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.307847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.310304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.313438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.316362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.397009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:36.481552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.500694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4f82525-f320-48c9-a514-5f89a2d16730 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223952 Aug 29 15:57:36.501998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2225/4404] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:57:36 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:36.514496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.515284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.519438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.520065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.527396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.527940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.528429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.528877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.532655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.535407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.537279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.540087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.542081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.545219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.616841 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4739423-19d0-44a9-bf73-4d6e2e508d6e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "POST /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79/action" status: 202 len: 1109 microversion: 2.1 time: 2.679329 Aug 29 15:57:36.632104 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2180/4405] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:33 2022] POST /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79/action => generated 1109 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:57:36.649097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:36.653792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:36.671277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.672376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.675133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:36.678240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:36.679507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:36.680202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:37.038973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:37.051089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-06939bd2-7a90-40cc-a037-70b94dfb059b tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.544071 Aug 29 15:57:37.052281 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2226/4406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:36 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:37.066554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:37.071342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:37.095874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:37.097992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:37.098811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:37.102757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:37.103464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:37.104092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:37.457572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:37.480147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:37.481715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:37.483016 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e542da1-2191-486b-9fd3-d7e8c1d820c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1707 microversion: 2.32 time: 0.429812 Aug 29 15:57:37.483627 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2227/4407] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:37 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1707 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:37.509421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:37.526028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:37.533831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:37.534335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:37.534777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:37.535523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:37.535986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:37.536458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:37.825477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:37.835015 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd8eaf3f-457a-4708-ad77-cbdf2b39a497 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.330018 Aug 29 15:57:37.839181 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2228/4408] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:37 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:37.934758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:37.952386 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cbf74c35-0909-4d7d-af90-ec30315f704e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 1.313665 Aug 29 15:57:37.956076 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2181/4409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:36 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:38.077609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:38.079055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:38.107769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:38.110475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:38.110857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.113387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:38.116844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:38.117321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.424722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:38.509293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-176f1d33-f319-4a55-bdc9-52078531d280 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.439553 Aug 29 15:57:38.514952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:38.515782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:38.526115 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2229/4410] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:38 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:38.526755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:38.528606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:38.530331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:38.530775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.531703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:38.532313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:38.532887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.858728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:38.859632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:38.871262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:38.871966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:38.872515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.873342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:38.877783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:38.878366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:38.973081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:38.990271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:38.992784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:38.995475 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1952a8c-a8e1-4a60-af2a-b5364b85ffdc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1707 microversion: 2.32 time: 0.486880 Aug 29 15:57:39.008941 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2182/4411] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:38 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1707 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:39.022184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:39.023472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:39.035567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.036315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.036977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.037887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.038519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.041059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.271704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:39.288544 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42b42f7d-2cfc-479c-a453-2cee5fdc970f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.429032 Aug 29 15:57:39.289521 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2230/4412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:38 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:39.514008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-29ae5f2c-9fb6-4bdc-814e-f07db32046a4 req-5470cc4b-ecf6-4ca1-8b4d-c0f4a8bf19ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feeb1ea1-65d9-4a46-93e4-298b1a4a4406", "tag": "0cd9b44c-8cfe-44c1-b8ca-c71560a475b1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:39.536986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-29ae5f2c-9fb6-4bdc-814e-f07db32046a4 req-5470cc4b-ecf6-4ca1-8b4d-c0f4a8bf19ef service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.537806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-29ae5f2c-9fb6-4bdc-814e-f07db32046a4 req-5470cc4b-ecf6-4ca1-8b4d-c0f4a8bf19ef service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.538392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-29ae5f2c-9fb6-4bdc-814e-f07db32046a4 req-5470cc4b-ecf6-4ca1-8b4d-c0f4a8bf19ef service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.554377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:39.568633 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-29ae5f2c-9fb6-4bdc-814e-f07db32046a4 req-5470cc4b-ecf6-4ca1-8b4d-c0f4a8bf19ef service nova] Creating event network-changed:0cd9b44c-8cfe-44c1-b8ca-c71560a475b1 for instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 on n-h1-836830-13 Aug 29 15:57:39.576161 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07efba8f-bd22-49b2-be67-7f8a8b806aed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.565495 Aug 29 15:57:39.579914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-29ae5f2c-9fb6-4bdc-814e-f07db32046a4 req-5470cc4b-ecf6-4ca1-8b4d-c0f4a8bf19ef service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288825 Aug 29 15:57:39.581026 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2231/4413] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:39.590321 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2183/4414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:39 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:39.592727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:39.596995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:39.619424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.619928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.620370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.621081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:39.621588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:39.622016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:39.688727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:39.950162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:39.962595 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0881144b-ea6d-4c7c-8bbb-04aeefe8c3d0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.378788 Aug 29 15:57:39.963232 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2232/4415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:39 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:40.023498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:40.024890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:40.039048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.043434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.044012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.045291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.047899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.048485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.312624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:40.313604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:40.337240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.337753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.338201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.342820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.343541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.344393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.679761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:40.690427 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-332a02ac-03d0-4255-bd17-03f652f48245 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.382381 Aug 29 15:57:40.691063 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2233/4416] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:40 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:40.707323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:40.708327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:40.731743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.732417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.733067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:40.734107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:40.734748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:40.735366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:41.030743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:41.072015 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f78d7582-c2b2-4d29-af44-e255d730e730 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.377859 Aug 29 15:57:41.088760 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2234/4417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:40 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:41.098149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:41.101029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:41.110908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:41.112449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:41.113473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:41.118369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:41.119385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:41.120813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:41.224193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:41.251385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:41.253229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:41.260147 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d2e5bd54-805d-4f28-9f8d-206fb4852951 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1754 microversion: 2.32 time: 1.238804 Aug 29 15:57:41.261635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2184/4418] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:40 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1754 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:41.403918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:41.425233 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e925a1a-1c4e-4a80-8e63-b58e1541e728 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.334658 Aug 29 15:57:41.426568 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2235/4419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:41 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:41.725173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:41.726953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:41.738492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:41.740015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:41.740843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:41.742028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:41.743190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:41.744251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:42.096276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:42.097378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:42.113170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:42.113977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:42.115404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:42.116585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:42.117305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:42.117932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:42.418207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:42.434928 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3df88c7b-24e0-4c09-8577-19733acdd9b9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.342167 Aug 29 15:57:42.436443 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2236/4420] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:42 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:42.440616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:42.447856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:42.464876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:42.465559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:42.466005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:42.466715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:42.467218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:42.467648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:42.918483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:42.949235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:42.956802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:42.968218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-992f7b15-1882-44c8-ba68-2b05ad71b4ee tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1754 microversion: 2.32 time: 0.528522 Aug 29 15:57:42.971467 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2237/4421] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:42 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1754 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:42.995173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:42.997595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:43.029143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:43.034566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:43.042336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:43.044696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:43.047924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:43.054655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:43.639719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:43.644834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:43.654660 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4fc01de4-44ce-4f87-8662-26d8afbac641 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.679134 Aug 29 15:57:43.660335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42af7bef-2472-4ef8-9cb0-8a4376e1d980 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 1.943979 Aug 29 15:57:43.665717 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2238/4422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:42 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:43.674666 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2185/4423] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:41 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:43.677196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:43.679780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:43.711321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:43.717315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:43.718000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:43.719015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:43.719663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:43.720320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:44.000707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:44.001352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:44.019396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:44.023839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:44.024657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:44.025704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:44.026511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:44.027576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:44.255561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:44.266582 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2852b195-3155-4eee-97ec-72ebdb74af09 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.594326 Aug 29 15:57:44.268010 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2239/4424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:43 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:44.449108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:44.466044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:44.472544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:44.475100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5041b2ae-700d-4d39-b7b5-310b857ba876 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1754 microversion: 2.32 time: 0.478420 Aug 29 15:57:44.488226 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2186/4425] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:43 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1754 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:44.683443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:44.684663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:44.686615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:44.687359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:44.709518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:44.710024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:44.710250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:44.710448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:44.715796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:44.716481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:44.724148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:44.725075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:44.725822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:44.726142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:44.729472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:44.733049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:45.231388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:45.247071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d38fe5f3-1166-4f7e-9246-436ef164e3b2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.569058 Aug 29 15:57:45.264150 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2240/4426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:44 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:45.270296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-28b15dcb-0d45-4125-8a07-71c1907b0c52 req-aeccd596-d990-40a1-b456-2047a4554efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f04d40-f4f7-49ad-9050-13106f86cf10", "name": "network-vif-plugged", "status": "completed", "tag": "6ca55786-29ad-4318-99af-5022019c67a1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:45.296316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-28b15dcb-0d45-4125-8a07-71c1907b0c52 req-aeccd596-d990-40a1-b456-2047a4554efd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:45.301326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-28b15dcb-0d45-4125-8a07-71c1907b0c52 req-aeccd596-d990-40a1-b456-2047a4554efd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:45.302644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-28b15dcb-0d45-4125-8a07-71c1907b0c52 req-aeccd596-d990-40a1-b456-2047a4554efd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:45.326434 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-28b15dcb-0d45-4125-8a07-71c1907b0c52 req-aeccd596-d990-40a1-b456-2047a4554efd service nova] Creating event network-vif-plugged:6ca55786-29ad-4318-99af-5022019c67a1 for instance 32f04d40-f4f7-49ad-9050-13106f86cf10 on n-h2-836830-13 Aug 29 15:57:45.340736 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-28b15dcb-0d45-4125-8a07-71c1907b0c52 req-aeccd596-d990-40a1-b456-2047a4554efd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074199 Aug 29 15:57:45.347156 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2241/4427] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:45.361345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:45.363283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:45.375925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:45.378674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:45.379487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:45.382994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:45.383750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:45.384420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:46.141007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:46.154573 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac89f821-95e7-47bf-b2fb-5fcb43baaf54 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 1.472398 Aug 29 15:57:46.155964 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2187/4428] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:44 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:46.161973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:46.168468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:46.194741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:46.195794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:46.196726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:46.197734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:46.198608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:46.199533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:46.229138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:46.238022 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-646109b9-b828-4af5-a12f-54466c836d89 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.889222 Aug 29 15:57:46.241280 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2242/4429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:45 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:46.273768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:46.274836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:46.285611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:46.288722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:46.290108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:46.291513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:46.293159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:46.294449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:46.585476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:46.601451 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-86fed433-89e1-462c-91e4-760c0512c154 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.331972 Aug 29 15:57:46.602791 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2243/4430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:46 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:46.646359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:46.668913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:46.683449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:46.687383 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d713da89-9db6-4664-8565-6b509da3580d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1801 microversion: 2.32 time: 0.529919 Aug 29 15:57:46.692991 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2188/4431] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:46 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1801 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:47.181516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:47.182203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:47.195767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.196262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.196699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.197407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.197859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.203624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.263800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:47.266261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:47.282440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.283455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.283995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.285273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.285749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.286711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.491543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:47.503709 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-386a0e41-7404-437c-96ca-03b933b4423a tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.326471 Aug 29 15:57:47.515942 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2244/4432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:47 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:47.558482 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 15:57:47.559492 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 15:57:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 (ip 10.222.0.83) !!! Aug 29 15:57:47.628266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:47.629201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:47.648600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.649201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.649753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.650763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.651332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.651938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.686021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:47.705261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b39d0928-7ec0-415f-bba8-e9a27065fdfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.447128 Aug 29 15:57:47.706030 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2189/4433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:47 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:47.722778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:47.723440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:47.757419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.757928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.758375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.759116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:47.763721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:47.764181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:47.865778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:47.876632 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-34afc90e-4bcf-41a4-b91f-91f1dbdffe47 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.252195 Aug 29 15:57:47.877677 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2245/4434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:47 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:48.154642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:48.167506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:48.169199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:48.171217 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-513dc2b5-46b0-4011-b2d7-5580ca8f3cc6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1801 microversion: 2.32 time: 0.452434 Aug 29 15:57:48.183627 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2190/4435] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:47 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1801 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:48.527682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:48.528974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:48.539129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:48.540468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:48.541534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:48.542431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:48.543131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:48.544103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:48.730899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:48.731551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:48.750922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:48.752503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:48.753604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:48.754624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:48.755324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:48.756482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:49.007870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:49.019930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4239615-7f33-4484-a75a-286b52feebba tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.295174 Aug 29 15:57:49.034409 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2191/4436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:48 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:49.034409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:49.034409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:49.034409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:49.035617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:49.036093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:49.041692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:49.042200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:49.042688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:49.056264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:49.064964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78821ef4-4510-4997-8c4d-d6477ace7da3 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.542139 Aug 29 15:57:49.065869 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2246/4437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:48 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:49.196635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:49.198134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:49.209355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:49.214143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:49.215444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:49.216637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:49.217211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:49.217743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:49.329031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:49.342985 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f993259-9b4e-4e35-a3d7-332e8571f2f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.320323 Aug 29 15:57:49.346647 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2192/4438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:49 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:49.475075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:49.489069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:49.490551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:49.501006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ddb9b5d3-5d62-4a07-b998-d9dd60043736 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1801 microversion: 2.32 time: 0.306799 Aug 29 15:57:49.501634 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2247/4439] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:49 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1801 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:57:50.044442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:50.045142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:50.060664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.063929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.064522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:50.065822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.075826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.076800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:50.087698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:50.089311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:50.102539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.104369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.104751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:50.106947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.107457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.107897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:50.621811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:50.636674 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b3a5ead-e093-4bd7-a796-50fe59ab8406 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.553681 Aug 29 15:57:50.643186 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2248/4440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:50 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:50.650754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:50.662803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:50.686419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.687127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.688163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:50.693737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.695493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.697142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:50.775192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:50.799906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:50.816175 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b95ccc2-8d06-4d59-bc21-b44525ad437d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.777372 Aug 29 15:57:50.819548 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2193/4441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:50 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:50.825010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:50.830276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:50.843331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.843761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.844198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:50.845168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:50.852435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:50.853408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:51.264958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:51.289499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:51.297343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:51.307726 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-189ae8c7-cc0d-464a-8418-b63e21bf04c3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1848 microversion: 2.32 time: 0.485998 Aug 29 15:57:51.324179 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2194/4442] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:50 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1848 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:51.370949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:51.381167 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb79cdc3-6040-4f5a-9c04-9c20ef36225a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.736246 Aug 29 15:57:51.382108 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2249/4443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:50 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:51.667827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:51.668443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:51.680082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:51.680916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:51.681583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:51.682554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:51.683678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:51.684320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:51.840541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:51.841143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:51.847605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:51.848294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:51.849597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:51.850465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:51.851094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:51.851686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:52.024093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:52.032625 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f5edd22-f7ce-45ed-b47d-9a0ba309b829 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.372444 Aug 29 15:57:52.033534 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2195/4444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:51 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:52.113428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:52.122676 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d6e3653-289d-4ccf-b945-0a9490aaaf9d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.285931 Aug 29 15:57:52.132552 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2250/4445] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:51 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:52.333729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:52.334976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:52.343926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:52.344697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:52.345349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:52.346608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:52.347241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:52.347848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:52.367175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:52.404468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:52.409370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:52.434778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:52.435553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:52.436136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:52.437028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:52.444629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:52.445027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:52.637727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:52.655095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:52.661502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:52.662728 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c43cd571-9a95-4ab4-8314-8180a0e11862 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1848 microversion: 2.32 time: 0.333043 Aug 29 15:57:52.663638 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2196/4446] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:52 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1848 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:52.814958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:52.823359 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-85ae197c-dab9-455b-93c6-867bb6257ad3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1518 microversion: 2.1 time: 0.424179 Aug 29 15:57:52.824591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2251/4447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:52 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1518 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:53.057804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:53.058563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:53.066874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.068175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.068924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.069886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.070357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.070781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.144997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:53.146467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:53.153998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.154497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.154936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.155672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.156129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.156628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.308944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:53.317529 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-74031950-6a2f-49eb-9c38-b84cb613923a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1514 microversion: 2.1 time: 0.176402 Aug 29 15:57:53.318388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2252/4448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:53 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:53.373707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:53.382246 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-009272f3-19e3-426a-857d-a06e15e140ce tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.331064 Aug 29 15:57:53.383080 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2197/4449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:53 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:53.705211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:53.705211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:53.719403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:57:53.732070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.732741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.735577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.736418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.736963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.738562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.840381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-836af9c9-1fe8-425d-9747-361f8731c9ca req-e18a1490-af0f-40c5-84bf-ea8b0bb667b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "6c92279a-1770-4793-9992-4098b7bf25ac"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:53.868075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-836af9c9-1fe8-425d-9747-361f8731c9ca req-e18a1490-af0f-40c5-84bf-ea8b0bb667b1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.868564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-836af9c9-1fe8-425d-9747-361f8731c9ca req-e18a1490-af0f-40c5-84bf-ea8b0bb667b1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.872131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-836af9c9-1fe8-425d-9747-361f8731c9ca req-e18a1490-af0f-40c5-84bf-ea8b0bb667b1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.904598 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-836af9c9-1fe8-425d-9747-361f8731c9ca req-e18a1490-af0f-40c5-84bf-ea8b0bb667b1 service nova] Creating event network-changed:6c92279a-1770-4793-9992-4098b7bf25ac for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:57:53.921837 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-836af9c9-1fe8-425d-9747-361f8731c9ca req-e18a1490-af0f-40c5-84bf-ea8b0bb667b1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086224 Aug 29 15:57:53.925049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2198/4450] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:53.943711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:53.948962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:53.963441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.966454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.970304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:53.971413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:53.973138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:53.977678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:54.145005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:54.165738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:54.177213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:54.178905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c3998b9-82d8-4906-99d2-651f3aa2585b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1848 microversion: 2.32 time: 0.490199 Aug 29 15:57:54.179679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2253/4451] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:53 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1848 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:54.342210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:54.343741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:54.365429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:54.367306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:54.367931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:54.379533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:54.380884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:54.384625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:54.456922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:54.476181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-408dfb2f-a4ab-496f-be68-1fde29d4bb31 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.548285 Aug 29 15:57:54.477131 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2199/4452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:53 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:54.482444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:54.482949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:54.501361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:54.501875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:54.502311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:54.503974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:54.509431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:54.510064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:54.822640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:54.840861 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5ec1290-9e22-4185-8f0d-f83665597fd8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1520 microversion: 2.1 time: 0.504957 Aug 29 15:57:54.841782 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2254/4453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:54 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:57:54.847706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:54.849354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:54.856068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:54.856806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:54.857418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:54.859264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:54.859882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:54.860688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:55.083630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:55.099408 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-625b9e08-0691-4f7e-bdf0-9674a812f86c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.618660 Aug 29 15:57:55.104234 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2200/4454] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:54 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:55.111945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:55.125347 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b45156e-ed53-4dcf-99d6-b103d3e2202c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.282049 Aug 29 15:57:55.126429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2255/4455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:54 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:55.155150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:55.156035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:55.164002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:55.164796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:55.165434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:55.166322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:55.167766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:55.168383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:55.211404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:55.212590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:55.232842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:55.233704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:55.234542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:55.239941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:55.241151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:55.242106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:55.624469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:55.640475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:55.642344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:55.643828 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4331fc71-dd5a-498c-9dde-471440611a53 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1848 microversion: 2.32 time: 0.439208 Aug 29 15:57:55.663060 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2256/4456] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:55 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1848 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:55.869043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:55.869707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:55.879514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:55.880097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:55.880518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:55.884278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:55.887979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:55.892179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:56.162596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:56.174943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-841972ae-1a33-4fe8-b832-68874d43cbfa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1520 microversion: 2.1 time: 0.310096 Aug 29 15:57:56.176171 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2257/4457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:55 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:56.183170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b7301e5-9115-4150-ac7a-0eceeaaaaecb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: .version_select at 0x7f32ed111820>, body: {"keypair": {"name": "tempest-keypair-539308454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgURRnJnCwL97RS4FFE7je6t3SPmzs0+hIjgNZQwL5zT2lv6J4IqqNmzaCJcN2katjTYXLzOq5HxWM9K4wunwndETFItMhlv2AkVYxne3ZdR8ZaRBPq3KzntzXryd0+gA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:56.210935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3b7301e5-9115-4150-ac7a-0eceeaaaaecb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:57:56.223158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3b7301e5-9115-4150-ac7a-0eceeaaaaecb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:57:56.257893 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b7301e5-9115-4150-ac7a-0eceeaaaaecb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079801 Aug 29 15:57:56.258504 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2258/4458] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:57:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:56.268371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:56.268996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:56.277188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:56.278137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:56.278721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:56.279969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:56.281750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:56.282388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:56.440980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:56.451340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1172a5c1-a908-4d91-b1fd-16e109e86b62 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 1.299728 Aug 29 15:57:56.452615 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2201/4459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:55 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:56.475317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5588c371-7352-4205-9ad4-dee177a42b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:56.486613 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-5588c371-7352-4205-9ad4-dee177a42b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 1544dd1d-9a43-4378-a72d-117809317752 has no mapping to a cell. Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5588c371-7352-4205-9ad4-dee177a42b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/1544dd1d-9a43-4378-a72d-117809317752/action HTTP/1.1 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 15 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: {"os-stop": {}} Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 1544dd1d-9a43-4378-a72d-117809317752 has no mapping to a cell. Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1544dd1d-9a43-4378-a72d-117809317752', 'body': {'os-stop': {}}} Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 1544dd1d-9a43-4378-a72d-117809317752 has no mapping to a cell. Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:56.496271 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1544dd1d-9a43-4378-a72d-117809317752 has no mapping to a cell. Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1544dd1d-9a43-4378-a72d-117809317752 has no mapping to a cell. Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5588c371-7352-4205-9ad4-dee177a42b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 1544dd1d-9a43-4378-a72d-117809317752 has no mapping to a cell. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5588c371-7352-4205-9ad4-dee177a42b52 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/1544dd1d-9a43-4378-a72d-117809317752/action" status: 404 len: 117 microversion: 2.1 time: 0.028069 Aug 29 15:57:56.500609 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2202/4460] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:56 2022] POST /compute/v2.1/servers/1544dd1d-9a43-4378-a72d-117809317752/action => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:56.514139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:56.525265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:56.545676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:56.546256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:56.549272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:56.550208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:56.550695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:56.551364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:56.674547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:56.684168 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a40d0afa-2c33-4ac4-9d47-192fd3d65906 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 0.424315 Aug 29 15:57:56.693580 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2259/4461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:56 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:56.707694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:56.710291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:56.717675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:56.721610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:56.722285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:56.725607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:56.735567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:56.736212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:56.992520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:57.007360 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8e4b3b5-d3b3-4876-8062-aab9ed372f4f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.503290 Aug 29 15:57:57.008278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2203/4462] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:56 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:57.048884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:57.049705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:57.060365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.063641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.064326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:57.065943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.066650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.068686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:57.377896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:57.404678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:57.406120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:57.407350 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e7bb24d-c574-4930-9f13-e1bfb8f72990 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1869 microversion: 2.32 time: 0.712446 Aug 29 15:57:57.408322 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2260/4463] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:56 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1869 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:57.420472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d26eafa5-5e52-4c3d-afb3-8a2f4d5bb91b req-b0da0114-b97b-4ac9-b5a9-e56fedf831cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7b492f-2974-4873-98c0-0425fce2aeb1", "name": "network-vif-plugged", "status": "completed", "tag": "2a30f220-ec72-4c4b-a016-4ce7eee826ed"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:57.439923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d26eafa5-5e52-4c3d-afb3-8a2f4d5bb91b req-b0da0114-b97b-4ac9-b5a9-e56fedf831cd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.440404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d26eafa5-5e52-4c3d-afb3-8a2f4d5bb91b req-b0da0114-b97b-4ac9-b5a9-e56fedf831cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.456544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d26eafa5-5e52-4c3d-afb3-8a2f4d5bb91b req-b0da0114-b97b-4ac9-b5a9-e56fedf831cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:57.486536 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d26eafa5-5e52-4c3d-afb3-8a2f4d5bb91b req-b0da0114-b97b-4ac9-b5a9-e56fedf831cd service nova] Creating event network-vif-plugged:2a30f220-ec72-4c4b-a016-4ce7eee826ed for instance bd7b492f-2974-4873-98c0-0425fce2aeb1 on n-h2-836830-13 Aug 29 15:57:57.499240 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d26eafa5-5e52-4c3d-afb3-8a2f4d5bb91b req-b0da0114-b97b-4ac9-b5a9-e56fedf831cd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089150 Aug 29 15:57:57.500591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2261/4464] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:57.519065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:57.520374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:57.553410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.554045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.555307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:57.556037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.556499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.558078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:57.797681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:57.825962 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-604f9354-6e36-4e72-97e5-6ca8dfaaed8f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.780818 Aug 29 15:57:57.826471 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2204/4465] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:57 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:57.852486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5ec21e17-4b76-4f2e-b476-b66e8de65860 req-abedba09-57de-4bae-b869-2660bef8389e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "3da879d5-255a-43b9-89f5-e8743644a9d4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:57.876614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5ec21e17-4b76-4f2e-b476-b66e8de65860 req-abedba09-57de-4bae-b869-2660bef8389e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.883442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5ec21e17-4b76-4f2e-b476-b66e8de65860 req-abedba09-57de-4bae-b869-2660bef8389e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.884134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5ec21e17-4b76-4f2e-b476-b66e8de65860 req-abedba09-57de-4bae-b869-2660bef8389e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:57.910727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-5ec21e17-4b76-4f2e-b476-b66e8de65860 req-abedba09-57de-4bae-b869-2660bef8389e service nova] Creating event network-changed:3da879d5-255a-43b9-89f5-e8743644a9d4 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:57:57.932449 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5ec21e17-4b76-4f2e-b476-b66e8de65860 req-abedba09-57de-4bae-b869-2660bef8389e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088162 Aug 29 15:57:57.935792 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2205/4466] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:57.950531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:57.951860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:57.968310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.969120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.969783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:57.971911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:57.975273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:57.977544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:58.256684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:58.272685 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b69f1f2-f6ec-4be7-91a0-099c5f933d4a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1520 microversion: 2.1 time: 0.765384 Aug 29 15:57:58.276231 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2262/4467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:57 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1520 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:58.288167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c11baca-eb7f-4649-9d0f-a5aafd1ccbb3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:58.289158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c11baca-eb7f-4649-9d0f-a5aafd1ccbb3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 5433f7fa-ab99-42e5-9a8f-f5e27631cf6d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:58.312199 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-8c11baca-eb7f-4649-9d0f-a5aafd1ccbb3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 5433f7fa-ab99-42e5-9a8f-f5e27631cf6d could not be found. Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c11baca-eb7f-4649-9d0f-a5aafd1ccbb3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/5433f7fa-ab99-42e5-9a8f-f5e27631cf6d/action HTTP/1.1 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 15 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: {"suspend": {}} Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5433f7fa-ab99-42e5-9a8f-f5e27631cf6d could not be found. Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5433f7fa-ab99-42e5-9a8f-f5e27631cf6d', 'body': {'suspend': {}}} Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5433f7fa-ab99-42e5-9a8f-f5e27631cf6d could not be found. Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5433f7fa-ab99-42e5-9a8f-f5e27631cf6d could not be found. Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:57:58.316163 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:57:58.324282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:57:58.324282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:57:58.324282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5433f7fa-ab99-42e5-9a8f-f5e27631cf6d could not be found. Aug 29 15:57:58.324282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:57:58.324282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c11baca-eb7f-4649-9d0f-a5aafd1ccbb3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 5433f7fa-ab99-42e5-9a8f-f5e27631cf6d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:57:58.324282 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c11baca-eb7f-4649-9d0f-a5aafd1ccbb3 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/5433f7fa-ab99-42e5-9a8f-f5e27631cf6d/action" status: 404 len: 111 microversion: 2.1 time: 0.039836 Aug 29 15:57:58.324282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2263/4468] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:58 2022] POST /compute/v2.1/servers/5433f7fa-ab99-42e5-9a8f-f5e27631cf6d/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:57:58.331508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:58.331856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:58.354352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:58.354858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:58.355401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:58.359927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:58.362714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:58.363230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:58.899660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:58.917465 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da7cb0f8-c377-41a9-a129-2313417cc43c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.594211 Aug 29 15:57:58.918304 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2264/4469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:58 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:58.927289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:58.933392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:58.959241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:58.962098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:58.964556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:58.965563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:58.967574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:58.971769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:59.356234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:59.400001 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c332eb30-c203-44e8-9c01-d613159062c0 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1369 microversion: 2.1 time: 1.456638 Aug 29 15:57:59.401841 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2206/4470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:57 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1369 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:59.431173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:59.435519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:59.453621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:59.454647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:59.459887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:59.461738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:59.462407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:59.463121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:59.490206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:59.503264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:59.512941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:59.529222 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d55e588a-7eeb-44e9-ac0a-0a8a33942582 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1869 microversion: 2.32 time: 0.595161 Aug 29 15:57:59.531269 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2265/4471] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:57:58 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1869 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:57:59.537758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:57:59.538735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:57:59.556152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:59.560271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:59.561013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:59.562608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:59.564521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:59.565200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:59.789355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:59.799356 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-155e1fa5-b784-4cee-9f3e-8b2b56d04281 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1520 microversion: 2.1 time: 0.266638 Aug 29 15:57:59.816965 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2266/4472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:59 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:57:59.839233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9c561f55-1bb5-46f9-b669-bcc1d68a0882 req-fce498c6-bfd2-47a6-87a2-922827825fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb45ee9b-9f30-4555-be78-f8f6899b2d79", "name": "network-vif-unplugged", "status": "completed", "tag": "e5ac2864-da7e-406b-bcf3-729730c994e1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:57:59.852311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9c561f55-1bb5-46f9-b669-bcc1d68a0882 req-fce498c6-bfd2-47a6-87a2-922827825fa9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:57:59.852845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9c561f55-1bb5-46f9-b669-bcc1d68a0882 req-fce498c6-bfd2-47a6-87a2-922827825fa9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:57:59.853274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9c561f55-1bb5-46f9-b669-bcc1d68a0882 req-fce498c6-bfd2-47a6-87a2-922827825fa9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:57:59.871458 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9c561f55-1bb5-46f9-b669-bcc1d68a0882 req-fce498c6-bfd2-47a6-87a2-922827825fa9 service nova] Creating event network-vif-unplugged:e5ac2864-da7e-406b-bcf3-729730c994e1 for instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 on n-h1-836830-13 Aug 29 15:57:59.877089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9c561f55-1bb5-46f9-b669-bcc1d68a0882 req-fce498c6-bfd2-47a6-87a2-922827825fa9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057805 Aug 29 15:57:59.878409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2267/4473] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:57:59.961832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:57:59.972516 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0f8d1748-2ec8-4a33-8855-09f94a0f701c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.566754 Aug 29 15:57:59.973122 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2207/4474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:57:59 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:00.000782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:00.001833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:00.010099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.010654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.011209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.012623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.012947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.013475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.040950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lazy-loading 'flavor' on Instance uuid 32f04d40-f4f7-49ad-9050-13106f86cf10 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:00.111808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:00.134698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33b81846-2b2a-4326-a9b5-43bec0dd956d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 202 len: 0 microversion: 2.1 time: 0.138252 Aug 29 15:58:00.144647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:00.145900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:00.150727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2268/4475] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:57:59 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:58:00.154542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.155228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.155895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.156881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.157532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.158155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.374979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b72b66fe-b8d4-4e33-9aef-2ee01d855f93 req-dd334936-d109-480e-a91c-819b64127ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "3d8f7eec-7c7b-463a-aa32-edc8ac2a0179"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:00.389159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b72b66fe-b8d4-4e33-9aef-2ee01d855f93 req-dd334936-d109-480e-a91c-819b64127ed2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.389870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b72b66fe-b8d4-4e33-9aef-2ee01d855f93 req-dd334936-d109-480e-a91c-819b64127ed2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.390455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b72b66fe-b8d4-4e33-9aef-2ee01d855f93 req-dd334936-d109-480e-a91c-819b64127ed2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.425812 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b72b66fe-b8d4-4e33-9aef-2ee01d855f93 req-dd334936-d109-480e-a91c-819b64127ed2 service nova] Creating event network-changed:3d8f7eec-7c7b-463a-aa32-edc8ac2a0179 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:00.435251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b72b66fe-b8d4-4e33-9aef-2ee01d855f93 req-dd334936-d109-480e-a91c-819b64127ed2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066822 Aug 29 15:58:00.436533 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2269/4476] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:00.454467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:00.455467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:00.466582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.467403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.469022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.470967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.472567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.474135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.653517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:00.663693 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8e140b8-e233-4d7c-8586-6a7ca6379168 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1513 microversion: 2.1 time: 0.523329 Aug 29 15:58:00.672718 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2208/4477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:00 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1513 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:00.679284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:00.679913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:00.698927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.699554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.700046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.700770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.701232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.701664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.856115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:00.867807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e15c74a-4870-4820-aa2a-ed6e24d35372 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1555 microversion: 2.1 time: 0.420071 Aug 29 15:58:00.875662 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2270/4478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:00 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1555 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:00.889600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:00.890329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:00.916712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.916712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.917122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:00.917773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:00.918224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:00.918649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:01.180584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:01.198462 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f4105c20-e82a-494f-a864-b30be272c96c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1520 microversion: 2.1 time: 0.321477 Aug 29 15:58:01.199102 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2271/4479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:00 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:01.215325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:01.215835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:01.224063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:01.224777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:01.225668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:01.225931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:01.226395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:01.226821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:01.339480 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c67898b5-ac58-4750-a687-923fcad11fab tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139360 Aug 29 15:58:01.340394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2272/4480] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:58:01 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:01.710874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:01.711717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:01.722113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:01.723082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:01.724061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:01.725387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:01.726427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:01.727920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:01.754709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:01.784526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:01.786069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:01.787688 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0cabb14a-2ad6-453f-9263-889a4aaffbbe tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1890 microversion: 2.32 time: 1.114154 Aug 29 15:58:01.788425 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2209/4481] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:00 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1890 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:01.900537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ce549747-94ed-4493-9d26-59fee9006e0c req-a64c811e-fecd-4990-9c0a-a36f8eaacf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb45ee9b-9f30-4555-be78-f8f6899b2d79", "name": "network-vif-plugged", "status": "completed", "tag": "e5ac2864-da7e-406b-bcf3-729730c994e1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:01.919081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ce549747-94ed-4493-9d26-59fee9006e0c req-a64c811e-fecd-4990-9c0a-a36f8eaacf11 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:01.919538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ce549747-94ed-4493-9d26-59fee9006e0c req-a64c811e-fecd-4990-9c0a-a36f8eaacf11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:01.919980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ce549747-94ed-4493-9d26-59fee9006e0c req-a64c811e-fecd-4990-9c0a-a36f8eaacf11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:01.933842 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ce549747-94ed-4493-9d26-59fee9006e0c req-a64c811e-fecd-4990-9c0a-a36f8eaacf11 service nova] Creating event network-vif-plugged:e5ac2864-da7e-406b-bcf3-729730c994e1 for instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 on n-h1-836830-13 Aug 29 15:58:01.939468 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ce549747-94ed-4493-9d26-59fee9006e0c req-a64c811e-fecd-4990-9c0a-a36f8eaacf11 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042682 Aug 29 15:58:01.940266 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2210/4482] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:02.221693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:02.223630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:02.239684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:02.241501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:02.242197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:02.243175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:02.244031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:02.244815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:02.502108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:02.513784 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bda260aa-4ae8-48a2-99b6-997f96f916c0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1520 microversion: 2.1 time: 0.297310 Aug 29 15:58:02.514380 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2211/4483] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:02 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:02.541632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1321634577", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d59f56-5b97-48d6-a59a-2e49bdfbf90b"}], "security_groups": [{"name": "tempest-securitygroup--1984647533"}], "key_name": "tempest-keypair-539308454", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:02.566403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:02.585988 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e6dbb5b-c7ab-42a1-8a45-95988027664c tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1496 microversion: 2.1 time: 0.886200 Aug 29 15:58:02.591072 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2273/4484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:01 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1496 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:02.611892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:02.613350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:02.632805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:02.634315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:02.636355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:02.637247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:02.638443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:02.642734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:02.760267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lazy-loading 'flavor' on Instance uuid 32f04d40-f4f7-49ad-9050-13106f86cf10 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:02.788806 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Cannot 'suspend' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state suspended Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action HTTP/1.1 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 15 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: {"suspend": {}} Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: exception: Cannot 'suspend' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state suspended Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'suspend': {}}} Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 29 15:58:02.795385 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state suspended Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state suspended Aug 29 15:58:02.799719 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:02.837040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 409 to user: Cannot 'suspend' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state suspended {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:02.842030 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b1ba7cfd-5426-46ae-8327-df175f468903 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 409 len: 148 microversion: 2.1 time: 0.232267 Aug 29 15:58:02.842700 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2274/4485] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:02 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 148 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:58:02.863945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] validate_networks() for [('e9d59f56-5b97-48d6-a59a-2e49bdfbf90b', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:58:02.873122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-30adf6f7-69d8-489c-b368-ccf8dee85c70 req-1e6763f6-3917-4126-96c0-f1b96664b8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "15a5e7af-4a04-480b-bdb6-6c17a8c86958"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:02.912585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-30adf6f7-69d8-489c-b368-ccf8dee85c70 req-1e6763f6-3917-4126-96c0-f1b96664b8d1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:02.913191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-30adf6f7-69d8-489c-b368-ccf8dee85c70 req-1e6763f6-3917-4126-96c0-f1b96664b8d1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:02.913639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-30adf6f7-69d8-489c-b368-ccf8dee85c70 req-1e6763f6-3917-4126-96c0-f1b96664b8d1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:02.943423 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-30adf6f7-69d8-489c-b368-ccf8dee85c70 req-1e6763f6-3917-4126-96c0-f1b96664b8d1 service nova] Creating event network-changed:15a5e7af-4a04-480b-bdb6-6c17a8c86958 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:02.955957 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-30adf6f7-69d8-489c-b368-ccf8dee85c70 req-1e6763f6-3917-4126-96c0-f1b96664b8d1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111772 Aug 29 15:58:02.956575 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2275/4486] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:02.977166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:02.978230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:02.999170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:02.999688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:03.002730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:03.004237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:03.005497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:03.019717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.132046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:04.142967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:04.145083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:04.147335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cccaa432-f114-4f00-a388-de8540d4614f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 1.188255 Aug 29 15:58:04.148923 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2276/4487] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:02 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:04.154659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:04.158029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:04.173072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.173899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.174521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.175423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.176057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.177340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.220966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:04.221629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:04.222119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:04.222533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:04.222946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:04.239562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.241918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.242395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.245742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.246262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.246713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.279813 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e371d858-5735-4199-916c-8c0eb9adbe46 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 202 len: 0 microversion: 2.1 time: 0.129012 Aug 29 15:58:04.281266 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2277/4488] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:04 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:58:04.287977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:04.290801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:04.291836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:04.294555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:04.301144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.302559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.303636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.305444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.306261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.307386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.322950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:58:04.325495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:58:04.410289 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-da18ef83-0a01-4fe5-afee-c87ae2ca9a04 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.874835 Aug 29 15:58:04.419586 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2212/4489] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:58:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:58:04.425785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:04.428662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:04.438306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.439112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.439791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.440911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.441908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.443721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:04.822929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:04.834098 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8fcd4dc-b326-413d-98f4-a856cee90fb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1505 microversion: 2.1 time: 0.551298 Aug 29 15:58:04.839166 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2278/4490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:04 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:04.850850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:04.855990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc02e4ec-882b-4cbf-a49f-5ed89246923e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:04.857001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc02e4ec-882b-4cbf-a49f-5ed89246923e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:04.882946 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2567d58d-c211-46e4-8951-29ad1e852818 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1502 microversion: 2.1 time: 0.462425 Aug 29 15:58:04.883626 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2213/4491] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:04 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1502 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:04.910346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c1144025-e526-4f51-8a67-b5e9d117d6a1 req-83ebbcce-aa92-4f10-a18d-def46cbfdea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd7b492f-2974-4873-98c0-0425fce2aeb1", "tag": "2a30f220-ec72-4c4b-a016-4ce7eee826ed"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:04.985652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c1144025-e526-4f51-8a67-b5e9d117d6a1 req-83ebbcce-aa92-4f10-a18d-def46cbfdea9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:04.986147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c1144025-e526-4f51-8a67-b5e9d117d6a1 req-83ebbcce-aa92-4f10-a18d-def46cbfdea9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:04.986585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c1144025-e526-4f51-8a67-b5e9d117d6a1 req-83ebbcce-aa92-4f10-a18d-def46cbfdea9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.018789 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c1144025-e526-4f51-8a67-b5e9d117d6a1 req-83ebbcce-aa92-4f10-a18d-def46cbfdea9 service nova] Creating event network-changed:2a30f220-ec72-4c4b-a016-4ce7eee826ed for instance bd7b492f-2974-4873-98c0-0425fce2aeb1 on n-h2-836830-13 Aug 29 15:58:05.029651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c1144025-e526-4f51-8a67-b5e9d117d6a1 req-83ebbcce-aa92-4f10-a18d-def46cbfdea9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138807 Aug 29 15:58:05.034572 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2214/4492] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:05.044322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc02e4ec-882b-4cbf-a49f-5ed89246923e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:05.054827 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc02e4ec-882b-4cbf-a49f-5ed89246923e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1241 microversion: 2.1 time: 0.212725 Aug 29 15:58:05.055466 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2279/4493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:04 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:05.065538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:05.068363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:05.071810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7a3cef7d-cdc1-43ce-889f-b2105795bd76 req-63721c40-57bc-4f91-82ee-f7c18837fd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "ef5a15c9-44d9-4991-94eb-d5af5728b051"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:05.099973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.100729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.106027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7a3cef7d-cdc1-43ce-889f-b2105795bd76 req-63721c40-57bc-4f91-82ee-f7c18837fd5c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.110337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.111309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.111982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.112567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.121695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7a3cef7d-cdc1-43ce-889f-b2105795bd76 req-63721c40-57bc-4f91-82ee-f7c18837fd5c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.122406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7a3cef7d-cdc1-43ce-889f-b2105795bd76 req-63721c40-57bc-4f91-82ee-f7c18837fd5c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.162858 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7a3cef7d-cdc1-43ce-889f-b2105795bd76 req-63721c40-57bc-4f91-82ee-f7c18837fd5c service nova] Creating event network-changed:ef5a15c9-44d9-4991-94eb-d5af5728b051 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:05.179469 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7a3cef7d-cdc1-43ce-889f-b2105795bd76 req-63721c40-57bc-4f91-82ee-f7c18837fd5c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118538 Aug 29 15:58:05.188059 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2280/4494] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:05.207365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:05.211390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:05.229198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.232576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.235704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.236491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.236987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.237388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.774205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:05.793324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:05.794787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:05.796042 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5191b42-5a9c-41f6-926b-87c81c3bb99b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.606654 Aug 29 15:58:05.796598 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2281/4495] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:05 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:05.867848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:05.878356 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-723ba00a-405b-4b6e-bed8-b22a5e8ce680 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 200 len: 1505 microversion: 2.1 time: 0.842408 Aug 29 15:58:05.887907 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2215/4496] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:05 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:05.912942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:05.913450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:05.918804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:05.919374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:05.928322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.928863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.929265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.929968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.930423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.930846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.937339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.943500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.944198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:05.945236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:05.947523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:05.948143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:06.027878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:58:06.082392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:06.196481 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9a05f47-e2d2-45d1-847e-685fb1d5afa4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "DELETE /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 204 len: 0 microversion: 2.1 time: 0.287520 Aug 29 15:58:06.197130 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2216/4497] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:05 2022] DELETE /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:58:06.206073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:06.206944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:06.247135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:06.247920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:06.248536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:06.249666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:06.251492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:06.259748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:06.394016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:06.405421 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed1d76bc-97f3-4088-aed2-8eb6d332c538 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1502 microversion: 2.1 time: 0.499640 Aug 29 15:58:06.423282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2282/4498] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:05 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1502 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:06.429362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-613516103", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "aca4efcc-32bf-4c7c-8bb1-34d4484e26bc"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:06.499474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] validate_networks() for [('aca4efcc-32bf-4c7c-8bb1-34d4484e26bc', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:58:06.779313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:06.796487 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b282dcf4-c57f-4717-b68b-bb635f70db40 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1293 microversion: 2.1 time: 0.598057 Aug 29 15:58:06.797772 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2217/4499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:06 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1293 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:06.826135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:06.829361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:06.844760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:06.845490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:06.846117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:06.848341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:06.851775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:06.852820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:07.299515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:07.318895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:07.321237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:07.323420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9624b338-0069-4517-93a1-8e998645d9da tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.500674 Aug 29 15:58:07.336856 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2218/4500] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:06 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:07.346047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-62a0f17d-e6a4-47d9-9f44-cf345ad5f480 req-6e33f45d-fda0-48a3-af3d-fc29e363f7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:07.363872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-62a0f17d-e6a4-47d9-9f44-cf345ad5f480 req-6e33f45d-fda0-48a3-af3d-fc29e363f7c9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:07.368192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-62a0f17d-e6a4-47d9-9f44-cf345ad5f480 req-6e33f45d-fda0-48a3-af3d-fc29e363f7c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:07.369263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-62a0f17d-e6a4-47d9-9f44-cf345ad5f480 req-6e33f45d-fda0-48a3-af3d-fc29e363f7c9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:07.385060 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-62a0f17d-e6a4-47d9-9f44-cf345ad5f480 req-6e33f45d-fda0-48a3-af3d-fc29e363f7c9 service nova] Creating event network-changed:eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:07.390325 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-62a0f17d-e6a4-47d9-9f44-cf345ad5f480 req-6e33f45d-fda0-48a3-af3d-fc29e363f7c9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052200 Aug 29 15:58:07.391283 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2219/4501] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:07.437801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:07.443833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:07.445781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:07.446240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:07.446827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:07.447434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:07.448002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:07.451358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:07.457813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:07.458387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:07.459320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:07.460045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:07.463828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:07.464833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:07.466390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:07.468025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:07.469459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:07.470123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:07.470839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:07.509210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Getting quotas for project d4283ccfd2a54553896677a670e675f9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:58:07.532645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Getting quotas for user 58ddd1273ce749e29578db36d61ca07a and project d4283ccfd2a54553896677a670e675f9. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:58:07.557228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:58:07.560817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:58:07.634908 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7d1d673-b22a-4dc0-8c51-2ea5f7eb08f4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210112 Aug 29 15:58:07.636640 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2283/4502] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:58:07.648705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c670eb21-5e72-4c3a-a611-f066c11800f7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:07.650487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c670eb21-5e72-4c3a-a611-f066c11800f7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:07.744843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c670eb21-5e72-4c3a-a611-f066c11800f7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:07.753213 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c670eb21-5e72-4c3a-a611-f066c11800f7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1217 microversion: 2.1 time: 0.110029 Aug 29 15:58:07.753805 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2284/4503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:07 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:07.825513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:07.826116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:07.836714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:07.837740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:07.838383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:07.839295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:07.839908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:07.840679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:08.001738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:08.013472 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7fd2b38-a1f3-40d4-97c2-12b35637d1c4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1299 microversion: 2.1 time: 0.193412 Aug 29 15:58:08.016534 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2285/4504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:07 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1299 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:08.350617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:08.351731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:08.367879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:08.370673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:08.371766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:08.373859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:08.376398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:08.376965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:08.588837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:08.608404 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-27e679dc-fec2-4ccc-954a-8d76a91b8de6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1502 microversion: 2.1 time: 1.181745 Aug 29 15:58:08.609574 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2220/4505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:07 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1502 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:08.777238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:08.778544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:08.780617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:08.790585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:08.791113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:08.795177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:08.795606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:08.796431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:08.796975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:08.797505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:08.815376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:08.817835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:08.820435 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4379f259-58f7-49d5-bbd4-ca50d07b2785 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.475556 Aug 29 15:58:08.821618 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2286/4506] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:08 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:08.995776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:09.004495 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f8dbc5aa-120f-43df-ba77-2a1ea74e7d96 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1269 microversion: 2.1 time: 0.231703 Aug 29 15:58:09.005366 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2221/4507] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:08 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:09.043794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:09.045435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:09.053686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:09.055195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:09.055195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:09.056172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:09.056861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:09.057299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:09.130847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:09.140472 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a1ee73d-a509-44e7-9eff-46323c805bc9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1299 microversion: 2.1 time: 0.100825 Aug 29 15:58:09.141207 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2287/4508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:09 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:09.630653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:09.631880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:09.639130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:09.639843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:09.640432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:09.641330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:09.641948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:09.642532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:09.846718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:09.848075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:09.856847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:09.857463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:09.858154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:09.859083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:09.859743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:09.860359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:09.877129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:10.143457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:10.160156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:10.165006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:10.173277 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-accd8342-a279-4e00-966f-c26f8f93e984 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.327277 Aug 29 15:58:10.187423 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2288/4509] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:09 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:10.193399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:10.194254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:10.198333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:10.203161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:10.203878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:10.204475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:10.205385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:10.206135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:10.206714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:10.309250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:10.327593 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6d94fdd-4661-44c5-b74d-fd764ea7e365 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1275 microversion: 2.1 time: 0.137984 Aug 29 15:58:10.328342 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2289/4510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:10 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:10.329799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:10.333787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:10.334421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:10.341698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:10.342285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:10.343273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:10.344188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:10.344774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:10.346054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:10.358893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d512d3f-60b0-44c4-a40c-7fa285c8fa94 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.732057 Aug 29 15:58:10.361765 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2222/4511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:09 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:10.374343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-acef6c2d-007b-4281-89c3-07426746f722 req-de6686f8-984f-4bb1-8e6a-71f252a62e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb45ee9b-9f30-4555-be78-f8f6899b2d79", "name": "network-vif-deleted", "tag": "e5ac2864-da7e-406b-bcf3-729730c994e1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:10.393541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-acef6c2d-007b-4281-89c3-07426746f722 req-de6686f8-984f-4bb1-8e6a-71f252a62e89 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:10.394293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-acef6c2d-007b-4281-89c3-07426746f722 req-de6686f8-984f-4bb1-8e6a-71f252a62e89 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:10.394970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-acef6c2d-007b-4281-89c3-07426746f722 req-de6686f8-984f-4bb1-8e6a-71f252a62e89 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:10.409968 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-acef6c2d-007b-4281-89c3-07426746f722 req-de6686f8-984f-4bb1-8e6a-71f252a62e89 service nova] Creating event network-vif-deleted:e5ac2864-da7e-406b-bcf3-729730c994e1 for instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 on n-h1-836830-13 Aug 29 15:58:10.416256 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-acef6c2d-007b-4281-89c3-07426746f722 req-de6686f8-984f-4bb1-8e6a-71f252a62e89 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048836 Aug 29 15:58:10.416968 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2223/4512] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:10.425348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:10.427744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:10.438095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:10.438797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:10.439461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:10.440936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:10.441376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:10.442051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:10.451419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:10.461710 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf001a7d-9733-45bd-86cd-051e59350266 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1299 microversion: 2.1 time: 0.132131 Aug 29 15:58:10.472034 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2290/4513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:10 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:11.005841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:11.017398 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cc35887-ffe3-4993-8744-c52e1f2a3780 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.598827 Aug 29 15:58:11.018364 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2224/4514] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:10 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:11.040513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad62e290-cedb-4c85-ad52-939fb1983c5d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:11.041407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad62e290-cedb-4c85-ad52-939fb1983c5d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 02a61485-8dab-4618-8218-5542aa4adb64] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:11.048732 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ad62e290-cedb-4c85-ad52-939fb1983c5d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 02a61485-8dab-4618-8218-5542aa4adb64 could not be found. Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad62e290-cedb-4c85-ad52-939fb1983c5d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/02a61485-8dab-4618-8218-5542aa4adb64/action HTTP/1.1 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 15 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: {"unpause": {}} Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 02a61485-8dab-4618-8218-5542aa4adb64 could not be found. Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '02a61485-8dab-4618-8218-5542aa4adb64', 'body': {'unpause': {}}} Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02a61485-8dab-4618-8218-5542aa4adb64 could not be found. Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02a61485-8dab-4618-8218-5542aa4adb64 could not be found. Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:11.050714 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:11.054750 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:11.054750 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:11.054750 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02a61485-8dab-4618-8218-5542aa4adb64 could not be found. Aug 29 15:58:11.054750 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:11.060708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad62e290-cedb-4c85-ad52-939fb1983c5d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 02a61485-8dab-4618-8218-5542aa4adb64 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:11.062080 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad62e290-cedb-4c85-ad52-939fb1983c5d tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/02a61485-8dab-4618-8218-5542aa4adb64/action" status: 404 len: 111 microversion: 2.1 time: 0.026136 Aug 29 15:58:11.063277 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2225/4515] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:11 2022] POST /compute/v2.1/servers/02a61485-8dab-4618-8218-5542aa4adb64/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:58:11.073178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:11.074671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:11.086268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.087200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.088550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.089508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.090899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.091635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.200531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:11.201105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:11.221217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.221729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.222225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.222957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.223552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.223979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.256725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a23f9cb-3f51-4f3f-bb00-6d5f8c7e966b tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/ips" status: 200 len: 146 microversion: 2.1 time: 0.363780 Aug 29 15:58:11.263342 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2291/4516] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:58:10 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/ips => generated 146 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:11.268601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:11.269610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:11.277263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.277944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.278893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.281392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.282051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.282816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.588868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:11.610426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:11.614479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:11.616112 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dd07fc60-d7f4-4418-bb8c-69e021747f92 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.351473 Aug 29 15:58:11.621545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2292/4517] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:11 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:11.634451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:11.638764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:11.651769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.653384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.653958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.654899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.657175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.657918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.810441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:11.855165 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3af652e2-a8ae-4a71-ba4a-bf75ad599fe9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1275 microversion: 2.1 time: 0.227589 Aug 29 15:58:11.856256 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2293/4518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:11 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:11.865269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:11.866237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:11.888295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.890767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.891326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:11.895251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:11.896390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:11.898385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.000487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:12.012020 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f02b9ee5-0093-4f69-a51f-dc06cf80a85e tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.943801 Aug 29 15:58:12.014945 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2226/4519] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:11 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:12.042811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:12.043718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:12.054552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.055404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.056240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.057219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.057874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.058441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.197053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:12.205592 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10b96dc9-92e2-44bc-a072-e1d9a20bfcec tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.347339 Aug 29 15:58:12.208100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2294/4520] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:11 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:12.445039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:12.455736 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9cdd93b-4225-4b1f-93f1-dfadf2cf65dd tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.420427 Aug 29 15:58:12.456933 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2227/4521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:12 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:12.469469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ff7b19b8-c988-4eb1-85da-07934d3bc447 req-31d87f42-f485-4130-952b-81e7db679f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "644b8c18-872f-4891-be77-ea6eb763455e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:12.477430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:12.478366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:12.485636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.485973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff7b19b8-c988-4eb1-85da-07934d3bc447 req-31d87f42-f485-4130-952b-81e7db679f13 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.486128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.486573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.486855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff7b19b8-c988-4eb1-85da-07934d3bc447 req-31d87f42-f485-4130-952b-81e7db679f13 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.487323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.487566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff7b19b8-c988-4eb1-85da-07934d3bc447 req-31d87f42-f485-4130-952b-81e7db679f13 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.488088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.488522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.504186 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ff7b19b8-c988-4eb1-85da-07934d3bc447 req-31d87f42-f485-4130-952b-81e7db679f13 service nova] Creating event network-changed:644b8c18-872f-4891-be77-ea6eb763455e for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:12.511810 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ff7b19b8-c988-4eb1-85da-07934d3bc447 req-31d87f42-f485-4130-952b-81e7db679f13 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046245 Aug 29 15:58:12.513710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2295/4522] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:12.516462 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Cannot 'unpause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action HTTP/1.1 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 15 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: {"unpause": {}} Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'unpause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'unpause': {}}} Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 in vm_state active. Cannot unpause while the instance is in this state. Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:12.518599 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:12.522986 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:12.522986 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:12.522986 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:12.522986 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:12.522986 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:12.522986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 409 to user: Cannot 'unpause' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:12.522986 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-adb6085e-a4ce-48ce-912c-6c6d65c77dff tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 409 len: 145 microversion: 2.1 time: 0.047569 Aug 29 15:58:12.525416 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2228/4523] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:12 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 15:58:12.530979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:12.531710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:12.538635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.539156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.539595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.540285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.540747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.541183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.644318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:12.644934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:12.659788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.660423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.661877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.662980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.663879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.664603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.705788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:12.716414 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0638ac3-3840-4a16-a307-bfbef73a938f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.189689 Aug 29 15:58:12.717748 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2296/4524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:12 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:12.745502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:12.746438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:12.753110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.753629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.754242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.755196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.755931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.756524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.939101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:12.949586 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-47736d4e-dc85-45e9-b92b-ceba55fd65bf tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.210488 Aug 29 15:58:12.950175 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2297/4525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:12 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:12.957132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:12.959513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:12.966120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.966749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.967424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:12.968244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:12.969126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:12.969657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.123479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:13.132293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d3fc99c-8c19-4f3e-87f5-996c8d10cbb2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.180802 Aug 29 15:58:13.133053 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2298/4526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:12 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:13.138542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-74db7835-f26f-427e-8fe7-006b4706a653 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:13.140114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-74db7835-f26f-427e-8fe7-006b4706a653 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: e4f38741-deb8-465a-adcc-8a0e778acc5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:13.146127 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-74db7835-f26f-427e-8fe7-006b4706a653 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance e4f38741-deb8-465a-adcc-8a0e778acc5c could not be found. Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-74db7835-f26f-427e-8fe7-006b4706a653 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/e4f38741-deb8-465a-adcc-8a0e778acc5c/action HTTP/1.1 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 18 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: {"unshelve": null} Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance e4f38741-deb8-465a-adcc-8a0e778acc5c could not be found. Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'e4f38741-deb8-465a-adcc-8a0e778acc5c', 'body': {'unshelve': None}} Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f38741-deb8-465a-adcc-8a0e778acc5c could not be found. Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f38741-deb8-465a-adcc-8a0e778acc5c could not be found. Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:13.149260 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f38741-deb8-465a-adcc-8a0e778acc5c could not be found. Aug 29 15:58:13.154295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:13.156567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-74db7835-f26f-427e-8fe7-006b4706a653 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance e4f38741-deb8-465a-adcc-8a0e778acc5c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:13.157583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-74db7835-f26f-427e-8fe7-006b4706a653 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/e4f38741-deb8-465a-adcc-8a0e778acc5c/action" status: 404 len: 111 microversion: 2.1 time: 0.023377 Aug 29 15:58:13.158237 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2299/4527] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:13 2022] POST /compute/v2.1/servers/e4f38741-deb8-465a-adcc-8a0e778acc5c/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:13.166839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:13.167601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:13.175672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.175859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.176205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.177556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.178011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.178450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.327705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:13.338504 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c432abd4-4d5c-41be-baff-d99d8843dc4a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.175551 Aug 29 15:58:13.340796 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2300/4528] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:13 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:13.347923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:13.349213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:13.358110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.358921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.359393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.361047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.361522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.362037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.440762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:13.452692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:13.454503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:13.455939 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38645b36-6048-40b8-9830-dde725741e07 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.816084 Aug 29 15:58:13.471660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2229/4529] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:12 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:13.478078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:13.479004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:13.485806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.486594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.487329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.488274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.489879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.490608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.614894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:13.633261 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8cac1b38-c39b-44ff-982b-d76af999ff92 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.290706 Aug 29 15:58:13.635596 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2301/4530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:13 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:13.860618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80c36521-aff0-4c9c-bf9d-237e306f4793"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:13.863433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:13.872617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.873297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.873900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:13.875178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:13.875807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:13.876217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.066186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:14.078298 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06233dc9-cf2d-4409-b64f-2f586f102551 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.605342 Aug 29 15:58:14.079169 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2230/4531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:13 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:14.117749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:14.118702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:14.125204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.126005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.126725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.127684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.128380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.129027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.168701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Cannot 'unshelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action HTTP/1.1 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 18 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: {"unshelve": null} Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'unshelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'unshelve': None}} Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 in vm_state active. Cannot unshelve while the instance is in this state. Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 15:58:14.170783 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active Aug 29 15:58:14.174568 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:14.178339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 409 to user: Cannot 'unshelve' instance 32f04d40-f4f7-49ad-9050-13106f86cf10 while it is in vm_state active {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:14.179541 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bb94c6c-9b68-43ef-ace2-6c8f2f79aca2 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action" status: 409 len: 146 microversion: 2.1 time: 0.084379 Aug 29 15:58:14.180721 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2231/4532] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:14 2022] POST /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10/action => generated 146 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 15:58:14.185698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:14.186608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:14.197245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.198094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.199631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.200561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.201252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.202019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.269798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:14.321451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:14.348255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8022639d-e224-4ffe-b961-9163d3718c77 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491669 Aug 29 15:58:14.350739 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2302/4533] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:58:13 2022] POST /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:14.357203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:14.358840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:14.367862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.368576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.369313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.370802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.371450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.372035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.626674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:14.636930 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7738f7f-0bd7-4612-8c11-7f3b2a2a4d73 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.284632 Aug 29 15:58:14.637674 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2303/4534] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:14 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:14.659736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:14.660360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:14.667692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.668430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.669071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.669777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.670420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.670854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.701228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:14.711176 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-385fc1c3-2bfb-4518-8fd6-0b8f4274327d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.529088 Aug 29 15:58:14.711764 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2232/4535] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:14 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:14.723289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:14.732078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:14.738514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.739399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.739909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:14.740894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:14.741531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:14.742179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.125299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:15.135506 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7bcf1ca2-0d2c-4064-91ec-75f07e6631c3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.415975 Aug 29 15:58:15.139237 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2233/4536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:14 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:15.150044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:15.151001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:15.170951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.171831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.172468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.173383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.174052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.174673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.235754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:15.252923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:15.254904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:15.256272 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c73c208-d5ba-450d-b55e-b3cec2332155 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.600954 Aug 29 15:58:15.261318 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2304/4537] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:14 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:15.272293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5417ac27-6a38-43f2-9d2c-3a3921505a49 req-30f9b5c7-491e-406c-8d5a-f1aade04bb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7124a92-4c7c-4c37-b7c8-82a9555d234c", "tag": "d70bd3be-78e1-46b6-a8f8-a77d018078a8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:15.297249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5417ac27-6a38-43f2-9d2c-3a3921505a49 req-30f9b5c7-491e-406c-8d5a-f1aade04bb10 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.297842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5417ac27-6a38-43f2-9d2c-3a3921505a49 req-30f9b5c7-491e-406c-8d5a-f1aade04bb10 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.300781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5417ac27-6a38-43f2-9d2c-3a3921505a49 req-30f9b5c7-491e-406c-8d5a-f1aade04bb10 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.322296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5417ac27-6a38-43f2-9d2c-3a3921505a49 req-30f9b5c7-491e-406c-8d5a-f1aade04bb10 service nova] Creating event network-changed:d70bd3be-78e1-46b6-a8f8-a77d018078a8 for instance e7124a92-4c7c-4c37-b7c8-82a9555d234c on n-h1-836830-13 Aug 29 15:58:15.334112 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5417ac27-6a38-43f2-9d2c-3a3921505a49 req-30f9b5c7-491e-406c-8d5a-f1aade04bb10 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069643 Aug 29 15:58:15.335825 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2305/4538] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:15.734207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:15.734901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:15.751595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.752082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.752514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.753215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:15.759437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:15.759889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:15.818660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:16.058541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.070651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a5834694-d62f-4d64-a0d3-5cd91be772fa tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.341308 Aug 29 15:58:16.072089 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2306/4539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:15 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:16.161895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:16.163483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:16.181816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:16.182743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:16.198569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:16.200122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:16.201446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:16.204379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:16.309857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.323618 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-90818e72-4436-42d3-9a92-dfbed1b2ede9 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 1.183110 Aug 29 15:58:16.324897 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2234/4540] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:15 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:16.330460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:16.336340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:16.353490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:16.354060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:16.354507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:16.355248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:16.355704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:16.356130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:16.381844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:16.449330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.458008 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f154024d-25c5-421a-8da0-ec5e69270fd7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.301848 Aug 29 15:58:16.458579 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2307/4541] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:16 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:16.465090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e170135-0bce-45e8-92f9-9342d6d683f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-240318255_updated"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:16.468379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e170135-0bce-45e8-92f9-9342d6d683f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 412cb7d1-d667-4283-92e1-5d984d840772] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:16.476227 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-1e170135-0bce-45e8-92f9-9342d6d683f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 412cb7d1-d667-4283-92e1-5d984d840772 could not be found. Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e170135-0bce-45e8-92f9-9342d6d683f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: request: PUT /compute/v2.1/servers/412cb7d1-d667-4283-92e1-5d984d840772 HTTP/1.1 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 80 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-240318255_updated"}} Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 412cb7d1-d667-4283-92e1-5d984d840772 could not be found. Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '412cb7d1-d667-4283-92e1-5d984d840772', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-240318255_updated'}}} Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412cb7d1-d667-4283-92e1-5d984d840772 could not be found. Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 15:58:16.478716 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412cb7d1-d667-4283-92e1-5d984d840772 could not be found. Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412cb7d1-d667-4283-92e1-5d984d840772 could not be found. Aug 29 15:58:16.483224 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:16.484505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e170135-0bce-45e8-92f9-9342d6d683f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 412cb7d1-d667-4283-92e1-5d984d840772 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:16.485389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e170135-0bce-45e8-92f9-9342d6d683f7 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "PUT /compute/v2.1/servers/412cb7d1-d667-4283-92e1-5d984d840772" status: 404 len: 111 microversion: 2.1 time: 0.025577 Aug 29 15:58:16.485992 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2308/4542] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 15:58:16 2022] PUT /compute/v2.1/servers/412cb7d1-d667-4283-92e1-5d984d840772 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:16.495183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:16.495810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:16.507207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:16.507973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:16.508578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:16.509501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:16.510141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:16.510729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:16.960153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.969876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.971348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:16.972567 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d447796-d54f-4a3e-bb52-246e0eac8b4d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.646491 Aug 29 15:58:16.987372 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2235/4543] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:16 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:17.092842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:17.093356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:17.110780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.111316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.111758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.112471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.113046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.113590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.170364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:17.185567 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-07cd3aae-f409-43cb-b9c3-0f3f88802a91 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.694093 Aug 29 15:58:17.186600 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2309/4544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:16 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:17.209480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:17.210102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:17.216557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.217080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.217472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.218340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.218953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.219609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.494755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:17.518749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:17.534090 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-487f22af-785a-4960-9d14-d0bf81a40fa6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.328321 Aug 29 15:58:17.550432 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2310/4545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:17 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:17.557334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:17.558829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:17.581504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.582141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.582591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.587722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.591064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.591930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.606143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:17.627547 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e52f9d99-2160-4d5f-b647-178a7f233f03 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.526324 Aug 29 15:58:17.628475 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2236/4546] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:17 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:17.633540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42ffea88-45a4-4c5a-ae41-7b1c8d5c9735 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42ffea88-45a4-4c5a-ae41-7b1c8d5c9735 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 HTTP/1.1 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 280 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:17.637586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 29 15:58:17.641546 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:17.645098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42ffea88-45a4-4c5a-ae41-7b1c8d5c9735 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:17.646655 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42ffea88-45a4-4c5a-ae41-7b1c8d5c9735 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "PUT /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 400 len: 619 microversion: 2.1 time: 0.017066 Aug 29 15:58:17.652933 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2237/4547] 10.222.0.83 () {60 vars in 1257 bytes} [Mon Aug 29 15:58:17 2022] PUT /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:58:17.658679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:17.672000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:17.680166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.683525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.684173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.685059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.687044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.690505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.753128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=14 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:17.861528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:17.877323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e74dbcf1-2315-44e3-af05-d93deb2b33bc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.334728 Aug 29 15:58:17.896134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2311/4548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:17 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:17.901478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-eede1136-19b9-4171-83d8-c282aa4fad56 req-33fc791b-5f29-43d7-b3c9-8aad7204be12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ef635f-cc6e-406f-ae79-d188a302b255", "tag": "81229daf-ef7b-4493-99ba-22c2cb37e17d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:17.916094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eede1136-19b9-4171-83d8-c282aa4fad56 req-33fc791b-5f29-43d7-b3c9-8aad7204be12 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:17.916828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eede1136-19b9-4171-83d8-c282aa4fad56 req-33fc791b-5f29-43d7-b3c9-8aad7204be12 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:17.917892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eede1136-19b9-4171-83d8-c282aa4fad56 req-33fc791b-5f29-43d7-b3c9-8aad7204be12 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:17.935242 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-eede1136-19b9-4171-83d8-c282aa4fad56 req-33fc791b-5f29-43d7-b3c9-8aad7204be12 service nova] Creating event network-changed:81229daf-ef7b-4493-99ba-22c2cb37e17d for instance 49ef635f-cc6e-406f-ae79-d188a302b255 on n-h2-836830-13 Aug 29 15:58:17.941032 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-eede1136-19b9-4171-83d8-c282aa4fad56 req-33fc791b-5f29-43d7-b3c9-8aad7204be12 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043228 Aug 29 15:58:17.942738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2312/4549] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:18.003931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:18.005685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:18.014844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.016281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.017427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.019122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.020880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.021559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.117188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:18.130397 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b7653da-2eea-4108-853d-9567208f6537 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.475919 Aug 29 15:58:18.131301 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2238/4550] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:17 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:18.155597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:18.156501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:18.164819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.165614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.166213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.167116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.167756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.168592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.306114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:18.323629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:18.325103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:18.326292 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18f8acea-4d12-4aa0-adac-b42263acf2ef tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.329258 Aug 29 15:58:18.327405 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2313/4551] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:17 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:18.652957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:18.653580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:18.668375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.668866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.669298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.670140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.670810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.671462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.738701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:18.755229 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c09da2d5-b24e-4300-8047-e8c3a48c6324 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.602882 Aug 29 15:58:18.756052 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2239/4552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:18 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:18.785334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9eca968b-9e15-4bae-b271-6a613131cbaa tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9eca968b-9e15-4bae-b271-6a613131cbaa tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 HTTP/1.1 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 24 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": ""}} Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10', 'body': {'server': {'name': ''}}} Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '' Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 15:58:18.793344 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 29 15:58:18.797347 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:58:18.802843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9eca968b-9e15-4bae-b271-6a613131cbaa tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:18.804298 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9eca968b-9e15-4bae-b271-6a613131cbaa tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "PUT /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 400 len: 108 microversion: 2.1 time: 0.029004 Aug 29 15:58:18.805116 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2240/4553] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 15:58:18 2022] PUT /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 15:58:18.822579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:18.829020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:18.844336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.845162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.846064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.847639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.849152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.850377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.869930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:18.883500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8188983b-8482-4fe7-9f9d-5d813ab165b4 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.237597 Aug 29 15:58:18.902898 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2314/4554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:18 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:18.916347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:18.921506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:18.933698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.934432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.935095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:18.936037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:18.936857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:18.938889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:19.126558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:19.139286 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa9ed5f3-cd3c-4396-bb69-ab44e3377d1d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.233524 Aug 29 15:58:19.143410 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2315/4555] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:18 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:19.201875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:19.216770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18f58015-fccb-4236-8301-c7dcaadaee1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1505 microversion: 2.1 time: 0.397228 Aug 29 15:58:19.217633 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2241/4556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:18 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:19.355006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:19.355640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:19.365214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:19.365708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:19.371000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:19.371971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:19.372967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:19.378911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:19.731209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:19.747440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:19.759364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:19.761088 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-007fb0cb-310c-4df7-8187-6f4aecd68361 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.409920 Aug 29 15:58:19.762040 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2316/4557] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:19 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:19.909658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:19.910187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:19.929042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:19.929859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:19.930458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:19.931657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:19.932270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:19.932851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:20.133113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:20.145618 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b6a6f2b-77f8-46b8-bd05-a76b7892803b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.237124 Aug 29 15:58:20.146956 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2242/4558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:19 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:20.160013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:20.160574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:20.168118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.170346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.170799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:20.171553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.172009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.172599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:20.440682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:20.451928 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-761d746c-d8e3-4d1b-9330-ea58ca5bfba0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.296219 Aug 29 15:58:20.452536 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2317/4559] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:20 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:20.789687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:20.790324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:20.806601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.807253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.807708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:20.808422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:20.808885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:20.809308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:21.167422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:21.168014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:21.188924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:21.189427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:21.189869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:21.190567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:21.191056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:21.202222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:21.294474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:21.315224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:21.322206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:21.323650 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a532007a-7cfa-4988-a682-78b595cdf6fd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.538586 Aug 29 15:58:21.330283 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2243/4560] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:20 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:21.480821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:21.481769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:21.495735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:21.500311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:21.501182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:21.505150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:21.511089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:21.511998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:22.081427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:22.092254 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d57524a3-a077-41e9-8773-d81b55a004bb tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.928575 Aug 29 15:58:22.108797 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2318/4561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:21 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:22.210284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:22.218731 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a2a5b38-dde0-415d-8ee8-10c1092b04f5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.741972 Aug 29 15:58:22.243982 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2244/4562] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:21 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:22.322056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6cfb7640-3afa-435e-8e5c-696eca37bc20 req-448d977f-55cc-4b0e-a9c9-819574f6a12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7124a92-4c7c-4c37-b7c8-82a9555d234c", "name": "network-vif-plugged", "status": "completed", "tag": "d70bd3be-78e1-46b6-a8f8-a77d018078a8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:22.346499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cfb7640-3afa-435e-8e5c-696eca37bc20 req-448d977f-55cc-4b0e-a9c9-819574f6a12e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:22.347451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cfb7640-3afa-435e-8e5c-696eca37bc20 req-448d977f-55cc-4b0e-a9c9-819574f6a12e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:22.348031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cfb7640-3afa-435e-8e5c-696eca37bc20 req-448d977f-55cc-4b0e-a9c9-819574f6a12e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:22.363730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:22.364866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:22.367311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6cfb7640-3afa-435e-8e5c-696eca37bc20 req-448d977f-55cc-4b0e-a9c9-819574f6a12e service nova] Creating event network-vif-plugged:d70bd3be-78e1-46b6-a8f8-a77d018078a8 for instance e7124a92-4c7c-4c37-b7c8-82a9555d234c on n-h1-836830-13 Aug 29 15:58:22.389593 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6cfb7640-3afa-435e-8e5c-696eca37bc20 req-448d977f-55cc-4b0e-a9c9-819574f6a12e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074991 Aug 29 15:58:22.390963 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2319/4563] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:22.392827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:22.393337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:22.393782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:22.394504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:22.394965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:22.401458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.119586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:23.120291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:23.136346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.136842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.137431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.138251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.138710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.139271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.382679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:23.392144 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8da50f84-6f0e-4a9b-a7b8-4a5e42e66e88 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.278079 Aug 29 15:58:23.393265 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2320/4564] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:23 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:23.399385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:23.400268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:23.407442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.408275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.409230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.410202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:23.411551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:23.412260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:23.573460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:23.594025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:23.596449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:23.597767 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec5ae171-d29a-4b5d-a23c-001c2b361906 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 1.238507 Aug 29 15:58:23.601119 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2245/4565] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:22 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:23.650196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:23.658359 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e2f17bc-7d0f-43d2-b8e0-aa3c56aa49cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1367 microversion: 2.1 time: 0.263822 Aug 29 15:58:23.659446 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2321/4566] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:23 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:24.417648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:24.418772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:24.438049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.440825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.441575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.445658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.448072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.449420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.627672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:24.629409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:24.652566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.655450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.656003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.657089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.662978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.663581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.737042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:24.753574 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c3ff15a2-b02c-4105-be49-e0b38bfbf799 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.342590 Aug 29 15:58:24.756684 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2246/4567] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:24 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:24.779267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:24.780207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:24.789534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.791011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.791685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.792605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:24.794159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:24.794762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:24.994772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:25.006191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec9c8cd1-740a-45a7-8a01-bb3db4815167 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1557 microversion: 2.1 time: 0.233837 Aug 29 15:58:25.025518 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2247/4568] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:24 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:25.036533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:25.037863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:25.049626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.053547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.059000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:25.059811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.060526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.061041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:25.131817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:25.160675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:25.163441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:25.180378 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-412dd3f9-6134-48f7-beca-4ee0cff2d208 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.558931 Aug 29 15:58:25.183628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2322/4569] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:24 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:25.238806 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa0fc5ea-d948-4720-b8c7-a02026922ecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210539 Aug 29 15:58:25.240336 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2248/4570] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:58:25 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:25.354166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-61c17e40-4efe-4698-9ad0-c3c7f738f238 req-7c4d1453-ba23-4f65-894e-006cc30fa39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ef635f-cc6e-406f-ae79-d188a302b255", "name": "network-vif-plugged", "status": "completed", "tag": "81229daf-ef7b-4493-99ba-22c2cb37e17d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:25.369556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-61c17e40-4efe-4698-9ad0-c3c7f738f238 req-7c4d1453-ba23-4f65-894e-006cc30fa39c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.370228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-61c17e40-4efe-4698-9ad0-c3c7f738f238 req-7c4d1453-ba23-4f65-894e-006cc30fa39c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.371223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-61c17e40-4efe-4698-9ad0-c3c7f738f238 req-7c4d1453-ba23-4f65-894e-006cc30fa39c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:25.387527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-61c17e40-4efe-4698-9ad0-c3c7f738f238 req-7c4d1453-ba23-4f65-894e-006cc30fa39c service nova] Creating event network-vif-plugged:81229daf-ef7b-4493-99ba-22c2cb37e17d for instance 49ef635f-cc6e-406f-ae79-d188a302b255 on n-h2-836830-13 Aug 29 15:58:25.398473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-61c17e40-4efe-4698-9ad0-c3c7f738f238 req-7c4d1453-ba23-4f65-894e-006cc30fa39c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051723 Aug 29 15:58:25.400848 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2323/4571] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:25.780338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:25.781554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:25.792120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.794394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.795164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:25.796727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:25.798280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:25.799183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:26.043470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:26.058825 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-357ec435-74f8-47ae-9340-252daa85fb14 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.285074 Aug 29 15:58:26.061240 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2249/4572] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:25 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:26.214984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:26.217111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:26.230727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:26.231904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:26.233980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:26.237363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:26.248486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:26.252817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:26.867367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:26.880936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:26.887095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:26.890080 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-901a41d5-0d86-49c6-9f67-175d8119e18f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.680517 Aug 29 15:58:26.894027 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2324/4573] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:26 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:27.082252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.084779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.099260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.100094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.101607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.105708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.106479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.107280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.206140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.206780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.218673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.218673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.218673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.219532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.219854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.220276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.266533 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 HTTP/1.1 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '672de70b-9063-4656-82fe-5d6d23d3ba61'} Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:27.268631 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.273130 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.281342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:27.283370 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ecd0c42e-f4c3-4569-9795-278829413d6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "DELETE /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 404 len: 111 microversion: 2.1 time: 0.085080 Aug 29 15:58:27.288547 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2325/4574] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:27 2022] DELETE /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:58:27.298412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-930c47c0-d723-47f1-9acf-816c264627e6 req-74397dc5-9a2f-44e5-b445-bf527380cd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7124a92-4c7c-4c37-b7c8-82a9555d234c", "tag": "d70bd3be-78e1-46b6-a8f8-a77d018078a8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:27.322520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-930c47c0-d723-47f1-9acf-816c264627e6 req-74397dc5-9a2f-44e5-b445-bf527380cd9c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.323470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-930c47c0-d723-47f1-9acf-816c264627e6 req-74397dc5-9a2f-44e5-b445-bf527380cd9c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.325381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-930c47c0-d723-47f1-9acf-816c264627e6 req-74397dc5-9a2f-44e5-b445-bf527380cd9c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.350819 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-930c47c0-d723-47f1-9acf-816c264627e6 req-74397dc5-9a2f-44e5-b445-bf527380cd9c service nova] Creating event network-changed:d70bd3be-78e1-46b6-a8f8-a77d018078a8 for instance e7124a92-4c7c-4c37-b7c8-82a9555d234c on n-h1-836830-13 Aug 29 15:58:27.361431 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-930c47c0-d723-47f1-9acf-816c264627e6 req-74397dc5-9a2f-44e5-b445-bf527380cd9c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071373 Aug 29 15:58:27.363805 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2326/4575] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:27.380641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.381756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 672de70b-9063-4656-82fe-5d6d23d3ba61] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.399178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.400971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.402345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.403546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.404388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.405155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.447769 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.451843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 HTTP/1.1 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '672de70b-9063-4656-82fe-5d6d23d3ba61'} Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:27.452862 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 672de70b-9063-4656-82fe-5d6d23d3ba61 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2d7b3bf-e6ec-424e-b38c-a6d81a19477a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61" status: 404 len: 111 microversion: 2.1 time: 0.087956 Aug 29 15:58:27.457773 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2327/4576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:27 2022] GET /compute/v2.1/servers/672de70b-9063-4656-82fe-5d6d23d3ba61 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:27.463580 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf2254e7-1930-4009-a4b2-257ca7532aa0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.385615 Aug 29 15:58:27.464564 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2250/4577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:27 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:27.485317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.485874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.505707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.508956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.509656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.511852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.512483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.513826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.520279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:27.592495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:58:27.778410 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dfc943eb-07dc-4d6a-9b0f-417585f58040 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "DELETE /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 204 len: 0 microversion: 2.1 time: 0.313730 Aug 29 15:58:27.782561 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2328/4578] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:58:27 2022] DELETE /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:58:27.799058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.799974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.809910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.810660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.811849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.813947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.814809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.815429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.922180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:27.922899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:27.935337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.937715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.938490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:27.939414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:27.942752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:27.943251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:28.347048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:28.353743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:28.357895 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2a92dd53-183f-45bb-993f-41af70956c1f tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.567762 Aug 29 15:58:28.365749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:28.367931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:28.370011 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e96c084-c018-41f5-88fa-2c6826546ecd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.452553 Aug 29 15:58:28.371208 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2329/4579] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:27 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:28.379207 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2251/4580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:27 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:28.494522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:28.495185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:28.514336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:28.514857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:28.515332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:28.516048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:28.517678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:28.521526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:28.838843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:28.855206 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a7e93de-54a0-4a2f-96da-f2d83965e779 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1317 microversion: 2.1 time: 0.370486 Aug 29 15:58:28.855862 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2330/4581] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:28 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:29.144323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:29.147265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.154471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.154977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.155439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.156155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.156781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.157592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.204112 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0bd0ef16-4c9a-4e0e-8197-4484e039d283 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063688 Aug 29 15:58:29.211294 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2252/4582] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:58:29 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:29.216967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:29.217473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.224208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.224955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.225557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.226545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.227203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.227794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.266447 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29f824ce-ab2f-4019-b7ff-c244a2d6cf94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/80c36521-aff0-4c9c-bf9d-237e306f4793" status: 200 len: 194 microversion: 2.1 time: 0.053412 Aug 29 15:58:29.271157 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2331/4583] 10.222.0.83 () {58 vars in 1413 bytes} [Mon Aug 29 15:58:29 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/80c36521-aff0-4c9c-bf9d-237e306f4793 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:29.404201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:29.404850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.405419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:29.406807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.414046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.414554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.416681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.417367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.418089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.419231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.419844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.420425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.423300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.424148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.424643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.425077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.591765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:29.602085 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87876507-6b0b-428b-b1dd-a906c18c9a6a tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.201634 Aug 29 15:58:29.603304 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2332/4584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:29 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:29.842387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:29.857160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:29.858746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:29.859993 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25c873e2-c122-47a3-92f8-40de4950d272 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.459641 Aug 29 15:58:29.861064 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2253/4585] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:29 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:29.882138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:29.882857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:29.890450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.890952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.891428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:29.892291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:29.892890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:29.893475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.169739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:30.182428 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89fd186f-f664-43b9-8e64-6af98c38d56f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1507 microversion: 2.1 time: 0.304980 Aug 29 15:58:30.183040 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2333/4586] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:29 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:30.203764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:30.204403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:30.211926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.212412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.212842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.213529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.213974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.214389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.245298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:30.508806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:30.524808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6a03dd35-a4b4-4437-9bd1-fb088c4045c5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1507 microversion: 2.1 time: 0.324497 Aug 29 15:58:30.526040 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2254/4587] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:30 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:30.545741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:30.548257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:30.558454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.558939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.566304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.567949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.568590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.569208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.624615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:30.626207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:30.638535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.642055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.645554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.646708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.647348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.647926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.690367 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f87fecd5-1363-4343-8d23-591244acaec7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "PUT /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1079 microversion: 2.1 time: 0.148479 Aug 29 15:58:30.691052 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2334/4588] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 15:58:30 2022] PUT /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1079 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:30.711160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:30.711786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:30.719081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.719586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.720027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.720734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:30.721186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:30.721852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:30.969300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:30.977913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:30.978355 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe19836e-0dcc-4dbe-a251-0e27c1a2adce tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1511 microversion: 2.1 time: 0.357872 Aug 29 15:58:30.981060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2255/4589] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:30 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:30.989609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:30.990251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:30.990903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-345d16d1-f8e5-4a94-b513-2963df7af468 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1505 microversion: 2.1 time: 0.285224 Aug 29 15:58:31.003093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.004076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.004807 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2335/4590] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:30 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:31.008774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.013824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.015619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.018289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:31.018548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.019493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.023634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:31.033252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.033952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.036563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.045188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.045963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.046624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.417922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:31.426401 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-837e3872-aa83-43d1-a43b-ad8d5d754da8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1505 microversion: 2.1 time: 0.415722 Aug 29 15:58:31.429439 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2336/4591] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:31 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:31.505694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:31.520425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:31.522277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:31.523513 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d2cca018-64ea-4388-bc11-682c3df6cb2e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.541290 Aug 29 15:58:31.535619 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2256/4592] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:30 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:31.545703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:31.549363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.557343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.557822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.558545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.559449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.559900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.560323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.642636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b6403805-d726-4761-b8c4-c457b377bb7b req-0ce2afb3-6458-4549-bd00-909def912e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f04d40-f4f7-49ad-9050-13106f86cf10", "name": "network-vif-deleted", "tag": "6ca55786-29ad-4318-99af-5022019c67a1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:31.664019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b6403805-d726-4761-b8c4-c457b377bb7b req-0ce2afb3-6458-4549-bd00-909def912e3e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.666022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b6403805-d726-4761-b8c4-c457b377bb7b req-0ce2afb3-6458-4549-bd00-909def912e3e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.666481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b6403805-d726-4761-b8c4-c457b377bb7b req-0ce2afb3-6458-4549-bd00-909def912e3e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.672211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:58:31.673119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:58:31.674089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:58:31.674728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:58:31.675661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:58:31.681754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b6403805-d726-4761-b8c4-c457b377bb7b req-0ce2afb3-6458-4549-bd00-909def912e3e service nova] Creating event network-vif-deleted:6ca55786-29ad-4318-99af-5022019c67a1 for instance 32f04d40-f4f7-49ad-9050-13106f86cf10 on n-h2-836830-13 Aug 29 15:58:31.704258 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b6403805-d726-4761-b8c4-c457b377bb7b req-0ce2afb3-6458-4549-bd00-909def912e3e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273494 Aug 29 15:58:31.706733 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2337/4593] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:31.755852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.761900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.762397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.762826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.763712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.764161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.764738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.796022 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18401bb6-b0d4-4b08-b7a7-daf601fe1152 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "POST /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255/action" status: 202 len: 1111 microversion: 2.1 time: 0.258736 Aug 29 15:58:31.796795 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2257/4594] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 15:58:31 2022] POST /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255/action => generated 1111 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 15:58:31.814318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:31.815042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.821869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.822353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.822786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.823512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.823968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.824394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.964367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39abd53f-aa8c-40d9-9e2b-ef612be57990"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:31.966754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:31.974721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.975251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.976046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.977288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:31.977911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:31.978494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:31.978982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:31.992420 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-03a1853d-a4f0-4c50-807b-01bc642b4a3f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.182349 Aug 29 15:58:31.993235 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2338/4595] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:31 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:32.009150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:32.009889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:32.016663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.017156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.017592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.018438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.018896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.019346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.061193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.061682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.062112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.062567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lazy-loading 'fault' on Instance uuid 32f04d40-f4f7-49ad-9050-13106f86cf10 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:32.131119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8efa4be1bf974daf84fc5f64b4ca3155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d953872c1bd443aa26ee4f47626bdc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:32.147043 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba31f3e2-6177-413d-9ed9-7020b05e8bb6 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 200 len: 1306 microversion: 2.1 time: 0.150473 Aug 29 15:58:32.147974 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2339/4596] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:31 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:32.306496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a87a2a17-d2fd-471d-8ae8-b67cf9615828 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "POST /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346443 Aug 29 15:58:32.307144 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2258/4597] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:58:31 2022] POST /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:32.550140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:32.550748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:32.562354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.563419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.563866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.564739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:32.565206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:32.565882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:32.877536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:32.888780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:32.890578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:32.892352 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d9a8734d-e6bd-4283-8222-5d0cd8622821 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.346124 Aug 29 15:58:32.893198 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2340/4598] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:32 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:33.017282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:33.018631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:33.026676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.027334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.028146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.029050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.029507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.029930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.173670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:33.174075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] [instance: 32f04d40-f4f7-49ad-9050-13106f86cf10] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:33.181075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.181575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.182018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.182738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.183236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.183671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.211385 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] HTTP exception thrown: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 could not be found. Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Request method failure captured: Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 HTTP/1.1 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOEhCP1CpQGyiUCJcyuAF0wjEjWQOry3jV-b2Ovpzxv6p2a-GvaxvpQEgRC5YxuqPp4uWxeTEkLUaZeSdZZu3jC40vGZCN6vXJthE2avRib00WwNn5GhKyoJb8TluCJn_99CqoHdHAObIQYWFn14FInRr5_W_bXPHSPE90HSxcsKVp0 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d953872c1bd443aa26ee4f47626bdc9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d953872c1bd443aa26ee4f47626bdc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d953872c1bd443aa26ee4f47626bdc9"}]}] Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d953872c1bd443aa26ee4f47626bdc9 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1698571428 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8efa4be1bf974daf84fc5f64b4ca3155 Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1698571428-project Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 could not be found. Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '32f04d40-f4f7-49ad-9050-13106f86cf10'} Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 could not be found. Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 could not be found. Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:33.214205 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 could not be found. Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] Returning 404 to user: Instance 32f04d40-f4f7-49ad-9050-13106f86cf10 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9adda61f-b708-4f54-8f66-1af7030e3d84 tempest-ServersNegativeTestJSON-1698571428 tempest-ServersNegativeTestJSON-1698571428-project] 10.222.0.83 "GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10" status: 404 len: 111 microversion: 2.1 time: 0.050738 Aug 29 15:58:33.218874 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2341/4599] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:33 2022] GET /compute/v2.1/servers/32f04d40-f4f7-49ad-9050-13106f86cf10 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:33.250680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:33.267834 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c9570585-c2d4-41dc-ba28-32f47352e4fd tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.257090 Aug 29 15:58:33.268612 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2259/4600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:33 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:33.920601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:33.921343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:33.930241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.930979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.931613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:33.932590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:33.933208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:33.933863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.290011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:34.291624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:34.307262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.308186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.308858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.310556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:34.312836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:34.313280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:34.412796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:34.425301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:34.429078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:34.430749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca68f836-e5b0-45da-99e6-f93e54430e58 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.514832 Aug 29 15:58:34.443112 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2342/4601] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:33 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:34.633460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:34.643961 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7102acba-71c1-4361-ac25-f31bbd245031 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.357989 Aug 29 15:58:34.644539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2260/4602] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:34 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:35.455601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:35.456444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:35.474145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.474791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.475380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.476215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.476785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.477321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.522860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:35.666745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:35.668019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:35.680571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.681356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.681955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.685658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:35.686338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:35.686931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:35.938721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:35.954228 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-59a699e7-22b7-4c94-bc5d-5afb85bca63c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.291674 Aug 29 15:58:35.955194 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2261/4603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:35 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:36.032789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:36.053655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:36.058679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:36.062532 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88264c2e-f639-4a23-aa93-3640b93376a4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.610936 Aug 29 15:58:36.092313 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2343/4604] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:35 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:36.980104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:36.981270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:36.992315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:36.996552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:36.997222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:36.999878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.000519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.006799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.100271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:37.101491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:37.116067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.116776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.118057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.118954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:37.128484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:37.129054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:37.340717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:37.353980 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ba91be1-b027-4fe6-9eec-d7b7372161f0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.377326 Aug 29 15:58:37.354882 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2262/4605] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:36 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:37.754238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:37.774573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:37.777741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:37.781103 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0ef2b59-1217-4837-a215-93538385d7a2 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.685362 Aug 29 15:58:37.793763 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2344/4606] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:37 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:38.379243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:38.381231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:38.396341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.398503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.398978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.399757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.402218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.404061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.690621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:38.710357 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ebcf8fa6-d023-4a09-a383-a5b85294df7a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.330735 Aug 29 15:58:38.711099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2263/4607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:38 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:38.806719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:38.808471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:38.817703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.818719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.819482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:38.820518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:38.821378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:38.822049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.210174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:39.237568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:39.246615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:39.248455 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9db4be65-502d-4402-b0c2-bae19ab25ec6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.446069 Aug 29 15:58:39.249021 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2345/4608] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:38 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:39.739850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:39.741276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:39.751191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=86 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:39.753129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.753992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.755411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.756639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:39.757755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:39.758406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:39.979007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:39.991946 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-110c7f0c-fca2-410c-9ed2-9bba08178122 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.257886 Aug 29 15:58:39.993700 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2264/4609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:39 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:40.274413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:40.276056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:40.285570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.286643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.287375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.288476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:40.289605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:40.290541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:40.537195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:40.549344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:40.551319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:40.553701 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5c66b89-24b5-4e6a-8717-4e2f5f5a5292 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.284694 Aug 29 15:58:40.574612 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2346/4610] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:40 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:41.013953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.014576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:41.022849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.024009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.024945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.025848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.026525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.027435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.146046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca1dd230-ef22-4d4c-a898-fafdd63e9fd9 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Calling method '.version_select at 0x7f32ed699550>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.211076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:41.220218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca1dd230-ef22-4d4c-a898-fafdd63e9fd9 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.271060 Aug 29 15:58:41.220551 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc2804a4-ef9e-4e95-ba20-530c51ab96f8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.210536 Aug 29 15:58:41.221217 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2265/4611] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:58:40 2022] GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5/defaults => generated 371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.223778 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2347/4612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:41.240259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c44ca148-a5ec-46d2-ab40-ec73d39331ef tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Calling method '.version_select at 0x7f32ed5e5790>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.321919 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c44ca148-a5ec-46d2-ab40-ec73d39331ef tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5" status: 200 len: 371 microversion: 2.1 time: 0.087811 Aug 29 15:58:41.322455 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2266/4613] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.341125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-131a91b9-1e79-433f-b19f-8e9fd077b2d7 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Calling method '.version_select at 0x7f32eda258b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.458325 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-131a91b9-1e79-433f-b19f-8e9fd077b2d7 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5/defaults" status: 200 len: 371 microversion: 2.1 time: 0.126029 Aug 29 15:58:41.459373 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2348/4614] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5/defaults => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:41.490175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5cae619f-2328-4688-91fb-35203a6d5259 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Calling method '.version_select at 0x7f32ed5e5dc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.565318 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5cae619f-2328-4688-91fb-35203a6d5259 tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5" status: 200 len: 371 microversion: 2.1 time: 0.092276 Aug 29 15:58:41.566280 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2267/4615] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.577620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04263d90-d7b7-4668-9641-f5209fcbdb5b tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] Calling method '.version_select at 0x7f32eda255e0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.586699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:41.589738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:41.601366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.602016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.602801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.603677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:41.604448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:41.605162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:41.744313 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04263d90-d7b7-4668-9641-f5209fcbdb5b tempest-QuotasTestJSON-1661126709 tempest-QuotasTestJSON-1661126709-project] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5?user_id=b1e69a0881324bfdb952dd32952847d3" status: 200 len: 371 microversion: 2.1 time: 0.171010 Aug 29 15:58:41.747182 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2349/4616] 10.222.0.83 () {58 vars in 1323 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/os-quota-sets/68419214521d4cc787505520266101e5?user_id=b1e69a0881324bfdb952dd32952847d3 => generated 371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:41.902508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:41.915251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:41.917059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:41.918505 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aec5b732-0b80-40b0-aeec-f22d654040ba tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.339743 Aug 29 15:58:41.919320 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2268/4617] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:41 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:42.246580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:42.247429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:42.259650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.260421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.260869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.261741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.262214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.262656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.545605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:42.557383 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7e246a5-ba3b-440f-9299-79e6dd0c0119 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.314940 Aug 29 15:58:42.558142 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2350/4618] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:42 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:42.951583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:42.951583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:42.965396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.965944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.966545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:42.967576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:42.968372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:42.968950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.272908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:43.292665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:43.294146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:43.295378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.348373 Aug 29 15:58:43.296490 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2269/4619] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:42 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:43.578395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.579113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:43.590692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.591218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.591661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.592384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:43.592842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:43.593275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:43.813332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:43.823510 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.249473 Aug 29 15:58:43.824460 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2351/4620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:43.901374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.902478 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001446 Aug 29 15:58:43.910769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.912803 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002618 Aug 29 15:58:43.913040 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2270/4621] 10.222.0.83 () {56 vars in 886 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:58:43.920377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.921073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2352/4622] 10.222.0.83 () {54 vars in 1035 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 29 15:58:43.921545 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f97d85ce-d093-42c0-9281-0df3bd60b095 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 29 15:58:43.931386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:43.932620 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a673deec-2b98-404a-91b9-997ce1772a99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001598 Aug 29 15:58:43.933092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2353/4624] 10.222.0.83 () {56 vars in 886 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 29 15:58:43.933226 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2271/4624] 10.222.0.83 () {54 vars in 1041 bytes} [Mon Aug 29 15:58:43 2022] GET /compute/v2.1/ => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:44.326966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:44.328135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:44.367066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.368415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.369068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.370044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.370676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.371581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.756784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:44.768696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:44.771896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:44.773632 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f86735dd-4db2-43a3-aaf7-e8a4c3f5c33f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.454286 Aug 29 15:58:44.774357 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2354/4625] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:44 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:44.846416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:44.847862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:44.856906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.857825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.858533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:44.860212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:44.860866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:44.861450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.105052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:45.107449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:45.116100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40d52db5-5758-4b77-a136-4c08c0fd806a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.274178 Aug 29 15:58:45.118703 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2272/4626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:44 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:45.804353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:45.806910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:45.827331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.828274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.829116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:45.830000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:45.830965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:45.831621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.132508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:46.141212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:46.142747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:46.144332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:46.148827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:46.154697 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d23ebe76-8e00-4f25-9cf5-977930757195 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.358315 Aug 29 15:58:46.155311 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2355/4627] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:45 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:46.164158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.165037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.165848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.170286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.170916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.171710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.434114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:46.437919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:46.445548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.446511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.447245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.448653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.449228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.449759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.476838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:46.486179 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d16d65fd-4d7e-4c37-b078-d6b7e4d822cd tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056937 Aug 29 15:58:46.493682 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2356/4628] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:58:46 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:46.496805 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b60e068a-8840-45b8-8919-788b4b81cc79 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.359535 Aug 29 15:58:46.505679 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2273/4629] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:46 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:46.633463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:46.641351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:46.650184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.652282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.658418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.659206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.659940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.660375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.762695 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-264d3714-742d-4ab1-8c1e-f4c2792acb69 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/80c36521-aff0-4c9c-bf9d-237e306f4793" status: 200 len: 194 microversion: 2.1 time: 0.137115 Aug 29 15:58:46.765854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2357/4630] 10.222.0.83 () {58 vars in 1413 bytes} [Mon Aug 29 15:58:46 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/80c36521-aff0-4c9c-bf9d-237e306f4793 => generated 194 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:46.783624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:46.784258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:46.793850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.794362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.794798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.796039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:46.799551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:46.800682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:46.944346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0632ede2-d7f6-4638-bad6-0ed7f8485962 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Action: 'create', calling method: .version_select at 0x7f32ed56b430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1714333723", "metadata": {"Type": "work"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:46.971826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lazy-loading 'services' on Instance uuid feeb1ea1-65d9-4a46-93e4-298b1a4a4406 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:47.099746 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-db1bd9dd-b679-4d7d-a39d-bddaf3b51425 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/80c36521-aff0-4c9c-bf9d-237e306f4793" status: 202 len: 0 microversion: 2.1 time: 0.319820 Aug 29 15:58:47.100969 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2358/4631] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 15:58:46 2022] DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/80c36521-aff0-4c9c-bf9d-237e306f4793 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:58:47.182438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:47.183486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:47.195697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:47.196190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:47.198932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.201201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:47.201834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:47.204654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.464927 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0632ede2-d7f6-4638-bad6-0ed7f8485962 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.771078 Aug 29 15:58:47.465571 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2274/4632] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 15:58:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 773 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 15:58:47.478741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f8d588bd-5ba9-4481-8b5e-8557da8b31cf tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed633280>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:47.503580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:47.517205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:47.520588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:47.522929 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af8d7604-be72-4a96-beb5-246f8c724da6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.345000 Aug 29 15:58:47.524489 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2359/4633] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:47 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:47.532152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:47.533100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:47.541877 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f8d588bd-5ba9-4481-8b5e-8557da8b31cf tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 200 len: 353 microversion: 2.1 time: 0.067054 Aug 29 15:58:47.542851 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2275/4634] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:47 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:47.547496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:47.548364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:47.549540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.551013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:47.551875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:47.553275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:47.758508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:47.771841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-14fc2885-ec1b-472c-a52e-504d512a057d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.245883 Aug 29 15:58:47.772638 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2360/4635] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:47 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:48.135177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4439ed0f-3bdc-4007-baa0-a8a574e34e84 req-6065f57f-efdd-419d-a49e-4ceb40109498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-plugged", "status": "completed", "tag": "6c92279a-1770-4793-9992-4098b7bf25ac"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:48.158584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4439ed0f-3bdc-4007-baa0-a8a574e34e84 req-6065f57f-efdd-419d-a49e-4ceb40109498 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.159153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4439ed0f-3bdc-4007-baa0-a8a574e34e84 req-6065f57f-efdd-419d-a49e-4ceb40109498 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.160365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4439ed0f-3bdc-4007-baa0-a8a574e34e84 req-6065f57f-efdd-419d-a49e-4ceb40109498 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.193370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4439ed0f-3bdc-4007-baa0-a8a574e34e84 req-6065f57f-efdd-419d-a49e-4ceb40109498 service nova] Creating event network-vif-plugged:6c92279a-1770-4793-9992-4098b7bf25ac for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:48.211888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4439ed0f-3bdc-4007-baa0-a8a574e34e84 req-6065f57f-efdd-419d-a49e-4ceb40109498 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185659 Aug 29 15:58:48.213575 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2276/4636] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:48.557879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:48.559814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7632cb98-1c07-4531-a517-de2756a8025d tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed6335e0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:48.561057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:48.589694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.590213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.590661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.597018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.600222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.600691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.882772 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7632cb98-1c07-4531-a517-de2756a8025d tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 200 len: 353 microversion: 2.1 time: 0.330593 Aug 29 15:58:48.884064 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2277/4637] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:48 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 353 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:48.908632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:48.917463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:48.957052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.968874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.969482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:48.975148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:48.979180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:48.979723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:49.168299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:49.185012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:49.194357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:49.198393 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9973db43-d194-4f88-922a-89e0b8fde81c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.649716 Aug 29 15:58:49.199840 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2361/4638] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:48 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:49.391554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:49.405530 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76ffb0dc-c966-4c64-87c3-7fb16344f13b tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.519137 Aug 29 15:58:49.423065 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2278/4639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:48 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:49.897898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b137496-a992-4b15-8097-3b1d48be74f8 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed125280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.011473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b137496-a992-4b15-8097-3b1d48be74f8 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 200 len: 354 microversion: 2.1 time: 0.117841 Aug 29 15:58:50.012183 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2362/4640] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:49 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:50.026890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f1656842-e97d-456d-895c-67d336147c72 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed56bb80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.170981 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f1656842-e97d-456d-895c-67d336147c72 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 200 len: 354 microversion: 2.1 time: 0.148668 Aug 29 15:58:50.171909 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2279/4641] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:50 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:50.185333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e6a67f7-93b7-4b22-b0c0-2cee325af926 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed2614c0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.234562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.235250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:50.252251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.252738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.253183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:50.257134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.257629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.258070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:50.333659 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e6a67f7-93b7-4b22-b0c0-2cee325af926 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 202 len: 0 microversion: 2.1 time: 0.151921 Aug 29 15:58:50.335013 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2363/4642] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:58:50 2022] DELETE /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:58:50.352315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1f846a0-c00b-49b5-86fe-041ca1f3290e tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed1458b0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.423618 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1f846a0-c00b-49b5-86fe-041ca1f3290e tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 200 len: 353 microversion: 2.1 time: 0.083726 Aug 29 15:58:50.424236 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2364/4643] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:50 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:50.438204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:50.439095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:50.451661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.453078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.455536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:50.456484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:50.458760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:50.461086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:50.724240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:50.744763 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88472c93-41c6-49c5-942b-457ee72c5aa8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.304765 Aug 29 15:58:50.744763 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2365/4644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:50 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:50.780593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:50.797481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:50.800727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:50.804099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de95efb3-540e-43e4-a29c-aad65b1b3a65 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.578833 Aug 29 15:58:50.805001 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2280/4645] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:50 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:51.448066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-193e6f46-56f7-4891-b1c7-b69edc6afa9d tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed3951f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:51.509905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-193e6f46-56f7-4891-b1c7-b69edc6afa9d tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 200 len: 353 microversion: 2.1 time: 0.075965 Aug 29 15:58:51.510856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2366/4646] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:51 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:51.770869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:51.771644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:51.774993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:51.802555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:51.803484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:51.804933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:51.806499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:51.807187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:51.808235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:51.834876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:51.835913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:51.870311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:51.877552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:51.879645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:51.880284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:51.881243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:51.883768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:51.884382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:51.945345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:58:52.142786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.151700 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95602833-c93a-42f3-9824-41587ec7f864 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.386601 Aug 29 15:58:52.152635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2281/4647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:51 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:52.259694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.280207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.291439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:52.292915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a6320e2-99c3-47b7-96ab-b016e8f66ef0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.469033 Aug 29 15:58:52.304519 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2367/4648] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:51 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:52.528119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e033bd7f-7027-4618-bfda-a4d4ea3c4f38 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ed5864c0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:52.796134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e033bd7f-7027-4618-bfda-a4d4ea3c4f38 tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 200 len: 353 microversion: 2.1 time: 0.271594 Aug 29 15:58:52.805705 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2282/4649] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:52 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 353 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:53.176823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:53.177601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:53.197183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.200236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.200790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.202601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.205419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.205998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.322541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:53.323454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:53.338041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.340110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.340988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.343564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:53.346573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:53.347459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:53.508568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.518068 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-943b15c7-fe95-42b6-834e-16f0c11df072 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.345973 Aug 29 15:58:53.519560 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2368/4650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:53 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:53.684092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.698566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.700691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:53.702185 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-248bc17e-ee2d-4c7e-9427-d01c7416b572 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.386859 Aug 29 15:58:53.702955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2283/4651] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:53 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:53.813660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eb47eb48-7088-4a11-abc4-153884b984df tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Calling method '.version_select at 0x7f32ee4eeca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:54.246774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-eb47eb48-7088-4a11-abc4-153884b984df tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] HTTP exception thrown: Volume f84737bd-ed9f-4c9b-8718-7216d1e0b75b could not be found. Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eb47eb48-7088-4a11-abc4-153884b984df tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Request method failure captured: Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b HTTP/1.1 Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOI2d_U7rhUTc2Gn8h9jcf0-k-L-0ScTMkHRtXphUiuutl_tvkMjqEi-xihokUxEGRR615wcbZnSitUidogqgEADmS6wu6MtJTRPSMjgPrfA7H8d4negEab28WCB-bMyfHjFA1pJmhM0NGYQ3Mv8of5ldczHDDMuIC581Iuch8yPQqU Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6457a1c666bc4e0eb583236aa037f19c Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesGetTestJSON-1067564428 Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6457a1c666bc4e0eb583236aa037f19c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6457a1c666bc4e0eb583236aa037f19c", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6457a1c666bc4e0eb583236aa037f19c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6457a1c666bc4e0eb583236aa037f19c"}]}] Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesGetTestJSON-1067564428 Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6457a1c666bc4e0eb583236aa037f19c Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesGetTestJSON-1067564428 Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesGetTestJSON-1067564428-project Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 1652b1d8c5904360a71f2f65a7b0feda Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesGetTestJSON-1067564428-project Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: exception: Volume f84737bd-ed9f-4c9b-8718-7216d1e0b75b could not be found. Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'f84737bd-ed9f-4c9b-8718-7216d1e0b75b'} Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f84737bd-ed9f-4c9b-8718-7216d1e0b75b could not be found. (HTTP 404) (Request-ID: req-90e55c51-5126-4177-837a-995d2fa5f2b2) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:58:54.249647 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f84737bd-ed9f-4c9b-8718-7216d1e0b75b could not be found. Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f84737bd-ed9f-4c9b-8718-7216d1e0b75b could not be found. Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f84737bd-ed9f-4c9b-8718-7216d1e0b75b could not be found. Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eb47eb48-7088-4a11-abc4-153884b984df tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] Returning 404 to user: Volume f84737bd-ed9f-4c9b-8718-7216d1e0b75b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:58:54.254084 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eb47eb48-7088-4a11-abc4-153884b984df tempest-VolumesGetTestJSON-1067564428 tempest-VolumesGetTestJSON-1067564428-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b" status: 404 len: 109 microversion: 2.1 time: 0.442450 Aug 29 15:58:54.260100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2369/4652] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:58:53 2022] GET /compute/v2.1/os-volumes/f84737bd-ed9f-4c9b-8718-7216d1e0b75b => generated 109 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:58:54.542823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:54.544668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:54.556675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.558287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.558891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:54.560266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.561517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.562107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:54.733241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:54.733876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:54.744374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.744945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.749545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:54.750546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:54.751135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:54.751577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:54.893876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:54.916525 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ceb8bf51-4572-411e-8ace-02672898679e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.372374 Aug 29 15:58:54.917218 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2284/4653] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:54 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:55.188223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:55.209594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:55.214767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:55.216684 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-df32175f-e343-4d58-b083-d83f1dbde858 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.488963 Aug 29 15:58:55.232454 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2370/4654] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:54 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:55.486803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:55.487353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:55.498508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:55.499004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:55.499454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:55.500150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:55.500600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:55.501524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:55.585608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-694cbcea-f96c-48da-8328-c98e21faa59d req-9f7685db-64e4-4519-93ce-aca67acd476a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-plugged", "status": "completed", "tag": "644b8c18-872f-4891-be77-ea6eb763455e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:55.604653 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-66dbf688-55b6-45cf-8162-b4ab541381a0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/39abd53f-aa8c-40d9-9e2b-ef612be57990" status: 200 len: 194 microversion: 2.1 time: 0.121756 Aug 29 15:58:55.610954 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2285/4655] 10.222.0.83 () {58 vars in 1413 bytes} [Mon Aug 29 15:58:55 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/39abd53f-aa8c-40d9-9e2b-ef612be57990 => generated 194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:55.614909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-694cbcea-f96c-48da-8328-c98e21faa59d req-9f7685db-64e4-4519-93ce-aca67acd476a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:55.615672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-694cbcea-f96c-48da-8328-c98e21faa59d req-9f7685db-64e4-4519-93ce-aca67acd476a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:55.617342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-694cbcea-f96c-48da-8328-c98e21faa59d req-9f7685db-64e4-4519-93ce-aca67acd476a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:55.628889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:55.629796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:55.669136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:55.669568 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-694cbcea-f96c-48da-8328-c98e21faa59d req-9f7685db-64e4-4519-93ce-aca67acd476a service nova] Creating event network-vif-plugged:644b8c18-872f-4891-be77-ea6eb763455e for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:55.670198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:55.671248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:55.673362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:55.674409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:55.675137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:55.678517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-694cbcea-f96c-48da-8328-c98e21faa59d req-9f7685db-64e4-4519-93ce-aca67acd476a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097735 Aug 29 15:58:55.679637 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2371/4656] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:58:55.883159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lazy-loading 'services' on Instance uuid feeb1ea1-65d9-4a46-93e4-298b1a4a4406 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:58:55.944324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:55.945684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:55.954591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:55.955454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:55.956390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:55.957979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:55.958638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:55.959505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.045634 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76b9f7c6-d912-448b-b88a-96e38162eed1 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/39abd53f-aa8c-40d9-9e2b-ef612be57990" status: 202 len: 0 microversion: 2.1 time: 0.428963 Aug 29 15:58:56.046530 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2286/4657] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 15:58:55 2022] DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments/39abd53f-aa8c-40d9-9e2b-ef612be57990 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:58:56.246308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:56.246783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.247059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:56.256326 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-972dcd14-f5a6-4a7f-ba5a-2dd6ec7d718c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.316713 Aug 29 15:58:56.267055 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2372/4658] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:55 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:56.267246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:56.267246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:56.267246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.267246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:56.267246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:56.267246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:56.512677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.526047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.529288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:56.530908 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8df7c78f-d9c9-49d2-94ea-ce71ab177cb6 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.292370 Aug 29 15:58:56.531717 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2287/4659] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:56 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:57.281914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:57.282527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:57.296273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.296938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.297396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:57.298169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.298799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.299424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:57.533603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:57.543754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e1cf411-4c85-4c86-bfe3-a68b6ff39269 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.265954 Aug 29 15:58:57.544663 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2373/4660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:57 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:58:57.562356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:57.563668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:57.572503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.593925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.594560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:57.595222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.595711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.596129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:57.718105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0e0be839-1ed1-4d7d-b26e-d6318ab6971c req-e407f72a-d9c5-4b38-b636-4975d2dc0cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-plugged", "status": "completed", "tag": "ef5a15c9-44d9-4991-94eb-d5af5728b051"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:58:57.763851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0e0be839-1ed1-4d7d-b26e-d6318ab6971c req-e407f72a-d9c5-4b38-b636-4975d2dc0cab service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:57.764337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0e0be839-1ed1-4d7d-b26e-d6318ab6971c req-e407f72a-d9c5-4b38-b636-4975d2dc0cab service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:57.769201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0e0be839-1ed1-4d7d-b26e-d6318ab6971c req-e407f72a-d9c5-4b38-b636-4975d2dc0cab service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:57.803960 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0e0be839-1ed1-4d7d-b26e-d6318ab6971c req-e407f72a-d9c5-4b38-b636-4975d2dc0cab service nova] Creating event network-vif-plugged:ef5a15c9-44d9-4991-94eb-d5af5728b051 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:58:57.819074 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0e0be839-1ed1-4d7d-b26e-d6318ab6971c req-e407f72a-d9c5-4b38-b636-4975d2dc0cab service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104997 Aug 29 15:58:57.825965 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2374/4661] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:58:57.988579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:57.998133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:57.999609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:58.000815 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d0e7e81c-67c7-4d43-8f85-6cf90846c9b0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.449339 Aug 29 15:58:58.008801 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2288/4662] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:57 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:58:58.578047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:58.580955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:58.604954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:58.612203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:58.612942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:58.614786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:58.616625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:58.617341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:58.884837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:58.896883 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d8e92fc-9cdd-45cb-a8d7-8bbc4cdf3344 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.329356 Aug 29 15:58:58.897505 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2375/4663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:58 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:58:59.026260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:59.030558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:59.055723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.065278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.067962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.070349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.070858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.071394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.564417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.575661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.579885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:58:59.588396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26286af8-0d8d-4f1a-a5d0-b17e16e52afd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.561248 Aug 29 15:58:59.589097 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2289/4664] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:58:59 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:58:59.929572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:58:59.930269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:58:59.940970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.941371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.942383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:58:59.943145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:58:59.943581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:58:59.943995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:00.202323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:00.212487 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-223f323a-eee3-4661-a887-d4d37289eb83 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.287707 Aug 29 15:59:00.216270 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2376/4665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:58:59 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:00.614416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:00.615857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:00.625767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.627613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.630104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:00.631976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:00.634098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:00.637310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.007129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:01.007796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:01.021755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.024350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.025512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.028181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.028923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.031110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.041147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.061301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.062815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.071807 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e0458b0-354f-4b53-8ce9-dc65f1b39b8f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.461717 Aug 29 15:59:01.072421 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2290/4666] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:00 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:01.110923 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02202533-f4f9-4693-952d-83efb79dcc28 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c/ips" status: 200 len: 150 microversion: 2.1 time: 0.108346 Aug 29 15:59:01.124562 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2377/4667] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:59:01 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c/ips => generated 150 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:01.136182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bca1f62f-ef19-46ab-aa63-2cb8f76be586"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:01.138987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:01.154969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.164934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.165395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.166148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.171860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.172325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.244616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:01.247397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:01.270366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=76 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:01.275392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.276145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.276823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.278154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.282531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.283303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.525271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:01.541210 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-58bea51f-199c-4004-8de0-774d3c700eed tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.306290 Aug 29 15:59:01.558719 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2378/4668] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:01 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:01.631192 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Invalid volume: volume bca1f62f-ef19-46ab-aa63-2cb8f76be586 is already attached to instances: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c/os-volume_attachments HTTP/1.1 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 74 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: {"volumeAttachment": {"volumeId": "bca1f62f-ef19-46ab-aa63-2cb8f76be586"}} Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid volume: volume bca1f62f-ef19-46ab-aa63-2cb8f76be586 is already attached to instances: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': 'e7124a92-4c7c-4c37-b7c8-82a9555d234c', 'body': {'volumeAttachment': {'volumeId': 'bca1f62f-ef19-46ab-aa63-2cb8f76be586'}}} Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bca1f62f-ef19-46ab-aa63-2cb8f76be586 is already attached to instances: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:59:01.632961 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bca1f62f-ef19-46ab-aa63-2cb8f76be586 is already attached to instances: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bca1f62f-ef19-46ab-aa63-2cb8f76be586 is already attached to instances: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:01.640920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 400 to user: Invalid volume: volume bca1f62f-ef19-46ab-aa63-2cb8f76be586 is already attached to instances: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:01.650873 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cfc9d09a-ae92-4fb5-be13-0c0600653c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.518763 Aug 29 15:59:01.660206 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2291/4669] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:59:01 2022] POST /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c/os-volume_attachments => generated 174 bytes in 526 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 15:59:01.668210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:01.668818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:01.680699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7787a486-dbae-43c4-bd0b-b7e8bd272d8c req-87d583f5-cecc-43da-9c04-c0b44a420663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-plugged", "status": "completed", "tag": "3da879d5-255a-43b9-89f5-e8743644a9d4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:01.686598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.687399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.688005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.693566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.696558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.711270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.719881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7787a486-dbae-43c4-bd0b-b7e8bd272d8c req-87d583f5-cecc-43da-9c04-c0b44a420663 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.724918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7787a486-dbae-43c4-bd0b-b7e8bd272d8c req-87d583f5-cecc-43da-9c04-c0b44a420663 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.725428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7787a486-dbae-43c4-bd0b-b7e8bd272d8c req-87d583f5-cecc-43da-9c04-c0b44a420663 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.768080 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7787a486-dbae-43c4-bd0b-b7e8bd272d8c req-87d583f5-cecc-43da-9c04-c0b44a420663 service nova] Creating event network-vif-plugged:3da879d5-255a-43b9-89f5-e8743644a9d4 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:59:01.781752 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7787a486-dbae-43c4-bd0b-b7e8bd272d8c req-87d583f5-cecc-43da-9c04-c0b44a420663 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106718 Aug 29 15:59:01.786287 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2292/4670] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:01.803968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:01.968439 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a553c2e-7ede-45db-a564-737def8d97b7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 204 len: 0 microversion: 2.1 time: 0.305428 Aug 29 15:59:01.969203 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2379/4671] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:01 2022] DELETE /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:01.980060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:01.980966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:01.988068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.988908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.989567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:01.990539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:01.991141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:01.991823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.096759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:02.097705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:02.112816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.116294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.116690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.118830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.119344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.122812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.473994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.493128 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19b789e5-b4c0-4935-bf21-bad2ceb973a8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1682 microversion: 2.1 time: 0.513675 Aug 29 15:59:02.494176 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2293/4672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:01 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1682 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:02.561111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.566097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:02.567009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:02.578311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.582900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.583485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.584367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:02.587058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:02.587571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:02.588075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.597586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:02.604476 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c191c65-af1f-436c-ab57-d7a759880e80 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.511771 Aug 29 15:59:02.606239 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2380/4673] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:02 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:03.126439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:03.140697 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36bc9508-047a-4f3a-bdda-b60405efb448 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.574872 Aug 29 15:59:03.141328 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2294/4674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:02 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:03.521212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:03.521877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:03.536133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.537056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.545396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.546368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.547014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.547736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.634445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:03.635519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:03.651841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.652571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.654690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.658082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.658727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.659568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.670721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:03.839514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:03.853193 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d757a300-a8a8-4be1-b260-55ca86a56cd9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1682 microversion: 2.1 time: 0.337668 Aug 29 15:59:03.854808 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2381/4675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:03 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:03.862476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-plugged", "status": "completed", "tag": "15a5e7af-4a04-480b-bdb6-6c17a8c86958"}, {"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-plugged", "status": "completed", "tag": "3d8f7eec-7c7b-463a-aa32-edc8ac2a0179"}, {"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-plugged", "status": "completed", "tag": "eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:03.877193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:03.877682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:03.878162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:03.899239 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] Creating event network-vif-plugged:15a5e7af-4a04-480b-bdb6-6c17a8c86958 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:59:03.899865 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] Creating event network-vif-plugged:3d8f7eec-7c7b-463a-aa32-edc8ac2a0179 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:59:03.900561 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] Creating event network-vif-plugged:eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:59:03.908059 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9afae531-461d-428a-b509-b40ab02ae85c req-601f51ad-de1c-4b39-8f4a-8f2c3018c4dd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051144 Aug 29 15:59:03.915551 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2382/4676] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:04.166715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:04.168588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:04.180791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.181571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.181729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:04.183318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.184226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.184969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.185669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.218433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:04.221075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:04.223069 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49f5461b-fd6c-4355-9ca7-303bc567803c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.593117 Aug 29 15:59:04.226796 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2295/4677] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:03 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 15:59:04.312799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:04.315877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:04.331810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.332650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.334926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.335941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.342505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.343230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.426853 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6fd19909-106e-460b-bc3b-b330f2763337 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116554 Aug 29 15:59:04.439328 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2296/4678] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:04 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:59:04.454832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:04.468416 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c8589a46-97d5-4a07-bc31-1cb849599347 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.309994 Aug 29 15:59:04.469591 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2383/4679] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:04 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:04.616958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:04.619909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:04.628116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.628838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.630841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.631605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.632075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.632508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.766389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29e4fbd3-e100-4efe-9281-eba0f22491ac tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.164217 Aug 29 15:59:04.774689 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2297/4680] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:04 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406/os-volume_attachments => generated 25 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:59:04.862450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:04.863055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:04.879435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:04.880531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:04.886235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.886735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.887208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.887913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.888374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.888807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.894516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.897323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.897977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.905155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:04.905657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:04.906104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:04.952452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:05.003743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:05.027152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.044429 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95d79771-7b02-4c14-88cf-1d7460d41d11 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1614 microversion: 2.1 time: 0.172203 Aug 29 15:59:05.049054 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2298/4681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:04 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1614 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:05.095620 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0b3f45f-5cac-449b-8e73-7c03e6161e94 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 204 len: 0 microversion: 2.1 time: 0.236624 Aug 29 15:59:05.096629 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2384/4682] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:04 2022] DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:05.107276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:05.108205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:05.118344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:05.119143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:05.119775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.120884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:05.121552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:05.122164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.253469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:05.254316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:05.268916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:05.269475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:05.271924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.272778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:05.276360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:05.279111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.380712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.405967 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8257e3a6-e8a1-4a84-b294-4e1f574e4d30 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1673 microversion: 2.1 time: 0.303153 Aug 29 15:59:05.422447 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2299/4683] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:05 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1673 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:05.430788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b9ed1296-6266-4a84-984b-9d2738118e8a req-16739dab-9748-4951-9ba1-3823eed19cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7124a92-4c7c-4c37-b7c8-82a9555d234c", "name": "network-vif-deleted", "tag": "d70bd3be-78e1-46b6-a8f8-a77d018078a8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:05.443645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b9ed1296-6266-4a84-984b-9d2738118e8a req-16739dab-9748-4951-9ba1-3823eed19cc0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:05.444343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b9ed1296-6266-4a84-984b-9d2738118e8a req-16739dab-9748-4951-9ba1-3823eed19cc0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:05.444975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b9ed1296-6266-4a84-984b-9d2738118e8a req-16739dab-9748-4951-9ba1-3823eed19cc0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.475337 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b9ed1296-6266-4a84-984b-9d2738118e8a req-16739dab-9748-4951-9ba1-3823eed19cc0 service nova] Creating event network-vif-deleted:d70bd3be-78e1-46b6-a8f8-a77d018078a8 for instance e7124a92-4c7c-4c37-b7c8-82a9555d234c on n-h1-836830-13 Aug 29 15:59:05.486669 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b9ed1296-6266-4a84-984b-9d2738118e8a req-16739dab-9748-4951-9ba1-3823eed19cc0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060755 Aug 29 15:59:05.487774 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2300/4684] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:05.496454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:05.497489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:05.508054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:05.508766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:05.509426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.511361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:05.512058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:05.513148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:05.611908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.625058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.627109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.628496 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f8d1d0b2-57d3-4247-9077-9e07ba0855a8 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.381108 Aug 29 15:59:05.631633 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2385/4685] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:05 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:05.722425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:05.736273 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2c44c5a4-ee7f-431d-b760-8c68ecda23c3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.246365 Aug 29 15:59:05.737419 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2301/4686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:05 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:06.072352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:06.072985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:06.085629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.086230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.086560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.087325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.087796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.088223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.231636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:06.242594 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-43fc9864-0db4-4bec-96ff-7d1216d84007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1614 microversion: 2.1 time: 0.173952 Aug 29 15:59:06.243861 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2386/4687] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:06 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1614 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:06.436483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:06.438166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:06.451916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.452780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.453708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.454913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.455604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.456502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.638590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:06.646359 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fecaa99-7aab-4e74-a501-65e085012a7c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1673 microversion: 2.1 time: 0.214824 Aug 29 15:59:06.651079 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2302/4688] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:06 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:06.675553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:06.676523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:06.688999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.696304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.696767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.702232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.702800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.703306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.763509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:06.764243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:06.771519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.772332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.772780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:06.773491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:06.780048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:06.780755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:07.133459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.141101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.144258 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-834b730a-f33c-49ea-bb44-ec2db9fed8b6 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1516 microversion: 2.1 time: 0.389577 Aug 29 15:59:07.145892 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2303/4689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:06 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1516 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:07.155060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.156923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.158431 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b911edb-06f6-414f-a6f6-867a3091d9d9 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1878 microversion: 2.32 time: 0.497578 Aug 29 15:59:07.183329 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2387/4690] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:06 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1878 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:07.269682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:07.271491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:07.286853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:07.288208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:07.295731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:07.298829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:07.299404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:07.299838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:07.370359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:07.370858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:07.371341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:07.371799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lazy-loading 'fault' on Instance uuid e7124a92-4c7c-4c37-b7c8-82a9555d234c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:07.445112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.459961 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-76307c36-da7b-4b27-a258-1491ee11cd78 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 200 len: 1331 microversion: 2.1 time: 0.198690 Aug 29 15:59:07.482127 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2304/4691] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:07 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 1331 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:07.682789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:07.683555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:07.703799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:07.704314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:07.705870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:07.708947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:07.710180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:07.711768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:07.844299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:07.853644 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-783bb360-c010-4f0b-acdc-b0f08b274a13 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1606 microversion: 2.1 time: 0.185611 Aug 29 15:59:07.868077 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2388/4692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:07 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1606 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:08.169361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.170301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:08.186092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.187102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:08.189983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.190489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.190988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.192401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.193376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.194005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.203628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.205473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.208324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.212132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.216064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.216880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.525940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:08.539583 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21e53328-49f1-4414-ba4a-ffa54c07fb46 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.375111 Aug 29 15:59:08.544344 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2305/4693] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:08 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:08.554772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5780bc91-3b2e-4a2f-bcf9-a981843b6f42 req-c543f0db-f988-4781-a901-6fa11d38109d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feeb1ea1-65d9-4a46-93e4-298b1a4a4406", "name": "network-vif-deleted", "tag": "0cd9b44c-8cfe-44c1-b8ca-c71560a475b1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:08.561611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:08.578165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:08.580190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:08.583425 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca95cd39-2aa3-494b-9f55-e9fe41ee8c38 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2829 microversion: 2.32 time: 0.401196 Aug 29 15:59:08.585008 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2389/4694] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 15:59:08 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2829 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:08.588286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5780bc91-3b2e-4a2f-bcf9-a981843b6f42 req-c543f0db-f988-4781-a901-6fa11d38109d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.589085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5780bc91-3b2e-4a2f-bcf9-a981843b6f42 req-c543f0db-f988-4781-a901-6fa11d38109d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.590924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5780bc91-3b2e-4a2f-bcf9-a981843b6f42 req-c543f0db-f988-4781-a901-6fa11d38109d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.596318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.600643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:08.610568 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-5780bc91-3b2e-4a2f-bcf9-a981843b6f42 req-c543f0db-f988-4781-a901-6fa11d38109d service nova] Creating event network-vif-deleted:0cd9b44c-8cfe-44c1-b8ca-c71560a475b1 for instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 on n-h1-836830-13 Aug 29 15:59:08.618892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5780bc91-3b2e-4a2f-bcf9-a981843b6f42 req-c543f0db-f988-4781-a901-6fa11d38109d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073190 Aug 29 15:59:08.620149 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2306/4695] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:08.622447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.625215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.625683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.626435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.627999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.630235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.630372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:08.630464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.638375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.639293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.640766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.642954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.643733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.644376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.661888 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c HTTP/1.1 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'e7124a92-4c7c-4c37-b7c8-82a9555d234c'} Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:08.663872 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a35db90-752e-493f-b08d-2e05188d712f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 404 len: 111 microversion: 2.1 time: 0.079116 Aug 29 15:59:08.668606 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2390/4696] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:08 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:08.675713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f20635d4-e1bb-4cdf-912f-925db2e1b21a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '.version_select at 0x7f32ed9d2ca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.706218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f20635d4-e1bb-4cdf-912f-925db2e1b21a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539308454" status: 202 len: 0 microversion: 2.1 time: 0.035293 Aug 29 15:59:08.711715 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2391/4697] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 15:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539308454 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 15:59:08.901645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:08.905566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:08.942653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.946638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.948772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:08.950332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:08.953133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:08.954362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:09.011824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:09.012643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:09.013301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:09.014145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lazy-loading 'fault' on Instance uuid feeb1ea1-65d9-4a46-93e4-298b1a4a4406 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:09.099193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f554eb660c324a759d70b3b974e78db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ad457701f641bd963da9221fb04094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:09.125540 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b53fa810-e93d-4904-9630-af4b36bb8cf3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 200 len: 1327 microversion: 2.1 time: 0.252374 Aug 29 15:59:09.126524 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2392/4698] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:08 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 1327 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:09.169131 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff125c8d-d619-4ab1-907d-2a7e9c32fac5 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.547286 Aug 29 15:59:09.169742 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2307/4699] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 15:59:08 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e/os-interface => generated 1831 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 15:59:09.568214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:09.569647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:09.582474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:09.584667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:09.585465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:09.587378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:09.588118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:09.589199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.028903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:10.043656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bf56d3ee-dc22-462e-bb91-1deb7e2508e1 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.481398 Aug 29 15:59:10.044782 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2393/4700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:09 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:10.149827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:10.151123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:10.154006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=80 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:10.172466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.172975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.173454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.174171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.174626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.175611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.193330 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] HTTP exception thrown: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Request method failure captured: Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 HTTP/1.1 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODggQQXOwCsr3V7XCt55ezJC6Qo5bdGD-FKA9qlFCnWnwAv0KlHYRXauOpL2AFGHoiCo8Gl9orxN1eZoejztsMWOiA58ZHMTJdYPNUvIbHnG7i_f1QlwqUtlGEZ0d5Rcqbepxy985b86QkI6KsA1LeRJ6f6-Z1oyHvCum5NAYW6MwQ Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c7ad457701f641bd963da9221fb04094", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c7ad457701f641bd963da9221fb04094"}]}] Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f554eb660c324a759d70b3b974e78db5 Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'feeb1ea1-65d9-4a46-93e4-298b1a4a4406'} Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:10.195730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:10.199737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:10.199737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:10.199737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:10.199737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:10.199737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:10.199737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:10.199737 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:10.201821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Returning 404 to user: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:10.203535 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5dd026c4-6599-4d60-8738-ebbed66e9bd0 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 404 len: 111 microversion: 2.1 time: 0.061197 Aug 29 15:59:10.204889 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2308/4701] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:10 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:10.215562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82fa7af5-2130-4f66-b549-9b1bdd8bcdaa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '.version_select at 0x7f32ed9d2ca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:10.243924 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82fa7af5-2130-4f66-b549-9b1bdd8bcdaa tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684107866" status: 202 len: 0 microversion: 2.1 time: 0.033438 Aug 29 15:59:10.249594 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2394/4702] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684107866 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:59:10.392191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:10.393069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:10.400295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.401287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.402179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.403921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.404445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.405202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.555170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lazy-loading 'services' on Instance uuid 1437eae0-dfed-4046-b2a9-3ac8b9783e9b {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:10.731504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-448f7e93-717a-45f3-9cb6-1f35a9322df1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments/bca1f62f-ef19-46ab-aa63-2cb8f76be586" status: 202 len: 0 microversion: 2.1 time: 0.344372 Aug 29 15:59:10.732364 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2309/4703] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 15:59:10 2022] DELETE /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments/bca1f62f-ef19-46ab-aa63-2cb8f76be586 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:59:10.743831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:10.748188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:10.759421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.760211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.761201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.762082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:10.762677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:10.763379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:10.832213 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-494644b4-ce47-451b-b608-b4716c3d8412 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095002 Aug 29 15:59:10.835064 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2395/4704] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:10 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:11.065892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:11.066620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:11.085886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.086557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.087046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.087779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.092259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.093810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.406330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:11.420338 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-535120e4-1171-435f-8e26-194039628088 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.358501 Aug 29 15:59:11.423314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2310/4705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:11 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:11.524802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0f90a624-2221-482d-8cf4-362afe02a99b req-a957954e-fe33-417a-9303-c012e71ecd4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "tag": "6c92279a-1770-4793-9992-4098b7bf25ac"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:11.536885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0f90a624-2221-482d-8cf4-362afe02a99b req-a957954e-fe33-417a-9303-c012e71ecd4b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.537527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0f90a624-2221-482d-8cf4-362afe02a99b req-a957954e-fe33-417a-9303-c012e71ecd4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.538058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0f90a624-2221-482d-8cf4-362afe02a99b req-a957954e-fe33-417a-9303-c012e71ecd4b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.553090 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0f90a624-2221-482d-8cf4-362afe02a99b req-a957954e-fe33-417a-9303-c012e71ecd4b service nova] Creating event network-changed:6c92279a-1770-4793-9992-4098b7bf25ac for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 15:59:11.558597 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0f90a624-2221-482d-8cf4-362afe02a99b req-a957954e-fe33-417a-9303-c012e71ecd4b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037936 Aug 29 15:59:11.559308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2396/4706] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:11.662938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-496cbddf-568e-4b0d-b8c0-f494a5870b6e req-4309e518-54fe-43f0-9e93-5f0f9a749ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ef635f-cc6e-406f-ae79-d188a302b255", "name": "network-vif-unplugged", "status": "completed", "tag": "81229daf-ef7b-4493-99ba-22c2cb37e17d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:11.675829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-496cbddf-568e-4b0d-b8c0-f494a5870b6e req-4309e518-54fe-43f0-9e93-5f0f9a749ba0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.677514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-496cbddf-568e-4b0d-b8c0-f494a5870b6e req-4309e518-54fe-43f0-9e93-5f0f9a749ba0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.678313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-496cbddf-568e-4b0d-b8c0-f494a5870b6e req-4309e518-54fe-43f0-9e93-5f0f9a749ba0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.703755 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-496cbddf-568e-4b0d-b8c0-f494a5870b6e req-4309e518-54fe-43f0-9e93-5f0f9a749ba0 service nova] Creating event network-vif-unplugged:81229daf-ef7b-4493-99ba-22c2cb37e17d for instance 49ef635f-cc6e-406f-ae79-d188a302b255 on n-h2-836830-13 Aug 29 15:59:11.720767 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-496cbddf-568e-4b0d-b8c0-f494a5870b6e req-4309e518-54fe-43f0-9e93-5f0f9a749ba0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063328 Aug 29 15:59:11.724184 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2311/4707] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:11.846533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:11.850354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:11.866127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.866621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.867078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.868006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:11.868685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:11.869111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:11.908989 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e296bc4-3ae6-4fd5-ab97-224cca7c097b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066743 Aug 29 15:59:11.909873 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2397/4708] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:11 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:12.446476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:12.447988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:12.467489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:12.468369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:12.472063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:12.476112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:12.477655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:12.479550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:12.923661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:12.928249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:12.935981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:12.948284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:12.948776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:12.949717 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7c95ba89-e0a7-42ba-9c39-96a1e2e21cf9 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.506128 Aug 29 15:59:12.957968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:12.959246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:12.960978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:12.962759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:12.981384 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2312/4709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:12 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:13.048399 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c2b5dd5-a8a5-4062-954e-ce38d5264a8f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130481 Aug 29 15:59:13.049458 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2398/4710] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:12 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:13.975897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:13.977409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:13.990302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:13.990868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:13.991365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:13.992561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:13.993260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:13.993848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:14.061344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:14.063765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:14.076612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:14.079756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:14.080462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:14.085651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:14.086437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:14.087863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:14.172055 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f7ee987-3df6-42ae-bfe3-dce0afcfaa95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114616 Aug 29 15:59:14.175315 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2399/4711] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:14 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:14.297648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:14.308318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:14.312685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eb67e883-464a-4532-8426-8e459a48b66c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.343641 Aug 29 15:59:14.314129 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2313/4712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:13 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:15.232862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:15.253106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:15.274487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:15.275999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:15.276697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:15.283229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:15.284064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:15.286604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:15.345884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:15.346540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:15.353916 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd5995c5-b2c8-4f2a-8ab7-dab9bada41dc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167972 Aug 29 15:59:15.360198 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2400/4713] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:15 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:15.379009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:15.380092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:15.380832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:15.382396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:15.382493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:15.382882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:15.771883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:15.786284 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c908f26e-6d5d-45af-8dd8-6736e28570b0 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.455354 Aug 29 15:59:15.787900 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2314/4714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:15 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:15.808625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1645987163", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "ba153548-1b01-49c3-9509-2db158a70c7d"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:15.870423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] validate_networks() for [('ba153548-1b01-49c3-9509-2db158a70c7d', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:59:16.368570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:16.372159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:16.391825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.393514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.394732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.397435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.398056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.403485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.496249 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c917daff-7169-4bc3-8e14-2878d7028629 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134024 Aug 29 15:59:16.501643 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2315/4715] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:16 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:16.509598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3f667985-16d0-4931-929f-8e26dea3d81e req-664edb23-c628-4938-a6e2-d25b5cd4fb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ef635f-cc6e-406f-ae79-d188a302b255", "name": "network-vif-plugged", "status": "completed", "tag": "81229daf-ef7b-4493-99ba-22c2cb37e17d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:16.533414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3f667985-16d0-4931-929f-8e26dea3d81e req-664edb23-c628-4938-a6e2-d25b5cd4fb72 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.536531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3f667985-16d0-4931-929f-8e26dea3d81e req-664edb23-c628-4938-a6e2-d25b5cd4fb72 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.537798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3f667985-16d0-4931-929f-8e26dea3d81e req-664edb23-c628-4938-a6e2-d25b5cd4fb72 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.563953 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3f667985-16d0-4931-929f-8e26dea3d81e req-664edb23-c628-4938-a6e2-d25b5cd4fb72 service nova] Creating event network-vif-plugged:81229daf-ef7b-4493-99ba-22c2cb37e17d for instance 49ef635f-cc6e-406f-ae79-d188a302b255 on n-h2-836830-13 Aug 29 15:59:16.575646 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3f667985-16d0-4931-929f-8e26dea3d81e req-664edb23-c628-4938-a6e2-d25b5cd4fb72 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072577 Aug 29 15:59:16.578451 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2316/4716] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:16.586884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:59:16.588574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:59:16.588939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:59:16.589717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:59:16.590283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:59:16.617671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.618508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.619385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.620501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.621178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.621884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.647428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Getting quotas for project dafa4e08d2ea4279a3fde5bc1a7669d0. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:16.655735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Getting quotas for user afcf02d997e146caa206dce027e15db1 and project dafa4e08d2ea4279a3fde5bc1a7669d0. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:16.693606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:59:16.696786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:59:16.780162 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0641b8b5-9892-4447-a040-22628d35ed16 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.195134 Aug 29 15:59:16.782451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2401/4717] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:59:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:59:16.814845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-369856ce-035d-47a7-84df-536d52e06855 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:16.815723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-369856ce-035d-47a7-84df-536d52e06855 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:16.834850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:16.835587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:16.871846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.872268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.872852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:16.880875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:16.881370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:16.881815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:17.044441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-369856ce-035d-47a7-84df-536d52e06855 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:17.061103 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-369856ce-035d-47a7-84df-536d52e06855 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1214 microversion: 2.1 time: 0.269957 Aug 29 15:59:17.063782 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2317/4718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:16 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:17.135602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:17.145382 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef41f8f6-2f33-4b85-bf55-25a9f884f944 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.336789 Aug 29 15:59:17.146289 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2402/4719] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:16 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:17.509470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:17.518207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:17.541747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:17.542539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:17.543152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:17.544551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:17.547592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:17.550091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:17.642112 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b42f6596-0bbd-46a8-921a-cb0145fd70af tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135377 Aug 29 15:59:17.646387 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2318/4720] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:17 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:18.086980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:18.089129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:18.096780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.097377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.098465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.099624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.100160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.100658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.167102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:18.167722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:18.174871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.175705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.179475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.179598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:18.180914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.181619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.183425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.188730 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7e81db0-0b1b-4337-b3d3-49580e2d0b4a tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1266 microversion: 2.1 time: 0.107655 Aug 29 15:59:18.189628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2403/4721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:18 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:18.362597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:18.373882 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d3ef06f-09e7-4bc5-aeb3-f1569d3e5687 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1522 microversion: 2.1 time: 0.210821 Aug 29 15:59:18.375056 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2319/4722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:18 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:18.660815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:18.664759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:18.684596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.685402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.686631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.687747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:18.688532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:18.689478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:18.713557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:18.738448 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-069e0fd9-ecc4-4a64-b0da-bf05b8e82710 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086411 Aug 29 15:59:18.739876 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2404/4723] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:18 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:19.216744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:19.229405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:19.263787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.264256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.264699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.265643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.268465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.269119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.400124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:19.400808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:19.412829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.419758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.420221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.421013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.421637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.422283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.602579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:19.612014 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca10265a-cff1-451c-baa4-18aa78bea872 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1314 microversion: 2.1 time: 0.402518 Aug 29 15:59:19.613983 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2320/4724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:19 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:19.666273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:19.674491 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0aa7edb2-6f30-4c6d-b888-5ae059dd6e60 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1507 microversion: 2.1 time: 0.278772 Aug 29 15:59:19.690489 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2405/4725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:19 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:19.697000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:19.698028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:19.704679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.705600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.706326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.708329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.709115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.709765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.752099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:19.755884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:19.762628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.763438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.764232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.765173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.765948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.766642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.831285 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dfd7f82b-322f-4aaf-bc7b-81bd42c6a4c5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083481 Aug 29 15:59:19.838369 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2406/4726] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:19 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 15:59:19.905632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:19.906481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:19.914632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.915540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.916204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.917171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:19.917899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:19.918693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:19.948492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:19.993067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:20.010670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dc75e0f3-c7e3-4b16-9bd9-c2bf31a6f5cf tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 200 len: 1507 microversion: 2.1 time: 0.316820 Aug 29 15:59:20.012176 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2321/4727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:19 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:20.038455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:20.039429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:20.071352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.072287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a01346b2-a683-4bfb-87dc-e1c349a7a7ee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 204 len: 0 microversion: 2.1 time: 0.169552 Aug 29 15:59:20.073196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.076377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.077929 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2407/4728] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:19 2022] DELETE /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:20.080217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.084205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.084777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.085860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:20.086852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:20.094871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.095794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.096438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.097381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.099259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.100032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.196388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:20.385067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:20.396062 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e4880506-b055-467b-afb5-3ab6887f643c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1681 microversion: 2.1 time: 0.315981 Aug 29 15:59:20.412419 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2408/4729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:20 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1681 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:20.439132 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62327d92-6192-476f-8b2c-1893f7a71ef5 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "DELETE /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 204 len: 0 microversion: 2.1 time: 0.406889 Aug 29 15:59:20.440703 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2322/4730] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:20 2022] DELETE /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:20.588154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1cefca3c-9c61-4d9c-9b50-e776c98aabb7 req-9c35e818-6a27-45a6-962d-34d8ebf389be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae9384b0-b7a4-428e-a429-e71d9cb3c844", "tag": "0734bccc-ab06-4fec-9882-02f34173b3f6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:20.606941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1270552248", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "aca4efcc-32bf-4c7c-8bb1-34d4484e26bc"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:20.612962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:20.626601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1cefca3c-9c61-4d9c-9b50-e776c98aabb7 req-9c35e818-6a27-45a6-962d-34d8ebf389be service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.627111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1cefca3c-9c61-4d9c-9b50-e776c98aabb7 req-9c35e818-6a27-45a6-962d-34d8ebf389be service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.627544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1cefca3c-9c61-4d9c-9b50-e776c98aabb7 req-9c35e818-6a27-45a6-962d-34d8ebf389be service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.649784 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1cefca3c-9c61-4d9c-9b50-e776c98aabb7 req-9c35e818-6a27-45a6-962d-34d8ebf389be service nova] Creating event network-changed:0734bccc-ab06-4fec-9882-02f34173b3f6 for instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 on n-h1-836830-13 Aug 29 15:59:20.655286 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1cefca3c-9c61-4d9c-9b50-e776c98aabb7 req-9c35e818-6a27-45a6-962d-34d8ebf389be service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071501 Aug 29 15:59:20.656017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2409/4731] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:20.663724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:20.664855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:20.675141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.676149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.676892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.677893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:20.678695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:20.679636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:20.715705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] validate_networks() for [('aca4efcc-32bf-4c7c-8bb1-34d4484e26bc', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:59:20.877466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:20.887641 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9757d5f4-e902-4385-97ef-5427391970c1 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1314 microversion: 2.1 time: 0.230256 Aug 29 15:59:20.888861 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2410/4732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:20 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:21.421116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:21.425577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:59:21.426247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:59:21.427073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:59:21.427553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:59:21.428189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:59:21.431915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:21.439382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.440331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.441035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.441319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.442088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.442613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.442940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.443086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.443748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.444717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.445394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.446269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.466340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Getting quotas for project d4283ccfd2a54553896677a670e675f9. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:21.472689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Getting quotas for user 58ddd1273ce749e29578db36d61ca07a and project d4283ccfd2a54553896677a670e675f9. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:21.487497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:59:21.490325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:59:21.547971 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f49cf93-9e11-468e-b537-19c4ea1a971e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945612 Aug 29 15:59:21.548889 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2323/4733] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 15:59:21.560024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-558be5b0-1edc-4fcd-9d41-217c3f4fb5f3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:21.561133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-558be5b0-1edc-4fcd-9d41-217c3f4fb5f3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:21.610349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:21.620182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea1d10dd-66b4-4ce7-8cc8-a80078a3237f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1681 microversion: 2.1 time: 0.202955 Aug 29 15:59:21.623623 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2411/4734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:21 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:21.631412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-558be5b0-1edc-4fcd-9d41-217c3f4fb5f3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:21.643508 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-558be5b0-1edc-4fcd-9d41-217c3f4fb5f3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1218 microversion: 2.1 time: 0.087159 Aug 29 15:59:21.644649 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2324/4735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:21 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:21.911558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:21.912163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:21.920229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.921307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.922138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:21.924004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:21.924849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:21.925452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:22.172732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:22.186900 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6f7adfff-ce70-4758-a85d-b9e1c529b2d5 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1314 microversion: 2.1 time: 0.281913 Aug 29 15:59:22.191388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2412/4736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:21 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:22.646383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:22.647016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:22.654401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:22.654898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:22.655365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:22.656079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:22.656539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:22.656967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:22.666444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:22.667630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:22.675401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:22.676026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:22.676956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:22.677748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:22.678408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:22.678931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:22.762456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:22.772870 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c1bee8e8-1b3a-4613-96be-43df9475342f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1270 microversion: 2.1 time: 0.110342 Aug 29 15:59:22.773695 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2413/4737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:22 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:22.976298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:22.989489 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f859d467-c284-440a-859c-999be7ff33cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1681 microversion: 2.1 time: 0.347814 Aug 29 15:59:22.992040 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2325/4738] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:22 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1681 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:23.211511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:23.212294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:23.218778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.219534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.220177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.221075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.221552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.222184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.369044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:23.369560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:23.376541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.377350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.377967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.379545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.380207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.380807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.390379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:23.397546 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] HTTP exception thrown: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Request method failure captured: Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 HTTP/1.1 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDODggQQXOwCsr3V7XCt55ezJC6Qo5bdGD-FKA9qlFCnWnwAv0KlHYRXauOpL2AFGHoiCo8Gl9orxN1eZoejztsMWOiA58ZHMTJdYPNUvIbHnG7i_f1QlwqUtlGEZ0d5Rcqbepxy985b86QkI6KsA1LeRJ6f6-Z1oyHvCum5NAYW6MwQ Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c7ad457701f641bd963da9221fb04094", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c7ad457701f641bd963da9221fb04094"}]}] Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f554eb660c324a759d70b3b974e78db5 Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'feeb1ea1-65d9-4a46-93e4-298b1a4a4406'} Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:23.400081 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.418598 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.419838 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-591be813-de8f-4082-aea8-2081bf4f72b0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1314 microversion: 2.1 time: 0.194377 Aug 29 15:59:23.419838 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2414/4739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:23 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:23.424497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Returning 404 to user: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:23.426806 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9fb277c3-02b7-4b2c-a804-ad9978b89346 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 404 len: 111 microversion: 2.1 time: 0.063015 Aug 29 15:59:23.428867 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2326/4740] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:23 2022] DELETE /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:23.436256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:23.436981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: feeb1ea1-65d9-4a46-93e4-298b1a4a4406] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:23.443800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.444549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.445530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.445891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.446413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.446983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.464369 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] HTTP exception thrown: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Request method failure captured: Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 HTTP/1.1 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDODggQQXOwCsr3V7XCt55ezJC6Qo5bdGD-FKA9qlFCnWnwAv0KlHYRXauOpL2AFGHoiCo8Gl9orxN1eZoejztsMWOiA58ZHMTJdYPNUvIbHnG7i_f1QlwqUtlGEZ0d5Rcqbepxy985b86QkI6KsA1LeRJ6f6-Z1oyHvCum5NAYW6MwQ Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c7ad457701f641bd963da9221fb04094", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c7ad457701f641bd963da9221fb04094"}]}] Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f554eb660c324a759d70b3b974e78db5 Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'feeb1ea1-65d9-4a46-93e4-298b1a4a4406'} Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:23.466595 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.470364 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:23.470364 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:23.470364 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:23.470364 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:23.470364 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:23.470364 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. Aug 29 15:59:23.470364 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:23.472463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Returning 404 to user: Instance feeb1ea1-65d9-4a46-93e4-298b1a4a4406 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:23.474130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-26d0546d-934a-4a5a-a825-dac1e58cc3a3 tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406" status: 404 len: 111 microversion: 2.1 time: 0.042109 Aug 29 15:59:23.475528 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2415/4741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:23 2022] GET /compute/v2.1/servers/feeb1ea1-65d9-4a46-93e4-298b1a4a4406 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:23.799355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:23.799992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:23.815788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.816306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.817758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.819358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:23.820014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:23.829458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:23.976680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:23.998797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-67b7e21b-f808-4a43-8843-18ee96fa5c42 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1276 microversion: 2.1 time: 0.203631 Aug 29 15:59:24.000815 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2327/4742] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:23 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:24.011708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:24.012356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:24.030629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.031146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.031784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:24.032656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.033267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.033914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:24.293771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:24.308712 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f57d0613-1de5-42b8-bf25-e0f18c495dc2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1681 microversion: 2.1 time: 0.300854 Aug 29 15:59:24.309848 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2416/4743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:24 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1681 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:24.426702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:24.427760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:24.446904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.447437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.447881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:24.448585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:24.449041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:24.449467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.026548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:25.027201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:25.041923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:25.042676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:25.043349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.044242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:25.048165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:25.048800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.209753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:25.218346 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45372eed-686c-448d-ba93-fc2b34f36c99 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.195924 Aug 29 15:59:25.233417 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2417/4744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:25 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:25.272070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:25.292905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6c13c3dc-9c7a-4907-b3c5-46962f8aa87b tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1314 microversion: 2.1 time: 0.870695 Aug 29 15:59:25.294199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2328/4745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:24 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:25.331055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:25.332088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:25.339810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:25.340602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:25.341276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.342219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:25.342908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:25.343672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.501923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:25.511387 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4a3f4f6-db8d-424b-850c-c6eec481d4df tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1681 microversion: 2.1 time: 0.185174 Aug 29 15:59:25.531211 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2418/4746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:25 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:25.730818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7684adf6-dae0-4a5a-a144-44896fa0acc5 req-cd7447b3-7b4c-4a8d-98fe-ef0d19f10538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ef635f-cc6e-406f-ae79-d188a302b255", "name": "network-vif-deleted", "tag": "81229daf-ef7b-4493-99ba-22c2cb37e17d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:25.776085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7684adf6-dae0-4a5a-a144-44896fa0acc5 req-cd7447b3-7b4c-4a8d-98fe-ef0d19f10538 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:25.781538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7684adf6-dae0-4a5a-a144-44896fa0acc5 req-cd7447b3-7b4c-4a8d-98fe-ef0d19f10538 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:25.782117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7684adf6-dae0-4a5a-a144-44896fa0acc5 req-cd7447b3-7b4c-4a8d-98fe-ef0d19f10538 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:25.841247 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7684adf6-dae0-4a5a-a144-44896fa0acc5 req-cd7447b3-7b4c-4a8d-98fe-ef0d19f10538 service nova] Creating event network-vif-deleted:81229daf-ef7b-4493-99ba-22c2cb37e17d for instance 49ef635f-cc6e-406f-ae79-d188a302b255 on n-h2-836830-13 Aug 29 15:59:25.861489 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7684adf6-dae0-4a5a-a144-44896fa0acc5 req-cd7447b3-7b4c-4a8d-98fe-ef0d19f10538 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130377 Aug 29 15:59:25.862439 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2329/4747] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:26.240238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:26.240940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:26.257456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.259318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.260154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.261265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.261914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.264258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.314822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:26.315709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:26.326210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.326787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.334175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.336389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.337100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.338587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.544633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:26.558235 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90513f61-7fd7-46ba-8174-539566fbaa5f tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.322697 Aug 29 15:59:26.563132 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2419/4748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:26 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:26.575362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:26.576615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:26.591307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.593023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.593702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.595132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.596352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.597165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.640538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:26.704572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:26.783321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:26.790617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:26.799402 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-518e372d-4da0-423d-b0b3-306d1af2584d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1614 microversion: 2.1 time: 0.236648 Aug 29 15:59:26.801640 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2420/4749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:26 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1614 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:26.813738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a685a208-3675-407c-b5a1-8671154f80e2 req-b1a2b105-5b38-41a1-b60f-4c78b6eab87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9384b0-b7a4-428e-a429-e71d9cb3c844", "name": "network-vif-plugged", "status": "completed", "tag": "0734bccc-ab06-4fec-9882-02f34173b3f6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:26.865780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a685a208-3675-407c-b5a1-8671154f80e2 req-b1a2b105-5b38-41a1-b60f-4c78b6eab87e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:26.868263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a685a208-3675-407c-b5a1-8671154f80e2 req-b1a2b105-5b38-41a1-b60f-4c78b6eab87e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:26.870034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a685a208-3675-407c-b5a1-8671154f80e2 req-b1a2b105-5b38-41a1-b60f-4c78b6eab87e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:26.969321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a685a208-3675-407c-b5a1-8671154f80e2 req-b1a2b105-5b38-41a1-b60f-4c78b6eab87e service nova] Creating event network-vif-plugged:0734bccc-ab06-4fec-9882-02f34173b3f6 for instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 on n-h1-836830-13 Aug 29 15:59:27.011606 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a685a208-3675-407c-b5a1-8671154f80e2 req-b1a2b105-5b38-41a1-b60f-4c78b6eab87e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206894 Aug 29 15:59:27.037371 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2421/4750] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:27.170755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:27.183243 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fbb3c23-1768-4552-ab57-cf8582b18d20 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1314 microversion: 2.1 time: 0.872029 Aug 29 15:59:27.197247 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2330/4751] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:26 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:27.582929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:27.583778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:27.596312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.598761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.599427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.602474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.603318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.603968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.822983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:27.823838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:27.837609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.838102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.838539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.839338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.839807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.840230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.885756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:27.897828 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-191c91c0-ffdc-46cb-aa35-52ee6e9b267e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.319666 Aug 29 15:59:27.901568 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2422/4752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:27 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:27.914786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-accd011c-48e9-4eac-b8ac-279c3b5e4712 req-3f8aa3f3-be82-4d8d-b645-4bfeab6478bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1437eae0-dfed-4046-b2a9-3ac8b9783e9b", "name": "network-vif-deleted", "tag": "9ea3ed73-8c83-406d-a7ea-2757956e4f36"}, {"name": "network-changed", "server_uuid": "08053c8b-a658-4d20-aeef-518e9064c135", "tag": "02c755fa-deca-42f8-b4a8-011f0e9e7d7b"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:27.944887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.945400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.947317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.947806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lazy-loading 'fault' on Instance uuid 1437eae0-dfed-4046-b2a9-3ac8b9783e9b {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:27.964148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-accd011c-48e9-4eac-b8ac-279c3b5e4712 req-3f8aa3f3-be82-4d8d-b645-4bfeab6478bf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:27.965089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-accd011c-48e9-4eac-b8ac-279c3b5e4712 req-3f8aa3f3-be82-4d8d-b645-4bfeab6478bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:27.965916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-accd011c-48e9-4eac-b8ac-279c3b5e4712 req-3f8aa3f3-be82-4d8d-b645-4bfeab6478bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:27.997218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-accd011c-48e9-4eac-b8ac-279c3b5e4712 req-3f8aa3f3-be82-4d8d-b645-4bfeab6478bf service nova] Creating event network-vif-deleted:9ea3ed73-8c83-406d-a7ea-2757956e4f36 for instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b on n-h2-836830-13 Aug 29 15:59:27.998079 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-accd011c-48e9-4eac-b8ac-279c3b5e4712 req-3f8aa3f3-be82-4d8d-b645-4bfeab6478bf service nova] Creating event network-changed:02c755fa-deca-42f8-b4a8-011f0e9e7d7b for instance 08053c8b-a658-4d20-aeef-518e9064c135 on n-h1-836830-13 Aug 29 15:59:28.016707 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-accd011c-48e9-4eac-b8ac-279c3b5e4712 req-3f8aa3f3-be82-4d8d-b645-4bfeab6478bf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.111944 Aug 29 15:59:28.017652 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2423/4753] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:28.064114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:28.079750 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e45145d-9371-4534-9986-832ec8adbecf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 200 len: 1332 microversion: 2.1 time: 0.259336 Aug 29 15:59:28.080365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2331/4754] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:27 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 1332 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:28.202087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:28.206282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:28.206479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:28.208697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:28.219750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.222409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.222409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.222409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.222862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.224202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.232181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.232805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.234217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.235050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.243836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.244465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.276105 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] HTTP exception thrown: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Request method failure captured: Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 HTTP/1.1 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDODggQQXOwCsr3V7XCt55ezJC6Qo5bdGD-FKA9qlFCnWnwAv0KlHYRXauOpL2AFGHoiCo8Gl9orxN1eZoejztsMWOiA58ZHMTJdYPNUvIbHnG7i_f1QlwqUtlGEZ0d5Rcqbepxy985b86QkI6KsA1LeRJ6f6-Z1oyHvCum5NAYW6MwQ Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c7ad457701f641bd963da9221fb04094", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c7ad457701f641bd963da9221fb04094"}]}] Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f554eb660c324a759d70b3b974e78db5 Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '2f7d43fd-6072-4fe5-ba70-357fa11e2c25'} Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:28.278244 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.282958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.283801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Returning 404 to user: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:28.284745 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2d8b41c6-dfd0-4bac-840d-e4577ceb459f tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 404 len: 111 microversion: 2.1 time: 0.090865 Aug 29 15:59:28.287679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2424/4755] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:28 2022] DELETE /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:28.297165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:28.297874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] [instance: 2f7d43fd-6072-4fe5-ba70-357fa11e2c25] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:28.307950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.309228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.309764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.310556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.311114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.311752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.359557 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] HTTP exception thrown: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Request method failure captured: Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 HTTP/1.1 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDODggQQXOwCsr3V7XCt55ezJC6Qo5bdGD-FKA9qlFCnWnwAv0KlHYRXauOpL2AFGHoiCo8Gl9orxN1eZoejztsMWOiA58ZHMTJdYPNUvIbHnG7i_f1QlwqUtlGEZ0d5Rcqbepxy985b86QkI6KsA1LeRJ6f6-Z1oyHvCum5NAYW6MwQ Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c7ad457701f641bd963da9221fb04094", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c7ad457701f641bd963da9221fb04094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c7ad457701f641bd963da9221fb04094"}]}] Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: c7ad457701f641bd963da9221fb04094 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1567543576 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f554eb660c324a759d70b3b974e78db5 Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeTestJSON-1567543576-project Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '2f7d43fd-6072-4fe5-ba70-357fa11e2c25'} Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:28.361136 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] Returning 404 to user: Instance 2f7d43fd-6072-4fe5-ba70-357fa11e2c25 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:28.365882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ef5d25a-b458-47be-9523-00ac7f38079c tempest-AttachVolumeTestJSON-1567543576 tempest-AttachVolumeTestJSON-1567543576-project] 10.222.0.83 "GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25" status: 404 len: 111 microversion: 2.1 time: 0.070693 Aug 29 15:59:28.384211 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2425/4756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:28 2022] GET /compute/v2.1/servers/2f7d43fd-6072-4fe5-ba70-357fa11e2c25 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:28.610001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:28.619441 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6142e387-2d78-44eb-ada3-7f422187cef0 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1314 microversion: 2.1 time: 0.418271 Aug 29 15:59:28.626245 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2332/4757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:28 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:28.926342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:28.927817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:28.935970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.937064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.937964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:28.939271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:28.939919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:28.940535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:29.105474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:29.106291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:29.124979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:29.125784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:29.126384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:29.127350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:29.127814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:29.128244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:29.141232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:29.156996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b HTTP/1.1 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1437eae0-dfed-4046-b2a9-3ac8b9783e9b'} Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:29.158902 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:29.164114 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:29.164114 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:29.164114 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:29.164114 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:29.164114 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:29.164114 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 15:59:29.164114 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:29.164965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:29.166593 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f783dc89-c94d-44d3-96a4-54b8f41ec84a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 404 len: 111 microversion: 2.1 time: 0.065160 Aug 29 15:59:29.171874 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2333/4758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:29 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:29.179427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ff166d1-b36c-4455-97b6-3d5f520d2055 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '.version_select at 0x7f32eda4da60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:29.215922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ff166d1-b36c-4455-97b6-3d5f520d2055 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740707574" status: 202 len: 0 microversion: 2.1 time: 0.042436 Aug 29 15:59:29.217139 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2334/4759] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 15:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740707574 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:59:29.267980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:29.279016 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33b54953-3177-40e5-ba69-6b462b952014 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.355901 Aug 29 15:59:29.295259 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2426/4760] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:28 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:29.648465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:29.649525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:29.656761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:29.657812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:29.658473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:29.659575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:29.661230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:29.662017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.301826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:30.303374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:30.310431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.311884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.312587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.313687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:30.314357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:30.315576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:30.484608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:30.497978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f6deafb9-d436-4b5f-886a-38db5603ffc2 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1497 microversion: 2.1 time: 0.853617 Aug 29 15:59:30.500318 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2335/4761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:29 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1497 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:30.541843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:30.554583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c409bfd-c592-4902-ad00-b93fe5bb2415 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.255816 Aug 29 15:59:30.558340 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2427/4762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:30 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:31.591319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:31.592544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:31.611477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:31.616111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.622589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.626105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.631845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:31.632348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:31.632788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:31.642375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=10 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:31.690945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7f758b3-baef-43e9-832c-3709d5e9ebb8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: .version_select at 0x7f32ed395160>, body: {"keypair": {"name": "tempest-keypair-1096685613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASyORupI64K2XNNhCFtl7fEzGaNsIwslirwb7No2aofCroLaMW4YeEjP7zkYTQn7HdsZTkyNBWAfQLdX01YI+5oabJGfPfBajZyFI/LYKIRDy737uyB8IrCLBTF0qXnGg=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:31.781910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b7f758b3-baef-43e9-832c-3709d5e9ebb8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:31.822058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b7f758b3-baef-43e9-832c-3709d5e9ebb8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:31.869874 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7f758b3-baef-43e9-832c-3709d5e9ebb8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183886 Aug 29 15:59:31.871457 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2428/4763] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 15:59:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:32.089689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:32.109467 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c9206209-4a85-46ef-9af2-d927475e2939 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.522290 Aug 29 15:59:32.111321 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2336/4764] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:31 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:33.135681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:33.136982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:33.153074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:33.155989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:33.156478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:33.157237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:33.157707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:33.163985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:33.529258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:33.538704 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-440f3a09-f89d-499d-86ad-3adfe4352f48 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.409673 Aug 29 15:59:33.544572 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2429/4765] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:33 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:34.532722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4119e86e-1f72-42aa-8eff-a6ed67271784"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:34.535847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:34.545423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:34.546170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:34.546624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:34.547520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:34.548102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:34.548725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:34.568875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:34.569568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:34.596102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:34.596616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:34.597073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:34.597853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:34.601531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:34.604162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.076547 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40f9696b-9b92-4441-844a-8500126c5377 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "POST /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547613 Aug 29 15:59:35.078271 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2337/4766] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 15:59:34 2022] POST /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:35.107237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-61daa784-5181-4a15-808e-2d2d16020dc2 req-26b7e725-1a10-4c2a-b729-5089fcf5cf5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08053c8b-a658-4d20-aeef-518e9064c135", "name": "network-vif-plugged", "status": "completed", "tag": "02c755fa-deca-42f8-b4a8-011f0e9e7d7b"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:35.127335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61daa784-5181-4a15-808e-2d2d16020dc2 req-26b7e725-1a10-4c2a-b729-5089fcf5cf5a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.128588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61daa784-5181-4a15-808e-2d2d16020dc2 req-26b7e725-1a10-4c2a-b729-5089fcf5cf5a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.130625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61daa784-5181-4a15-808e-2d2d16020dc2 req-26b7e725-1a10-4c2a-b729-5089fcf5cf5a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.148718 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-61daa784-5181-4a15-808e-2d2d16020dc2 req-26b7e725-1a10-4c2a-b729-5089fcf5cf5a service nova] Creating event network-vif-plugged:02c755fa-deca-42f8-b4a8-011f0e9e7d7b for instance 08053c8b-a658-4d20-aeef-518e9064c135 on n-h1-836830-13 Aug 29 15:59:35.155403 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-61daa784-5181-4a15-808e-2d2d16020dc2 req-26b7e725-1a10-4c2a-b729-5089fcf5cf5a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061613 Aug 29 15:59:35.157152 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2338/4767] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:35.219324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:35.243198 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-923ba4dc-453d-4cdd-bf81-3ccf11ba78c8 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.680491 Aug 29 15:59:35.261022 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2430/4768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:34 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:35.635721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:35.637718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:35.649292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.652289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.654085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.656310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.657025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.659976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.703553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:35.867621 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dab2f7fc-4929-4dcf-910f-838d69446e07 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 204 len: 0 microversion: 2.1 time: 0.240237 Aug 29 15:59:35.868744 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2339/4769] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:35 2022] DELETE /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:35.877337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:35.879647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:35.887805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.888809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.889451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:35.890385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:35.891063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:35.892411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.057255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1353022573", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d59f56-5b97-48d6-a59a-2e49bdfbf90b"}], "security_groups": [{"name": "tempest-securitygroup--1133207370"}], "key_name": "tempest-keypair-1096685613", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:36.131330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:36.148251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-27a8d9bd-66a3-4bc6-9baa-cbeb68b37e64 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1503 microversion: 2.1 time: 0.274201 Aug 29 15:59:36.165365 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2431/4770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:35 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1503 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:36.220428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] validate_networks() for [('e9d59f56-5b97-48d6-a59a-2e49bdfbf90b', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 15:59:36.274517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:36.275479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:36.289670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.290295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.290745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.291502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.293787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.294260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.547335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:36.566710 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92fada10-c9de-4437-bea4-15654c4eec75 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1318 microversion: 2.1 time: 0.298719 Aug 29 15:59:36.577108 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2432/4771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:36 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:36.588866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:36.900391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 15:59:36.900998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 15:59:36.901515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 15:59:36.902208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 15:59:36.903521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 15:59:36.915842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.916633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.917169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.918156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:36.918711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:36.919257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:36.935062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-926b0d43-26d5-4e34-9636-ac368165e4c9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Action: 'create', calling method: .version_select at 0x7f32ed2e1d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2071537144"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:36.956336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 15:59:36.963582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 15:59:36.980196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 15:59:36.982917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 15:59:37.043414 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-891a3c4e-feab-43d9-a712-b3fcd609ef67 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.991989 Aug 29 15:59:37.044236 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2340/4772] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 15:59:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 15:59:37.065066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2d784e45-f490-4510-b1ff-f9d58238b2b1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:37.065674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2d784e45-f490-4510-b1ff-f9d58238b2b1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:37.164072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d784e45-f490-4510-b1ff-f9d58238b2b1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:37.178130 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2d784e45-f490-4510-b1ff-f9d58238b2b1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1242 microversion: 2.1 time: 0.125408 Aug 29 15:59:37.182691 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2341/4773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:37 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:37.195244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:37.199161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:37.216392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.216919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.217868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.220464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.225840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.226791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.870953 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-926b0d43-26d5-4e34-9636-ac368165e4c9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.102456 Aug 29 15:59:37.871784 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2433/4774] 10.222.0.83 () {60 vars in 1155 bytes} [Mon Aug 29 15:59:36 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1104 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 15:59:37.877595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:37.878217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:37.899632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.900157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.900935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.902213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:37.902941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:37.903577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:37.968476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:37.992832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a43cb5b-0c5b-4005-a6fc-5bf56cf3a3bb tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1503 microversion: 2.1 time: 0.808562 Aug 29 15:59:37.994947 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2342/4775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:37 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1503 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:38.016372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9bbc141-5b24-423c-b06a-09d476706d9e tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed60c700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:38.180259 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a9bbc141-5b24-423c-b06a-09d476706d9e tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 200 len: 345 microversion: 2.1 time: 0.183204 Aug 29 15:59:38.182060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2343/4776] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:37 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:38.205762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:38.207189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:38.220537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.223945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.224408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.225159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.225635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.226143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.259015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:38.269440 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-920b1cd5-e9e8-4d80-b3d8-3e1cd38da34e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1508 microversion: 2.1 time: 0.396572 Aug 29 15:59:38.293100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2434/4777] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:37 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:38.300528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:38.303856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:38.323979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.326401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.327287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.328675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.330623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.331190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.447842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:38.477211 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-43891ecd-3cd7-4081-b611-aad80f55a2c0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1246 microversion: 2.1 time: 0.277949 Aug 29 15:59:38.477843 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2344/4778] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:38 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1246 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:38.587847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:38.600945 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a7d3a10-64c8-48bd-8c3c-8ced14725503 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1508 microversion: 2.1 time: 0.304189 Aug 29 15:59:38.616705 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2435/4779] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:38 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:38.627400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:38.630082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:38.644160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.645308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.649872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.652066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.652969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.653562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.856626 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d132030-b6ad-4da7-88b8-514b8dc0677c tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "PUT /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1080 microversion: 2.1 time: 0.232064 Aug 29 15:59:38.866738 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2345/4780] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 15:59:38 2022] PUT /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1080 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:38.878874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:38.880692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:38.909566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.912151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.912800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:38.916557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:38.920708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:38.921450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.023128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:39.026100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:39.068767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.073034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.074515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.076767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.082438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.084803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.357904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afcf02d997e146caa206dce027e15db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dafa4e08d2ea4279a3fde5bc1a7669d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:39.375302 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbcbe3f6-9b3c-4519-b292-00cf82262c45 tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 200 len: 1299 microversion: 2.1 time: 0.358712 Aug 29 15:59:39.376166 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2346/4781] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:39 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 1299 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:39.385924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b3ae9783-36f0-4bc1-8cad-b7edc8532a45 req-82550154-1ace-4c60-b640-34f15ab7ce46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae9384b0-b7a4-428e-a429-e71d9cb3c844", "name": "network-vif-deleted", "tag": "0734bccc-ab06-4fec-9882-02f34173b3f6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:39.412931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b3ae9783-36f0-4bc1-8cad-b7edc8532a45 req-82550154-1ace-4c60-b640-34f15ab7ce46 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.416280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b3ae9783-36f0-4bc1-8cad-b7edc8532a45 req-82550154-1ace-4c60-b640-34f15ab7ce46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.417732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b3ae9783-36f0-4bc1-8cad-b7edc8532a45 req-82550154-1ace-4c60-b640-34f15ab7ce46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.420231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:39.437435 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52bbfef1-de5b-4959-a1cc-c0175fdb5710 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1506 microversion: 2.1 time: 0.562648 Aug 29 15:59:39.449757 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2436/4782] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:38 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:39.465768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-96fc5623-5d5b-4b63-9bd2-3e6d0db31eeb tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ee5e5940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:39.501967 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b3ae9783-36f0-4bc1-8cad-b7edc8532a45 req-82550154-1ace-4c60-b640-34f15ab7ce46 service nova] Creating event network-vif-deleted:0734bccc-ab06-4fec-9882-02f34173b3f6 for instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 on n-h1-836830-13 Aug 29 15:59:39.528353 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b3ae9783-36f0-4bc1-8cad-b7edc8532a45 req-82550154-1ace-4c60-b640-34f15ab7ce46 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130353 Aug 29 15:59:39.529115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2347/4783] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:39.536384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:39.554019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:39.574803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.577861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.581854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.586502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.589184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.591791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.640982 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-96fc5623-5d5b-4b63-9bd2-3e6d0db31eeb tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 200 len: 345 microversion: 2.1 time: 0.196156 Aug 29 15:59:39.641910 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2437/4784] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:39 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:39.648308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:39.649134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:39.665410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.670346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.672584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.677253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:39.678869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:39.681949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:39.844202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:39.860734 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31aa8275-826a-424e-9ba1-4a55ce317964 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1312 microversion: 2.1 time: 0.217071 Aug 29 15:59:39.862360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2438/4785] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:39 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:40.128164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:40.142025 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd71c641-2956-44fd-9c63-1f88176a5e95 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1506 microversion: 2.1 time: 0.610173 Aug 29 15:59:40.145593 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2348/4786] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:39 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:40.170284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:40.173706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:40.183554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.184052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.184498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.185306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.185897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.186341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.283785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-13b2ee81-c271-4b9b-a4bb-18e9ea52e84d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "PUT /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1082 microversion: 2.1 time: 0.119905 Aug 29 15:59:40.286327 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2439/4787] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 15:59:40 2022] PUT /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1082 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:40.307850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:40.308821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:40.327713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.329792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.331484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.335424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.337070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.338536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.402251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:40.406020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] [instance: ae9384b0-b7a4-428e-a429-e71d9cb3c844] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:40.430724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.435543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.436465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.438713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.439888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.442204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.483860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] HTTP exception thrown: Instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 could not be found. Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Request method failure captured: Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 HTTP/1.1 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOJQONbHU29iDO5z-lmlkPLyeQOMiaOLTUSP46qF3JkwN96zKA0Rg99iGsKqBYX8MoPQKCd-LoENZJH66S8VvxDRuzFbjoXQdemPKUT0QRF3rkLYYL1gXPrBW3EynK_FezApnjRHB4LpMNyW2087i1CDI_mArwRDA8utjpsmAejorJ4 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: dafa4e08d2ea4279a3fde5bc1a7669d0 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesActionsTest-719772010 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dafa4e08d2ea4279a3fde5bc1a7669d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_dafa4e08d2ea4279a3fde5bc1a7669d0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/dafa4e08d2ea4279a3fde5bc1a7669d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/dafa4e08d2ea4279a3fde5bc1a7669d0"}]}] Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesActionsTest-719772010 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: dafa4e08d2ea4279a3fde5bc1a7669d0 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesActionsTest-719772010 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesActionsTest-719772010-project Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: afcf02d997e146caa206dce027e15db1 Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesActionsTest-719772010-project Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 could not be found. Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ae9384b0-b7a4-428e-a429-e71d9cb3c844'} Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 could not be found. Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 could not be found. Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:40.488040 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:40.493589 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:40.493589 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:40.493589 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:40.493589 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:40.493589 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:40.493589 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 could not be found. Aug 29 15:59:40.493589 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:40.495483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] Returning 404 to user: Instance ae9384b0-b7a4-428e-a429-e71d9cb3c844 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:40.496974 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e27f77be-5e38-4e70-8c4d-4bc63174cbfc tempest-VolumesActionsTest-719772010 tempest-VolumesActionsTest-719772010-project] 10.222.0.83 "GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844" status: 404 len: 111 microversion: 2.1 time: 0.103474 Aug 29 15:59:40.498077 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2440/4788] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:40 2022] GET /compute/v2.1/servers/ae9384b0-b7a4-428e-a429-e71d9cb3c844 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:40.658549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dcb46cc4-e9ee-4ac2-93b2-927c6c5c6032 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ee2cc1f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:40.693121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:40.710454 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2140ed2d-257b-4d8f-874c-29c724e4f8f2 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1508 microversion: 2.1 time: 0.403058 Aug 29 15:59:40.711443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2349/4789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:40 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1508 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:40.733031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:40.733936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:40.743775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.746833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.747741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:40.749689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:40.752580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:40.753234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.011416 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dcb46cc4-e9ee-4ac2-93b2-927c6c5c6032 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 200 len: 346 microversion: 2.1 time: 0.358774 Aug 29 15:59:41.012484 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2441/4790] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:40 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 346 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:41.028167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.029041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:41.062793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.064487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.069506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.070549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.073685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.076163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.238332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:41.265753 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72473937-0af1-43d4-aba6-016e5ba0351b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1300 microversion: 2.1 time: 0.251519 Aug 29 15:59:41.283817 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2442/4791] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:41 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1300 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:41.292139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8410511e-2796-4a9c-96b9-dfee695be353 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Action: 'create', calling method: .version_select at 0x7f32ed91e8b0>, body: {"snapshot": {"volume_id": "49c9d97e-608f-4076-b1ea-a55b51a55031", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1194137598"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:41.327467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:41.348960 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-45430347-34f3-4017-a283-37b48ade0099 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1508 microversion: 2.1 time: 0.618552 Aug 29 15:59:41.359305 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2350/4792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:40 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1508 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:41.374492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.375146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:41.389928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.397884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.404853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.407106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.408104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.409191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.471386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:41.486721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:41.660444 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8410511e-2796-4a9c-96b9-dfee695be353 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.375036 Aug 29 15:59:41.661953 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2443/4793] 10.222.0.83 () {60 vars in 1162 bytes} [Mon Aug 29 15:59:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:41.674618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d70ff894-1dee-4943-b067-b7dd0dc9280a tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed938ee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.696614 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e10333b-01ed-41d4-a591-f74ae7a2a306 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "DELETE /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 204 len: 0 microversion: 2.1 time: 0.317674 Aug 29 15:59:41.706135 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2351/4794] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:41 2022] DELETE /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 15:59:41.729823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.730403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:41.746185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d70ff894-1dee-4943-b067-b7dd0dc9280a tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 287 microversion: 2.1 time: 0.076666 Aug 29 15:59:41.749493 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2444/4795] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:41 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:41.757774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.758526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.759225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.760211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:41.760828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:41.761440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:41.762537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3fb914fd-f848-48b4-b2bf-c3ecf5667af5 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed90e700>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.822335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3fb914fd-f848-48b4-b2bf-c3ecf5667af5 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.065399 Aug 29 15:59:41.825620 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2445/4796] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 15:59:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:41.837977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f7ef89af-846f-4773-aa65-345ed97afe3c tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed2a0a60>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:41.855309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:41.856871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 15:59:41.924367 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f7ef89af-846f-4773-aa65-345ed97afe3c tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 287 microversion: 2.1 time: 0.091673 Aug 29 15:59:41.925779 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2446/4797] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:41 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:41.999908 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.compute.api [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Instance is already in deleting state, ignoring this request Aug 29 15:59:42.006510 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8a767fc-7581-4d9f-8e43-b289ecf39c7d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "DELETE /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 204 len: 0 microversion: 2.1 time: 0.295369 Aug 29 15:59:42.006993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2352/4798] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:41 2022] DELETE /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 15:59:42.018761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:42.022626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:42.045861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:42.046484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:42.046892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:42.051647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:42.054062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:42.054604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:42.289952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:42.290572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:42.300207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:42.300697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:42.301761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:42.302739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:42.303232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:42.303661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:42.377226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:42.387360 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-229fa398-2dff-450c-93a7-ab49158ca070 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1514 microversion: 2.1 time: 0.375259 Aug 29 15:59:42.389825 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2447/4799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:42 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:42.642178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:42.650382 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-239abcfd-732b-4a32-a335-80087571745e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.364817 Aug 29 15:59:42.667168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2353/4800] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:42 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:42.938040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a850b93-9120-4784-84b7-94ec23143ce5 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ee2cc1f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:42.975933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-69fecd69-e5f8-43ea-a33b-c7a2af0f88ac req-785974e9-2ad6-4b9b-9f76-6e3cc7242104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc5de0-11ee-454e-a7d9-941f08fef311", "tag": "3cabd8d1-dd8b-4902-be8d-ef97792e2af8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:43.001345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-69fecd69-e5f8-43ea-a33b-c7a2af0f88ac req-785974e9-2ad6-4b9b-9f76-6e3cc7242104 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.002507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-69fecd69-e5f8-43ea-a33b-c7a2af0f88ac req-785974e9-2ad6-4b9b-9f76-6e3cc7242104 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.003133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-69fecd69-e5f8-43ea-a33b-c7a2af0f88ac req-785974e9-2ad6-4b9b-9f76-6e3cc7242104 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.016407 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-69fecd69-e5f8-43ea-a33b-c7a2af0f88ac req-785974e9-2ad6-4b9b-9f76-6e3cc7242104 service nova] Creating event network-changed:3cabd8d1-dd8b-4902-be8d-ef97792e2af8 for instance 65fc5de0-11ee-454e-a7d9-941f08fef311 on n-h2-836830-13 Aug 29 15:59:43.023846 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-69fecd69-e5f8-43ea-a33b-c7a2af0f88ac req-785974e9-2ad6-4b9b-9f76-6e3cc7242104 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053071 Aug 29 15:59:43.027952 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2354/4801] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:43.130737 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a850b93-9120-4784-84b7-94ec23143ce5 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 287 microversion: 2.1 time: 0.197416 Aug 29 15:59:43.131368 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2448/4802] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:42 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:43.419053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:43.419936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:43.433538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.434040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.441039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.445794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.446490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.447156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.680193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:43.680825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:43.710799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.711335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.711783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.724883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:43.726199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:43.726669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:43.852712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:43.862632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:43.874754 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14ef65be-56e3-4a59-a98c-fb09d8d3f9d7 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1514 microversion: 2.1 time: 0.460438 Aug 29 15:59:43.891093 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2355/4803] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:43 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1514 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:44.099316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:44.109752 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e40175f8-7849-405d-b414-8705ec780007 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.439001 Aug 29 15:59:44.130724 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2449/4804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:43 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:44.143383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae64bb1a-def4-4bae-976f-5b53c8e1d9a1 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed5bdb80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:44.307380 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae64bb1a-def4-4bae-976f-5b53c8e1d9a1 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 287 microversion: 2.1 time: 0.167789 Aug 29 15:59:44.308297 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2356/4805] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:44 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:44.902176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:44.902812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:44.918822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:44.919815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:44.925679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:44.926793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:44.927626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:44.928323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.135538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:45.136078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:45.149315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.149863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.150322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.151135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.151541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.152005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.395365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ddd1273ce749e29578db36d61ca07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4283ccfd2a54553896677a670e675f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:45.407719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-758a96aa-7948-49da-ae6b-da8e1eb355d3 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 200 len: 1514 microversion: 2.1 time: 0.509884 Aug 29 15:59:45.428084 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2450/4806] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:44 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 1514 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:45.440716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b6af224-c60b-431a-9c35-fda2b77d3326 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ee242670>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:45.586683 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b6af224-c60b-431a-9c35-fda2b77d3326 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 288 microversion: 2.1 time: 0.171696 Aug 29 15:59:45.590696 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2451/4807] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:45 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:45.593777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:45.602122 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e7aa09a-6d9b-4da2-834d-26c0745da0fd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.472214 Aug 29 15:59:45.602727 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2357/4808] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:45 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:45.604014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-26f95b50-ecd5-4fe9-95d4-b87308dc0f73 req-d417a4ea-c50c-43f2-b7d2-86e1ecde9b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08053c8b-a658-4d20-aeef-518e9064c135", "name": "network-vif-deleted", "tag": "02c755fa-deca-42f8-b4a8-011f0e9e7d7b"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:45.612099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2d6ae7a-5bff-412e-b895-fda3b617c5db tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed5795e0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:45.621383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-26f95b50-ecd5-4fe9-95d4-b87308dc0f73 req-d417a4ea-c50c-43f2-b7d2-86e1ecde9b59 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:45.622128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-26f95b50-ecd5-4fe9-95d4-b87308dc0f73 req-d417a4ea-c50c-43f2-b7d2-86e1ecde9b59 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:45.623296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-26f95b50-ecd5-4fe9-95d4-b87308dc0f73 req-d417a4ea-c50c-43f2-b7d2-86e1ecde9b59 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:45.675357 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-26f95b50-ecd5-4fe9-95d4-b87308dc0f73 req-d417a4ea-c50c-43f2-b7d2-86e1ecde9b59 service nova] Creating event network-vif-deleted:02c755fa-deca-42f8-b4a8-011f0e9e7d7b for instance 08053c8b-a658-4d20-aeef-518e9064c135 on n-h1-836830-13 Aug 29 15:59:45.696373 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-26f95b50-ecd5-4fe9-95d4-b87308dc0f73 req-d417a4ea-c50c-43f2-b7d2-86e1ecde9b59 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104025 Aug 29 15:59:45.701002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2452/4809] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:45.721862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2d6ae7a-5bff-412e-b895-fda3b617c5db tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 202 len: 0 microversion: 2.1 time: 0.118046 Aug 29 15:59:45.722445 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2358/4810] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 15:59:45 2022] DELETE /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:59:45.733802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0513715-5be6-4ec2-a55f-94cb65540d75 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32eef84ca0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:45.828273 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0513715-5be6-4ec2-a55f-94cb65540d75 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 287 microversion: 2.1 time: 0.100770 Aug 29 15:59:45.829039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2453/4811] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:45 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:46.439114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.439742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 08053c8b-a658-4d20-aeef-518e9064c135] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:46.458449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.459803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.461243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.462534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.463465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.464188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.490418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] HTTP exception thrown: Instance 08053c8b-a658-4d20-aeef-518e9064c135 could not be found. Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Request method failure captured: Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 HTTP/1.1 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOHMTZ6meCPfdi3b70KCmLV749vJRIemhwxsyO6BxFT-LHqh3RBwPUwGNI6fuhvOvvEDP0dvj6wKzx6fYiRv-Afx3S7hUF_FYQE_JaGbVe57b0rpEh9nsPpRiTU3H64ziEDo76GgrrNHuGvNTWdMkflWLFyug9WpzhHpZ0rIdni_irU Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d4283ccfd2a54553896677a670e675f9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d4283ccfd2a54553896677a670e675f9"}]}] Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 58ddd1273ce749e29578db36d61ca07a Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 08053c8b-a658-4d20-aeef-518e9064c135 could not be found. Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '08053c8b-a658-4d20-aeef-518e9064c135'} Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08053c8b-a658-4d20-aeef-518e9064c135 could not be found. Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08053c8b-a658-4d20-aeef-518e9064c135 could not be found. Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.492556 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.497231 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.497231 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.497231 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.497231 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:46.497231 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:46.497231 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08053c8b-a658-4d20-aeef-518e9064c135 could not be found. Aug 29 15:59:46.497231 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.499647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Returning 404 to user: Instance 08053c8b-a658-4d20-aeef-518e9064c135 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:46.501390 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c73f9949-8017-4356-8f76-6c2c1599d99e tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135" status: 404 len: 111 microversion: 2.1 time: 0.071253 Aug 29 15:59:46.501985 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2359/4812] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:46 2022] GET /compute/v2.1/servers/08053c8b-a658-4d20-aeef-518e9064c135 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:46.511828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.513371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:46.521760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.522517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.523155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.524066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.525048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.525655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.543474 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] HTTP exception thrown: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Request method failure captured: Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 HTTP/1.1 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOHMTZ6meCPfdi3b70KCmLV749vJRIemhwxsyO6BxFT-LHqh3RBwPUwGNI6fuhvOvvEDP0dvj6wKzx6fYiRv-Afx3S7hUF_FYQE_JaGbVe57b0rpEh9nsPpRiTU3H64ziEDo76GgrrNHuGvNTWdMkflWLFyug9WpzhHpZ0rIdni_irU Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d4283ccfd2a54553896677a670e675f9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d4283ccfd2a54553896677a670e675f9"}]}] Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 58ddd1273ce749e29578db36d61ca07a Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '49ef635f-cc6e-406f-ae79-d188a302b255'} Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:46.545886 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Returning 404 to user: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f660d7f-99ab-4c4e-bbd3-2a7e10be4213 tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "DELETE /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 404 len: 111 microversion: 2.1 time: 0.040858 Aug 29 15:59:46.554000 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2454/4813] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:46 2022] DELETE /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:46.568708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.569355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: 49ef635f-cc6e-406f-ae79-d188a302b255] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:46.579095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.579449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.591278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.592849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.593753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.594505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.626717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.627690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:46.628376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] HTTP exception thrown: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Request method failure captured: Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 HTTP/1.1 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOHMTZ6meCPfdi3b70KCmLV749vJRIemhwxsyO6BxFT-LHqh3RBwPUwGNI6fuhvOvvEDP0dvj6wKzx6fYiRv-Afx3S7hUF_FYQE_JaGbVe57b0rpEh9nsPpRiTU3H64ziEDo76GgrrNHuGvNTWdMkflWLFyug9WpzhHpZ0rIdni_irU Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d4283ccfd2a54553896677a670e675f9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d4283ccfd2a54553896677a670e675f9"}]}] Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 58ddd1273ce749e29578db36d61ca07a Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '49ef635f-cc6e-406f-ae79-d188a302b255'} Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.631281 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.637485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.637485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.637485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.637485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:46.637485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:46.637485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. Aug 29 15:59:46.637485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.639979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Returning 404 to user: Instance 49ef635f-cc6e-406f-ae79-d188a302b255 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:46.641159 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7b703ce-e977-4d26-8d6b-7a901a4069fe tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255" status: 404 len: 111 microversion: 2.1 time: 0.088197 Aug 29 15:59:46.642372 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2360/4814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:46 2022] GET /compute/v2.1/servers/49ef635f-cc6e-406f-ae79-d188a302b255 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:46.652707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.657521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.661781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.662954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.669307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.669948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.676539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.678240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:46.709361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.711437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.713217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.715770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.716436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.717178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.748371 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] HTTP exception thrown: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Request method failure captured: Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 HTTP/1.1 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOHMTZ6meCPfdi3b70KCmLV749vJRIemhwxsyO6BxFT-LHqh3RBwPUwGNI6fuhvOvvEDP0dvj6wKzx6fYiRv-Afx3S7hUF_FYQE_JaGbVe57b0rpEh9nsPpRiTU3H64ziEDo76GgrrNHuGvNTWdMkflWLFyug9WpzhHpZ0rIdni_irU Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d4283ccfd2a54553896677a670e675f9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d4283ccfd2a54553896677a670e675f9"}]}] Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 58ddd1273ce749e29578db36d61ca07a Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'eb45ee9b-9f30-4555-be78-f8f6899b2d79'} Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:46.750008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Returning 404 to user: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-932f353e-c7c5-4817-970a-fa2b33edbd9a tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "DELETE /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 404 len: 111 microversion: 2.1 time: 0.104426 Aug 29 15:59:46.755074 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2361/4815] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 15:59:46 2022] DELETE /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:46.764273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.765084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] [instance: eb45ee9b-9f30-4555-be78-f8f6899b2d79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:46.773928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.774669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.775365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.776339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:46.777030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:46.777695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:46.807727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] HTTP exception thrown: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Request method failure captured: Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 HTTP/1.1 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOHMTZ6meCPfdi3b70KCmLV749vJRIemhwxsyO6BxFT-LHqh3RBwPUwGNI6fuhvOvvEDP0dvj6wKzx6fYiRv-Afx3S7hUF_FYQE_JaGbVe57b0rpEh9nsPpRiTU3H64ziEDo76GgrrNHuGvNTWdMkflWLFyug9WpzhHpZ0rIdni_irU Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d4283ccfd2a54553896677a670e675f9", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d4283ccfd2a54553896677a670e675f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d4283ccfd2a54553896677a670e675f9"}]}] Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: d4283ccfd2a54553896677a670e675f9 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-114997083 Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 58ddd1273ce749e29578db36d61ca07a Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerDiskConfigTestJSON-114997083-project Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'eb45ee9b-9f30-4555-be78-f8f6899b2d79'} Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:46.810612 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.814446 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:46.814446 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:46.814446 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:46.814446 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:46.814446 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:46.814446 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. Aug 29 15:59:46.814446 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:46.821203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] Returning 404 to user: Instance eb45ee9b-9f30-4555-be78-f8f6899b2d79 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:46.823909 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9be0c1b2-523e-4b99-a281-3995e995c74d tempest-ServerDiskConfigTestJSON-114997083 tempest-ServerDiskConfigTestJSON-114997083-project] 10.222.0.83 "GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79" status: 404 len: 111 microversion: 2.1 time: 0.063803 Aug 29 15:59:46.828004 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2362/4816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:46 2022] GET /compute/v2.1/servers/eb45ee9b-9f30-4555-be78-f8f6899b2d79 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:46.842950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0cb3f41c-c681-4283-8a17-971f4e09c32c tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed500f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:46.892836 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0cb3f41c-c681-4283-8a17-971f4e09c32c tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 287 microversion: 2.1 time: 0.054100 Aug 29 15:59:46.893526 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2363/4817] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:46 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:46.962091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:46.984966 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c253f03f-40fd-4296-90e5-3eb7a96d09cb tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.348447 Aug 29 15:59:46.987452 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2455/4818] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:46 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 15:59:47.907704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0806b29-467d-49ce-be6b-d1ba18f5961d tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32edb38670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:47.920828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:47.921800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:47.968671 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0806b29-467d-49ce-be6b-d1ba18f5961d tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 200 len: 287 microversion: 2.1 time: 0.066368 Aug 29 15:59:47.974883 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2364/4819] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:47 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:48.006967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:48.007622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:48.027902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:48.029767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:48.030365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:48.031164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:48.033472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:48.033938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:48.473606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:48.486158 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-66c22a59-b74a-4076-8ed8-37aa911e5e1c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.484180 Aug 29 15:59:48.490596 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2456/4820] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:48 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:48.984090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94fb7a22-109c-4456-b7ad-003aa6de6093 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed5dc670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:49.087845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-94fb7a22-109c-4456-b7ad-003aa6de6093 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] HTTP exception thrown: Snapshot 8ca9e68a-7d8a-441c-a506-72b512f34813 could not be found. Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94fb7a22-109c-4456-b7ad-003aa6de6093 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Request method failure captured: Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 HTTP/1.1 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOJoOqxH89ep8CF8Lnya6OwArE27NZ5grNoSs-sbdvEJSjDOqGQFhB93_Hwh54xCaRj9ljOCBSLhg29Xc2J0wxLHFzRonYXP2qLtxSkItQw1ty4-KdTHocgD22Au4tIHh80cUYGZDQdUf70S0jyzSFUOJuj6k1LEX64pJw1thO86r8E Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_67467b6a2bc44a7f98c525cc7c8d3c15", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/67467b6a2bc44a7f98c525cc7c8d3c15"}]}] Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 1452d6fd4a0e4905bf4faaea119e03b1 Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: exception: Snapshot 8ca9e68a-7d8a-441c-a506-72b512f34813 could not be found. Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '8ca9e68a-7d8a-441c-a506-72b512f34813'} Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8ca9e68a-7d8a-441c-a506-72b512f34813 could not be found. (HTTP 404) (Request-ID: req-5da4cf02-e98f-42d5-acc5-bcb09b55891c) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:59:49.098881 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8ca9e68a-7d8a-441c-a506-72b512f34813 could not be found. Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8ca9e68a-7d8a-441c-a506-72b512f34813 could not be found. Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8ca9e68a-7d8a-441c-a506-72b512f34813 could not be found. Aug 29 15:59:49.103478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:49.108256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94fb7a22-109c-4456-b7ad-003aa6de6093 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Returning 404 to user: Snapshot 8ca9e68a-7d8a-441c-a506-72b512f34813 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:49.109383 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94fb7a22-109c-4456-b7ad-003aa6de6093 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813" status: 404 len: 111 microversion: 2.1 time: 0.131351 Aug 29 15:59:49.110559 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2365/4821] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 15:59:48 2022] GET /compute/v2.1/os-snapshots/8ca9e68a-7d8a-441c-a506-72b512f34813 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:49.122083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-112df6b0-2e0d-4ffb-949f-73abe3ec77f6 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed2a0c10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:49.244045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-112df6b0-2e0d-4ffb-949f-73abe3ec77f6 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 202 len: 0 microversion: 2.1 time: 0.125423 Aug 29 15:59:49.244361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2457/4822] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:59:49 2022] DELETE /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:59:49.270350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75f8a36b-ea80-45a9-b296-5dd0f4f16932 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed586b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:49.428006 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75f8a36b-ea80-45a9-b296-5dd0f4f16932 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 200 len: 345 microversion: 2.1 time: 0.177936 Aug 29 15:59:49.429270 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2366/4823] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:49 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:49.522281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:49.522942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:49.537514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.538169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.538627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:49.539756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:49.542396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:49.544160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:50.045530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:50.059065 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91cd1987-c651-49c4-9efc-bf0d549bbeee tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.543559 Aug 29 15:59:50.059711 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2458/4824] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:49 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:50.446772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-223faa9b-8905-4ad5-bd17-3338a98adb02 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed5903a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:50.644467 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-223faa9b-8905-4ad5-bd17-3338a98adb02 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 200 len: 345 microversion: 2.1 time: 0.206304 Aug 29 15:59:50.645417 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2367/4825] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:50 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:51.086858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:51.088667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:51.117416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 15:59:51.127567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:51.129532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:51.133161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:51.135172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:51.135635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:51.137114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:51.500917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:51.527922 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cdc1a9a6-fdcb-457f-8166-3cda149f38b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.445339 Aug 29 15:59:51.528582 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2459/4826] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:51 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:51.668212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0b59651-3a79-40a0-aa46-b8aefe3eb2fa tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed53b0d0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:51.790838 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0b59651-3a79-40a0-aa46-b8aefe3eb2fa tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 200 len: 345 microversion: 2.1 time: 0.127182 Aug 29 15:59:51.791853 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2368/4827] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:51 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:52.561016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:52.561939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:52.584814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:52.587318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:52.588046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:52.591345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:52.592163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:52.595557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:52.810041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77c2271f-50d8-4d5c-9e19-5c817aff26b9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed58e160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:52.922036 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77c2271f-50d8-4d5c-9e19-5c817aff26b9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 200 len: 345 microversion: 2.1 time: 0.119494 Aug 29 15:59:52.922779 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2369/4828] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:52 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:53.152473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:53.175191 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-513af125-dc3b-4ec0-8af7-811ae955465d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.621151 Aug 29 15:59:53.177838 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2460/4829] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:52 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:53.937511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-133fc3c2-1fa5-42d3-8020-c8b693d58c98 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed54adc0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:53.983638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-133fc3c2-1fa5-42d3-8020-c8b693d58c98 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] HTTP exception thrown: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-133fc3c2-1fa5-42d3-8020-c8b693d58c98 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Request method failure captured: Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 HTTP/1.1 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOJoOqxH89ep8CF8Lnya6OwArE27NZ5grNoSs-sbdvEJSjDOqGQFhB93_Hwh54xCaRj9ljOCBSLhg29Xc2J0wxLHFzRonYXP2qLtxSkItQw1ty4-KdTHocgD22Au4tIHh80cUYGZDQdUf70S0jyzSFUOJuj6k1LEX64pJw1thO86r8E Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_67467b6a2bc44a7f98c525cc7c8d3c15", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/67467b6a2bc44a7f98c525cc7c8d3c15"}]}] Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 1452d6fd4a0e4905bf4faaea119e03b1 Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: exception: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '49c9d97e-608f-4076-b1ea-a55b51a55031'} Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. (HTTP 404) (Request-ID: req-053843e7-6b1c-4794-9991-a9a7b55a043e) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:59:53.987342 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:53.992701 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:53.997643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-133fc3c2-1fa5-42d3-8020-c8b693d58c98 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Returning 404 to user: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:53.999922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-133fc3c2-1fa5-42d3-8020-c8b693d58c98 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 404 len: 109 microversion: 2.1 time: 0.065751 Aug 29 15:59:54.002773 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2370/4830] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:53 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:54.022742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0e3b4ad-65cc-45bc-a143-d0da724b76cc tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ee55be50>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.061201 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b0e3b4ad-65cc-45bc-a143-d0da724b76cc tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] HTTP exception thrown: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0e3b4ad-65cc-45bc-a143-d0da724b76cc tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Request method failure captured: Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 HTTP/1.1 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOJoOqxH89ep8CF8Lnya6OwArE27NZ5grNoSs-sbdvEJSjDOqGQFhB93_Hwh54xCaRj9ljOCBSLhg29Xc2J0wxLHFzRonYXP2qLtxSkItQw1ty4-KdTHocgD22Au4tIHh80cUYGZDQdUf70S0jyzSFUOJuj6k1LEX64pJw1thO86r8E Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_67467b6a2bc44a7f98c525cc7c8d3c15", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/67467b6a2bc44a7f98c525cc7c8d3c15"}]}] Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 1452d6fd4a0e4905bf4faaea119e03b1 Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: exception: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '49c9d97e-608f-4076-b1ea-a55b51a55031'} Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. (HTTP 404) (Request-ID: req-af38b074-a91e-4be6-b3d4-4aecda2891e3) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:59:54.063544 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.069416 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.080539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0e3b4ad-65cc-45bc-a143-d0da724b76cc tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Returning 404 to user: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:54.080539 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0e3b4ad-65cc-45bc-a143-d0da724b76cc tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 404 len: 109 microversion: 2.1 time: 0.057927 Aug 29 15:59:54.081360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2461/4831] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 15:59:54 2022] DELETE /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 15:59:54.086571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b3a4d56-fe41-41ac-9b44-badbbc6aaaa9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Calling method '.version_select at 0x7f32ed586ca0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.209109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.210545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:54.226404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.226905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.227378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.228101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.228556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.228984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.309880 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-2b3a4d56-fe41-41ac-9b44-badbbc6aaaa9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] HTTP exception thrown: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b3a4d56-fe41-41ac-9b44-badbbc6aaaa9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Request method failure captured: Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 HTTP/1.1 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOJoOqxH89ep8CF8Lnya6OwArE27NZ5grNoSs-sbdvEJSjDOqGQFhB93_Hwh54xCaRj9ljOCBSLhg29Xc2J0wxLHFzRonYXP2qLtxSkItQw1ty4-KdTHocgD22Au4tIHh80cUYGZDQdUf70S0jyzSFUOJuj6k1LEX64pJw1thO86r8E Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_67467b6a2bc44a7f98c525cc7c8d3c15", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/67467b6a2bc44a7f98c525cc7c8d3c15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/67467b6a2bc44a7f98c525cc7c8d3c15"}]}] Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 67467b6a2bc44a7f98c525cc7c8d3c15 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-834685791 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 1452d6fd4a0e4905bf4faaea119e03b1 Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesSnapshotsTestJSON-834685791-project Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: method: Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: exception: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '49c9d97e-608f-4076-b1ea-a55b51a55031'} Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. (HTTP 404) (Request-ID: req-697357d3-3c4b-4cb0-acba-ef5bd57409a9) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 15:59:54.312772 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. Aug 29 15:59:54.318330 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 15:59:54.323593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b3a4d56-fe41-41ac-9b44-badbbc6aaaa9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] Returning 404 to user: Volume 49c9d97e-608f-4076-b1ea-a55b51a55031 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 15:59:54.324969 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2b3a4d56-fe41-41ac-9b44-badbbc6aaaa9 tempest-VolumesSnapshotsTestJSON-834685791 tempest-VolumesSnapshotsTestJSON-834685791-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031" status: 404 len: 109 microversion: 2.1 time: 0.244467 Aug 29 15:59:54.326170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2371/4832] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 15:59:54 2022] GET /compute/v2.1/os-volumes/49c9d97e-608f-4076-b1ea-a55b51a55031 => generated 109 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 15:59:54.555061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.557347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:54.581085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.585193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.588752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.591298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.597328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.599360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.609521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:54.619406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7ec069e-c4b2-4347-b631-b7c2088710ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.424879 Aug 29 15:59:54.636032 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2462/4833] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:54 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:54.774728 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d47f051-e3d3-4589-a6fd-d9f9a8fde182 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226425 Aug 29 15:59:54.783304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2372/4834] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 15:59:54 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 15:59:54.793057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:54.796348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:54.828675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.838870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-25b67d70-de23-4828-a35b-3fa4b89712d4 req-ea99bff7-8a53-4ba6-82c5-935f678d9983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc5de0-11ee-454e-a7d9-941f08fef311", "name": "network-vif-plugged", "status": "completed", "tag": "3cabd8d1-dd8b-4902-be8d-ef97792e2af8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 15:59:54.853932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.854402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.859722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.865532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.869142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.890265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-25b67d70-de23-4828-a35b-3fa4b89712d4 req-ea99bff7-8a53-4ba6-82c5-935f678d9983 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:54.890825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-25b67d70-de23-4828-a35b-3fa4b89712d4 req-ea99bff7-8a53-4ba6-82c5-935f678d9983 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:54.891300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-25b67d70-de23-4828-a35b-3fa4b89712d4 req-ea99bff7-8a53-4ba6-82c5-935f678d9983 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:54.950168 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-25b67d70-de23-4828-a35b-3fa4b89712d4 req-ea99bff7-8a53-4ba6-82c5-935f678d9983 service nova] Creating event network-vif-plugged:3cabd8d1-dd8b-4902-be8d-ef97792e2af8 for instance 65fc5de0-11ee-454e-a7d9-941f08fef311 on n-h2-836830-13 Aug 29 15:59:54.960160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-25b67d70-de23-4828-a35b-3fa4b89712d4 req-ea99bff7-8a53-4ba6-82c5-935f678d9983 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128537 Aug 29 15:59:54.963278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2373/4835] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 15:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 15:59:55.089182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lazy-loading 'services' on Instance uuid bd7b492f-2974-4873-98c0-0425fce2aeb1 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 15:59:55.298754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f99afc51-9cfb-4b1c-bd0d-4782be7b9393 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments/4119e86e-1f72-42aa-8eff-a6ed67271784" status: 202 len: 0 microversion: 2.1 time: 0.515193 Aug 29 15:59:55.303787 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2463/4836] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 15:59:54 2022] DELETE /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments/4119e86e-1f72-42aa-8eff-a6ed67271784 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 15:59:55.651375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:55.652192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:55.669085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.670969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.673003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:55.674111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:55.675846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:55.678155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:56.069900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:56.078764 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-038de389-1744-4f25-9531-3a8bee4121c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.432709 Aug 29 15:59:56.079313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2374/4837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:55 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:57.106669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:57.108773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:57.129196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.129978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.130522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.131272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:57.131732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:57.132153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:57.496816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:57.506155 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-64649aa9-31b6-4cb9-b504-4220ffd789d6 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1368 microversion: 2.1 time: 0.404806 Aug 29 15:59:57.508419 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2464/4838] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:57 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:58.536332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:58.538556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:58.565143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:58.571489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:58.576116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:58.577039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:58.579746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:58.582908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:58.936518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 15:59:58.950441 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff1fdb10-c4d1-4e86-b6de-4c53311a6e99 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1558 microversion: 2.1 time: 0.423177 Aug 29 15:59:58.954768 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2375/4839] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 15:59:58 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1558 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 15:59:58.980132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 15:59:58.980640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 15:59:59.010255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.010763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.011247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.012004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 15:59:59.012473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 15:59:59.013160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 15:59:59.372422 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-870b525f-eb90-4407-b5cd-3c00906e2e42 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.399542 Aug 29 15:59:59.374361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2465/4840] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 15:59:58 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-interface => generated 284 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:02.140914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c0f1fb4e-9a18-4944-a8dc-5b1754e9a9b6 req-b636aaa0-1c80-403d-9086-deb618931d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fc5de0-11ee-454e-a7d9-941f08fef311", "tag": "3cabd8d1-dd8b-4902-be8d-ef97792e2af8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:02.188841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c0f1fb4e-9a18-4944-a8dc-5b1754e9a9b6 req-b636aaa0-1c80-403d-9086-deb618931d08 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:02.193932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c0f1fb4e-9a18-4944-a8dc-5b1754e9a9b6 req-b636aaa0-1c80-403d-9086-deb618931d08 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:02.206386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c0f1fb4e-9a18-4944-a8dc-5b1754e9a9b6 req-b636aaa0-1c80-403d-9086-deb618931d08 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:02.272394 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c0f1fb4e-9a18-4944-a8dc-5b1754e9a9b6 req-b636aaa0-1c80-403d-9086-deb618931d08 service nova] Creating event network-changed:3cabd8d1-dd8b-4902-be8d-ef97792e2af8 for instance 65fc5de0-11ee-454e-a7d9-941f08fef311 on n-h2-836830-13 Aug 29 16:00:02.297443 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c0f1fb4e-9a18-4944-a8dc-5b1754e9a9b6 req-b636aaa0-1c80-403d-9086-deb618931d08 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156715 Aug 29 16:00:02.299331 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2376/4841] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:05.576512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:05.577140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:05.598455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:05.598917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:05.608442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:05.609404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:05.616350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:05.619943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:06.143042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:06.168568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:06.170821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:06.172463 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8109084e-e738-4603-b77d-20d557f6c86a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2948 microversion: 2.32 time: 0.601815 Aug 29 16:00:06.183803 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2466/4842] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:00:05 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2948 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:00:06.204042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:06.205248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:06.219630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:06.223750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:06.224397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:06.225284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:06.226047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:06.228017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:06.898459 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0733240-290c-4434-b006-7f3d4761a19a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.699094 Aug 29 16:00:06.899203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2377/4843] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 16:00:06 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e/os-interface => generated 1831 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:00:10.178856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:10.183319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:10.193571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:10.194472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:10.195372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:10.196378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:10.197259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:10.211615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:10.351619 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76e31ed5-63de-42bd-bf6d-886a8959ddc1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.177980 Aug 29 16:00:10.352217 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2467/4844] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:00:10 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments => generated 25 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:00:10.479242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:10.482865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:10.496435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:10.498315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:10.499400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:10.501670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:10.503925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:10.507455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:10.508631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:10.576095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-508f7e90-ceb9-4059-8fae-3f770dcb9d93 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101713 Aug 29 16:00:10.585696 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2378/4845] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:00:10 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:00:10.709898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:10.710437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:10.734163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:10.737234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:10.738921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:10.741886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:10.742569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:10.743215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:10.831354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:00:11.061137 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f044645-9b24-4b5d-b4ad-ef8b6b40a77d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 204 len: 0 microversion: 2.1 time: 0.358003 Aug 29 16:00:11.068649 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2468/4846] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:00:10 2022] DELETE /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:11.072253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:11.072934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:11.096045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:11.097219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:11.098971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:11.101385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:11.102051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:11.102653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:12.105686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:12.110751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:12.121224 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b31b860-d00d-4b90-8853-07c84d247e65 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1680 microversion: 2.1 time: 1.052777 Aug 29 16:00:12.122241 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2379/4847] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:11 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1680 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:13.147813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:13.149379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:13.171282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:13.172028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:13.172762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:13.173635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:13.174239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:13.179178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:13.703350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1432826555", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7bd42f9c-287b-40c9-af10-80349a2705d8"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:13.807708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] validate_networks() for [('7bd42f9c-287b-40c9-af10-80349a2705d8', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:00:14.032240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:14.046951 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5a665c0b-16da-4997-bf08-fabafe228213 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1680 microversion: 2.1 time: 0.905128 Aug 29 16:00:14.047578 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2380/4848] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:13 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1680 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:14.757289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:00:14.759256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:00:14.760040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:00:14.760778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:00:14.761444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:00:14.785580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:14.787669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:14.788551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:14.791716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:14.793643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:14.794835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:14.837889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:14.872781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Getting quotas for project 5b02f0c534c9462c9de0e6fab11cea27. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:00:14.890708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Getting quotas for user e460fd09b56f4c47a46062a41fc89bbf and project 5b02f0c534c9462c9de0e6fab11cea27. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:00:14.932572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Going to run 3 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:00:14.949576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:00:15.031834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=501faf25-d9e7-4bb2-9ad8-ef7ff05b2632,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:00:15.070694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:15.072411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:15.083496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.084253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.086994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.087922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.089511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.090127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.135153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=d1d05dd2-c41c-4524-922c-a67a9565ec51,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:00:15.299527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05bb3e29-516c-48f1-a896-6c7a593a5b4e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.159502 Aug 29 16:00:15.302982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2469/4849] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:00:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:00:15.314380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:15.328285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:15.329077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:15.397141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.397663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.398111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.400975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:15.402385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:15.402844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:15.466711 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ccbfe6b-b050-4561-a35f-44144d7e032f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.155682 Aug 29 16:00:15.469466 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2470/4850] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 16:00:15 2022] GET /compute/v2.1/servers => generated 1018 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:15.480114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6dd6878c-751b-4159-ad3f-ad452c89b5ba tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:15.480754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6dd6878c-751b-4159-ad3f-ad452c89b5ba tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:15.636572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6dd6878c-751b-4159-ad3f-ad452c89b5ba tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:15.648451 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6dd6878c-751b-4159-ad3f-ad452c89b5ba tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1223 microversion: 2.1 time: 0.172612 Aug 29 16:00:15.651153 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2471/4851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:15 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:15.703939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:15.714075 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba448e19-fa17-44f0-868c-b3d060ba0eb1 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1680 microversion: 2.1 time: 0.648542 Aug 29 16:00:15.723212 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2381/4852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:15 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1680 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:16.506738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3d66f377-d73c-4d5c-95c0-caf18182a624 req-a761d052-cb2b-44dc-8545-e41aa475c72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd7b492f-2974-4873-98c0-0425fce2aeb1", "name": "network-vif-deleted", "tag": "2a30f220-ec72-4c4b-a016-4ce7eee826ed"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:16.541887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3d66f377-d73c-4d5c-95c0-caf18182a624 req-a761d052-cb2b-44dc-8545-e41aa475c72a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:16.542496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3d66f377-d73c-4d5c-95c0-caf18182a624 req-a761d052-cb2b-44dc-8545-e41aa475c72a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:16.543109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3d66f377-d73c-4d5c-95c0-caf18182a624 req-a761d052-cb2b-44dc-8545-e41aa475c72a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:16.570079 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3d66f377-d73c-4d5c-95c0-caf18182a624 req-a761d052-cb2b-44dc-8545-e41aa475c72a service nova] Creating event network-vif-deleted:2a30f220-ec72-4c4b-a016-4ce7eee826ed for instance bd7b492f-2974-4873-98c0-0425fce2aeb1 on n-h2-836830-13 Aug 29 16:00:16.608378 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3d66f377-d73c-4d5c-95c0-caf18182a624 req-a761d052-cb2b-44dc-8545-e41aa475c72a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107209 Aug 29 16:00:16.614817 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2472/4853] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:00:16.669023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-072df68e-6f61-4a17-8a50-d890a180706d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:16.669773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-072df68e-6f61-4a17-8a50-d890a180706d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:16.743576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:16.744305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:16.808422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:16.823733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:16.824329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:16.833113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:16.841824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:16.842456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:16.997847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-072df68e-6f61-4a17-8a50-d890a180706d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:17.007527 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-072df68e-6f61-4a17-8a50-d890a180706d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1223 microversion: 2.1 time: 0.342597 Aug 29 16:00:17.019743 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2382/4854] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:16 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1223 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:17.082960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:17.086188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:17.087799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:17.090786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lazy-loading 'fault' on Instance uuid bd7b492f-2974-4873-98c0-0425fce2aeb1 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:00:17.180638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef76ec0a3c064d1eba53fbdb4feaf889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '127d2af276e74dad8b3f7cd93027954f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:17.198573 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-caed7551-9049-4d42-ae64-e8ef36a4940c tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 200 len: 1329 microversion: 2.1 time: 0.458192 Aug 29 16:00:17.204950 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2473/4855] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:16 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 1329 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:18.035037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:18.037740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:18.078559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:18.080023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:18.080787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:18.083196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:18.085145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:18.087383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:18.227148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:18.228453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:18.257346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:18.272503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:18.273562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:18.277326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:18.279507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:18.284008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:18.348090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:18.366986 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e8a4415-3908-499c-9c1f-3aff71585481 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1227 microversion: 2.1 time: 0.337766 Aug 29 16:00:18.372808 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2383/4856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:18 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1227 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:18.415594 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] HTTP exception thrown: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Request method failure captured: Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 HTTP/1.1 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOGemRjhWBrRa6swnUnH4A-KNQSbyz094q5sLmSY3E_4b801dnOwK58T6ZSFt0GiZuzkG7VBsJL4pRK9-JaaYO3u5wgsK5IocMF_aLcQvtCJ9rw7RoA0LaDPXt6CFGqExYMhtrIip4epKWWg6gEkA6P2pWlbt_q0fPfi5Nucq0EB3OQ Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 127d2af276e74dad8b3f7cd93027954f Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/127d2af276e74dad8b3f7cd93027954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_127d2af276e74dad8b3f7cd93027954f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/127d2af276e74dad8b3f7cd93027954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/127d2af276e74dad8b3f7cd93027954f"}]}] Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 127d2af276e74dad8b3f7cd93027954f Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachSCSIVolumeTestJSON-231256149-project Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ef76ec0a3c064d1eba53fbdb4feaf889 Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-231256149-project Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bd7b492f-2974-4873-98c0-0425fce2aeb1'} Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:18.420201 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:18.424541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:18.424541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:18.424541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:18.424541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:18.424541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:18.424541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:18.424541 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:18.437506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Returning 404 to user: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:18.444178 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2d7e578b-d887-49c8-bd68-2c14ae1a4a8e tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 404 len: 111 microversion: 2.1 time: 0.221530 Aug 29 16:00:18.450891 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2474/4857] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:18 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:18.455700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9ab66152-e83f-4058-bbb5-2bc5d4f834a4 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '.version_select at 0x7f32ed510160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:18.524973 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9ab66152-e83f-4058-bbb5-2bc5d4f834a4 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-32096509" status: 202 len: 0 microversion: 2.1 time: 0.054673 Aug 29 16:00:18.529091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2384/4858] 10.222.0.83 () {58 vars in 1215 bytes} [Mon Aug 29 16:00:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-32096509 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:00:19.398519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:19.400884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:19.422375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:19.422375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:19.432884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:19.433931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:19.437909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:19.441822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:19.729991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:19.765547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a8ff887-e8e7-433a-a1cd-12a87065538c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1275 microversion: 2.1 time: 0.372204 Aug 29 16:00:19.786002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2475/4859] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:19 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1275 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:20.793319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:20.793963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:20.808821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:20.809336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:20.809780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:20.810495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:20.813770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:20.815564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:21.092835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:21.105277 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d2f7690-d650-4cc0-8379-35fff1ccd903 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1281 microversion: 2.1 time: 0.316890 Aug 29 16:00:21.115888 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2385/4860] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:20 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1281 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:22.134291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:22.134981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:22.140328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:22.163226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:22.167873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:22.171949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:22.174291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:22.178660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:22.179542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:22.356267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:22.403398 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a331442-17e5-4170-999d-79acf615e3e5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1281 microversion: 2.1 time: 0.279014 Aug 29 16:00:22.407222 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2476/4861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:22 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:23.425937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:23.427353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:23.442863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:23.443656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:23.444259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:23.446339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:23.448167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:23.449550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:23.872914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:23.882436 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c851b49c-02cf-4fe3-a89c-dd958df89ae7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1281 microversion: 2.1 time: 0.460434 Aug 29 16:00:23.883048 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2386/4862] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:23 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1281 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:24.913479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:24.914407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:24.921516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:24.922366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:24.923288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:24.924082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:24.924680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:24.925500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:25.054923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:25.070988 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-729b7834-ddb1-43e4-8926-21f10b42a583 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1281 microversion: 2.1 time: 0.167534 Aug 29 16:00:25.071487 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2477/4863] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:24 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:25.410723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a57e4d3b-664b-4d1c-9ee6-52269dcbffae req-ced51cd7-ce66-4d0c-a21c-de454b09487b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d05dd2-c41c-4524-922c-a67a9565ec51", "tag": "1f6f779b-da17-4ad7-9f75-fe8de56746b6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:25.446113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a57e4d3b-664b-4d1c-9ee6-52269dcbffae req-ced51cd7-ce66-4d0c-a21c-de454b09487b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:25.447062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a57e4d3b-664b-4d1c-9ee6-52269dcbffae req-ced51cd7-ce66-4d0c-a21c-de454b09487b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:25.448998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a57e4d3b-664b-4d1c-9ee6-52269dcbffae req-ced51cd7-ce66-4d0c-a21c-de454b09487b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:25.491120 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a57e4d3b-664b-4d1c-9ee6-52269dcbffae req-ced51cd7-ce66-4d0c-a21c-de454b09487b service nova] Creating event network-changed:1f6f779b-da17-4ad7-9f75-fe8de56746b6 for instance d1d05dd2-c41c-4524-922c-a67a9565ec51 on n-h2-836830-13 Aug 29 16:00:25.500807 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a57e4d3b-664b-4d1c-9ee6-52269dcbffae req-ced51cd7-ce66-4d0c-a21c-de454b09487b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098718 Aug 29 16:00:25.502095 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2387/4864] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:26.092979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:26.093737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:26.101233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:26.103215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:26.119878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:26.122018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:26.123643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:26.126173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:26.129598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:26.130111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:26.810137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:26.827740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ef64518-0c35-4a30-b25c-6a7e814efc77 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 0.738996 Aug 29 16:00:26.835306 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2478/4865] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:26 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:27.715891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-86dfa3c5-1ab2-46ef-a1f7-cf9229b190ec req-221401bc-4165-4945-9e07-2de27e65f245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "501faf25-d9e7-4bb2-9ad8-ef7ff05b2632", "tag": "a150324a-9095-4341-89fe-222581dfe10e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:27.726988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:27.747869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-86dfa3c5-1ab2-46ef-a1f7-cf9229b190ec req-221401bc-4165-4945-9e07-2de27e65f245 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:27.748730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-86dfa3c5-1ab2-46ef-a1f7-cf9229b190ec req-221401bc-4165-4945-9e07-2de27e65f245 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:27.751659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-86dfa3c5-1ab2-46ef-a1f7-cf9229b190ec req-221401bc-4165-4945-9e07-2de27e65f245 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:27.780024 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-86dfa3c5-1ab2-46ef-a1f7-cf9229b190ec req-221401bc-4165-4945-9e07-2de27e65f245 service nova] Creating event network-changed:a150324a-9095-4341-89fe-222581dfe10e for instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 on n-h1-836830-13 Aug 29 16:00:27.789573 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-86dfa3c5-1ab2-46ef-a1f7-cf9229b190ec req-221401bc-4165-4945-9e07-2de27e65f245 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078553 Aug 29 16:00:27.800886 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2388/4866] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:00:27.856212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:27.857007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:27.888622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:27.897587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:27.901137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:27.905046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:27.908160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:27.913955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:28.649002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:28.680756 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-959755e3-6690-4b9a-a626-7734c6fcf13e tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 0.812652 Aug 29 16:00:28.682726 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2479/4867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:27 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:29.716311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:29.717028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:29.749750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.750188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.750633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.751531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.751832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.752261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.814058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a965bd12-b11d-4e17-9c38-4be0f9a8e46e req-91f0934c-d2a9-4ef9-b553-a8c4a5f99c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75d7e33-5bd3-4079-b10b-a9e577eea3b7", "tag": "4416f05c-731e-4c3d-8b54-d67db1ed3ca7"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:29.835589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a965bd12-b11d-4e17-9c38-4be0f9a8e46e req-91f0934c-d2a9-4ef9-b553-a8c4a5f99c1e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.839605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a965bd12-b11d-4e17-9c38-4be0f9a8e46e req-91f0934c-d2a9-4ef9-b553-a8c4a5f99c1e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.840297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a965bd12-b11d-4e17-9c38-4be0f9a8e46e req-91f0934c-d2a9-4ef9-b553-a8c4a5f99c1e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.861186 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a965bd12-b11d-4e17-9c38-4be0f9a8e46e req-91f0934c-d2a9-4ef9-b553-a8c4a5f99c1e service nova] Creating event network-changed:4416f05c-731e-4c3d-8b54-d67db1ed3ca7 for instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 on n-h1-836830-13 Aug 29 16:00:29.868617 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a965bd12-b11d-4e17-9c38-4be0f9a8e46e req-91f0934c-d2a9-4ef9-b553-a8c4a5f99c1e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059149 Aug 29 16:00:29.869804 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2480/4868] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:00:29.875452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:29.876322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:29.885915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.886660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.887333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.888563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.889236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.889867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.909802 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] HTTP exception thrown: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Request method failure captured: Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 HTTP/1.1 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOGemRjhWBrRa6swnUnH4A-KNQSbyz094q5sLmSY3E_4b801dnOwK58T6ZSFt0GiZuzkG7VBsJL4pRK9-JaaYO3u5wgsK5IocMF_aLcQvtCJ9rw7RoA0LaDPXt6CFGqExYMhtrIip4epKWWg6gEkA6P2pWlbt_q0fPfi5Nucq0EB3OQ Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 127d2af276e74dad8b3f7cd93027954f Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/127d2af276e74dad8b3f7cd93027954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_127d2af276e74dad8b3f7cd93027954f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/127d2af276e74dad8b3f7cd93027954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/127d2af276e74dad8b3f7cd93027954f"}]}] Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 127d2af276e74dad8b3f7cd93027954f Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachSCSIVolumeTestJSON-231256149-project Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ef76ec0a3c064d1eba53fbdb4feaf889 Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-231256149-project Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bd7b492f-2974-4873-98c0-0425fce2aeb1'} Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:29.912870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:29.916930 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:29.919449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Returning 404 to user: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:29.920582 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b893f17-43aa-4b32-ba00-c31a2fcc2d61 tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 404 len: 111 microversion: 2.1 time: 0.049491 Aug 29 16:00:29.922381 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2481/4869] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:00:29 2022] DELETE /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:29.932733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:29.933741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] [instance: bd7b492f-2974-4873-98c0-0425fce2aeb1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:29.942796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.943951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.944779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.945781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:29.946440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:29.947127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:29.997908 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] HTTP exception thrown: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Request method failure captured: Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 HTTP/1.1 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOGemRjhWBrRa6swnUnH4A-KNQSbyz094q5sLmSY3E_4b801dnOwK58T6ZSFt0GiZuzkG7VBsJL4pRK9-JaaYO3u5wgsK5IocMF_aLcQvtCJ9rw7RoA0LaDPXt6CFGqExYMhtrIip4epKWWg6gEkA6P2pWlbt_q0fPfi5Nucq0EB3OQ Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 127d2af276e74dad8b3f7cd93027954f Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/127d2af276e74dad8b3f7cd93027954f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_127d2af276e74dad8b3f7cd93027954f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/127d2af276e74dad8b3f7cd93027954f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/127d2af276e74dad8b3f7cd93027954f"}]}] Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 127d2af276e74dad8b3f7cd93027954f Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-231256149 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachSCSIVolumeTestJSON-231256149-project Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ef76ec0a3c064d1eba53fbdb4feaf889 Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-231256149-project Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bd7b492f-2974-4873-98c0-0425fce2aeb1'} Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:30.002413 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:30.007076 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:30.007076 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:30.007076 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:30.007076 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:30.007076 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:30.007076 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. Aug 29 16:00:30.007076 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:30.011729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] Returning 404 to user: Instance bd7b492f-2974-4873-98c0-0425fce2aeb1 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:30.012833 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8774193f-0d97-45bc-ae14-6af08c6e350d tempest-AttachSCSIVolumeTestJSON-231256149 tempest-AttachSCSIVolumeTestJSON-231256149-project] 10.222.0.83 "GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1" status: 404 len: 111 microversion: 2.1 time: 0.085483 Aug 29 16:00:30.015672 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2482/4870] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:29 2022] GET /compute/v2.1/servers/bd7b492f-2974-4873-98c0-0425fce2aeb1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:00:30.170027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:30.187047 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5cbecaab-4fd7-42bb-9c89-65e71f729486 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 0.474670 Aug 29 16:00:30.188332 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2389/4871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:29 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:31.210902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:31.211832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:31.226569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:31.229091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:31.231522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:31.232953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:31.235218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:31.236449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:31.564123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:31.580666 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2fbff5b-b43e-42e8-8c8a-5397c1f2c24c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 0.374759 Aug 29 16:00:31.583397 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2483/4872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:31 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:32.603904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:32.605043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:32.619331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:32.620587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:32.622036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:32.623562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:32.627618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:32.629839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:33.870759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:33.884131 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6132172b-56e7-4d1a-b831-9c6c29f9e9a4 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 1.284162 Aug 29 16:00:33.884900 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2390/4873] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:32 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:34.928373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:34.930130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-28603ecf-56eb-4ed7-8c75-8ee3120e2c97 req-83efab24-c77d-46a3-b1c7-f6759a1efe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501faf25-d9e7-4bb2-9ad8-ef7ff05b2632", "name": "network-vif-plugged", "status": "completed", "tag": "a150324a-9095-4341-89fe-222581dfe10e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:34.930644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:34.946441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:34.947939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:34.950459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:34.951475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:34.953702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:34.956083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:34.957407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-28603ecf-56eb-4ed7-8c75-8ee3120e2c97 req-83efab24-c77d-46a3-b1c7-f6759a1efe80 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:34.958947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-28603ecf-56eb-4ed7-8c75-8ee3120e2c97 req-83efab24-c77d-46a3-b1c7-f6759a1efe80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:34.959428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-28603ecf-56eb-4ed7-8c75-8ee3120e2c97 req-83efab24-c77d-46a3-b1c7-f6759a1efe80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:35.000985 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-28603ecf-56eb-4ed7-8c75-8ee3120e2c97 req-83efab24-c77d-46a3-b1c7-f6759a1efe80 service nova] Creating event network-vif-plugged:a150324a-9095-4341-89fe-222581dfe10e for instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 on n-h1-836830-13 Aug 29 16:00:35.026155 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-28603ecf-56eb-4ed7-8c75-8ee3120e2c97 req-83efab24-c77d-46a3-b1c7-f6759a1efe80 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112391 Aug 29 16:00:35.031363 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2391/4874] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:35.364064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:35.375976 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-62860b68-d81d-4510-bed3-5d335b5b1598 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 0.473457 Aug 29 16:00:35.383532 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2484/4875] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:34 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:36.413264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:36.414224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:36.439081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:36.439849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:36.440949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:36.441889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:36.442525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:36.445258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:37.144825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-35e3b9d8-c7a5-4a69-a160-7ec2fff784a3 req-9e8cf979-b39b-4540-bf78-d0b5e344f9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d05dd2-c41c-4524-922c-a67a9565ec51", "name": "network-vif-plugged", "status": "completed", "tag": "1f6f779b-da17-4ad7-9f75-fe8de56746b6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:37.178254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-35e3b9d8-c7a5-4a69-a160-7ec2fff784a3 req-9e8cf979-b39b-4540-bf78-d0b5e344f9b2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:37.191088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-35e3b9d8-c7a5-4a69-a160-7ec2fff784a3 req-9e8cf979-b39b-4540-bf78-d0b5e344f9b2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:37.192264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-35e3b9d8-c7a5-4a69-a160-7ec2fff784a3 req-9e8cf979-b39b-4540-bf78-d0b5e344f9b2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:37.233247 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-35e3b9d8-c7a5-4a69-a160-7ec2fff784a3 req-9e8cf979-b39b-4540-bf78-d0b5e344f9b2 service nova] Creating event network-vif-plugged:1f6f779b-da17-4ad7-9f75-fe8de56746b6 for instance d1d05dd2-c41c-4524-922c-a67a9565ec51 on n-h2-836830-13 Aug 29 16:00:37.250605 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-35e3b9d8-c7a5-4a69-a160-7ec2fff784a3 req-9e8cf979-b39b-4540-bf78-d0b5e344f9b2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109601 Aug 29 16:00:37.253720 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2485/4876] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:38.015282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:38.029099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5bfe8065-e0b4-4b6a-ac34-cfe19e883713 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 1.631402 Aug 29 16:00:38.033847 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2392/4877] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:36 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:39.056844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:39.057596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:39.089983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:39.093831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:39.095730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:39.096487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:39.097027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:39.110162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:39.286134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2652609c-54f9-4846-95ed-1d32e6098af5 req-8e213542-e476-4b48-9598-edd90d3f6ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75d7e33-5bd3-4079-b10b-a9e577eea3b7", "name": "network-vif-plugged", "status": "completed", "tag": "4416f05c-731e-4c3d-8b54-d67db1ed3ca7"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:39.300710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2652609c-54f9-4846-95ed-1d32e6098af5 req-8e213542-e476-4b48-9598-edd90d3f6ad3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:39.301669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2652609c-54f9-4846-95ed-1d32e6098af5 req-8e213542-e476-4b48-9598-edd90d3f6ad3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:39.302542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2652609c-54f9-4846-95ed-1d32e6098af5 req-8e213542-e476-4b48-9598-edd90d3f6ad3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:39.319733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2652609c-54f9-4846-95ed-1d32e6098af5 req-8e213542-e476-4b48-9598-edd90d3f6ad3 service nova] Creating event network-vif-plugged:4416f05c-731e-4c3d-8b54-d67db1ed3ca7 for instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 on n-h1-836830-13 Aug 29 16:00:39.329688 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2652609c-54f9-4846-95ed-1d32e6098af5 req-8e213542-e476-4b48-9598-edd90d3f6ad3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048073 Aug 29 16:00:39.335225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2393/4878] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:00:39.619437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:39.645129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78d00c58-d5aa-4ff6-962b-daa1b0634b41 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 0.592689 Aug 29 16:00:39.645530 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2486/4879] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:39 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:40.667578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:40.669018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:40.676428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:40.678499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:40.679231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:40.679837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:40.682990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:40.683756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:40.684204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:40.966991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:40.988714 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-109df1cc-2383-4cb1-b996-e3e674596369 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1323 microversion: 2.1 time: 0.325130 Aug 29 16:00:40.989498 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2394/4880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:40 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1323 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:42.049816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:42.051079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:42.076220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:42.078813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:42.080216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:42.082002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:42.083422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:42.084178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:42.712662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:42.764697 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ffd4b764-1beb-4d76-96de-9beb65fda123 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 200 len: 1516 microversion: 2.1 time: 0.751733 Aug 29 16:00:42.786973 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2487/4881] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:42 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 1516 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:42.791681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:42.792913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:42.811060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:42.814732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:42.815876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:42.817013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:42.817759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:42.818308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.335148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:43.337505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=68 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:43.347880 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40ba865d-f033-4641-bd67-549dff6adde6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51" status: 200 len: 1516 microversion: 2.1 time: 0.561250 Aug 29 16:00:43.349242 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2395/4882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:42 2022] GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 => generated 1516 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:43.376107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:43.377366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:43.387259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.388144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.389132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.390044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.390674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.391324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.677382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:43.685691 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b6cea15-7f9d-4cf4-8d91-842e149dabfb tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 200 len: 1516 microversion: 2.1 time: 0.314336 Aug 29 16:00:43.688926 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2488/4883] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:43 2022] GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 1516 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:00:43.715959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:43.717022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:43.724735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.725742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.726371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.727273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.727931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.728649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.765346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:00:43.942848 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dcdad800-f44f-414b-ad70-18beb9c38644 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "DELETE /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 204 len: 0 microversion: 2.1 time: 0.236648 Aug 29 16:00:43.948270 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2396/4884] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:00:43 2022] DELETE /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:43.953042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:43.953792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:43.962517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.963549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.971012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:43.978453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:43.980583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:43.982100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:44.488505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:44.507835 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-687b2907-a1aa-4bf1-a369-7adf537f0345 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 200 len: 1522 microversion: 2.1 time: 0.555750 Aug 29 16:00:44.512207 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2489/4885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:43 2022] GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:45.536778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:45.538590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:45.553318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:45.553821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:45.557486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:45.558651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:45.559174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:45.560780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:46.161251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:46.179711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9efadccf-2f12-418b-8a3d-6f9ce3784155 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 200 len: 1522 microversion: 2.1 time: 0.648171 Aug 29 16:00:46.205388 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2397/4886] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:45 2022] GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:46.605923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c9cf0ee0-4fb8-4832-8745-a117724f0427 req-121a4f52-f3cb-4c36-98ea-ab7ec4467e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "501faf25-d9e7-4bb2-9ad8-ef7ff05b2632", "name": "network-vif-deleted", "tag": "a150324a-9095-4341-89fe-222581dfe10e"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:46.649597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c9cf0ee0-4fb8-4832-8745-a117724f0427 req-121a4f52-f3cb-4c36-98ea-ab7ec4467e79 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:46.658117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c9cf0ee0-4fb8-4832-8745-a117724f0427 req-121a4f52-f3cb-4c36-98ea-ab7ec4467e79 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:46.664015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c9cf0ee0-4fb8-4832-8745-a117724f0427 req-121a4f52-f3cb-4c36-98ea-ab7ec4467e79 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:46.682089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=90 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:46.709314 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c9cf0ee0-4fb8-4832-8745-a117724f0427 req-121a4f52-f3cb-4c36-98ea-ab7ec4467e79 service nova] Creating event network-vif-deleted:a150324a-9095-4341-89fe-222581dfe10e for instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 on n-h1-836830-13 Aug 29 16:00:46.722137 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c9cf0ee0-4fb8-4832-8745-a117724f0427 req-121a4f52-f3cb-4c36-98ea-ab7ec4467e79 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122540 Aug 29 16:00:46.725665 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2490/4887] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:47.228482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:47.231334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:47.253769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:47.255065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:47.256010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:47.258388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:47.259540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:47.260209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:47.382763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:47.383426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:47.383893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:47.387589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lazy-loading 'fault' on Instance uuid 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:00:47.559984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:47.575785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aef34f21-9347-4810-a975-840633bea64a tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 200 len: 1313 microversion: 2.1 time: 0.365613 Aug 29 16:00:47.579422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2398/4888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:47 2022] GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:48.605234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:48.605952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:48.622256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.624576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.625216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.625865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.626440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.626758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.657046 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] HTTP exception thrown: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 HTTP/1.1 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '501faf25-d9e7-4bb2-9ad8-ef7ff05b2632'} Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:48.659268 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:48.665213 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:48.674039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 404 to user: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:48.679885 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b584437-ca78-4a8b-adaf-f3b7145d4501 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 404 len: 111 microversion: 2.1 time: 0.076325 Aug 29 16:00:48.682455 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2491/4889] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:48 2022] GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:48.697042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:48.716214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:48.717726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:48.729394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.730980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.731786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.732798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:48.733824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:48.735448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:48.958459 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe2ef4a5-8561-43a7-9d66-b81763fdf7e7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.265210 Aug 29 16:00:48.959479 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2399/4890] 10.222.0.83 () {58 vars in 1230 bytes} [Mon Aug 29 16:00:48 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 16:00:48.992041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c25ad73-78bc-4f7d-be79-0680d5f3ee7f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c25ad73-78bc-4f7d-be79-0680d5f3ee7f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 16:00:49.013697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.018114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c25ad73-78bc-4f7d-be79-0680d5f3ee7f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:49.020735 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c25ad73-78bc-4f7d-be79-0680d5f3ee7f tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.044821 Aug 29 16:00:49.021946 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2492/4891] 10.222.0.83 () {58 vars in 1182 bytes} [Mon Aug 29 16:00:48 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:00:49.034670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.041210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:49.041889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:49.057222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.059168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.059621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.060401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.060863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.061287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.128593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:00:49.198174 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2677c2ab-c529-40b6-92c3-937c403166e2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.168322 Aug 29 16:00:49.199648 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2400/4892] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 16:00:49 2022] GET /compute/v2.1/servers => generated 683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:00:49.212279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.240012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:49.253532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.servers [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Removing options 'limit' from query {{(pid=129133) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 29 16:00:49.256202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:49.283551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.285211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.286398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.288088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.292902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.293592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.371773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:00:49.513338 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3bfaa233-45b5-43df-b992-ca7e150f1946 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.305359 Aug 29 16:00:49.532750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f81f4670-50ee-4b21-9eaf-f88687195a38 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.533358 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2493/4893] 10.222.0.83 () {58 vars in 1144 bytes} [Mon Aug 29 16:00:49 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f81f4670-50ee-4b21-9eaf-f88687195a38 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: action_args: {} Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise error Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi '-1' Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 16:00:49.552653 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f81f4670-50ee-4b21-9eaf-f88687195a38 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f81f4670-50ee-4b21-9eaf-f88687195a38 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.030468 Aug 29 16:00:49.560771 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2401/4894] 10.222.0.83 () {58 vars in 1142 bytes} [Mon Aug 29 16:00:49 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:00:49.565927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c73dd16b-a6fe-476d-b035-7d84f88d19a0 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c73dd16b-a6fe-476d-b035-7d84f88d19a0 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: action_args: {} Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi 'testing' Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 29 16:00:49.576889 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c73dd16b-a6fe-476d-b035-7d84f88d19a0 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:49.584570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c73dd16b-a6fe-476d-b035-7d84f88d19a0 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016309 Aug 29 16:00:49.594429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2494/4895] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 16:00:49 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:00:49.600430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7dc9cf5-4096-468a-a289-832019b25ca5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.613423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f7dc9cf5-4096-468a-a289-832019b25ca5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:49.614239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f7dc9cf5-4096-468a-a289-832019b25ca5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:49.667874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.servers [None req-f7dc9cf5-4096-468a-a289-832019b25ca5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Flavor 'non_existing_flavor' could not be found {{(pid=129132) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 29 16:00:49.674702 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f7dc9cf5-4096-468a-a289-832019b25ca5 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.078874 Aug 29 16:00:49.676454 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2402/4896] 10.222.0.83 () {58 vars in 1178 bytes} [Mon Aug 29 16:00:49 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 16:00:49.695870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:49.702123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:49.702800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:49.751960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.752545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.753726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:49.754435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:49.754895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:49.755350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.080033 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54072f39-4342-4946-b1fe-6e0cc7d86b50 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.395264 Aug 29 16:00:50.097141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:50.103885 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2495/4897] 10.222.0.83 () {58 vars in 1174 bytes} [Mon Aug 29 16:00:49 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:00:50.104652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:50.108859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:50.119585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:50.120467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:50.121129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.122095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:50.122798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:50.123461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.228583 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2db2df07-41ee-443d-87a9-ad19620390f7 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.136431 Aug 29 16:00:50.243098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:50.259319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:50.260095 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2403/4898] 10.222.0.83 () {58 vars in 1184 bytes} [Mon Aug 29 16:00:50 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:00:50.265275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:50.276212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:50.278584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:50.282173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.283299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:50.284219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:50.285104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.345441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:00:50.425338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:50.445407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:50.448723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:50.450584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.752327 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7edc82b-6bdd-44a8-b8e5-311b35709505 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.513372 Aug 29 16:00:50.754755 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2496/4899] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 16:00:50 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:50.787557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1bf16b4-fbb8-4f90-9b63-94f32b3a77b6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:50.794311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1bf16b4-fbb8-4f90-9b63-94f32b3a77b6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:50.795689 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1bf16b4-fbb8-4f90-9b63-94f32b3a77b6 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013628 Aug 29 16:00:50.796653 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2404/4900] 10.222.0.83 () {58 vars in 1178 bytes} [Mon Aug 29 16:00:50 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:00:50.813830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:50.824257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:50.829210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Searching by: {'deleted': False, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:00:50.849803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:50.850768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:50.851642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.853688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:50.854361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:50.855168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:50.910356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:00:50.991845 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-543c7f68-f7db-4344-a99c-5970b0f40fa2 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.183453 Aug 29 16:00:51.008998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2497/4901] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 16:00:50 2022] GET /compute/v2.1/servers => generated 683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:51.026255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:51.027408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:51.037475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.038986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.040150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.041106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.041737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.042374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.095314 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] HTTP exception thrown: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 HTTP/1.1 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '501faf25-d9e7-4bb2-9ad8-ef7ff05b2632'} Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:51.100918 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:51.106061 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:51.109704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 404 to user: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:51.114662 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-023c9314-4c25-4dcd-a9b0-99e4c40f5651 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "DELETE /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 404 len: 111 microversion: 2.1 time: 0.091847 Aug 29 16:00:51.122537 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2405/4902] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:00:51 2022] DELETE /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:51.124816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:51.125731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:51.151883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.151883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.151883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.151883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.151883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.152441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.249970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:00:51.531543 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54ee5c4a-f501-4d2c-bf9d-e2fb79a37364 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51" status: 204 len: 0 microversion: 2.1 time: 0.410249 Aug 29 16:00:51.534248 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2498/4903] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:00:51 2022] DELETE /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:00:51.544094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:51.544608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:51.561323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.563838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.564509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.566732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.567431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.570630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.647331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:00:51.909057 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb83bf8a-b2bd-47fa-8e9d-583a06f495ab tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 204 len: 0 microversion: 2.1 time: 0.366530 Aug 29 16:00:51.916022 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2406/4904] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:00:51 2022] DELETE /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:00:51.924998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:51.925970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:51.940874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.941458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.941897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:51.942610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:51.952139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:51.952749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:52.004872 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] HTTP exception thrown: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 HTTP/1.1 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '501faf25-d9e7-4bb2-9ad8-ef7ff05b2632'} Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:52.006696 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:52.011316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 404 to user: Instance 501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:52.015694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24cac735-c44c-48b8-9fe3-c8a372c229df tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632" status: 404 len: 111 microversion: 2.1 time: 0.087558 Aug 29 16:00:52.016317 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2499/4905] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:51 2022] GET /compute/v2.1/servers/501faf25-d9e7-4bb2-9ad8-ef7ff05b2632 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:00:52.025249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:52.026234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:52.036291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:52.038834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:52.039495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:52.041951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:52.051548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:52.052898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:52.350710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:52.367181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4c8e687c-691c-48fd-9b19-579c913e288c tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51" status: 200 len: 1522 microversion: 2.1 time: 0.339305 Aug 29 16:00:52.367181 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2407/4906] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:52 2022] GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:53.388445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:53.389692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:53.403315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:00:53.407056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:53.409597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:53.413134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:53.416839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:53.418630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:53.419353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:53.782054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:53.791184 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ff6d94d-75d5-4cd9-beac-48fa0aa9834d tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51" status: 200 len: 1522 microversion: 2.1 time: 0.409037 Aug 29 16:00:53.791781 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2500/4907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:53 2022] GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:54.818142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:54.818843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:54.827172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:54.827929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:54.828676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:54.829607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:54.830302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:54.831803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:55.435965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:55.452853 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e787581-7dbb-42a4-8c15-f8c7de16ba58 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51" status: 200 len: 1522 microversion: 2.1 time: 0.638908 Aug 29 16:00:55.458960 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2408/4908] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:54 2022] GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:55.821804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-66ee2ecf-e9f6-426d-b93b-4b9ba54f7908 req-35551484-34c7-4c9b-9f1e-d4d722c47bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75d7e33-5bd3-4079-b10b-a9e577eea3b7", "name": "network-vif-deleted", "tag": "4416f05c-731e-4c3d-8b54-d67db1ed3ca7"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:55.860176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66ee2ecf-e9f6-426d-b93b-4b9ba54f7908 req-35551484-34c7-4c9b-9f1e-d4d722c47bde service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:55.860674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66ee2ecf-e9f6-426d-b93b-4b9ba54f7908 req-35551484-34c7-4c9b-9f1e-d4d722c47bde service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:55.861107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66ee2ecf-e9f6-426d-b93b-4b9ba54f7908 req-35551484-34c7-4c9b-9f1e-d4d722c47bde service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:55.892302 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-66ee2ecf-e9f6-426d-b93b-4b9ba54f7908 req-35551484-34c7-4c9b-9f1e-d4d722c47bde service nova] Creating event network-vif-deleted:4416f05c-731e-4c3d-8b54-d67db1ed3ca7 for instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 on n-h1-836830-13 Aug 29 16:00:55.905517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-66ee2ecf-e9f6-426d-b93b-4b9ba54f7908 req-35551484-34c7-4c9b-9f1e-d4d722c47bde service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087871 Aug 29 16:00:55.906796 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2501/4909] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:56.478036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:56.478650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:56.511044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:56.511823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:56.521050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:56.522293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:56.524865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:56.525571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:56.714465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:56.721943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:56.730452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:56.731458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lazy-loading 'fault' on Instance uuid d1d05dd2-c41c-4524-922c-a67a9565ec51 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:00:56.966130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e460fd09b56f4c47a46062a41fc89bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b02f0c534c9462c9de0e6fab11cea27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:00:56.975214 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7af12299-f267-452e-81ae-cf59f1d6e181 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51" status: 200 len: 1313 microversion: 2.1 time: 0.501020 Aug 29 16:00:56.988102 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2409/4910] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:56 2022] GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:00:57.965730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c0d4ed47-661b-48dc-a772-dd6789b2abe7 req-8406ca3e-7b4a-41b3-9ee4-c2b12137eb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d05dd2-c41c-4524-922c-a67a9565ec51", "name": "network-vif-deleted", "tag": "1f6f779b-da17-4ad7-9f75-fe8de56746b6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:00:57.986051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c0d4ed47-661b-48dc-a772-dd6789b2abe7 req-8406ca3e-7b4a-41b3-9ee4-c2b12137eb6d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:57.991686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c0d4ed47-661b-48dc-a772-dd6789b2abe7 req-8406ca3e-7b4a-41b3-9ee4-c2b12137eb6d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:57.992144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c0d4ed47-661b-48dc-a772-dd6789b2abe7 req-8406ca3e-7b4a-41b3-9ee4-c2b12137eb6d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.011781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:58.013713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: d1d05dd2-c41c-4524-922c-a67a9565ec51] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:58.054726 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c0d4ed47-661b-48dc-a772-dd6789b2abe7 req-8406ca3e-7b4a-41b3-9ee4-c2b12137eb6d service nova] Creating event network-vif-deleted:1f6f779b-da17-4ad7-9f75-fe8de56746b6 for instance d1d05dd2-c41c-4524-922c-a67a9565ec51 on n-h2-836830-13 Aug 29 16:00:58.063211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:58.064202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:58.066752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.067908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:58.068610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:58.071868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.072009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c0d4ed47-661b-48dc-a772-dd6789b2abe7 req-8406ca3e-7b4a-41b3-9ee4-c2b12137eb6d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111462 Aug 29 16:00:58.072589 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2502/4911] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:00:58.089195 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] HTTP exception thrown: Instance d1d05dd2-c41c-4524-922c-a67a9565ec51 could not be found. Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 HTTP/1.1 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d1d05dd2-c41c-4524-922c-a67a9565ec51 could not be found. Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd1d05dd2-c41c-4524-922c-a67a9565ec51'} Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d05dd2-c41c-4524-922c-a67a9565ec51 could not be found. Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d05dd2-c41c-4524-922c-a67a9565ec51 could not be found. Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.092082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d05dd2-c41c-4524-922c-a67a9565ec51 could not be found. Aug 29 16:00:58.096999 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.098873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 404 to user: Instance d1d05dd2-c41c-4524-922c-a67a9565ec51 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:58.100299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-93797e2f-96e7-472e-907e-238f2a562101 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51" status: 404 len: 111 microversion: 2.1 time: 0.092285 Aug 29 16:00:58.101789 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2410/4912] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:58 2022] GET /compute/v2.1/servers/d1d05dd2-c41c-4524-922c-a67a9565ec51 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:00:58.112684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:00:58.113641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] [instance: f75d7e33-5bd3-4079-b10b-a9e577eea3b7] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:00:58.126069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:58.128756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:58.129481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.131346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:00:58.134276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:00:58.135222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:00:58.158295 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] HTTP exception thrown: Instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 could not be found. Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Request method failure captured: Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 HTTP/1.1 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOKMfjc2rddzc0Gp8ziKKzJBYOjpyyO8yHyuIr51K0BERFDhHmef-ZBvYr7Yu-pKJxMrwfs6sXRbJWvX4zZ2nrWLeDb2Vhat8zUEOvvNU0BLtnMmbypJImqA3HadHbcj2T5Ua-B3LtPydA-pmXwu5WLH-ITq1Ukd9Y_MmD-BX5x-pOQ Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_5b02f0c534c9462c9de0e6fab11cea27", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/5b02f0c534c9462c9de0e6fab11cea27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/5b02f0c534c9462c9de0e6fab11cea27"}]}] Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 5b02f0c534c9462c9de0e6fab11cea27 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-450672580 Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e460fd09b56f4c47a46062a41fc89bbf Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ListServersNegativeTestJSON-450672580-project Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 could not be found. Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'f75d7e33-5bd3-4079-b10b-a9e577eea3b7'} Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 could not be found. Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 could not be found. Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.160285 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 could not be found. Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] Returning 404 to user: Instance f75d7e33-5bd3-4079-b10b-a9e577eea3b7 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e06eddf8-055a-4c72-8a39-83c5ed561e15 tempest-ListServersNegativeTestJSON-450672580 tempest-ListServersNegativeTestJSON-450672580-project] 10.222.0.83 "GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7" status: 404 len: 111 microversion: 2.1 time: 0.054864 Aug 29 16:00:58.164764 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2503/4913] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:00:58 2022] GET /compute/v2.1/servers/f75d7e33-5bd3-4079-b10b-a9e577eea3b7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:09.884806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:09.886227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:09.887142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:10.298588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2072119273", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "ed560634-6716-4282-9596-e4e456a1700a"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:10.424386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] validate_networks() for [('ed560634-6716-4282-9596-e4e456a1700a', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:01:12.433803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:01:12.435101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:01:12.435749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:01:12.437984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:01:12.437984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:01:12.462718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:12.463244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:12.463677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:12.464417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:12.464873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:12.465298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:12.534791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Getting quotas for project 380e64930bc44fa0b1204f3acd328537. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:12.555966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Getting quotas for user 9ee1a19085a04426be20de4023ef1a9b and project 380e64930bc44fa0b1204f3acd328537. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:12.602783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:01:12.609999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:01:12.722240 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-641d036d-f965-45db-958e-7b9c8f50101f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.841867 Aug 29 16:01:12.724267 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2411/4914] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:01:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:01:12.735194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09ee8a97-e783-4fca-9173-916439dca882 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:12.736915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09ee8a97-e783-4fca-9173-916439dca882 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:12.740393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:12.742240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:12.743533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:12.747652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:12.887633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09ee8a97-e783-4fca-9173-916439dca882 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:12.909874 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09ee8a97-e783-4fca-9173-916439dca882 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1216 microversion: 2.1 time: 0.178944 Aug 29 16:01:12.921137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2504/4915] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:12 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1216 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:13.939899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:13.943882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:13.966472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:13.968326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:13.969068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:13.975905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:13.977931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:13.978822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:14.181647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:14.189527 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b455ea3b-8835-4d56-b5c5-cabc5f1e2459 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1212 microversion: 2.1 time: 0.254078 Aug 29 16:01:14.195361 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2412/4916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:13 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1212 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:14.898107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:14.898615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:14.917857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:14.920737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:14.922658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:14.923831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:14.929546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:14.931686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.017686 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-115ec0c2-0adb-4bfd-b4f3-1f507470cb00 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/ips" status: 200 len: 149 microversion: 2.1 time: 0.862379 Aug 29 16:01:15.040058 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2505/4917] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:01:14 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/ips => generated 149 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:01:15.212689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:15.213583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:15.225212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.229066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.233658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.234417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.234898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.245276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.354882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Calling method '.version_select at 0x7f32ed54a310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:15.357366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.358094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.359040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.382484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.384300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.385510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.421678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:15.422429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:15.423237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:15.432713 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-afb1497c-c8a6-43a9-98ca-c85d0bcabc78 tempest-PortsAdminExtendedAttrsTestJSON-2076370547 tempest-PortsAdminExtendedAttrsTestJSON-2076370547-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.548801 Aug 29 16:01:15.440293 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2413/4918] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 16:01:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:01:15.582547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:15.608720 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15f9fd53-bd96-4375-8725-811a3534251f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1286 microversion: 2.1 time: 0.393568 Aug 29 16:01:15.625159 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2506/4919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:15 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1286 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:16.633990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:16.636356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:16.658185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:16.661408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:16.662343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:16.664488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:16.667566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:16.672120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:17.249267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:17.274241 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57b51903-2615-4990-b001-46dad121f203 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.637255 Aug 29 16:01:17.296478 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2414/4920] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:16 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:18.307847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:18.309057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:18.320837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:18.323406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:18.324038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:18.326373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:18.327986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:18.328603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:18.839945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:18.853078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef33521c-b8c9-4410-9dca-b50530403d37 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.549232 Aug 29 16:01:18.853682 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2507/4921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:18 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:18.869538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7d065d0a-0de5-4cdf-b482-0bf4e22b2aa9 req-6fb3f03c-8e84-4007-ad00-d1e3a604d6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb15dc6-fd67-4561-b65d-a28069259da8", "tag": "9978ef50-397a-4268-9241-97bdd12c94ac"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:18.901779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d065d0a-0de5-4cdf-b482-0bf4e22b2aa9 req-6fb3f03c-8e84-4007-ad00-d1e3a604d6d6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:18.902281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d065d0a-0de5-4cdf-b482-0bf4e22b2aa9 req-6fb3f03c-8e84-4007-ad00-d1e3a604d6d6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:18.902720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d065d0a-0de5-4cdf-b482-0bf4e22b2aa9 req-6fb3f03c-8e84-4007-ad00-d1e3a604d6d6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:18.926512 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7d065d0a-0de5-4cdf-b482-0bf4e22b2aa9 req-6fb3f03c-8e84-4007-ad00-d1e3a604d6d6 service nova] Creating event network-changed:9978ef50-397a-4268-9241-97bdd12c94ac for instance 0cb15dc6-fd67-4561-b65d-a28069259da8 on n-h1-836830-13 Aug 29 16:01:18.939277 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7d065d0a-0de5-4cdf-b482-0bf4e22b2aa9 req-6fb3f03c-8e84-4007-ad00-d1e3a604d6d6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073111 Aug 29 16:01:18.943341 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2415/4922] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:19.270355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f097de-fdd0-48ce-b38d-d6757de2b76c"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:19.274199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:19.281541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:19.282315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:19.282934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:19.283989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:19.284720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:19.285455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:19.756795 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8be219d3-9b76-428b-b3a2-7d909a8c7695 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491678 Aug 29 16:01:19.758923 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2508/4923] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:01:19 2022] POST /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:19.875703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:19.876529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:19.894321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:19.895328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:19.896327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:19.901109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:19.901881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:19.902571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:20.314036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:20.329856 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81f23479-f940-4680-a49d-915f43e36e0f tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.457621 Aug 29 16:01:20.358216 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2416/4924] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:19 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:21.355243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:21.356296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:21.388253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:21.390377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:21.392501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:21.394353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:21.400447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:21.402086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:21.677557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:21.699266 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37159e04-d266-4a5c-af81-1c1f9f7d3fb6 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.347672 Aug 29 16:01:21.701108 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2509/4925] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:21 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:22.726570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:22.728981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:22.739457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:22.740194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:22.741796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:22.742434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:22.742878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:22.743627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:22.744081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:22.744509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:23.136952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:23.158038 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4959aebd-204d-4027-8658-7337bf3afed5 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.432604 Aug 29 16:01:23.160776 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2417/4926] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:22 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:24.182581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:24.183940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:24.193988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:24.200019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:24.200991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:24.202499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:24.207885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:24.208621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:24.209283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:24.651791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:24.676346 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bdbe1dc1-db78-4271-9215-c8029fa65b98 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.495016 Aug 29 16:01:24.690373 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2510/4927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:24 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:25.689337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-585321757", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:25.704474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:25.705224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:25.726459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:25.733166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:25.733646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:25.734409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:25.747235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:25.748143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:25.836412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] validate_networks() for [('692c297a-85b1-4611-a17e-bc2859e627b4', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:01:26.911437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:26.920547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79690f84-f7b7-4a87-9421-59f52d29e3a7 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 1.224077 Aug 29 16:01:26.921139 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2511/4928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:25 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:27.057106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:01:27.057583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:01:27.058018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:01:27.058455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:01:27.058861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:01:27.089525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:27.091369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:27.091851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:27.092693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:27.093167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:27.095324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:27.144170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for project eb9fe4b710cb46779f13a142f1301567. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:27.161002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for user dcd426ac002048bf9db072739a81c2e4 and project eb9fe4b710cb46779f13a142f1301567. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:27.197621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:01:27.204725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:01:27.353112 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6dee2bad-1d2d-4773-9ef5-c39f65757d0d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.859133 Aug 29 16:01:27.360050 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2418/4929] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:01:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:01:27.368991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67eb9729-c28a-4aef-af4b-75d76100d9f5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:27.369917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67eb9729-c28a-4aef-af4b-75d76100d9f5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:27.539056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-67eb9729-c28a-4aef-af4b-75d76100d9f5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:27.546894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67eb9729-c28a-4aef-af4b-75d76100d9f5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1221 microversion: 2.1 time: 0.181935 Aug 29 16:01:27.562216 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2512/4930] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:27 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:27.697070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1318427094", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:27.865701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] validate_networks() for [('692c297a-85b1-4611-a17e-bc2859e627b4', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:01:27.946449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:27.949533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:27.971763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:27.973453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:27.974993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:27.978650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:27.979839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:27.982009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:28.756499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:28.769187 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ac2d78c6-81b5-4641-88f1-5ab4705130b1 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.830229 Aug 29 16:01:28.772973 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2513/4931] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:27 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:29.793521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:29.794931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:29.810464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:29.817382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:29.822444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:29.825488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:29.827128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:29.827128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:30.437928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:01:30.438399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:01:30.438827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:01:30.439275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:01:30.439726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:01:30.465259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:30.465779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:30.467832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:30.472891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:30.473880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:30.474756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:30.514400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:30.529010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for project eb9fe4b710cb46779f13a142f1301567. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:01:30.530595 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92f2b9fb-c9b7-4c78-a17b-3f14d95af589 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 0.741100 Aug 29 16:01:30.534954 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2514/4932] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:29 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:30.540074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-600ba101-15a1-4b4e-9e30-14d43fc2f738 req-aeac7717-de74-4574-ba64-a2b63150f5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb15dc6-fd67-4561-b65d-a28069259da8", "name": "network-vif-plugged", "status": "completed", "tag": "9978ef50-397a-4268-9241-97bdd12c94ac"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:30.555691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for user dcd426ac002048bf9db072739a81c2e4 and project eb9fe4b710cb46779f13a142f1301567. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:01:30.576393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:01:30.579396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:01:30.590149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-600ba101-15a1-4b4e-9e30-14d43fc2f738 req-aeac7717-de74-4574-ba64-a2b63150f5a9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:30.590642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-600ba101-15a1-4b4e-9e30-14d43fc2f738 req-aeac7717-de74-4574-ba64-a2b63150f5a9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:30.596666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-600ba101-15a1-4b4e-9e30-14d43fc2f738 req-aeac7717-de74-4574-ba64-a2b63150f5a9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:30.648061 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-600ba101-15a1-4b4e-9e30-14d43fc2f738 req-aeac7717-de74-4574-ba64-a2b63150f5a9 service nova] Creating event network-vif-plugged:9978ef50-397a-4268-9241-97bdd12c94ac for instance 0cb15dc6-fd67-4561-b65d-a28069259da8 on n-h1-836830-13 Aug 29 16:01:30.672945 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-600ba101-15a1-4b4e-9e30-14d43fc2f738 req-aeac7717-de74-4574-ba64-a2b63150f5a9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136609 Aug 29 16:01:30.675734 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2515/4933] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:30.726994 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-59ba8836-69c2-4ce2-a8b5-78d0c505efd3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.032370 Aug 29 16:01:30.730834 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2419/4934] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:01:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:01:30.756877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c88a9d02-c4ee-43f3-950f-bea04da71b10 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:30.757701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c88a9d02-c4ee-43f3-950f-bea04da71b10 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:31.055422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c88a9d02-c4ee-43f3-950f-bea04da71b10 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:31.068820 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c88a9d02-c4ee-43f3-950f-bea04da71b10 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1222 microversion: 2.1 time: 0.330568 Aug 29 16:01:31.070226 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2516/4935] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:30 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:31.557637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:31.559283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:31.575247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:31.579117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:31.583013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:31.584659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:31.585937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:31.587219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:32.091058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:32.092507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:32.104886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:32.116882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:32.117361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:32.118133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:32.118588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:32.121029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:32.251731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:32.265259 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83b7def4-08cf-46d1-ab26-af91ed88aeff tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1226 microversion: 2.1 time: 0.177993 Aug 29 16:01:32.271438 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2517/4936] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:32 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1226 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:32.753014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:32.766127 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8763e763-35ee-4c6a-86c1-447c1f70913b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1316 microversion: 2.1 time: 1.216114 Aug 29 16:01:32.776930 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2420/4937] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:31 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1316 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:33.291284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:33.296227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:33.328167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:33.329060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:33.335432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:33.338270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:33.338976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:33.339636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:33.645045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:33.657776 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-259d9df5-9b0a-4b10-a7a9-d5b380799f84 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1282 microversion: 2.1 time: 0.370644 Aug 29 16:01:33.664740 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2518/4938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:33 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1282 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:33.798393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:33.801021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:33.809897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:33.810561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:33.810998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:33.819663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:33.827179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:33.827954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:34.698059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:34.698853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:34.716622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:34.717125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:34.717577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:34.718315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:34.718778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:34.719248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:35.051141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:35.062041 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f8b7f07d-195d-48dd-9d7c-d0a36fe06294 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1280 microversion: 2.1 time: 0.375235 Aug 29 16:01:35.062620 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2519/4939] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:34 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1280 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:36.085869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:36.087474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:36.102829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:36.103624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:36.108946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:36.109970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:36.110616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:36.111312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:36.194484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:36.209555 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-635a9892-a73f-4ba0-825b-300f47c2aae9 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1505 microversion: 2.1 time: 2.413280 Aug 29 16:01:36.212270 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2421/4940] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:33 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1505 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:36.237859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:36.238784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:36.264918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:36.265725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:36.266330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:36.275446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:36.276352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:36.276978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:36.375651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:01:36.616786 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e4d99ad-af24-4dcb-88f0-1c694fda59fd tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 204 len: 0 microversion: 2.1 time: 0.380810 Aug 29 16:01:36.622058 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2422/4941] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:01:36 2022] DELETE /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:01:36.635596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:36.636357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:36.651507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:36.659669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:36.660279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:36.661046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:36.661530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:36.661965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:37.472557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:37.493107 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b592cb2c-713c-4126-82b3-9c47110d108b tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1511 microversion: 2.1 time: 0.858302 Aug 29 16:01:37.498403 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2423/4942] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:36 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1511 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:37.524515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:37.533937 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04306feb-ae37-4325-be8f-b8b342f8543c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1280 microversion: 2.1 time: 1.452360 Aug 29 16:01:37.551423 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2520/4943] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:36 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1280 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:38.519987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:38.521334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:38.536895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.537988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.538740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.539710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.540353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.542243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.571888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:38.572681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:38.584160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.587646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.588355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.589330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:38.592067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:38.592768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:38.888002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:38.897754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf5c7d9e-1feb-4764-851f-785df25c40c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.329834 Aug 29 16:01:38.904689 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2521/4944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:38 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:39.451737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:39.491154 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e130652-92eb-4bcb-91ac-02761ebd1641 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1511 microversion: 2.1 time: 0.975961 Aug 29 16:01:39.507607 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2424/4945] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:38 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1511 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:39.536732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f097de-fdd0-48ce-b38d-d6757de2b76c"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:39.541052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:39.559951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.559951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.559951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.563314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.563501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.564324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.690755 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Invalid volume: volume a2f097de-fdd0-48ce-b38d-d6757de2b76c is already attached to instances: 65fc5de0-11ee-454e-a7d9-941f08fef311 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments HTTP/1.1 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 74 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: {"volumeAttachment": {"volumeId": "a2f097de-fdd0-48ce-b38d-d6757de2b76c"}} Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid volume: volume a2f097de-fdd0-48ce-b38d-d6757de2b76c is already attached to instances: 65fc5de0-11ee-454e-a7d9-941f08fef311 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '65fc5de0-11ee-454e-a7d9-941f08fef311', 'body': {'volumeAttachment': {'volumeId': 'a2f097de-fdd0-48ce-b38d-d6757de2b76c'}}} Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2f097de-fdd0-48ce-b38d-d6757de2b76c is already attached to instances: 65fc5de0-11ee-454e-a7d9-941f08fef311 Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:39.693331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2f097de-fdd0-48ce-b38d-d6757de2b76c is already attached to instances: 65fc5de0-11ee-454e-a7d9-941f08fef311 Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2f097de-fdd0-48ce-b38d-d6757de2b76c is already attached to instances: 65fc5de0-11ee-454e-a7d9-941f08fef311 Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 400 to user: Invalid volume: volume a2f097de-fdd0-48ce-b38d-d6757de2b76c is already attached to instances: 65fc5de0-11ee-454e-a7d9-941f08fef311 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72d135ce-efe4-42b6-93e6-98cd5e2899c2 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.164353 Aug 29 16:01:39.698785 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2522/4946] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:01:39 2022] POST /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 174 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 16:01:39.803843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:39.804979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:39.816668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.817414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.832029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.835732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.836240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.836809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.927359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:39.928046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:39.936714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.937227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.937669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.942746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:39.943317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:39.943770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:39.952469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:40.066166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:40.068771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lazy-loading 'services' on Instance uuid 65fc5de0-11ee-454e-a7d9-941f08fef311 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:01:40.200500 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f5f0da1-3d35-4e8d-983f-e1daa33f5e95 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments/a2f097de-fdd0-48ce-b38d-d6757de2b76c" status: 202 len: 0 microversion: 2.1 time: 0.403271 Aug 29 16:01:40.205541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2425/4947] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:01:39 2022] DELETE /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments/a2f097de-fdd0-48ce-b38d-d6757de2b76c => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:01:40.213087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:40.217602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:40.224790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:40.253272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:40.254192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:40.254658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:40.256700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:40.257397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:40.260117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:40.354309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-db82dba3-1203-4170-8624-c9b4e970c6f4 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145242 Aug 29 16:01:40.354943 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2426/4948] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:40 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:40.370166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:40.385743 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5da1ae9-9a36-4e59-8239-502f5b5ed19d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.462943 Aug 29 16:01:40.387253 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2523/4949] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:39 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:40.517496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:40.518333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:40.520311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:40.532161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:40.533556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:40.534664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:40.535908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:40.536686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:40.538044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:40.570321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:41.366745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:41.380661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:41.392318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:41.414174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.418387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.421809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.424526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.425415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.426086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.545298 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-358c595f-03e0-4651-bee6-dec5d6964a10 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182616 Aug 29 16:01:41.547161 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2524/4950] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:41 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:41.559456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:41.563473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:41.587196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.588098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.589218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.590194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.591234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.591908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.835525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:41.846685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dfffd6b5-7718-4330-831e-4ee5e8356d56 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1511 microversion: 2.1 time: 1.333189 Aug 29 16:01:41.856107 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2427/4951] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:40 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1511 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:41.861395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e57f7130-38d8-401f-8983-c2b7643e7f03 req-4ea0ecb7-b55f-4f7a-902e-761e9cd82cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f1caeb-d314-411b-8e0a-e9762b370f5c", "tag": "4bd4633f-3a03-4008-8d43-9b4e86477ab3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:41.883242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:41.892887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e57f7130-38d8-401f-8983-c2b7643e7f03 req-4ea0ecb7-b55f-4f7a-902e-761e9cd82cd3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:41.893244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e57f7130-38d8-401f-8983-c2b7643e7f03 req-4ea0ecb7-b55f-4f7a-902e-761e9cd82cd3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:41.893684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e57f7130-38d8-401f-8983-c2b7643e7f03 req-4ea0ecb7-b55f-4f7a-902e-761e9cd82cd3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:41.894996 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0fe3292-5c10-4c2c-8133-a2c6b21fc816 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.342063 Aug 29 16:01:41.911534 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2525/4952] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:41 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:41.969410 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e57f7130-38d8-401f-8983-c2b7643e7f03 req-4ea0ecb7-b55f-4f7a-902e-761e9cd82cd3 service nova] Creating event network-changed:4bd4633f-3a03-4008-8d43-9b4e86477ab3 for instance 38f1caeb-d314-411b-8e0a-e9762b370f5c on n-h2-836830-13 Aug 29 16:01:41.976609 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e57f7130-38d8-401f-8983-c2b7643e7f03 req-4ea0ecb7-b55f-4f7a-902e-761e9cd82cd3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118820 Aug 29 16:01:41.977729 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2428/4953] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:42.560411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:42.563208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:42.584795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.585540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.586197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.587118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.587737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.588327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.671869 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d8e5b15-7b41-4544-8c65-dea822cf8546 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113526 Aug 29 16:01:42.678151 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2526/4954] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:42 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:42.882522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:42.884441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:42.900741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.901655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.902550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.905547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.907153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.907847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.925536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:42.926574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:42.940435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=53 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:42.944730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.951734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.952471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:42.953452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:42.954126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:42.959141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.051887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:43.052385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:43.052827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.053289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lazy-loading 'fault' on Instance uuid 0cb15dc6-fd67-4561-b65d-a28069259da8 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:01:43.304193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee1a19085a04426be20de4023ef1a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380e64930bc44fa0b1204f3acd328537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:43.312376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cebe919d-2022-4c2e-8aed-8b276a451e12 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 200 len: 1306 microversion: 2.1 time: 0.435956 Aug 29 16:01:43.312967 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2429/4955] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:42 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 1306 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:43.586083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:43.605632 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d67e69eb-f435-4705-8d53-558f8c8ed9bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.684275 Aug 29 16:01:43.611819 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2527/4956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:42 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:01:43.686950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:43.690255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:43.719096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:43.720085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:43.722803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.726503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:43.728491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:43.731330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:43.836847 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ac91918-4e1c-4214-bce1-ffd8afa34943 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151993 Aug 29 16:01:43.841458 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2430/4957] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:43 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:44.058098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-831828bf-ccda-444b-a6a6-41879c1ae954 req-82f565d9-c8e0-4136-865c-8622437e0861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb15dc6-fd67-4561-b65d-a28069259da8", "name": "network-vif-deleted", "tag": "9978ef50-397a-4268-9241-97bdd12c94ac"}, {"name": "network-changed", "server_uuid": "b298b8a5-3dc2-4fa7-bd5a-c664295f4127", "tag": "1d53e89f-4d18-494d-b868-dd6686eb78e8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:44.090540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-831828bf-ccda-444b-a6a6-41879c1ae954 req-82f565d9-c8e0-4136-865c-8622437e0861 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.110219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-831828bf-ccda-444b-a6a6-41879c1ae954 req-82f565d9-c8e0-4136-865c-8622437e0861 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.112785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-831828bf-ccda-444b-a6a6-41879c1ae954 req-82f565d9-c8e0-4136-865c-8622437e0861 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.169653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-831828bf-ccda-444b-a6a6-41879c1ae954 req-82f565d9-c8e0-4136-865c-8622437e0861 service nova] Creating event network-vif-deleted:9978ef50-397a-4268-9241-97bdd12c94ac for instance 0cb15dc6-fd67-4561-b65d-a28069259da8 on n-h1-836830-13 Aug 29 16:01:44.174223 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-831828bf-ccda-444b-a6a6-41879c1ae954 req-82f565d9-c8e0-4136-865c-8622437e0861 service nova] Creating event network-changed:1d53e89f-4d18-494d-b868-dd6686eb78e8 for instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 on n-h1-836830-13 Aug 29 16:01:44.194614 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-831828bf-ccda-444b-a6a6-41879c1ae954 req-82f565d9-c8e0-4136-865c-8622437e0861 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.140124 Aug 29 16:01:44.197399 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2528/4958] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:44.339278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:44.343847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.358042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.360363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.362714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.363676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.368098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.368811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.391567 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] HTTP exception thrown: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Request method failure captured: Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 HTTP/1.1 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLFk-23oiAOl-88HbBHdpPUs1y4YTiZJ16CIIeYerpu82T9ZXsHSMrY2dd3wmx6Zb4ssFBPJKlbGPQSBt0eVAgOggXcxeFSnMl_k3Uu0Kf-yKIMeWg10DlPTOwJ8iqyRaCvR_Pw0KDccVilOrsoyUT5t5Ld_h4T3IGYPdAUzUCtweQ Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_380e64930bc44fa0b1204f3acd328537", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/380e64930bc44fa0b1204f3acd328537"}]}] Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9ee1a19085a04426be20de4023ef1a9b Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '0cb15dc6-fd67-4561-b65d-a28069259da8'} Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.394862 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.399410 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.399410 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.399410 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.399410 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:44.399410 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:44.399410 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.399410 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.402678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Returning 404 to user: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:44.404292 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7c12ee5-f801-4467-9788-d8f54a1aec62 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 404 len: 111 microversion: 2.1 time: 0.071637 Aug 29 16:01:44.405540 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2431/4959] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:44 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:44.418190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-905854462", "metadata": {"image_type": "test"}}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:44.421860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.431670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.432608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.434491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.435701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.437222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.437896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.456025 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] HTTP exception thrown: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Request method failure captured: Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8/action HTTP/1.1 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 111 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOLFk-23oiAOl-88HbBHdpPUs1y4YTiZJ16CIIeYerpu82T9ZXsHSMrY2dd3wmx6Zb4ssFBPJKlbGPQSBt0eVAgOggXcxeFSnMl_k3Uu0Kf-yKIMeWg10DlPTOwJ8iqyRaCvR_Pw0KDccVilOrsoyUT5t5Ld_h4T3IGYPdAUzUCtweQ Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_380e64930bc44fa0b1204f3acd328537", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/380e64930bc44fa0b1204f3acd328537"}]}] Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 9ee1a19085a04426be20de4023ef1a9b Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-905854462", "metadata": {"image_type": "test"}}} Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '0cb15dc6-fd67-4561-b65d-a28069259da8', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-905854462', 'metadata': {'image_type': 'test'}}}} Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 16:01:44.458309 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.462210 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.467128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Returning 404 to user: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:44.468786 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-80f05a21-c16a-4149-9e1a-287381e4fccc tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "POST /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8/action" status: 404 len: 111 microversion: 2.1 time: 0.057708 Aug 29 16:01:44.469945 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2529/4960] 10.222.0.83 () {60 vars in 1279 bytes} [Mon Aug 29 16:01:44 2022] POST /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:44.484676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-409981ed-2ca0-4a2f-9e9d-1df39e842a82 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-986155528", "metadata": {"image_type": "test"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:44.487351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-409981ed-2ca0-4a2f-9e9d-1df39e842a82 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Failed to fetch instance by id tempest-invalid-1434228686 {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 16:01:44.487921 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-409981ed-2ca0-4a2f-9e9d-1df39e842a82 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] HTTP exception thrown: Instance tempest-invalid-1434228686 could not be found. Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-409981ed-2ca0-4a2f-9e9d-1df39e842a82 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Request method failure captured: Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/tempest-invalid-1434228686/action HTTP/1.1 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 111 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLFk-23oiAOl-88HbBHdpPUs1y4YTiZJ16CIIeYerpu82T9ZXsHSMrY2dd3wmx6Zb4ssFBPJKlbGPQSBt0eVAgOggXcxeFSnMl_k3Uu0Kf-yKIMeWg10DlPTOwJ8iqyRaCvR_Pw0KDccVilOrsoyUT5t5Ld_h4T3IGYPdAUzUCtweQ Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_380e64930bc44fa0b1204f3acd328537", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/380e64930bc44fa0b1204f3acd328537"}]}] Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9ee1a19085a04426be20de4023ef1a9b Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-986155528", "metadata": {"image_type": "test"}}} Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance tempest-invalid-1434228686 could not be found. Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'tempest-invalid-1434228686', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-986155528', 'metadata': {'image_type': 'test'}}}} Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1434228686 could not be found. Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:44.489565 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1434228686 could not be found. Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1434228686 could not be found. Aug 29 16:01:44.493604 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.495883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-409981ed-2ca0-4a2f-9e9d-1df39e842a82 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Returning 404 to user: Instance tempest-invalid-1434228686 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:44.496980 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-409981ed-2ca0-4a2f-9e9d-1df39e842a82 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "POST /compute/v2.1/servers/tempest-invalid-1434228686/action" status: 404 len: 101 microversion: 2.1 time: 0.016585 Aug 29 16:01:44.498112 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2432/4961] 10.222.0.83 () {60 vars in 1249 bytes} [Mon Aug 29 16:01:44 2022] POST /compute/v2.1/servers/tempest-invalid-1434228686/action => generated 101 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:44.509926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f332b4a4-c523-4047-8ab4-472a06c7fdfb tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-970527403"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:44.512848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f332b4a4-c523-4047-8ab4-472a06c7fdfb tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 16:01:44.518339 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f332b4a4-c523-4047-8ab4-472a06c7fdfb tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f332b4a4-c523-4047-8ab4-472a06c7fdfb tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Request method failure captured: Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 56 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOLFk-23oiAOl-88HbBHdpPUs1y4YTiZJ16CIIeYerpu82T9ZXsHSMrY2dd3wmx6Zb4ssFBPJKlbGPQSBt0eVAgOggXcxeFSnMl_k3Uu0Kf-yKIMeWg10DlPTOwJ8iqyRaCvR_Pw0KDccVilOrsoyUT5t5Ld_h4T3IGYPdAUzUCtweQ Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_380e64930bc44fa0b1204f3acd328537", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/380e64930bc44fa0b1204f3acd328537"}]}] Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 9ee1a19085a04426be20de4023ef1a9b Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: {"createImage": {"name": "tempest-test-snap-970527403"}} Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-970527403'}}} Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.520379 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.524482 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.526442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f332b4a4-c523-4047-8ab4-472a06c7fdfb tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:44.527603 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f332b4a4-c523-4047-8ab4-472a06c7fdfb tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.022022 Aug 29 16:01:44.531484 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2530/4962] 10.222.0.83 () {60 vars in 1275 bytes} [Mon Aug 29 16:01:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:44.543598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07d4efae-a8f2-41c1-81b9-df3e0a818438 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1260268477"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:44.547153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-07d4efae-a8f2-41c1-81b9-df3e0a818438 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 16:01:44.547922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-07d4efae-a8f2-41c1-81b9-df3e0a818438 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07d4efae-a8f2-41c1-81b9-df3e0a818438 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Request method failure captured: Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 57 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLFk-23oiAOl-88HbBHdpPUs1y4YTiZJ16CIIeYerpu82T9ZXsHSMrY2dd3wmx6Zb4ssFBPJKlbGPQSBt0eVAgOggXcxeFSnMl_k3Uu0Kf-yKIMeWg10DlPTOwJ8iqyRaCvR_Pw0KDccVilOrsoyUT5t5Ld_h4T3IGYPdAUzUCtweQ Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_380e64930bc44fa0b1204f3acd328537", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/380e64930bc44fa0b1204f3acd328537"}]}] Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9ee1a19085a04426be20de4023ef1a9b Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: {"createImage": {"name": "tempest-test-snap-1260268477"}} Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1260268477'}}} Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.549901 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 29 16:01:44.553931 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.556530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07d4efae-a8f2-41c1-81b9-df3e0a818438 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:44.557676 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07d4efae-a8f2-41c1-81b9-df3e0a818438 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018173 Aug 29 16:01:44.558851 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2433/4963] 10.222.0.83 () {60 vars in 1281 bytes} [Mon Aug 29 16:01:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:44.571835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:44.572719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.582450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.583368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.584107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.585057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.585760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.586410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.608395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] HTTP exception thrown: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Request method failure captured: Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 HTTP/1.1 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOLFk-23oiAOl-88HbBHdpPUs1y4YTiZJ16CIIeYerpu82T9ZXsHSMrY2dd3wmx6Zb4ssFBPJKlbGPQSBt0eVAgOggXcxeFSnMl_k3Uu0Kf-yKIMeWg10DlPTOwJ8iqyRaCvR_Pw0KDccVilOrsoyUT5t5Ld_h4T3IGYPdAUzUCtweQ Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_380e64930bc44fa0b1204f3acd328537", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/380e64930bc44fa0b1204f3acd328537"}]}] Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 9ee1a19085a04426be20de4023ef1a9b Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '0cb15dc6-fd67-4561-b65d-a28069259da8'} Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:44.611510 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.615551 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.618673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Returning 404 to user: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:44.619810 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-522ef7d5-744f-4c2b-92e1-54bcb3e8390a tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 404 len: 111 microversion: 2.1 time: 0.052858 Aug 29 16:01:44.625601 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2531/4964] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:01:44 2022] DELETE /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:44.634259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:44.635472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] [instance: 0cb15dc6-fd67-4561-b65d-a28069259da8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.639230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:44.639589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.654363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.655279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.655992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.658023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.658981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.660281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.662901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.664093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.664943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.665970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.667765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.668262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.692800 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] HTTP exception thrown: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Request method failure captured: Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 HTTP/1.1 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLFk-23oiAOl-88HbBHdpPUs1y4YTiZJ16CIIeYerpu82T9ZXsHSMrY2dd3wmx6Zb4ssFBPJKlbGPQSBt0eVAgOggXcxeFSnMl_k3Uu0Kf-yKIMeWg10DlPTOwJ8iqyRaCvR_Pw0KDccVilOrsoyUT5t5Ld_h4T3IGYPdAUzUCtweQ Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_380e64930bc44fa0b1204f3acd328537", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/380e64930bc44fa0b1204f3acd328537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/380e64930bc44fa0b1204f3acd328537"}]}] Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 380e64930bc44fa0b1204f3acd328537 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2027166475 Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 9ee1a19085a04426be20de4023ef1a9b Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ImagesNegativeTestJSON-2027166475-project Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '0cb15dc6-fd67-4561-b65d-a28069259da8'} Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:01:44.698401 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.702643 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:01:44.702643 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:01:44.702643 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:01:44.702643 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:01:44.702643 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:01:44.702643 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. Aug 29 16:01:44.702643 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:01:44.704961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] Returning 404 to user: Instance 0cb15dc6-fd67-4561-b65d-a28069259da8 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:01:44.708296 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f62b30a-b96d-4ffd-b35d-ed8255594a01 tempest-ImagesNegativeTestJSON-2027166475 tempest-ImagesNegativeTestJSON-2027166475-project] 10.222.0.83 "GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8" status: 404 len: 111 microversion: 2.1 time: 0.082485 Aug 29 16:01:44.710475 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2434/4965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:44 2022] GET /compute/v2.1/servers/0cb15dc6-fd67-4561-b65d-a28069259da8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:01:44.853518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:44.856204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:44.869395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.870495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.874604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.875645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:44.876413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:44.877310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:44.982275 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b205bd9-08bb-4c70-b614-ab238806cf33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133521 Aug 29 16:01:44.989015 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2435/4966] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:44 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:45.194679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:45.216334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d0d07fd-5094-4c9d-aef7-21c545728ddb tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.588344 Aug 29 16:01:45.217897 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2532/4967] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:44 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:45.995500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:45.998402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:46.019050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.019739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.019989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.020709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.021170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.021602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.123410 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed448912-34b8-41a0-b88e-d05fafb0de33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131938 Aug 29 16:01:46.129821 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2436/4968] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:45 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:46.243928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:46.244580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:46.253132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.257023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.257803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.259920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:46.260608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:46.262287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:46.929235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:46.947406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18d20aed-8701-4a0b-a819-32e7bacca1de tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.709940 Aug 29 16:01:46.948612 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2533/4969] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:46 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:47.139368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:47.143180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:47.157582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:47.161773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:47.163156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:47.168322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:47.169042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:47.169673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:47.243281 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d9ae6dc-fab7-4ffc-9918-85c5c2384072 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107295 Aug 29 16:01:47.247728 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2437/4970] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:47 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:47.970262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:47.971580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:47.981416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:47.981910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:47.982348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:47.983070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:47.983533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:47.983959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:48.259441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:48.262385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:48.280934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:48.285439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:48.290424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:48.291856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:48.292578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:48.294417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:48.415619 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1a1321cc-8a9b-45f1-86e6-9a515c6a1c2b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160377 Aug 29 16:01:48.417770 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2438/4971] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:48 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:01:48.650868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:48.669208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d53ff4f8-b2cb-4ede-b14b-1c2ffc4d1026 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.702977 Aug 29 16:01:48.674453 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2534/4972] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:47 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:49.429767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:49.433277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:49.452858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.458509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.459318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.460241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.460873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.465282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.598711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-013e9f07-95f9-4a1c-8085-0119db4af509 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171889 Aug 29 16:01:49.601034 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2439/4973] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:49 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:49.696623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:49.697253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:49.713471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.714004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.714461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:49.715231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:49.718140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:49.720250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.464432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:50.483061 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77c8dd57-43cb-48b7-ad53-2cd710029aac tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.792111 Aug 29 16:01:50.512088 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2535/4974] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:49 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:50.615752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:50.618198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:50.650503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.651705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.652881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.656770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:50.659214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:50.663513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:50.764872 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d9e85f8-681e-4fc7-83f1-95aa275e9262 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154526 Aug 29 16:01:50.768792 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2440/4975] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:50 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:51.576159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:51.577594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:51.594575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.598643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.599339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.601476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.603993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.606334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.669144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7f44a151-099a-4198-8127-044a41e77291 req-fb8ae2a2-ffc1-4d45-aba8-3f14421dab2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f1caeb-d314-411b-8e0a-e9762b370f5c", "name": "network-vif-plugged", "status": "completed", "tag": "4bd4633f-3a03-4008-8d43-9b4e86477ab3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:51.699929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7f44a151-099a-4198-8127-044a41e77291 req-fb8ae2a2-ffc1-4d45-aba8-3f14421dab2e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.701420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7f44a151-099a-4198-8127-044a41e77291 req-fb8ae2a2-ffc1-4d45-aba8-3f14421dab2e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.702036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7f44a151-099a-4198-8127-044a41e77291 req-fb8ae2a2-ffc1-4d45-aba8-3f14421dab2e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.723729 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7f44a151-099a-4198-8127-044a41e77291 req-fb8ae2a2-ffc1-4d45-aba8-3f14421dab2e service nova] Creating event network-vif-plugged:4bd4633f-3a03-4008-8d43-9b4e86477ab3 for instance 38f1caeb-d314-411b-8e0a-e9762b370f5c on n-h2-836830-13 Aug 29 16:01:51.730416 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7f44a151-099a-4198-8127-044a41e77291 req-fb8ae2a2-ffc1-4d45-aba8-3f14421dab2e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066248 Aug 29 16:01:51.732322 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2441/4976] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:51.787307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:51.793299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:51.823124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.826884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.827559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.828565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:51.830295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:51.858162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:51.909809 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe1f1396-18d3-4a0b-af9e-42e4aef9c371 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132829 Aug 29 16:01:51.910717 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2442/4977] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:01:51 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 16:01:52.068474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:52.068474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:52.069147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.069832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.070987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.071941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.072844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.073557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.144586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:01:52.280521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:52.298215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1391f528-d9d7-464a-8a05-5483976f5fe8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.747410 Aug 29 16:01:52.302980 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2536/4978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:51 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:52.321858 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21568ebe-e713-4b7a-a431-f239dd18cc09 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 204 len: 0 microversion: 2.1 time: 0.274331 Aug 29 16:01:52.332484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:52.333453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:52.338691 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2443/4979] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:01:52 2022] DELETE /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:01:52.340751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.341737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.342418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.343448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:52.344125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:52.344764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:52.714723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:52.727401 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2fa45b26-f6c9-43f4-b510-565e55481c0c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1682 microversion: 2.1 time: 0.399997 Aug 29 16:01:52.744966 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2537/4980] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:52 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1682 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:53.326285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.342961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.363623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.364427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.365139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.366216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.366878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.367572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.428988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:53.633489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:53.644410 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c958950e-919e-4e7c-ac9f-ff15403890be tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.325779 Aug 29 16:01:53.645814 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2444/4981] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:53.757883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:53.759180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:53.770065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.770860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.773700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.774840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.775515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.776202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.887521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-191aff92-d689-4f74-9197-b653b0c04a4c req-dabae564-3da5-49c0-80a0-47848e13d0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b298b8a5-3dc2-4fa7-bd5a-c664295f4127", "name": "network-vif-plugged", "status": "completed", "tag": "1d53e89f-4d18-494d-b868-dd6686eb78e8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:53.920796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-191aff92-d689-4f74-9197-b653b0c04a4c req-dabae564-3da5-49c0-80a0-47848e13d0e0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:53.921541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-191aff92-d689-4f74-9197-b653b0c04a4c req-dabae564-3da5-49c0-80a0-47848e13d0e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:53.922142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-191aff92-d689-4f74-9197-b653b0c04a4c req-dabae564-3da5-49c0-80a0-47848e13d0e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:53.966435 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-191aff92-d689-4f74-9197-b653b0c04a4c req-dabae564-3da5-49c0-80a0-47848e13d0e0 service nova] Creating event network-vif-plugged:1d53e89f-4d18-494d-b868-dd6686eb78e8 for instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 on n-h1-836830-13 Aug 29 16:01:53.974095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-191aff92-d689-4f74-9197-b653b0c04a4c req-dabae564-3da5-49c0-80a0-47848e13d0e0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089680 Aug 29 16:01:53.975467 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2445/4982] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:54.314912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:54.332668 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-25601d07-7acb-485f-88f1-9f3ed5be0c84 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1682 microversion: 2.1 time: 0.579156 Aug 29 16:01:54.343938 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2538/4983] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:53 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1682 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:54.667979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:54.669040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:54.690545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.691438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.692119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:54.695307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:54.696367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:54.697693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.370141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:55.371970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:55.373613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:55.385189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.388166 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f269866e-65eb-49e5-a140-81acbc6cc765 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1322 microversion: 2.1 time: 0.725565 Aug 29 16:01:55.391314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2446/4984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:54 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:55.392482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.393355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.399677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:55.401893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:55.402800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:55.810480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:55.830543 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7e5d58b-5d03-4a9f-bae2-185e8d922d1f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1682 microversion: 2.1 time: 0.455781 Aug 29 16:01:55.831304 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2539/4985] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:55 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1682 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:56.413857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:56.415733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:56.428406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.434315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.435002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.436051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.436758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.437420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.846770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:56.859817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:56.863624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:56.868178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-806d592e-f15f-47e8-b8ca-e045533090b3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1517 microversion: 2.1 time: 0.445482 Aug 29 16:01:56.868889 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2447/4986] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:56 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1517 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:56.895191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:01:56.897820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:56.913060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.914502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.914955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.915713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.915838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.916167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.916747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.917409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.918319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:56.918977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:56.919630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.923065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:56.969069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lazy-loading 'flavor' on Instance uuid b298b8a5-3dc2-4fa7-bd5a-c664295f4127 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:01:57.212177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c7e18af-646b-40d6-8165-e4b645bd1887 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action" status: 200 len: 32 microversion: 2.1 time: 0.318736 Aug 29 16:01:57.217014 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2448/4987] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:01:56 2022] POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action => generated 32 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:01:57.233969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:57.234708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:57.247111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.252710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.253466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.256596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:57.257860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:57.258907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:57.517907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:57.526515 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dd9135ee-96d4-41cb-8e8a-309491a70b86 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1682 microversion: 2.1 time: 0.676607 Aug 29 16:01:57.533088 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2540/4988] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:56 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1682 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:58.161942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:58.185967 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcc5c204-9c55-439e-bac5-b8679c1c50bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.966739 Aug 29 16:01:58.190531 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2449/4989] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:57 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:58.561716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:58.562438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:58.584400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:58.585771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:58.586217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:58.586942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:58.591683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:58.592783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:58.807514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:58.844243 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-966e4b89-a3f7-41c0-aee1-c4353812baed tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1614 microversion: 2.1 time: 0.293756 Aug 29 16:01:58.847459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2541/4990] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:58 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1614 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:01:59.213003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:59.214042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:59.225598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.233044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.233800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.234752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.240114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.244083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.677307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] Calling method '.version_select at 0x7f32ed50af70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:59.717066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.717779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.718418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.719545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.721095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.721813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.812475 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39b85a3a-4ed0-4ac2-a874-d52d49516490 tempest-AbsoluteLimitsTestJSON-1042244320 tempest-AbsoluteLimitsTestJSON-1042244320-project] 10.222.0.83 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.711040 Aug 29 16:01:59.827983 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2450/4991] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 16:01:59 2022] GET /compute/v2.1/limits => generated 511 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:01:59.875624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:01:59.876520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:01:59.902873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.912277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.917120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.917933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:01:59.918424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:01:59.918868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:01:59.926082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:01:59.929813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:01:59.934580 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc4d406c-a4c1-48b3-8138-682066585152 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.725348 Aug 29 16:01:59.948925 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2542/4992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:59 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:00.052302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.053371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.054177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.055051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lazy-loading 'fault' on Instance uuid 65fc5de0-11ee-454e-a7d9-941f08fef311 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:02:00.510343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e65a3544-7414-4579-9ebb-ebc0a8931aab req-b3553fcb-d7d1-4715-a35c-3f0c6318d4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fc5de0-11ee-454e-a7d9-941f08fef311", "name": "network-vif-deleted", "tag": "3cabd8d1-dd8b-4902-be8d-ef97792e2af8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:00.555236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e65a3544-7414-4579-9ebb-ebc0a8931aab req-b3553fcb-d7d1-4715-a35c-3f0c6318d4d0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.555476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e65a3544-7414-4579-9ebb-ebc0a8931aab req-b3553fcb-d7d1-4715-a35c-3f0c6318d4d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.557296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e65a3544-7414-4579-9ebb-ebc0a8931aab req-b3553fcb-d7d1-4715-a35c-3f0c6318d4d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.620844 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e65a3544-7414-4579-9ebb-ebc0a8931aab req-b3553fcb-d7d1-4715-a35c-3f0c6318d4d0 service nova] Creating event network-vif-deleted:3cabd8d1-dd8b-4902-be8d-ef97792e2af8 for instance 65fc5de0-11ee-454e-a7d9-941f08fef311 on n-h2-836830-13 Aug 29 16:02:00.621319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:00.632927 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-51ab436d-58de-4906-a4f0-a3ac5f602c4f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 200 len: 1332 microversion: 2.1 time: 0.768644 Aug 29 16:02:00.636714 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2451/4993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:01:59 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 1332 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:00.650539 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e65a3544-7414-4579-9ebb-ebc0a8931aab req-b3553fcb-d7d1-4715-a35c-3f0c6318d4d0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147221 Aug 29 16:02:00.684205 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2543/4994] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:00.975123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:00.976400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:00.985026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.995991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.996705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:00.998309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:00.999008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:00.999701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:01.619571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:01.629893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ede0b89-d6d2-49fb-b7ac-6eca72886a12 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.659517 Aug 29 16:02:01.647464 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2452/4995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:00 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:01.675248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:01.676597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:01.685321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:01.686001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:01.686626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:01.688467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:01.690496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:01.691220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:01.716176 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 HTTP/1.1 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '65fc5de0-11ee-454e-a7d9-941f08fef311'} Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:01.718619 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:01.724846 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:01.724846 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:01.724846 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:01.724846 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:01.724846 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:01.724846 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:02:01.724846 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:01.730797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:01.740233 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-21a2472b-afe7-4ea9-a46d-4c8c0db06d0e tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 404 len: 111 microversion: 2.1 time: 0.082933 Aug 29 16:02:01.741220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2544/4996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:01 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:01.750989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9456b2eb-7681-4bf9-833f-0c7bcb0046b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '.version_select at 0x7f32edaa9a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:01.808775 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9456b2eb-7681-4bf9-833f-0c7bcb0046b8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096685613" status: 202 len: 0 microversion: 2.1 time: 0.061934 Aug 29 16:02:01.809795 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2453/4997] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:02:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096685613 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:02:02.660733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:02.661649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:02.671151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:02.671964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:02.672771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:02.676322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:02.678242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:02.679110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:03.186516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:03.201121 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09ab921f-920b-4c64-8149-ba37bd67f4b0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.544406 Aug 29 16:02:03.215376 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2545/4998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:02 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:03.232115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ec808255-2b6d-485c-8831-45281d957976 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: .version_select at 0x7f32ed514dc0>, body: {"keypair": {"name": "tempest-keypair-873209268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYtLQhlDMnn6zeBn4cdMZLXiq+WaEpgmRDJTeYD+CnZSlCEtoMRRov/DS/Rsm1wE6svxaA0RGy85IGoLK3b7NJHiF0pCxbYsWZ3BYjkSKpEdobYvUicRfyn4jijhUWLQ=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:03.252797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ec808255-2b6d-485c-8831-45281d957976 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:02:03.258928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ec808255-2b6d-485c-8831-45281d957976 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:02:03.321587 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ec808255-2b6d-485c-8831-45281d957976 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092626 Aug 29 16:02:03.322547 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2454/4999] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:02:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:03.804326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:03.806247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:03.806851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:03.808012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:03.808902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:03.809483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:03.810067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:03.842760 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d79695c-475c-4c51-93b0-2fdeeecd10cb tempest-AZV2TestJSON-650348233 tempest-AZV2TestJSON-650348233-project] 10.222.0.83 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.196194 Aug 29 16:02:03.844124 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2546/5000] 10.222.0.83 () {58 vars in 1164 bytes} [Mon Aug 29 16:02:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:02:04.229859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:04.230776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:04.248335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:04.249927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:04.250666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:04.252135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:04.253265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:04.253897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:04.738865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:04.756532 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a5fb075-0502-4297-9b5d-7d8f4daa0292 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.531074 Aug 29 16:02:04.770451 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2455/5001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:04 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:05.783439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:05.784057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:05.799149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.799923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.800722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:05.802988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:05.804132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:05.804775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:06.199225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:06.209959 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c1e8d22-2753-4d6d-bf12-45db9052ae28 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.432305 Aug 29 16:02:06.211793 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2547/5002] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:05 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:06.557528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1904779558", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9d59f56-5b97-48d6-a59a-2e49bdfbf90b"}], "security_groups": [{"name": "tempest-securitygroup--360584969"}], "key_name": "tempest-keypair-873209268", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:07.158984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] validate_networks() for [('e9d59f56-5b97-48d6-a59a-2e49bdfbf90b', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:02:07.232650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:07.233322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:07.248640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:07.250062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:07.250514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:07.252279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:07.252886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:07.253354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:07.609686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:07.624006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52d1121b-3e62-48e7-9d88-b27a153a0c21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.394872 Aug 29 16:02:07.625858 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2548/5003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:07 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:08.661602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:08.662159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:08.686643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:08.692362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:08.692976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:08.695984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:08.710952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:08.711551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:09.019725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:02:09.020874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:02:09.021713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:02:09.022448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:02:09.023075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:02:09.044026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:09.045602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:09.046224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:09.047217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:09.047881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:09.049130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:09.066592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:09.086397 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-55dce093-a68d-4ce2-9e63-6e942a94f2a8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.444218 Aug 29 16:02:09.110263 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2549/5004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:08 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:09.126362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:02:09.144921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Getting quotas for user c1c8b71252e84112bb1fd0513cf49f69 and project b585ff61700d433e8b6c74e059537135. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:02:09.207801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:02:09.215193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:02:09.315933 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9ad8a087-82ca-40b1-b469-53966ff77bd0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.760600 Aug 29 16:02:09.322516 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2456/5005] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:02:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:02:09.328657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a8d1ade-78c3-4470-aa60-333f485a0902 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:09.330587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8a8d1ade-78c3-4470-aa60-333f485a0902 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:09.458435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8a8d1ade-78c3-4470-aa60-333f485a0902 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:09.473577 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a8d1ade-78c3-4470-aa60-333f485a0902 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1241 microversion: 2.1 time: 0.148207 Aug 29 16:02:09.474555 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2550/5006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:09 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:10.130724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:10.131606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:10.146028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:10.152388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.152909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.153359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.161422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.162254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.162891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.519001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:10.524176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:10.546617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.547449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.548062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.555456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:10.556229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:10.556963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:10.781444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:10.801208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d9d39db-3adc-40bd-8896-a0cdb09d0e18 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1237 microversion: 2.1 time: 0.309930 Aug 29 16:02:10.803846 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2551/5007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:10 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1237 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:11.019974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:11.032023 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8356cd4e-d66c-4aaa-a5e4-d71aa00576fd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.905717 Aug 29 16:02:11.034561 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2457/5008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:10 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:11.826919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:11.828145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:11.853129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:11.854253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:11.854891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:11.855813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:11.858086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:11.858852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.183673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:12.207675 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54477b4c-fd62-4e90-9311-b6a67a07b25d tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1299 microversion: 2.1 time: 0.382142 Aug 29 16:02:12.212161 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2552/5009] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:11 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1299 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:12.229250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:12.237819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:12.268154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.273715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.278761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.280360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.284636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.287454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.416477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:12.417118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:12.429621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.430908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.432584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.434864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.436820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.437411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.483404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:02:12.620905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba2d37f3-e2f9-42ec-a15c-435b85c02118 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 204 len: 0 microversion: 2.32 time: 0.701379 Aug 29 16:02:12.628417 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2458/5010] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 16:02:11 2022] DELETE /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:02:12.636783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:12.638267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:12.649372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.650097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.650541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.651466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:12.651980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:12.652402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:12.656683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:12.668162 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46331510-8c46-42a8-83ad-24966fc16e31 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.454310 Aug 29 16:02:12.686656 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2553/5011] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:12 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:13.238955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:13.239653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:13.246789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=56 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:13.265386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:13.265830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:13.270599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:13.273399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:13.273895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:13.276822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:13.332172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:13.373236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:13.378792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:13.387050 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6269c0e2-f212-4523-8ae9-7b659115a00f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2954 microversion: 2.32 time: 0.753241 Aug 29 16:02:13.388684 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2459/5012] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:12 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2954 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:13.480587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:13.511748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba3c7705-8379-4768-bd7d-1bc06759f0e3 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1299 microversion: 2.1 time: 0.277329 Aug 29 16:02:13.514380 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2554/5013] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:13 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:13.692939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:13.693909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:13.708021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:13.711623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:13.712985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:13.715276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:13.715896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:13.716393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.419733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:14.421684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:14.435684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:14.443202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:14.444078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:14.445214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.446161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:14.450647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:14.451408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.562198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:14.576629 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71e83f03-de28-45eb-9995-fb8ed71e4c45 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.889775 Aug 29 16:02:14.591353 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2460/5014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:13 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:14.597581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:14.598444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:14.604965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:14.605666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:14.607097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.607987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:14.608616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:14.609221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:14.615659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:14.734485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:14.749339 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-598575c1-b0f4-4ec3-bb66-fc6bbd1443cc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1299 microversion: 2.1 time: 0.155571 Aug 29 16:02:14.750313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2461/5015] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:14 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:15.315340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:15.334249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:15.336407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:15.338578 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f8a92702-a02f-4760-a651-42467315c56e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2954 microversion: 2.32 time: 0.922590 Aug 29 16:02:15.339919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2555/5016] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:14 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2954 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:15.600302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:15.600302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:15.612406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.612911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.613428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.614087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.614553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.614997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.778328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:15.779229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:15.798880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.814452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.817285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.819391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:15.823529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:15.826214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:15.984246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:15.996090 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73d9706b-82b5-495f-967e-0d32e01ef496 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1299 microversion: 2.1 time: 0.223135 Aug 29 16:02:15.997948 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2556/5017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:15 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:16.140974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:16.155828 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7306a26e-0a19-407f-a8fa-6271f3dfc2e1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 0.561250 Aug 29 16:02:16.162560 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2462/5018] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:15 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:16.372324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:16.373202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:16.401932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:16.403352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:16.403972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:16.404885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:16.405525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:16.406111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:17.023483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:17.023647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:17.036833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:17.037330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:17.038021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:17.038723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:17.039203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:17.051318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:17.894201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:17.910238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:17.911736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:17.913302 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68cccef3-d0a3-40a5-95e4-df960ff03d4b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2954 microversion: 2.32 time: 1.545122 Aug 29 16:02:17.926159 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2557/5019] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:16 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2954 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:17.932676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:17.933304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:17.950414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:17.950951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:17.951444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:17.952156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:17.952614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:17.953043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:18.195767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:18.208179 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc6b5a1a-b81c-4f1d-8fe9-4fa4cd066413 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 1.189684 Aug 29 16:02:18.211357 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2463/5020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:17 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:18.363469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9297d8da-eea3-4a1b-8f9b-30e5c53f5662 req-654f815e-baa0-4c85-beee-1b6270fad33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-unplugged", "status": "completed", "tag": "644b8c18-872f-4891-be77-ea6eb763455e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:18.381361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9297d8da-eea3-4a1b-8f9b-30e5c53f5662 req-654f815e-baa0-4c85-beee-1b6270fad33e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:18.383486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9297d8da-eea3-4a1b-8f9b-30e5c53f5662 req-654f815e-baa0-4c85-beee-1b6270fad33e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:18.386827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9297d8da-eea3-4a1b-8f9b-30e5c53f5662 req-654f815e-baa0-4c85-beee-1b6270fad33e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:18.427581 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9297d8da-eea3-4a1b-8f9b-30e5c53f5662 req-654f815e-baa0-4c85-beee-1b6270fad33e service nova] Creating event network-vif-unplugged:644b8c18-872f-4891-be77-ea6eb763455e for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:18.440394 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9297d8da-eea3-4a1b-8f9b-30e5c53f5662 req-654f815e-baa0-4c85-beee-1b6270fad33e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088179 Aug 29 16:02:18.444726 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2464/5021] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:18.943196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:18.944197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:18.976264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:18.991245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:18.991695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:18.992648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:18.993284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:19.003616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:19.138528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:19.182354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:19.266423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:19.277264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1509f94c-6715-45b1-97d0-1a4e4b016b7c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1523 microversion: 2.1 time: 1.349900 Aug 29 16:02:19.277855 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2558/5022] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:17 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1523 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:19.295282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:19.295901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:19.308347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:19.308850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:19.309282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:19.311144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:19.317805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:19.318430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:19.471562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:19.652579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:19.673667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:19.675942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:19.677276 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7c8b66ef-e0be-4971-8e86-bddf3302cf5a tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2933 microversion: 2.32 time: 0.739063 Aug 29 16:02:19.696344 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2465/5023] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:18 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2933 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:19.724221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:19.734234 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29b0c695-9988-4f59-8209-fa351a0c5ed0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 0.443365 Aug 29 16:02:19.735070 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2559/5024] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:19 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:20.304433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:20.305645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:20.328628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:20.331656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:20.332535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:20.335814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:20.337630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:20.339509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:20.509346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-unplugged", "status": "completed", "tag": "ef5a15c9-44d9-4991-94eb-d5af5728b051"}, {"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-unplugged", "status": "completed", "tag": "6c92279a-1770-4793-9992-4098b7bf25ac"}, {"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-unplugged", "status": "completed", "tag": "eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11"}, {"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-unplugged", "status": "completed", "tag": "3da879d5-255a-43b9-89f5-e8743644a9d4"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:20.539625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:20.541865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:20.542345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:20.576649 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Creating event network-vif-unplugged:ef5a15c9-44d9-4991-94eb-d5af5728b051 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:20.577165 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Creating event network-vif-unplugged:6c92279a-1770-4793-9992-4098b7bf25ac for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:20.577675 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Creating event network-vif-unplugged:eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:20.578173 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] Creating event network-vif-unplugged:3da879d5-255a-43b9-89f5-e8743644a9d4 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:20.594537 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fe542595-9837-4aeb-b3a6-8fea35432b92 req-c03ff331-95ce-4833-a4d7-37141fc5a379 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.088809 Aug 29 16:02:20.599201 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2560/5025] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:20.715884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:20.717091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:20.724859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:20.729832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:20.737514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:20.738297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:20.739304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:20.739304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:21.389427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:21.398794 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5ccd889-688b-46c4-bf6d-6bbfdf84d494 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1503 microversion: 2.1 time: 1.100364 Aug 29 16:02:21.411406 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2466/5026] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:20 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1503 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:21.417314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:21.417950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:21.434804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:21.435343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:21.435790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:21.436494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:21.436947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:21.437370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:21.577885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:21.600293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:21.610592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:21.613575 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02197d88-b9d9-4816-92bf-05ea20d979c7 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2933 microversion: 2.32 time: 0.901966 Aug 29 16:02:21.615893 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2561/5027] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:20 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2933 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:21.627512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a586598e-d9a7-4f02-a955-8b2b6cb83f36 req-58fe1da8-004b-40f3-a511-3f60ad456cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d339d7-3d48-4b7a-849b-90bfd8088fe5", "tag": "bfc0d741-ac38-475d-9dcb-b439dc11c07f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:21.641258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a586598e-d9a7-4f02-a955-8b2b6cb83f36 req-58fe1da8-004b-40f3-a511-3f60ad456cd1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:21.642470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a586598e-d9a7-4f02-a955-8b2b6cb83f36 req-58fe1da8-004b-40f3-a511-3f60ad456cd1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:21.643177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a586598e-d9a7-4f02-a955-8b2b6cb83f36 req-58fe1da8-004b-40f3-a511-3f60ad456cd1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:21.673234 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a586598e-d9a7-4f02-a955-8b2b6cb83f36 req-58fe1da8-004b-40f3-a511-3f60ad456cd1 service nova] Creating event network-changed:bfc0d741-ac38-475d-9dcb-b439dc11c07f for instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 on n-h2-836830-13 Aug 29 16:02:21.697756 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a586598e-d9a7-4f02-a955-8b2b6cb83f36 req-58fe1da8-004b-40f3-a511-3f60ad456cd1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079330 Aug 29 16:02:21.698706 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2562/5028] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:21.976648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1840940502", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "faea7517-a2c4-42cb-a8ad-48f6569f1a01"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:22.092671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] validate_networks() for [('faea7517-a2c4-42cb-a8ad-48f6569f1a01', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:02:23.266177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:23.287564 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f4ec57d3-3fd0-4543-a8c0-1801bf2edc93 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 1.874313 Aug 29 16:02:23.288671 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2467/5029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:21 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:23.294981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:23.295888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:23.316840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.318277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.319558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:23.326508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.327331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.328270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:23.665419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:02:23.667330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:02:23.668130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:02:23.669230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:02:23.669947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:02:23.701154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.701581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.702025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:23.707974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.708472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.708916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:23.756258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Getting quotas for project f7d03c12309544fd8cf7870748a3ea30. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:02:23.763259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Getting quotas for user ad48c13a52614472ae2025f02bcd2cb8 and project f7d03c12309544fd8cf7870748a3ea30. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:02:23.792117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:23.807486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:02:23.810250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:02:23.827446 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed93072b-d13a-443b-8a17-a0a79c8f803a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1515 microversion: 2.1 time: 0.532303 Aug 29 16:02:23.843534 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2468/5030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:23 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:23.849019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:23.849267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:23.885397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.885397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.885397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:23.885815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:23.886101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:23.894919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:24.000964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42fab246-443e-40b8-bc6c-79b765991254 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.299646 Aug 29 16:02:24.005014 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2563/5031] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:02:24.073736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-562f8ea1-1029-43cb-b77d-623161e45b62 req-ae96cb9d-99c3-4d1b-94c4-ab835dedb907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-unplugged", "status": "completed", "tag": "15a5e7af-4a04-480b-bdb6-6c17a8c86958"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:24.124792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-562f8ea1-1029-43cb-b77d-623161e45b62 req-ae96cb9d-99c3-4d1b-94c4-ab835dedb907 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:24.127847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-562f8ea1-1029-43cb-b77d-623161e45b62 req-ae96cb9d-99c3-4d1b-94c4-ab835dedb907 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:24.128710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-562f8ea1-1029-43cb-b77d-623161e45b62 req-ae96cb9d-99c3-4d1b-94c4-ab835dedb907 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:24.164270 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-562f8ea1-1029-43cb-b77d-623161e45b62 req-ae96cb9d-99c3-4d1b-94c4-ab835dedb907 service nova] Creating event network-vif-unplugged:15a5e7af-4a04-480b-bdb6-6c17a8c86958 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:24.176058 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-562f8ea1-1029-43cb-b77d-623161e45b62 req-ae96cb9d-99c3-4d1b-94c4-ab835dedb907 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169371 Aug 29 16:02:24.177140 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2564/5032] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:24.184230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc353187-14d8-4d01-b5b2-0421c6e9fa3b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:24.191681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bc353187-14d8-4d01-b5b2-0421c6e9fa3b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 608f96bf-1123-462d-8cd3-b8838727922d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:24.207590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-bc353187-14d8-4d01-b5b2-0421c6e9fa3b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Instance 608f96bf-1123-462d-8cd3-b8838727922d could not be found. Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc353187-14d8-4d01-b5b2-0421c6e9fa3b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/608f96bf-1123-462d-8cd3-b8838727922d/action HTTP/1.1 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 14 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: {"rescue": {}} Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 608f96bf-1123-462d-8cd3-b8838727922d could not be found. Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '608f96bf-1123-462d-8cd3-b8838727922d', 'body': {'rescue': {}}} Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608f96bf-1123-462d-8cd3-b8838727922d could not be found. Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608f96bf-1123-462d-8cd3-b8838727922d could not be found. Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:24.219378 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:24.224543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:24.224543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:24.224543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:24.224543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:24.224543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608f96bf-1123-462d-8cd3-b8838727922d could not be found. Aug 29 16:02:24.224543 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:24.232726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc353187-14d8-4d01-b5b2-0421c6e9fa3b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 404 to user: Instance 608f96bf-1123-462d-8cd3-b8838727922d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:24.235996 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc353187-14d8-4d01-b5b2-0421c6e9fa3b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/608f96bf-1123-462d-8cd3-b8838727922d/action" status: 404 len: 111 microversion: 2.1 time: 0.057439 Aug 29 16:02:24.241478 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2565/5033] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:02:24 2022] POST /compute/v2.1/servers/608f96bf-1123-462d-8cd3-b8838727922d/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:24.278620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c6a5d90-3379-4f26-b2b5-041115f6284a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:24.278620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c6a5d90-3379-4f26-b2b5-041115f6284a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:24.520075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c6a5d90-3379-4f26-b2b5-041115f6284a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:24.559864 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c6a5d90-3379-4f26-b2b5-041115f6284a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1225 microversion: 2.1 time: 0.316936 Aug 29 16:02:24.560659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2566/5034] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:24 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1225 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:24.593701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:24.594274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:24.602550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:24.603294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:24.603906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:24.605145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:24.605977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:24.606768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:24.612994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:24.732860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04850bf9-a950-4eaf-bcd8-ad2073a2d947 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action" status: 202 len: 0 microversion: 2.1 time: 0.143010 Aug 29 16:02:24.736560 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2567/5035] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:02:24 2022] POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:02:24.749118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:24.754646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:24.769944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:24.771803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:24.773307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:24.775305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:24.776173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:24.777608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:25.092780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:25.102095 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4b849ce7-0021-40dc-88a2-5e2e7cb0e744 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 0.361844 Aug 29 16:02:25.111004 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2568/5036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:24 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:25.119441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:25.120235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:25.139397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:25.139902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:25.140339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:25.141049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:25.141510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:25.142565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:25.451889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:25.474565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:25.479600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:25.483912 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8400a6ea-918f-4d99-9d69-25931d286faa tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2912 microversion: 2.32 time: 1.649793 Aug 29 16:02:25.484750 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2469/5037] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:23 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2912 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:25.590323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:25.591180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:25.604380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:25.604898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:25.605344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:25.606061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:25.609599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:25.610093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:25.643793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:25.655335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-142e4266-6af1-49c6-b140-77f016829470 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1520 microversion: 2.1 time: 0.542223 Aug 29 16:02:25.667824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2569/5038] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:25 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:25.835719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:25.854144 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a2884dcb-2e36-4d11-b97f-53026ff9c025 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1277 microversion: 2.1 time: 0.266571 Aug 29 16:02:25.854778 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2470/5039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:25 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:26.136875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:26.137898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:26.155852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.159783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.160392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:26.161283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.168098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.171128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:26.512088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:26.513819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:26.528842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.531891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.533258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:26.534769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.535450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.536658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:26.676794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:26.694456 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ff43955-ee0b-4fb3-8dd1-5ee685b37d8c tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 0.561521 Aug 29 16:02:26.695544 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2570/5040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:26 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:26.702475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:26.703511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:26.710529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.711373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.712080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:26.713055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:26.716498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:26.718863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.076154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:27.087323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f22d503-a2d5-4677-aa34-f797199f8142 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1500 microversion: 2.1 time: 0.390443 Aug 29 16:02:27.105451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2571/5041] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:26 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1500 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:27.115309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-49e97e2e-2841-46f0-a473-52fa99a28306 req-c12e023e-a4ca-4d3c-804e-2cb09d9d9e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-deleted", "tag": "6c92279a-1770-4793-9992-4098b7bf25ac"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:27.136642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-49e97e2e-2841-46f0-a473-52fa99a28306 req-c12e023e-a4ca-4d3c-804e-2cb09d9d9e48 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.137128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-49e97e2e-2841-46f0-a473-52fa99a28306 req-c12e023e-a4ca-4d3c-804e-2cb09d9d9e48 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.137694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-49e97e2e-2841-46f0-a473-52fa99a28306 req-c12e023e-a4ca-4d3c-804e-2cb09d9d9e48 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.167557 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-49e97e2e-2841-46f0-a473-52fa99a28306 req-c12e023e-a4ca-4d3c-804e-2cb09d9d9e48 service nova] Creating event network-vif-deleted:6c92279a-1770-4793-9992-4098b7bf25ac for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:27.178679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-49e97e2e-2841-46f0-a473-52fa99a28306 req-c12e023e-a4ca-4d3c-804e-2cb09d9d9e48 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071741 Aug 29 16:02:27.179343 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2572/5042] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:27.186251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:27.187308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:27.205270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.205821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.206432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.207284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.207944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.208187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.396901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:27.418030 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e0a5b73b-f60d-46f7-84a9-99780b18e4fd tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1283 microversion: 2.1 time: 0.237442 Aug 29 16:02:27.418936 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2573/5043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:27 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1283 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:27.431266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:27.433968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:27.460914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.461725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.471832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.472919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.473645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.474245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.522634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lazy-loading 'flavor' on Instance uuid 38f1caeb-d314-411b-8e0a-e9762b370f5c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:02:27.550379 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Cannot 'rescue' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state paused Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action HTTP/1.1 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 14 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: {"rescue": {}} Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: exception: Cannot 'rescue' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state paused Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '38f1caeb-d314-411b-8e0a-e9762b370f5c', 'body': {'rescue': {}}} Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c in vm_state paused. Cannot rescue while the instance is in this state. Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state paused Aug 29 16:02:27.552839 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state paused Aug 29 16:02:27.558940 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:27.561857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 409 to user: Cannot 'rescue' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state paused {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:27.568373 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2f97ebc-bc65-441e-bda4-4cf38a778f9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action" status: 409 len: 144 microversion: 2.1 time: 0.147698 Aug 29 16:02:27.572336 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2574/5044] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:02:27 2022] POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action => generated 144 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:02:27.577732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:27.578302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:27.599750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.600260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.600884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.601404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.601864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.602986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.725941 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-55fbb933-000f-4452-9bbb-62b0e43dcffd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action" status: 202 len: 0 microversion: 2.1 time: 0.152163 Aug 29 16:02:27.731250 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2575/5045] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:02:27 2022] POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:02:27.740308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:27.741335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:27.748231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.748984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.749585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:27.750509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:27.751284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:27.752172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:28.268705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:28.283717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:28.284942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:28.290309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c19a3232-5c8c-4240-8272-3fd4d179a6e0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2865 microversion: 2.32 time: 1.784191 Aug 29 16:02:28.295365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2471/5046] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:26 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2865 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:28.300912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:28.307302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:28.317339 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0eb94567-2189-4d21-9d2d-6a279786e66f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 0.582484 Aug 29 16:02:28.318449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:28.324906 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2576/5047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:27 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:28.355865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:28.356636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:28.359730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:28.361264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:28.362143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:28.363004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:28.443631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:28.451787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:28.466421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:28.466935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:28.467383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:28.471794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:28.472143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:28.475400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:28.841481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:28.851107 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5a4011f-0688-49e6-a343-24f5b967e7fa tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1283 microversion: 2.1 time: 0.412326 Aug 29 16:02:28.864724 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2577/5048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:28 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1283 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:29.273598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:29.282099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30f5f7dd-b9ec-4fe2-a44b-ac7d98e13d95 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1515 microversion: 2.1 time: 0.985411 Aug 29 16:02:29.284927 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2472/5049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:28 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1515 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:29.320317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:29.320939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:29.332674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.333178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.333617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.334322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.338817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.340758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.354440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:29.355271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:29.373060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.374033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.377730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.378816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.379729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.380765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.725450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:29.739508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:29.748729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:29.752459 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3f7cab7-6d75-4a98-b1d5-a85e229f9b6d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2579 microversion: 2.32 time: 0.434028 Aug 29 16:02:29.752459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2578/5050] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:29 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2579 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:29.889738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:29.891487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:29.906256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.909471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.910071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:29.910928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:29.917096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:29.918619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.055895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:30.082638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fc59f9c-1f7f-4e4a-8c37-44b333bc2ef1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 0.738128 Aug 29 16:02:30.096203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2473/5051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:29 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:30.237648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:30.251508 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2382ef4f-0fe5-47d4-a691-bc18dbdf7068 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1283 microversion: 2.1 time: 0.364963 Aug 29 16:02:30.252893 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2579/5052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:29 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1283 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:30.749387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4fea5b13-86dc-4f07-ab1a-814ea1cbd9c5 req-f4239b8c-61f3-4d02-91a8-a045c3719d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-deleted", "tag": "15a5e7af-4a04-480b-bdb6-6c17a8c86958"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:30.779358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:30.780141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:30.786257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4fea5b13-86dc-4f07-ab1a-814ea1cbd9c5 req-f4239b8c-61f3-4d02-91a8-a045c3719d4d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:30.810632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4fea5b13-86dc-4f07-ab1a-814ea1cbd9c5 req-f4239b8c-61f3-4d02-91a8-a045c3719d4d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:30.813780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:30.816427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4fea5b13-86dc-4f07-ab1a-814ea1cbd9c5 req-f4239b8c-61f3-4d02-91a8-a045c3719d4d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.826407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:30.827141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.843746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:30.845977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:30.852335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:30.877551 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4fea5b13-86dc-4f07-ab1a-814ea1cbd9c5 req-f4239b8c-61f3-4d02-91a8-a045c3719d4d service nova] Creating event network-vif-deleted:15a5e7af-4a04-480b-bdb6-6c17a8c86958 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:30.910451 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4fea5b13-86dc-4f07-ab1a-814ea1cbd9c5 req-f4239b8c-61f3-4d02-91a8-a045c3719d4d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174326 Aug 29 16:02:30.913314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2474/5053] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:31.120266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:31.121044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:31.136935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:31.137380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:31.138989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:31.140393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:31.142502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:31.146312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:31.662744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:31.703337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:31.713320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:31.718836 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a580e76-042d-439e-af42-5ef343e6fd63 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2532 microversion: 2.32 time: 0.944468 Aug 29 16:02:31.736022 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2580/5054] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:30 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2532 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:31.743776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:31.745784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:31.773976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:31.774729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:31.776078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:31.779751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:31.780880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:31.786872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:32.750709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:32.763649 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1784699-afd6-4433-9b28-3b940b671380 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 1.646022 Aug 29 16:02:32.794168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2475/5055] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:31 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:32.802748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:32.803779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:32.821678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:32.822455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:32.823120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:32.824018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:32.824832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:32.825433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.200931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:33.216494 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-763f6b7a-101a-44b4-baea-d5bece066c95 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 1.483006 Aug 29 16:02:33.219219 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2581/5056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:31 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:33.235963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9954ca7e-f806-4197-a7cc-1eb5dcdb18dc req-3b07e72e-2b5e-4756-b065-ab1da1402ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d339d7-3d48-4b7a-849b-90bfd8088fe5", "name": "network-vif-plugged", "status": "completed", "tag": "bfc0d741-ac38-475d-9dcb-b439dc11c07f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:33.249198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9954ca7e-f806-4197-a7cc-1eb5dcdb18dc req-3b07e72e-2b5e-4756-b065-ab1da1402ad3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.250064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9954ca7e-f806-4197-a7cc-1eb5dcdb18dc req-3b07e72e-2b5e-4756-b065-ab1da1402ad3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.250757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9954ca7e-f806-4197-a7cc-1eb5dcdb18dc req-3b07e72e-2b5e-4756-b065-ab1da1402ad3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.271119 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9954ca7e-f806-4197-a7cc-1eb5dcdb18dc req-3b07e72e-2b5e-4756-b065-ab1da1402ad3 service nova] Creating event network-vif-plugged:bfc0d741-ac38-475d-9dcb-b439dc11c07f for instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 on n-h2-836830-13 Aug 29 16:02:33.279307 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9954ca7e-f806-4197-a7cc-1eb5dcdb18dc req-3b07e72e-2b5e-4756-b065-ab1da1402ad3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058473 Aug 29 16:02:33.280181 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2582/5057] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:33.321084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b2cb4bf6-ab25-4739-91a7-4a131798529e req-5756c478-8a97-432b-bccd-8cc59e6739e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-deleted", "tag": "ef5a15c9-44d9-4991-94eb-d5af5728b051"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:33.380751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b2cb4bf6-ab25-4739-91a7-4a131798529e req-5756c478-8a97-432b-bccd-8cc59e6739e1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.383556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b2cb4bf6-ab25-4739-91a7-4a131798529e req-5756c478-8a97-432b-bccd-8cc59e6739e1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.386311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b2cb4bf6-ab25-4739-91a7-4a131798529e req-5756c478-8a97-432b-bccd-8cc59e6739e1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.435665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:33.440230 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b2cb4bf6-ab25-4739-91a7-4a131798529e req-5756c478-8a97-432b-bccd-8cc59e6739e1 service nova] Creating event network-vif-deleted:ef5a15c9-44d9-4991-94eb-d5af5728b051 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:33.463964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b2cb4bf6-ab25-4739-91a7-4a131798529e req-5756c478-8a97-432b-bccd-8cc59e6739e1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165596 Aug 29 16:02:33.472390 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2583/5058] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:33.505998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:33.511888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:33.544039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.557625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.559230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.562092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.566687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.571401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.686268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lazy-loading 'flavor' on Instance uuid 38f1caeb-d314-411b-8e0a-e9762b370f5c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:02:33.737616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:33.880965 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2330cae3-1be1-42fe-846b-b9031cbd9f63 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action" status: 200 len: 32 microversion: 2.1 time: 0.406907 Aug 29 16:02:33.884371 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2584/5059] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:02:33 2022] POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action => generated 32 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:02:33.914863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:33.915800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:33.926644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.928139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.929854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:33.930864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:33.931531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:33.932158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.169869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:34.193039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:34.202597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:34.204274 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-34b52c83-4ac7-4839-94c4-87218fe0f46e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2371 microversion: 2.32 time: 1.408678 Aug 29 16:02:34.215849 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2476/5060] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:32 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2371 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:34.232819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:34.233461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:34.235319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:34.243816 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-405bcd7b-e92e-42a0-b671-95b356ba9ce5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 0.344873 Aug 29 16:02:34.244405 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2585/5061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:33 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:34.261441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:34.264789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.265303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.265751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.266475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.267038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.267474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.271728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:34.279500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.279992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.281252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.286496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:34.304843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:34.305641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:34.532659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:34.862764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:34.877674 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9a64bec-263a-4aac-a128-07e62eb3ca40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.661149 Aug 29 16:02:34.878271 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2477/5062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:34 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:34.895418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:34.903925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f262808-363d-4ab6-9236-90b174997ef6 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 0.653364 Aug 29 16:02:34.915209 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2586/5063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:34 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:35.246376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:35.247058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:35.256143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:35.258702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:35.259190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:35.263414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:35.264096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:35.267394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:35.275003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:35.276200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:35.292590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:35.293090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:35.299888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:35.300661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:35.301140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:35.301583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:35.617749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:35.632018 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37ec3497-1bac-4e20-a3cd-f62c05bdd8fc tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1366 microversion: 2.1 time: 0.364078 Aug 29 16:02:35.634382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2587/5064] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:35 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:35.901448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:35.902143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:35.917334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:35.917854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:35.918303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:35.919059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:35.920197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:35.929074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.508912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:36.526279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:36.528096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:36.529737 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c367068b-2fab-4550-b455-14f30cc7bf88 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2258 microversion: 2.32 time: 1.287970 Aug 29 16:02:36.537924 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2478/5065] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:35 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2258 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:36.544348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:36.545234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:36.561202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.565230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.568451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.569475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.570184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.572590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.582346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:36.598227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:36.607595 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7beb20c-3d8e-425f-b396-f96cb18fcb40 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.711108 Aug 29 16:02:36.612650 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2588/5066] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:35 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:36.624884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-80c25b2b-e0ae-4188-9700-4faf5c127812 req-12b5b0e2-5c5b-4154-8eff-adfd6cbb900d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3909d9a-688c-4a52-a96f-27dd1650f0f1", "tag": "89b27ec0-b7f8-4567-b199-3296cace1191"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:36.657462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-80c25b2b-e0ae-4188-9700-4faf5c127812 req-12b5b0e2-5c5b-4154-8eff-adfd6cbb900d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.658195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-80c25b2b-e0ae-4188-9700-4faf5c127812 req-12b5b0e2-5c5b-4154-8eff-adfd6cbb900d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.658752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-80c25b2b-e0ae-4188-9700-4faf5c127812 req-12b5b0e2-5c5b-4154-8eff-adfd6cbb900d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.690345 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-80c25b2b-e0ae-4188-9700-4faf5c127812 req-12b5b0e2-5c5b-4154-8eff-adfd6cbb900d service nova] Creating event network-changed:89b27ec0-b7f8-4567-b199-3296cace1191 for instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 on n-h1-836830-13 Aug 29 16:02:36.708891 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-80c25b2b-e0ae-4188-9700-4faf5c127812 req-12b5b0e2-5c5b-4154-8eff-adfd6cbb900d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094436 Aug 29 16:02:36.710022 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2589/5067] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:36.716691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:36.717816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:36.727552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.728226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.728847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:36.729720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:36.730322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:36.730870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.284964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:37.314754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b36a344f-03e1-4411-8d19-f8e8d7876021 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1557 microversion: 2.1 time: 0.601979 Aug 29 16:02:37.318090 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2590/5068] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:36 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1557 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:37.341216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:37.343312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:37.350446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.351277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.351905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.353227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.353884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.354484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.423464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:37.438756 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26baf675-9cef-4192-9ef8-9f23ac9f58ee tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 0.899178 Aug 29 16:02:37.439390 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2479/5069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:36 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:37.567439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:37.570040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:37.584181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.587355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.587994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.588883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.595742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.596762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.729982 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9339da92-ff84-46a7-9ff1-ead7f7be4500 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.392679 Aug 29 16:02:37.748054 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2591/5070] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:02:37 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-interface => generated 285 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:37.749292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:37.752993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:37.771572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.772186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.772760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:37.773718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:37.774291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:37.774984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:38.130372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:38.147006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4e7a94e-a0af-4fba-b82f-eaae91ec7644 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.409872 Aug 29 16:02:38.147854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2592/5071] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:37 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:38.464174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:38.465395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:38.473911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:38.475205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:38.476666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:38.477588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:38.478301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:38.479163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:38.791274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:38.807941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:38.810908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:38.812760 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4a1beb4-502b-4b84-9499-fda7ae55a56c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 2211 microversion: 2.32 time: 1.250323 Aug 29 16:02:38.815815 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2480/5072] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:37 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 2211 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:38.873292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b0c54268-5b52-4174-9f6c-2e35ee7d9730 req-3baa91c6-e298-4cf1-a8ad-06a4cbb7022c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-deleted", "tag": "644b8c18-872f-4891-be77-ea6eb763455e"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:38.890682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b0c54268-5b52-4174-9f6c-2e35ee7d9730 req-3baa91c6-e298-4cf1-a8ad-06a4cbb7022c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:38.892127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b0c54268-5b52-4174-9f6c-2e35ee7d9730 req-3baa91c6-e298-4cf1-a8ad-06a4cbb7022c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:38.892772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b0c54268-5b52-4174-9f6c-2e35ee7d9730 req-3baa91c6-e298-4cf1-a8ad-06a4cbb7022c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:38.906959 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b0c54268-5b52-4174-9f6c-2e35ee7d9730 req-3baa91c6-e298-4cf1-a8ad-06a4cbb7022c service nova] Creating event network-vif-deleted:644b8c18-872f-4891-be77-ea6eb763455e for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:38.914283 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b0c54268-5b52-4174-9f6c-2e35ee7d9730 req-3baa91c6-e298-4cf1-a8ad-06a4cbb7022c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044773 Aug 29 16:02:38.916140 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2481/5073] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:38.918119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:38.926745 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae4b2fe9-9174-4a1a-898b-70b58646fec7 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 0.467917 Aug 29 16:02:38.934516 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2593/5074] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:38 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:39.171058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:39.172254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:39.187261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.189896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.190687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.192914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.195463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.195927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.841232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:39.842597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:39.853023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.853838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.854525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.866984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.867783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.874411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.928509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:39.939748 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3231b54c-d0ee-428c-9b1a-21b8635878ca tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.773496 Aug 29 16:02:39.940355 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2482/5075] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:39 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:39.958327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:39.959413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:39.973296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.976814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.977432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:39.978322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:39.982569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:39.983234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:40.297339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:40.319393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:40.321289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:40.322747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-870017cf-72f5-4d5e-afb7-1d11fd8c5512 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.487313 Aug 29 16:02:40.358459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2594/5076] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:39 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:40.651971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:40.666570 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab2426e6-52fb-4358-833b-35883d68e294 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 0.720260 Aug 29 16:02:40.667423 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2483/5077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:39 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:40.962883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:40.963595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:40.966853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d4f49a28-1aa0-454d-96a9-1c16b401ee0a req-1a63795b-e00c-4b35-aa6a-93ecb1507454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e", "name": "network-vif-deleted", "tag": "eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:40.980217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:41.010434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.011505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.012395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4f49a28-1aa0-454d-96a9-1c16b401ee0a req-1a63795b-e00c-4b35-aa6a-93ecb1507454 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.012996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.013593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4f49a28-1aa0-454d-96a9-1c16b401ee0a req-1a63795b-e00c-4b35-aa6a-93ecb1507454 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.014498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4f49a28-1aa0-454d-96a9-1c16b401ee0a req-1a63795b-e00c-4b35-aa6a-93ecb1507454 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.014951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.015679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.018341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.042742 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d4f49a28-1aa0-454d-96a9-1c16b401ee0a req-1a63795b-e00c-4b35-aa6a-93ecb1507454 service nova] Creating event network-vif-deleted:eada145a-dbd5-4eb9-bcdd-e19e0d2e2f11 for instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e on n-h2-836830-13 Aug 29 16:02:41.060780 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d4f49a28-1aa0-454d-96a9-1c16b401ee0a req-1a63795b-e00c-4b35-aa6a-93ecb1507454 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109313 Aug 29 16:02:41.064094 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2595/5078] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:41.355533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:41.357051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:41.359613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:41.380351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.381579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.382301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.383789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.385853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.387146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.738624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:41.747188 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80303126-36ac-4564-b0b9-cc9281d06415 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.790230 Aug 29 16:02:41.751704 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2484/5079] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:40 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:41.758981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:41.765090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:41.788023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.789025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.789653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.790550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:41.791217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:41.791813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:41.856789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:41.885792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:41.893159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:41.897039 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a5f2c1f-5c62-4953-bdac-ba1550b40682 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.545422 Aug 29 16:02:41.913730 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2596/5080] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:41 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:42.191929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:42.220757 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30d2926c-8119-4d34-a531-b4c411b0cbf5 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 0.467510 Aug 29 16:02:42.221572 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2485/5081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:41 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:42.776906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:42.778111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:42.795983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.806720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.807466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:42.808954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.823438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.828660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:42.924970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:42.925692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:42.941179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.941738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.942198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:42.942945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:42.943439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:42.943874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.146404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.157719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.159998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.161447 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f4b34454-a462-4445-b48b-6497b58a1d42 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.240944 Aug 29 16:02:43.176363 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2486/5082] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:42 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:02:43.244871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a47a121c-7854-4158-a52f-1617b1bc17dd req-4c21b40c-f0c6-4e6b-a120-450ff16cda76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d339d7-3d48-4b7a-849b-90bfd8088fe5", "tag": "bfc0d741-ac38-475d-9dcb-b439dc11c07f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:43.275330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a47a121c-7854-4158-a52f-1617b1bc17dd req-4c21b40c-f0c6-4e6b-a120-450ff16cda76 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.276103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a47a121c-7854-4158-a52f-1617b1bc17dd req-4c21b40c-f0c6-4e6b-a120-450ff16cda76 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.276740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a47a121c-7854-4158-a52f-1617b1bc17dd req-4c21b40c-f0c6-4e6b-a120-450ff16cda76 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.295476 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a47a121c-7854-4158-a52f-1617b1bc17dd req-4c21b40c-f0c6-4e6b-a120-450ff16cda76 service nova] Creating event network-changed:bfc0d741-ac38-475d-9dcb-b439dc11c07f for instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 on n-h2-836830-13 Aug 29 16:02:43.305658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.349765 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a47a121c-7854-4158-a52f-1617b1bc17dd req-4c21b40c-f0c6-4e6b-a120-450ff16cda76 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132530 Aug 29 16:02:43.350646 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f46b9f2-f7c4-48ac-91be-91aafa6bb565 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.572466 Aug 29 16:02:43.351588 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2597/5083] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:42 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:43.352747 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2487/5084] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:43.365202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:43.374265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:43.390502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.393859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.395379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.397250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.397937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.398611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.499299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-01f5bb3a-f2e6-4274-bacd-b25968cc4511 req-6c409990-6dcd-4ae5-82e8-95015c1806bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3909d9a-688c-4a52-a96f-27dd1650f0f1", "name": "network-vif-plugged", "status": "completed", "tag": "89b27ec0-b7f8-4567-b199-3296cace1191"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:43.525693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-01f5bb3a-f2e6-4274-bacd-b25968cc4511 req-6c409990-6dcd-4ae5-82e8-95015c1806bf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:43.526580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-01f5bb3a-f2e6-4274-bacd-b25968cc4511 req-6c409990-6dcd-4ae5-82e8-95015c1806bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:43.526925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-01f5bb3a-f2e6-4274-bacd-b25968cc4511 req-6c409990-6dcd-4ae5-82e8-95015c1806bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:43.562092 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-01f5bb3a-f2e6-4274-bacd-b25968cc4511 req-6c409990-6dcd-4ae5-82e8-95015c1806bf service nova] Creating event network-vif-plugged:89b27ec0-b7f8-4567-b199-3296cace1191 for instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 on n-h1-836830-13 Aug 29 16:02:43.575947 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-01f5bb3a-f2e6-4274-bacd-b25968cc4511 req-6c409990-6dcd-4ae5-82e8-95015c1806bf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082095 Aug 29 16:02:43.576789 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2488/5085] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:02:43.682241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:43.691650 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af4d6792-b300-4e8b-893e-d5b6bde4e539 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 0.335809 Aug 29 16:02:43.692263 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2598/5086] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:43 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:44.205574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:44.206429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:44.222291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.222821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.223333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.224111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.224583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.225018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.352332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:44.364414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:44.366153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:44.367606 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d022bb5a-bfd9-48b6-bfa4-b15d61008a3f tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.167958 Aug 29 16:02:44.368973 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2489/5087] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:44 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:44.378733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:44.380056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:44.391258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.392758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.393469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.394544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.395200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.395789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.716675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:44.719405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:44.730259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.730776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.731447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.732273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:44.733342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:44.759413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:44.761327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:44.787440 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-743c774f-4607-4cf4-9dc5-5e0e5460116d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.398131 Aug 29 16:02:44.792479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2599/5088] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:44 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:45.135103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:45.146028 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5aa95f38-7f81-4539-85aa-e3a85861f3c1 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1325 microversion: 2.1 time: 0.433069 Aug 29 16:02:45.161993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2490/5089] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:44 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:45.397663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:45.398371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:45.435456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.435992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.436764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:45.439291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.441095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.441846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:45.471484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:45.605970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:45.622477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:45.624293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:45.626752 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e78c575-6e5d-4f4e-aa19-97fb38b6c6ff tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.234923 Aug 29 16:02:45.628152 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2600/5090] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:45 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:45.814144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:45.815778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:45.824086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.824616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.825058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:45.825954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:45.826423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:45.826882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.044860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:46.053175 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c06f7458-c1e8-49f8-bb59-662061a9b0a1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.243612 Aug 29 16:02:46.053771 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2491/5091] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:45 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:46.174530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:46.175192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:46.184693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.185858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.186319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.187089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.187549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.187981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.490417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:46.505723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2e1a07f-ba12-4ffe-bc11-a18eeea25595 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1522 microversion: 2.1 time: 0.333294 Aug 29 16:02:46.524025 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2601/5092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:46 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:46.530609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:46.531174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:46.538783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.539589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.540231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.541110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.541752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.542426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.585359 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] HTTP exception thrown: Action 999 not found Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Request method failure captured: Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1/os-instance-actions/999 HTTP/1.1 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOMMCNJaKC2IB6qmhBqQWN-dJol62ODKGcfKofclAaEMVryg1SOdTdUyJguYr5VPwayoWJVXugw1_lp5ZyOb59IlAdJtZ5HvKQOUEX2NwwNhKk43qMOthjHVLhIZEF5A9PmbZrX5asdBsw3wJGp00IPYqySGpumLyM8EwoeYUs8ipTw Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: f7d03c12309544fd8cf7870748a3ea30 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f7d03c12309544fd8cf7870748a3ea30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f7d03c12309544fd8cf7870748a3ea30", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f7d03c12309544fd8cf7870748a3ea30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f7d03c12309544fd8cf7870748a3ea30"}]}] Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: f7d03c12309544fd8cf7870748a3ea30 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-InstanceActionsNegativeTestJSON-1957569294-project Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ad48c13a52614472ae2025f02bcd2cb8 Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1957569294-project Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: exception: Action 999 not found Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': 'f3909d9a-688c-4a52-a96f-27dd1650f0f1', 'id': '999'} Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 29 16:02:46.598008 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.604595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Returning 404 to user: Action 999 not found {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:46.606035 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed500238-8dbb-487f-b71d-dc81de52663a tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.079322 Aug 29 16:02:46.607180 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2492/5093] 10.222.0.83 () {58 vars in 1308 bytes} [Mon Aug 29 16:02:46 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1/os-instance-actions/999 => generated 66 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:02:46.621620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99af06c3-9007-41e3-b41e-ed78dba99e64 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '.version_select at 0x7f32f286b160>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:46.626242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-99af06c3-9007-41e3-b41e-ed78dba99e64 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: d20c8d93-eb4b-4d79-8cf0-01c28e471348] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:46.638467 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-99af06c3-9007-41e3-b41e-ed78dba99e64 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] HTTP exception thrown: Instance d20c8d93-eb4b-4d79-8cf0-01c28e471348 could not be found. Aug 29 16:02:46.652079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99af06c3-9007-41e3-b41e-ed78dba99e64 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Request method failure captured: Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/d20c8d93-eb4b-4d79-8cf0-01c28e471348/os-instance-actions HTTP/1.1 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOMMCNJaKC2IB6qmhBqQWN-dJol62ODKGcfKofclAaEMVryg1SOdTdUyJguYr5VPwayoWJVXugw1_lp5ZyOb59IlAdJtZ5HvKQOUEX2NwwNhKk43qMOthjHVLhIZEF5A9PmbZrX5asdBsw3wJGp00IPYqySGpumLyM8EwoeYUs8ipTw Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: f7d03c12309544fd8cf7870748a3ea30 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f7d03c12309544fd8cf7870748a3ea30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f7d03c12309544fd8cf7870748a3ea30", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f7d03c12309544fd8cf7870748a3ea30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f7d03c12309544fd8cf7870748a3ea30"}]}] Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: f7d03c12309544fd8cf7870748a3ea30 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-InstanceActionsNegativeTestJSON-1957569294-project Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ad48c13a52614472ae2025f02bcd2cb8 Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1957569294-project Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: method: Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d20c8d93-eb4b-4d79-8cf0-01c28e471348 could not be found. Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': 'd20c8d93-eb4b-4d79-8cf0-01c28e471348'} Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d20c8d93-eb4b-4d79-8cf0-01c28e471348 could not be found. Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:46.653446 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d20c8d93-eb4b-4d79-8cf0-01c28e471348 could not be found. Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d20c8d93-eb4b-4d79-8cf0-01c28e471348 could not be found. Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99af06c3-9007-41e3-b41e-ed78dba99e64 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Returning 404 to user: Instance d20c8d93-eb4b-4d79-8cf0-01c28e471348 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-99af06c3-9007-41e3-b41e-ed78dba99e64 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/d20c8d93-eb4b-4d79-8cf0-01c28e471348/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.037429 Aug 29 16:02:46.659361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2602/5094] 10.222.0.83 () {58 vars in 1296 bytes} [Mon Aug 29 16:02:46 2022] GET /compute/v2.1/servers/d20c8d93-eb4b-4d79-8cf0-01c28e471348/os-instance-actions => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:46.662184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:46.679803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.681352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:46.682840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.684484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:46.685061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.689735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.690222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.692878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.713449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.716968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.717436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.718224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.722408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.722942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.792257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:02:46.836525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:46.850634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:46.852534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:46.854134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-97d5b999-a29a-4862-bfc9-fb07b22ffe96 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.205835 Aug 29 16:02:46.855801 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2493/5095] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:46 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:46.953787 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be92881f-7631-4803-bcb7-56e48edc43d4 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 204 len: 0 microversion: 2.1 time: 0.285681 Aug 29 16:02:46.954651 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2603/5096] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:02:46 2022] DELETE /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:02:46.966845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:46.967852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:46.978046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.979268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.980023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:46.981091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:46.981439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:46.981957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.082491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:47.085439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:47.111324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.114887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.117983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.120578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.123294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.125462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.275369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:47.286628 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e35eb0f3-237e-44d5-8038-0eb0a4063680 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1528 microversion: 2.1 time: 0.326513 Aug 29 16:02:47.304111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2494/5097] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:46 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1528 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:47.508707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:47.523967 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82ab120f-b72d-414b-b586-0eabd19dedc0 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.451167 Aug 29 16:02:47.538049 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2604/5098] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:47 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:47.878365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:47.879737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:47.893296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.899485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.900317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:47.901538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:47.902197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:47.902828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.289826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:48.315304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:48.317429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:48.332907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:48.336983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.337764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.338573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:48.339340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.340797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ea9db776-1384-434b-82e6-366550680bbd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.466444 Aug 29 16:02:48.344043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.347060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.358456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.359864 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2495/5099] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:47 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:48.545980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:48.546993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:48.585145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.586039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.586909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.587937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:48.588750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:48.590100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:48.713730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:48.728192 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ecdc94cc-324b-47d3-bf2f-750c3048050d tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1528 microversion: 2.1 time: 0.418317 Aug 29 16:02:48.738770 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2605/5100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:48 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1528 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:49.143751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:49.158919 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f41f972-509f-4390-a92f-6c74965e8ed5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.616817 Aug 29 16:02:49.161026 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2496/5101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:48 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:49.374530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:49.375800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:49.412052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.419918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.422897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.430968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.434501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.436619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.629218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:49.642989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:49.648900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:49.654548 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-415c49ec-9b0d-4902-8f21-06b820ed0c41 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.285611 Aug 29 16:02:49.655854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2606/5102] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:49 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:49.675106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-564c939b-d6ee-44bc-9527-656d708b16fe req-a632f69d-ec0a-45d5-9df4-afd76c09d720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3909d9a-688c-4a52-a96f-27dd1650f0f1", "name": "network-vif-deleted", "tag": "89b27ec0-b7f8-4567-b199-3296cace1191"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:49.706110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-564c939b-d6ee-44bc-9527-656d708b16fe req-a632f69d-ec0a-45d5-9df4-afd76c09d720 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.706890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-564c939b-d6ee-44bc-9527-656d708b16fe req-a632f69d-ec0a-45d5-9df4-afd76c09d720 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.707518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-564c939b-d6ee-44bc-9527-656d708b16fe req-a632f69d-ec0a-45d5-9df4-afd76c09d720 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.756692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:49.757311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:49.770616 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-564c939b-d6ee-44bc-9527-656d708b16fe req-a632f69d-ec0a-45d5-9df4-afd76c09d720 service nova] Creating event network-vif-deleted:89b27ec0-b7f8-4567-b199-3296cace1191 for instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 on n-h1-836830-13 Aug 29 16:02:49.778889 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-564c939b-d6ee-44bc-9527-656d708b16fe req-a632f69d-ec0a-45d5-9df4-afd76c09d720 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109391 Aug 29 16:02:49.780188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2497/5103] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:02:49.781328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.784383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.785075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.785999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.788591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.789260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.904178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:49.905746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:49.908189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:49.908680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lazy-loading 'fault' on Instance uuid f3909d9a-688c-4a52-a96f-27dd1650f0f1 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:02:50.020890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad48c13a52614472ae2025f02bcd2cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d03c12309544fd8cf7870748a3ea30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:50.032693 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fa8c9e13-76af-4251-a87d-f01903a9fe68 tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 200 len: 1315 microversion: 2.1 time: 0.282993 Aug 29 16:02:50.045993 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2607/5104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:49 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:50.184532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:50.185926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:50.198648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.199674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.200297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:50.202052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.202683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.208354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:50.275148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:50.597688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:50.612688 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82ceb982-5436-4250-a540-c2586e3710fa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.434402 Aug 29 16:02:50.613718 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2498/5105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:50 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:50.694176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:50.695495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:50.713122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.717436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.718346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:50.719395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:50.720244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:50.720864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:50.810956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:50.824607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:50.826470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:50.828743 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-275ada06-5ea4-4704-a0c1-3df2071e67a0 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.149829 Aug 29 16:02:50.845644 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2608/5106] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:50 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:02:51.072102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:51.072845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] [instance: f3909d9a-688c-4a52-a96f-27dd1650f0f1] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:51.083271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.084305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.084767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.085594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.086058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.086910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.120158 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] HTTP exception thrown: Instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 could not be found. Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Request method failure captured: Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 HTTP/1.1 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOMMCNJaKC2IB6qmhBqQWN-dJol62ODKGcfKofclAaEMVryg1SOdTdUyJguYr5VPwayoWJVXugw1_lp5ZyOb59IlAdJtZ5HvKQOUEX2NwwNhKk43qMOthjHVLhIZEF5A9PmbZrX5asdBsw3wJGp00IPYqySGpumLyM8EwoeYUs8ipTw Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: f7d03c12309544fd8cf7870748a3ea30 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f7d03c12309544fd8cf7870748a3ea30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f7d03c12309544fd8cf7870748a3ea30", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f7d03c12309544fd8cf7870748a3ea30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f7d03c12309544fd8cf7870748a3ea30"}]}] Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: f7d03c12309544fd8cf7870748a3ea30 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1957569294 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-InstanceActionsNegativeTestJSON-1957569294-project Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ad48c13a52614472ae2025f02bcd2cb8 Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1957569294-project Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 could not be found. Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'f3909d9a-688c-4a52-a96f-27dd1650f0f1'} Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 could not be found. Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 could not be found. Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.121940 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 could not be found. Aug 29 16:02:51.128426 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:51.131684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] Returning 404 to user: Instance f3909d9a-688c-4a52-a96f-27dd1650f0f1 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:51.132955 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-513d0e94-68d5-4972-bb7f-e3a64f75372b tempest-InstanceActionsNegativeTestJSON-1957569294 tempest-InstanceActionsNegativeTestJSON-1957569294-project] 10.222.0.83 "GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1" status: 404 len: 111 microversion: 2.1 time: 0.066404 Aug 29 16:02:51.133717 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2499/5107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:51 2022] GET /compute/v2.1/servers/f3909d9a-688c-4a52-a96f-27dd1650f0f1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:02:51.637077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:51.637946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:51.650751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.655794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.658094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.659892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.662697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.664186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.856600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:51.857313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:51.874757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.878700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.879365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:51.880193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:51.880990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:51.887766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.194729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:52.216713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:52.218093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:52.223623 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-882aacdb-1be4-4016-8e52-f6006ecd2673 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.371224 Aug 29 16:02:52.224232 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2500/5108] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:51 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:02:52.520647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:52.537922 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4978e06-480b-408e-8fb9-4988d4b2040d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1501 microversion: 2.1 time: 0.905479 Aug 29 16:02:52.555386 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2609/5109] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:51 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1501 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:52.573736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fb11f1c-9a07-4a87-bcda-9831f4c6f8a2"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:52.577961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:52.594187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.596119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.596764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.601335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.602044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.604089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.674239 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Cannot 'attach_volume' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state rescued Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/os-volume_attachments HTTP/1.1 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 74 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: {"volumeAttachment": {"volumeId": "3fb11f1c-9a07-4a87-bcda-9831f4c6f8a2"}} Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'attach_volume' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state rescued Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': '38f1caeb-d314-411b-8e0a-e9762b370f5c', 'body': {'volumeAttachment': {'volumeId': '3fb11f1c-9a07-4a87-bcda-9831f4c6f8a2'}}} Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 16:02:52.677151 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state rescued Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state rescued Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 409 to user: Cannot 'attach_volume' instance 38f1caeb-d314-411b-8e0a-e9762b370f5c while it is in vm_state rescued {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1c2532a5-4e4c-4696-8929-a02dcf6f49bd tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.109926 Aug 29 16:02:52.685847 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2501/5110] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:02:52 2022] POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/os-volume_attachments => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:02:52.689349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:02:52.689901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:52.697467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.708777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.708777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.709392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.709586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.710015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.824157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e05df94-f5ec-41a0-8999-b1321b31a96d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action" status: 202 len: 0 microversion: 2.1 time: 0.139765 Aug 29 16:02:52.825471 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2610/5111] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:02:52 2022] POST /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:02:52.835784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:52.836819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:52.851852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.854939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.856097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:52.857369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:52.859395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:52.861441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:53.257360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:53.258286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:53.274505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:53.275047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:53.275469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:53.279213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:53.279706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:53.281652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:53.653245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:53.704080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:53.707906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:53.710920 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2f9f31aa-fdb3-48c0-ad6f-b9dd8b8bc8ea tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.461254 Aug 29 16:02:53.713021 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2611/5112] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:53 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:02:53.933528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:53.944536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21e2afc1-c9ef-4b40-8226-23c571ce6455 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1509 microversion: 2.1 time: 1.114539 Aug 29 16:02:53.947104 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2502/5113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:52 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1509 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:02:54.741816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:54.745928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:54.754976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:54.755630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:54.756324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:54.757211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:54.757736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:54.759303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:54.965642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:54.975912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:54.976749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:54.987827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:54.997994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:55.000450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:55.005563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:55.006436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:55.008156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-36eab4b3-45d8-4068-ab71-d5d588ef4b5e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.271726 Aug 29 16:02:55.009551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:55.014460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:55.016133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:55.016799 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2612/5114] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:54 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:55.556674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:55.579524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-65e977b4-4b7e-432c-8839-1c9ea285ca3d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1509 microversion: 2.1 time: 0.611919 Aug 29 16:02:55.588288 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2503/5115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:54 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1509 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:56.039813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:56.041083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:56.051520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:56.056557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:56.058695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:56.059655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:56.069078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:56.069530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:56.306404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:56.333032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:56.335740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:56.337521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f667369-829a-4a29-b043-20e2373fe13d tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.302579 Aug 29 16:02:56.339274 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2613/5116] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:56 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:56.616826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:56.618185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:56.650364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:56.651707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:56.654151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:56.655038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:56.657936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:56.658887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:57.054515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:57.070953 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0e0fe1a-0b29-447a-a0bc-ed526f5057bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1509 microversion: 2.1 time: 0.460737 Aug 29 16:02:57.072630 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2504/5117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:56 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:57.362939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:57.364203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:57.377383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:57.381897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:57.382539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:57.383484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:57.384110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:57.386611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:57.579523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:57.583758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:02:57.598560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:57.604497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:57.605814 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fae851cf-2a41-4793-a2bc-53b190ce34b3 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.248432 Aug 29 16:02:57.610336 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2614/5118] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:57 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:02:58.105427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:58.108116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:58.136181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:58.148078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:58.151455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:58.152228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:58.152702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:58.153135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:58.634456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:58.635170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:58.665689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:58.666200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:58.682306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:58.683338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:58.696228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:58.698181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:58.824384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:58.840881 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4866264-426b-4e00-951c-7ac94dcb3c01 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1515 microversion: 2.1 time: 0.750804 Aug 29 16:02:58.841502 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2505/5119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:02:58 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1515 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:02:58.881759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:58.908171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:58.909275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:02:58.910581 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b76841b-5808-4033-b8ad-ceb2a3ff65dc tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.281604 Aug 29 16:02:58.919305 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2615/5120] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:58 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:02:59.944869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:02:59.946276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:02:59.979891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.983987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.986394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:02:59.988037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:02:59.988879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:02:59.990510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:00.113667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:00.134014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:00.144511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:00.145781 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02b05908-d48d-4475-8741-16d332d2883e tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.208913 Aug 29 16:03:00.159299 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2506/5121] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:02:59 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:03:01.178059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:01.179853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:01.221803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:01.224418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:01.229068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:01.230247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:01.232571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:01.239190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:01.490410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:01.509619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:01.512216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:01.514008 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa05f8f0-3c4d-4929-9775-7b6a842959f4 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.344246 Aug 29 16:03:01.529104 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2616/5122] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:03:01 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:03:01.771882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1463a805-ef54-4be4-aefc-a7d9096d7a99 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'create', calling method: .version_select at 0x7f32ee446ee0>, body: {"keypair": {"name": "tempest-keypair-1987182539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiFlvrtR7fH9iBWB3fczq+2PMfkIzcrEhTNjLapZRkFBWKD4zHkEb4tsNFpj0t5JhOLUNWZw8lxnIOXxFelvlRGG68od4KtXqhIFy9A/DlxL7n1lZHyv1aHYhSqVX9y0Q=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:01.803345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-1463a805-ef54-4be4-aefc-a7d9096d7a99 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for project eb9fe4b710cb46779f13a142f1301567. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:01.827365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-1463a805-ef54-4be4-aefc-a7d9096d7a99 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for user dcd426ac002048bf9db072739a81c2e4 and project eb9fe4b710cb46779f13a142f1301567. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:01.898078 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1463a805-ef54-4be4-aefc-a7d9096d7a99 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134944 Aug 29 16:03:01.898711 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2507/5123] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:03:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:02.553596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:02.554417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:02.568009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.569081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.572343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:02.573325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:02.573932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:02.574606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:02.733845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:02.750480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:02.755282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:02.766703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-adbf01fa-4405-4b54-a9f1-82382e308050 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.216670 Aug 29 16:03:02.771811 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2617/5124] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:03:02 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:03:03.800621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:03.801252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:03.813982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:03.814721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:03.815220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:03.815950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:03.816415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:03.816851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:04.241914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:04.265129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:04.267369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:04.273338 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7486272d-09f8-4e2d-b925-277d6ac32692 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.478829 Aug 29 16:03:04.281503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2508/5125] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:03:03 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:03:05.310160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:05.311566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:05.325679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:05.326165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:05.328983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:05.333463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:05.333950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:05.334835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:05.995781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:06.014318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:06.015811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:06.017566 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29460969-e868-4ce3-bbad-6ad39ae82718 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.714311 Aug 29 16:03:06.033975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2618/5126] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:03:05 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:03:06.298322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1717150010", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "692c297a-85b1-4611-a17e-bc2859e627b4"}], "security_groups": [{"name": "tempest-securitygroup--2016248447"}], "key_name": "tempest-keypair-1987182539", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:06.996514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] validate_networks() for [('692c297a-85b1-4611-a17e-bc2859e627b4', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:07.057266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:07.057907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:07.069079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:07.071507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:07.072102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:07.073434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:07.074266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:07.074814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:07.303539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:07.334388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:07.341446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cd0536429dd4c47b296b9645b6e0c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32dcc4d8d4a44d24bce81642e49a84ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:07.346582 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7aa51237-37ae-46e0-b7d8-35e9acbbef9c tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 200 len: 1603 microversion: 2.32 time: 0.293087 Aug 29 16:03:07.364492 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2619/5127] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:03:07 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 1603 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:03:08.382372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:08.383215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:08.408524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.415517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.420747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.424818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.430562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.433838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.486515 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] HTTP exception thrown: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Request method failure captured: Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e HTTP/1.1 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF_46dzyt1GNrBZri6tltWWcH6Fd9S7sgwd2GkSYZnc3OsaqAbInN-Rc4Ycu7WzEoeRrBSz52PfnA7z8TkXZxkcJktZ6ScNa-Ah8hebkkLUTbZlLc8A5VPODlQHBaHgjjeCS_ayG4mPy0LfiUzfqaRTcx8rYC0MPd2uBx8hdzhVti0 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 32dcc4d8d4a44d24bce81642e49a84ab Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32dcc4d8d4a44d24bce81642e49a84ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_32dcc4d8d4a44d24bce81642e49a84ab", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32dcc4d8d4a44d24bce81642e49a84ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/32dcc4d8d4a44d24bce81642e49a84ab"}]}] Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 32dcc4d8d4a44d24bce81642e49a84ab Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TaggedBootDevicesTest-446807887-project Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 2cd0536429dd4c47b296b9645b6e0c48 Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TaggedBootDevicesTest-446807887-project Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e'} Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:08.497295 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:08.505530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Returning 404 to user: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:08.506967 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-62c3cf29-434d-480a-a52e-6e7a986e0340 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 404 len: 111 microversion: 2.32 time: 0.129638 Aug 29 16:03:08.507698 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2620/5128] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:03:08 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:03:08.511797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:08.512421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:08.515257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:08.515782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:08.516213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:08.518180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83b1556b-a999-4ffa-8c47-50def9a64f5b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '.version_select at 0x7f32ed0cbee0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:08.535727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.536486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.538937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.542047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:08.542860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:08.543692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:08.568448 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83b1556b-a999-4ffa-8c47-50def9a64f5b tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-697449914" status: 204 len: 0 microversion: 2.32 time: 0.054391 Aug 29 16:03:08.570188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2621/5129] 10.222.0.83 () {60 vars in 1259 bytes} [Mon Aug 29 16:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-697449914 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:03:08.607220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for project eb9fe4b710cb46779f13a142f1301567. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:08.617326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Getting quotas for user dcd426ac002048bf9db072739a81c2e4 and project eb9fe4b710cb46779f13a142f1301567. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:08.655805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:03:08.660444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:03:08.777403 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-72acd7f8-7c63-4ce5-aae0-77e6b10a918f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.481039 Aug 29 16:03:08.781699 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2509/5130] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:03:08.790621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16f3713d-6434-4c75-b81b-507b213b7f1c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:08.791588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-16f3713d-6434-4c75-b81b-507b213b7f1c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:08.964503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-16f3713d-6434-4c75-b81b-507b213b7f1c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:08.975391 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-16f3713d-6434-4c75-b81b-507b213b7f1c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1246 microversion: 2.1 time: 0.189074 Aug 29 16:03:08.975975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2622/5131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:08 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1246 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:10.001714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:10.002338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:10.017045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:10.017650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:10.019535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:10.020272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:10.020732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:10.021163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:10.360715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:10.376411 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7025e1ae-876b-48e0-8811-dde2b7f416c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1242 microversion: 2.1 time: 0.379109 Aug 29 16:03:10.377935 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2510/5132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:09 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1242 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:11.398672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:11.400174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:11.407765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.417157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.419639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.421085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:11.422019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:11.429816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:11.608406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:11.620667 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d2733d0-fcd9-4cd5-9710-d2ccdc80d015 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1304 microversion: 2.1 time: 0.225967 Aug 29 16:03:11.635047 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2623/5133] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:11 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1304 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:12.645246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:12.647171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:12.656411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:12.671412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:12.677739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:12.678950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:12.679910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:12.680546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:12.682754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:13.189837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:13.202317 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f923b6f9-0bf4-479b-9fdf-fbedf33ac31d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 0.562215 Aug 29 16:03:13.207417 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2511/5134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:12 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:14.226418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:14.227152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:14.232354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:14.247487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:14.250199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:14.250748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:14.251537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:14.253585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:14.254047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:14.757334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-61fb8543-be7e-4455-895f-06409814997b req-aaaac65d-6e14-4ff1-a000-03ea3b63dcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877d07e1-ab80-48ee-abda-805c63efa629", "tag": "2210e537-a1a0-4e7d-b359-02a48cb5d032"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:14.805907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61fb8543-be7e-4455-895f-06409814997b req-aaaac65d-6e14-4ff1-a000-03ea3b63dcb1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:14.806637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61fb8543-be7e-4455-895f-06409814997b req-aaaac65d-6e14-4ff1-a000-03ea3b63dcb1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:14.807282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-61fb8543-be7e-4455-895f-06409814997b req-aaaac65d-6e14-4ff1-a000-03ea3b63dcb1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:14.833712 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-61fb8543-be7e-4455-895f-06409814997b req-aaaac65d-6e14-4ff1-a000-03ea3b63dcb1 service nova] Creating event network-changed:2210e537-a1a0-4e7d-b359-02a48cb5d032 for instance 877d07e1-ab80-48ee-abda-805c63efa629 on n-h1-836830-13 Aug 29 16:03:14.856786 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-61fb8543-be7e-4455-895f-06409814997b req-aaaac65d-6e14-4ff1-a000-03ea3b63dcb1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104157 Aug 29 16:03:14.860732 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2512/5135] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:03:15.123004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:15.132778 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa1b4cd4-a17b-4024-8a3b-f67b0a010e37 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 0.911184 Aug 29 16:03:15.140092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2624/5136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:14 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:16.164176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:16.164905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:16.181332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:16.187642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:16.188226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:16.189137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:16.189623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:16.190163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:16.669298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:16.680458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f0f63bb-7a7e-4711-96e5-29f6fd1857b7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 0.522789 Aug 29 16:03:16.693346 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2513/5137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:16 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:17.704322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:17.705059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:17.732244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:17.732765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:17.733214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:17.733943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:17.734403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:17.734908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:18.501779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:18.518805 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20f60376-c27f-4a91-8299-a0a136d6908f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 0.818860 Aug 29 16:03:18.519679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2625/5138] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:17 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:19.541072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:19.541865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:19.545378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.546058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=10 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:19.577863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.578424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.579115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.579953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:19.580514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:19.580956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:19.991595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:20.619723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eca27754-7e8d-44de-bbf6-f3b9d8984cba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'create', calling method: .version_select at 0x7f32edacc3a0>, body: {"keypair": {"name": "tempest-keypair-1623115461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu4PrSS9wfhky9rHLeWgZzE32oHlM9aSPDg7sR2ZGWqJkW6TH3Smgqrr1r1PA2Ob1AUw5QzCG8/1Tmay+sXz6/l60UHJ80Jd164zSErGzSSedPyRiIDFKrt8GzTycrfhw=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:20.661602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-eca27754-7e8d-44de-bbf6-f3b9d8984cba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:20.670789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-eca27754-7e8d-44de-bbf6-f3b9d8984cba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for user f075974a803f46eda667db6d754453ba and project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:20.736057 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eca27754-7e8d-44de-bbf6-f3b9d8984cba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.750867 Aug 29 16:03:20.736891 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2626/5139] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:03:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:03:20.809771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:20.813519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=78 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:20.834498 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e27eb34-9d9d-4495-bbe6-11cd2bfefe60 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 1.298254 Aug 29 16:03:20.868125 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2514/5140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:19 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:21.146807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ad2dbe6d-5ad7-40d7-9909-ca7206969dcc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: .version_select at 0x7f32ee99dca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-981313937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe4/GkS8GsuYYV3vy15Y0/SqR5sICjJg69nvvxOnSax8wlryAXJggqNnScn0kUYmNxOyxaLLrseiS1UmYHySIXsDNGIqY8sjR+kGeBMein0zMi5jC5PuVZw3/+geSPbNA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:21.211056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ad2dbe6d-5ad7-40d7-9909-ca7206969dcc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:21.233238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ad2dbe6d-5ad7-40d7-9909-ca7206969dcc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:21.336780 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ad2dbe6d-5ad7-40d7-9909-ca7206969dcc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.596216 Aug 29 16:03:21.338628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2627/5141] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:03:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:21.874793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:21.875403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:21.893566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.894122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.894564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:21.895457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:21.896397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:21.896397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.434398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:22.446563 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5f90c2e-a7c7-420e-a3d5-39faef5ce521 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 0.576202 Aug 29 16:03:22.447422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2515/5142] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:21 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:22.884024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:22.884540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:22.897290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.897793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.898232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.898931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.900005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.903827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.946848 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] HTTP exception thrown: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Request method failure captured: Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e HTTP/1.1 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF_46dzyt1GNrBZri6tltWWcH6Fd9S7sgwd2GkSYZnc3OsaqAbInN-Rc4Ycu7WzEoeRrBSz52PfnA7z8TkXZxkcJktZ6ScNa-Ah8hebkkLUTbZlLc8A5VPODlQHBaHgjjeCS_ayG4mPy0LfiUzfqaRTcx8rYC0MPd2uBx8hdzhVti0 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 32dcc4d8d4a44d24bce81642e49a84ab Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32dcc4d8d4a44d24bce81642e49a84ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_32dcc4d8d4a44d24bce81642e49a84ab", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32dcc4d8d4a44d24bce81642e49a84ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/32dcc4d8d4a44d24bce81642e49a84ab"}]}] Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 32dcc4d8d4a44d24bce81642e49a84ab Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TaggedBootDevicesTest-446807887-project Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 2cd0536429dd4c47b296b9645b6e0c48 Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TaggedBootDevicesTest-446807887-project Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e'} Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:22.951911 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:22.956511 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:03:22.960433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Returning 404 to user: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:22.965093 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d07a4e5e-a31f-47c4-95d3-fa5a02ddb831 tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "DELETE /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 404 len: 111 microversion: 2.32 time: 0.086035 Aug 29 16:03:22.969871 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2628/5143] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 16:03:22 2022] DELETE /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:03:22.976073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:22.977383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] [instance: 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:22.989749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.990920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.993192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:22.994149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:22.995269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:22.998437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.035262 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] HTTP exception thrown: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Request method failure captured: Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e HTTP/1.1 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF_46dzyt1GNrBZri6tltWWcH6Fd9S7sgwd2GkSYZnc3OsaqAbInN-Rc4Ycu7WzEoeRrBSz52PfnA7z8TkXZxkcJktZ6ScNa-Ah8hebkkLUTbZlLc8A5VPODlQHBaHgjjeCS_ayG4mPy0LfiUzfqaRTcx8rYC0MPd2uBx8hdzhVti0 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.32 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 32dcc4d8d4a44d24bce81642e49a84ab Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32dcc4d8d4a44d24bce81642e49a84ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_32dcc4d8d4a44d24bce81642e49a84ab", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/32dcc4d8d4a44d24bce81642e49a84ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/32dcc4d8d4a44d24bce81642e49a84ab"}]}] Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 32dcc4d8d4a44d24bce81642e49a84ab Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TaggedBootDevicesTest-446807887 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TaggedBootDevicesTest-446807887-project Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 2cd0536429dd4c47b296b9645b6e0c48 Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TaggedBootDevicesTest-446807887-project Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e'} Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:03:23.038125 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:03:23.042905 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:03:23.042905 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:03:23.042905 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:03:23.042905 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:03:23.042905 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:03:23.042905 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. Aug 29 16:03:23.042905 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:03:23.055922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] Returning 404 to user: Instance 2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:03:23.058313 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc6aff31-76ff-4c64-b79c-61ce923d99dd tempest-TaggedBootDevicesTest-446807887 tempest-TaggedBootDevicesTest-446807887-project] 10.222.0.83 "GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e" status: 404 len: 111 microversion: 2.32 time: 0.086487 Aug 29 16:03:23.060663 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2516/5144] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:03:22 2022] GET /compute/v2.1/servers/2a52e9b7-aed7-458f-a69b-8c3d4ca2f41e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:03:23.472806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:23.473897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:23.490173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:23.497834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:23.498625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:23.499685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:23.501068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:23.502061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.084699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:24.093922 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f417d44c-651f-4e74-8d7a-f776f4cc496e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 0.624583 Aug 29 16:03:24.107309 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2629/5145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:23 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:24.320146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-66ac2476-3665-41e5-a632-a9e64984d82e req-64fcdba2-ffaa-4bc0-a978-5047ea8bf1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877d07e1-ab80-48ee-abda-805c63efa629", "name": "network-vif-plugged", "status": "completed", "tag": "2210e537-a1a0-4e7d-b359-02a48cb5d032"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:24.340550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-66ac2476-3665-41e5-a632-a9e64984d82e req-64fcdba2-ffaa-4bc0-a978-5047ea8bf1bb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:24.343426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-66ac2476-3665-41e5-a632-a9e64984d82e req-64fcdba2-ffaa-4bc0-a978-5047ea8bf1bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:24.345461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-66ac2476-3665-41e5-a632-a9e64984d82e req-64fcdba2-ffaa-4bc0-a978-5047ea8bf1bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:24.378778 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-66ac2476-3665-41e5-a632-a9e64984d82e req-64fcdba2-ffaa-4bc0-a978-5047ea8bf1bb service nova] Creating event network-vif-plugged:2210e537-a1a0-4e7d-b359-02a48cb5d032 for instance 877d07e1-ab80-48ee-abda-805c63efa629 on n-h1-836830-13 Aug 29 16:03:24.397077 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-66ac2476-3665-41e5-a632-a9e64984d82e req-64fcdba2-ffaa-4bc0-a978-5047ea8bf1bb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085213 Aug 29 16:03:24.398348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2517/5146] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:24.717754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1208745332", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "6ea2b694-452f-4d82-b3fa-48824b11ca34"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:24.818373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] validate_networks() for [('6ea2b694-452f-4d82-b3fa-48824b11ca34', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:25.121923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:25.122722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:25.141423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.143398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.143861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.144596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.153126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.154708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.470091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:25.486335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9366a8b1-9e59-4347-b5c2-52b1597d5913 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1372 microversion: 2.1 time: 0.367038 Aug 29 16:03:25.500780 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2518/5147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:25 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1372 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:25.500780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-455039392", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f86097cf-c2ec-48f3-b00c-ae541e26f7ef"}], "security_groups": [{"name": "tempest-securitygroup--1078349433"}], "key_name": "tempest-keypair-1623115461", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:25.548098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:25.548662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:25.549149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:25.549563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:25.549980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:25.571565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.572872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.586729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.589007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:25.593197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:25.595820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:25.679799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Getting quotas for project 315f3de5e40e4a0ca12713b37c555371. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:25.698355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Getting quotas for user e9cd9c0bd017459cb630823a39e8bd17 and project 315f3de5e40e4a0ca12713b37c555371. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:25.727061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:03:25.729680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:03:25.832871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] validate_networks() for [('f86097cf-c2ec-48f3-b00c-ae541e26f7ef', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:25.860768 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea21125d-f304-4c58-901a-313908298f12 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.148073 Aug 29 16:03:25.866409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2630/5148] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:03:25.879732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-232a2e6c-bccb-4905-9317-0879d6fc7d96 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:25.880607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-232a2e6c-bccb-4905-9317-0879d6fc7d96 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:26.145323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-232a2e6c-bccb-4905-9317-0879d6fc7d96 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:26.153708 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-232a2e6c-bccb-4905-9317-0879d6fc7d96 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1219 microversion: 2.1 time: 0.280478 Aug 29 16:03:26.173908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2631/5149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:25 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:26.508814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:26.509435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:26.523294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.523807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.524253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.525159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.525638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.526075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.873170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:26.874212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:26.874877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:26.875513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:26.876270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:26.891448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.892251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.893261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.894223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:26.894907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:26.896489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:26.919001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:26.926327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for user f075974a803f46eda667db6d754453ba and project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:26.943157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:03:26.945941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:03:27.030207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:27.063558 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0b9e91e-236b-4928-86d6-64d809ef4812 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1567 microversion: 2.1 time: 0.558160 Aug 29 16:03:27.073324 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2632/5150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:26 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1567 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:27.115492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:27.129825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:27.135300 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-906f24c0-14f4-4c0e-a120-361213acea98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.622592 Aug 29 16:03:27.136374 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2519/5151] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:03:27.153453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6e81989-20dc-433c-a383-5336c30b7fa9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:27.161894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d6e81989-20dc-433c-a383-5336c30b7fa9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:27.179144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.196313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.198886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.202256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.204393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.222362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.278828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d6e81989-20dc-433c-a383-5336c30b7fa9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:27.287274 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6e81989-20dc-433c-a383-5336c30b7fa9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1238 microversion: 2.1 time: 0.142296 Aug 29 16:03:27.296393 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2520/5152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:27 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1238 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:27.302626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:27.315953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:27.325010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.325738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.326381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.327305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:27.328362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:27.329181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:27.419572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:27.429924 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82e1969a-4f2b-4776-920f-4a45000539e0 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1271 microversion: 2.1 time: 0.131123 Aug 29 16:03:27.430783 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2521/5153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:27 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:27.462719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7e23b84d-08d9-43a1-983d-f3b5d82aad9e tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.362378 Aug 29 16:03:27.463704 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2633/5154] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:03:27 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-interface => generated 285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:28.318349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:28.319710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:28.341160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.341667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.342108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:28.342825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.343311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.343737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:28.460799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:28.462395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:28.471361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.473741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.474445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:28.478683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:28.482308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:28.483123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:28.671455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:28.675708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=75 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:28.692540 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c37e05aa-62b5-4d28-8296-1d67cfc84e99 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1277 microversion: 2.1 time: 0.238144 Aug 29 16:03:28.694056 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2634/5155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:28 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:29.329524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:29.362307 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3808394-73b1-45da-80f2-315a9ca89690 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1242 microversion: 2.1 time: 1.043941 Aug 29 16:03:29.366794 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2522/5156] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:28 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1242 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:29.715962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:29.717273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:29.726368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.727480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.728653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.729628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:29.730322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:29.731183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:29.842505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:29.865792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c6381e5e-364f-499b-86b8-49806e901df3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1277 microversion: 2.1 time: 0.152566 Aug 29 16:03:29.868117 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2635/5157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:29 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:30.385365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:30.385959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:30.397401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.404520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.405076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.408512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.409020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.409458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.888426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:30.889036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:30.911337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.911829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.912267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:30.913140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:30.913481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:30.914170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:31.060315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:31.080701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3ab4dbc-394a-42e9-a324-674a3063032e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1296 microversion: 2.1 time: 0.698229 Aug 29 16:03:31.082572 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2523/5158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:30 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1296 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:31.756916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:31.771473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0236b16-f5b0-4495-b3b8-b613e0e20258 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.886935 Aug 29 16:03:31.772075 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2636/5159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:30 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:32.115805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:32.117661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:32.133861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.136813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.137770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.141157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.144378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.146543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.431274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-35c20859-38d1-4e97-8e55-f87905f29bce req-a35f1eed-9763-447b-a1a7-ca15d45f89c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877d07e1-ab80-48ee-abda-805c63efa629", "tag": "2210e537-a1a0-4e7d-b359-02a48cb5d032"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:32.446225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-35c20859-38d1-4e97-8e55-f87905f29bce req-a35f1eed-9763-447b-a1a7-ca15d45f89c2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.447433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-35c20859-38d1-4e97-8e55-f87905f29bce req-a35f1eed-9763-447b-a1a7-ca15d45f89c2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.449316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-35c20859-38d1-4e97-8e55-f87905f29bce req-a35f1eed-9763-447b-a1a7-ca15d45f89c2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.465185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-35c20859-38d1-4e97-8e55-f87905f29bce req-a35f1eed-9763-447b-a1a7-ca15d45f89c2 service nova] Creating event network-changed:2210e537-a1a0-4e7d-b359-02a48cb5d032 for instance 877d07e1-ab80-48ee-abda-805c63efa629 on n-h1-836830-13 Aug 29 16:03:32.483969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-35c20859-38d1-4e97-8e55-f87905f29bce req-a35f1eed-9763-447b-a1a7-ca15d45f89c2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313991 Aug 29 16:03:32.493152 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2637/5160] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:32.751808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:32.767709 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0ecb41b-6805-44dd-a419-b2e24bbb2cea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1296 microversion: 2.1 time: 0.662955 Aug 29 16:03:32.775348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2524/5161] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:32 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1296 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:32.794539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:32.795869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:32.810935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.811790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.812482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:32.813957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:32.814823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:32.815486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:33.099219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:33.107256 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2ddf978-62bb-48bf-8e9a-1d9a46030e64 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.317954 Aug 29 16:03:33.115392 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2638/5162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:32 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:33.792218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:33.793680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:33.809223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.816372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.817173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:33.818107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:33.821132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:33.821767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:34.139747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:34.140372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:34.159782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:34.160281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:34.160724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:34.161438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:34.161898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:34.162332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:35.147723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:35.155807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-661522fe-7b58-4e3e-85ed-d87339f699eb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 1.019979 Aug 29 16:03:35.167424 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2639/5163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:34 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:36.191237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:36.191237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:36.199399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:36.207012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=16 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:36.224127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:36.225657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:36.227608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:36.232550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:36.233435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:36.234082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:36.238734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:36.247157 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fce6a185-3ab2-4ca8-a631-08b631a00231 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 2.459049 Aug 29 16:03:36.250811 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2525/5164] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:33 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:36.715465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:36.741421 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f44f1e4d-13e8-405e-a1d1-56a3ec282925 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.563459 Aug 29 16:03:36.755807 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2640/5165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:36 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:36.817740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e246c7f2-28ef-4a14-af32-19fca17744f2 req-12a48dda-e9cf-4767-8eb3-5fd3ac8c4724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf96bbf-ec37-465c-816c-2ecbf0b3263a", "tag": "a9571ca3-08af-4062-8b99-029b7d9d9177"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:36.840459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e246c7f2-28ef-4a14-af32-19fca17744f2 req-12a48dda-e9cf-4767-8eb3-5fd3ac8c4724 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:36.847912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e246c7f2-28ef-4a14-af32-19fca17744f2 req-12a48dda-e9cf-4767-8eb3-5fd3ac8c4724 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:36.851752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e246c7f2-28ef-4a14-af32-19fca17744f2 req-12a48dda-e9cf-4767-8eb3-5fd3ac8c4724 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:36.887186 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e246c7f2-28ef-4a14-af32-19fca17744f2 req-12a48dda-e9cf-4767-8eb3-5fd3ac8c4724 service nova] Creating event network-changed:a9571ca3-08af-4062-8b99-029b7d9d9177 for instance caf96bbf-ec37-465c-816c-2ecbf0b3263a on n-h2-836830-13 Aug 29 16:03:36.908378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e246c7f2-28ef-4a14-af32-19fca17744f2 req-12a48dda-e9cf-4767-8eb3-5fd3ac8c4724 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092796 Aug 29 16:03:36.915865 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2526/5166] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:37.270453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:37.271098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:37.290087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:37.290590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:37.291059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:37.294851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:37.295316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:37.297812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:37.764649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:37.765480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:37.768169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:37.772283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:37.792370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:37.793357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:37.796104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:37.799634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:37.800325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:37.801196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:38.142004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:38.161688 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49966e93-90f2-413c-9ef4-0b4e4d915f5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.895764 Aug 29 16:03:38.162294 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2641/5167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:37 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:39.186955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:39.188342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:39.213988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:39.214610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:39.215612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:39.216616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:39.223701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:39.224268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:39.366935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:39.417620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08468385-df2a-40fc-82f2-48b9afa2dc32 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 1.635912 Aug 29 16:03:39.425055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2527/5168] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:37 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:39.599090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:39.616272 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8ac63f28-ca96-4240-a4c3-c111e753af4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.432922 Aug 29 16:03:39.617250 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2642/5169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:39 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:39.899293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-cdc88efa-5d11-4ef7-aa0f-4e428aef7143 req-b7681efe-c11c-4f23-94a1-f290f028a61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:39.914623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cdc88efa-5d11-4ef7-aa0f-4e428aef7143 req-b7681efe-c11c-4f23-94a1-f290f028a61c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:39.923013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cdc88efa-5d11-4ef7-aa0f-4e428aef7143 req-b7681efe-c11c-4f23-94a1-f290f028a61c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:39.923499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cdc88efa-5d11-4ef7-aa0f-4e428aef7143 req-b7681efe-c11c-4f23-94a1-f290f028a61c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:39.960583 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-cdc88efa-5d11-4ef7-aa0f-4e428aef7143 req-b7681efe-c11c-4f23-94a1-f290f028a61c service nova] Creating event network-changed:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:03:39.971660 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-cdc88efa-5d11-4ef7-aa0f-4e428aef7143 req-b7681efe-c11c-4f23-94a1-f290f028a61c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079804 Aug 29 16:03:39.998225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2528/5170] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:03:40.445890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:40.446702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:40.465637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.466292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.466837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.471317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.471805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.472251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.638785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:40.639546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:40.664331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.668136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.668916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:40.670582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:40.672472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:40.674845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:41.090664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:41.100142 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a730f018-ee88-4149-a225-2025816ca0d2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.658706 Aug 29 16:03:41.105902 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2643/5171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:40 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:41.230712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:41.247551 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d50ea2fe-e18d-479c-9526-d166a3489fb0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.614252 Aug 29 16:03:41.253815 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2529/5172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:40 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:42.131280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:42.132347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:42.148900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.150959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.172691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.174294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.175576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.177527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.284194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:42.295001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:42.322857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.323523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.324056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.324834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:42.325537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:42.326146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:42.889780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:42.908604 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce0242a2-b3b3-487a-8d63-b1585040827a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.628320 Aug 29 16:03:42.909845 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2530/5173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:42 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:43.241639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:43.257583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c3a1419-81b1-45ec-bd67-c2b536f726b4 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 1.130099 Aug 29 16:03:43.262144 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2644/5174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:42 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:43.934090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:43.934827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:43.936958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:43.951006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:43.954397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:43.957101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:43.958854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:43.961569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:43.964363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.048129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-656124581", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "0070caee-9a77-44d9-acd5-8488295536d5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-981313937", "security_groups": [{"name": "tempest-secgroup-smoke-1478690227"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:44.257997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] validate_networks() for [('0070caee-9a77-44d9-acd5-8488295536d5', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:03:44.636792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:44.640399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:44.648842 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-146e5f15-06b4-4f61-8d72-289e5618e393 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.719994 Aug 29 16:03:44.649739 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2531/5175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:43 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:44.654789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:44.655758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:44.664299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:44.665072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:44.665702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.666600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:44.668285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:44.669226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:44.880260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:44.892038 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-855fcacf-c612-45ac-ad19-b73456c4e0a3 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.240959 Aug 29 16:03:44.892843 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2532/5176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:44 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:45.122809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:03:45.123381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:03:45.123974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:03:45.124642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:03:45.125205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:03:45.158235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.158235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.158235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.158235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.158235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.158235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.205012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:03:45.212218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:03:45.231475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:03:45.235125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:03:45.296058 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4efc8dad-a0cf-4ab4-8a50-04f4085948a5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.253492 Aug 29 16:03:45.310070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c77b2a5a-4947-4d85-9a39-c7f9489cd8e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:45.311365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c77b2a5a-4947-4d85-9a39-c7f9489cd8e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:45.316904 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2645/5177] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:03:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:03:45.415079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c77b2a5a-4947-4d85-9a39-c7f9489cd8e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:45.430037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c77b2a5a-4947-4d85-9a39-c7f9489cd8e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1265 microversion: 2.1 time: 0.122059 Aug 29 16:03:45.430596 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2533/5178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:45 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:45.671213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:45.672570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:45.686368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.687659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.688375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.690546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.693788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.694257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.913741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:45.914704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:45.959500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.960022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.960450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:45.961172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:45.961631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:45.962060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:46.188587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:46.199928 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e981ae20-c15d-4631-8bfa-e48caa0b32da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.532480 Aug 29 16:03:46.202182 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2646/5179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:45 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:46.353438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:46.364893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95763375-a0af-4915-b57d-1f1ab787895e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.455105 Aug 29 16:03:46.379558 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2534/5180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:45 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:46.454480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:46.455905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:46.472537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:46.473163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:46.473717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:46.474671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:46.475308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:46.475838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:46.849602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:46.857497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d44dc39-c44f-4594-8c04-1158857cd3ff tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1261 microversion: 2.1 time: 0.407553 Aug 29 16:03:46.861930 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2647/5181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:46 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1261 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:47.230623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:47.233624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:47.255573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.256454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.257170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.258135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.259299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.260003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.387225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:47.387947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:47.402866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.403813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.404768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.407055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.409091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.410779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.757861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:47.789974 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b95e5dd-6307-43b3-b66b-ebe3c05cbcd1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.393591 Aug 29 16:03:47.791292 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2648/5182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:47 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:47.890112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:47.896974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:47.908987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.913038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.913854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:47.915133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:47.915795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:47.917169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.081141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:48.089544 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da96064a-6c1d-40ab-b625-58e1a1aafa31 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1323 microversion: 2.1 time: 0.209137 Aug 29 16:03:48.090126 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2649/5183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:47 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1323 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:48.280117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:48.328143 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-781754e3-b10b-49a1-99d5-08193d4b2c20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 1.100761 Aug 29 16:03:48.331335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2535/5184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:47 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:48.415829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-336999cf-c9f6-4f14-996a-c21b28cbbe8c req-26968354-7135-4d83-a16c-6e5511977155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf96bbf-ec37-465c-816c-2ecbf0b3263a", "name": "network-vif-plugged", "status": "completed", "tag": "a9571ca3-08af-4062-8b99-029b7d9d9177"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:48.435314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-336999cf-c9f6-4f14-996a-c21b28cbbe8c req-26968354-7135-4d83-a16c-6e5511977155 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.435851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-336999cf-c9f6-4f14-996a-c21b28cbbe8c req-26968354-7135-4d83-a16c-6e5511977155 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.436285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-336999cf-c9f6-4f14-996a-c21b28cbbe8c req-26968354-7135-4d83-a16c-6e5511977155 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.449153 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-336999cf-c9f6-4f14-996a-c21b28cbbe8c req-26968354-7135-4d83-a16c-6e5511977155 service nova] Creating event network-vif-plugged:a9571ca3-08af-4062-8b99-029b7d9d9177 for instance caf96bbf-ec37-465c-816c-2ecbf0b3263a on n-h2-836830-13 Aug 29 16:03:48.456229 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-336999cf-c9f6-4f14-996a-c21b28cbbe8c req-26968354-7135-4d83-a16c-6e5511977155 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359497 Aug 29 16:03:48.456998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2650/5185] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:48.815761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:48.816917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:48.826733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.827632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.828884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:48.831960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:48.832990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:48.833741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:49.115219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:49.116583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:49.140328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:49.142910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:49.143601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:49.144520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:49.145162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:49.145771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:49.438502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:49.449091 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f12d92b-ef34-4205-9e67-673471416ccf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1323 microversion: 2.1 time: 0.341723 Aug 29 16:03:49.454017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2651/5186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:49 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1323 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:49.471760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:49.472648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:49.482938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:49.483733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:49.484889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:49.490780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:49.491958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:49.492568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:49.769378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:49.777678 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a89fce0-03ef-43ed-9328-034dc034128d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.322228 Aug 29 16:03:49.778815 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2652/5187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:49 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:49.942208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:49.945031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:49.953638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc8d9676-274b-4a2d-aab3-34f3cc713c09 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 1.145181 Aug 29 16:03:49.954817 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2536/5188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:48 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:50.472225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1894c806-01a0-4089-a10e-4badf5cb482e req-30650da7-bbdb-4223-8309-2c3715606910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-plugged", "status": "completed", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:50.474557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:50.475607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:50.483344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.484174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:50.484830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.485951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.486597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:50.486952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1894c806-01a0-4089-a10e-4badf5cb482e req-30650da7-bbdb-4223-8309-2c3715606910 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.487417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.487554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1894c806-01a0-4089-a10e-4badf5cb482e req-30650da7-bbdb-4223-8309-2c3715606910 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:50.487875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1894c806-01a0-4089-a10e-4badf5cb482e req-30650da7-bbdb-4223-8309-2c3715606910 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.521590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1894c806-01a0-4089-a10e-4badf5cb482e req-30650da7-bbdb-4223-8309-2c3715606910 service nova] Creating event network-vif-plugged:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:03:50.527465 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1894c806-01a0-4089-a10e-4badf5cb482e req-30650da7-bbdb-4223-8309-2c3715606910 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058982 Aug 29 16:03:50.528441 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2653/5189] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:50.801942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:50.802330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:50.808872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.809473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:50.809971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.810725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.811279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:50.811763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:50.815609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:50.964621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:50.966782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:50.974680 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5a760fa-3fcf-4fd1-b3d1-1b8b6bf928a3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 0.504534 Aug 29 16:03:50.975653 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2537/5190] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:50 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:50.979149 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4590d39f-3ee1-4a49-8e83-8926e037ae4c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.183140 Aug 29 16:03:50.990922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:50.991758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:50.992655 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2654/5191] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:50 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:50.998622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:50.999329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:51.000414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:51.001094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:51.001656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:51.002826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:51.585933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:51.595296 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6a24754-2a87-4f5f-bbd0-6601b403614f tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1319 microversion: 2.1 time: 0.618405 Aug 29 16:03:51.596440 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2538/5192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:50 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:51.997847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:51.999082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:52.002832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:52.003486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:52.006974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.007705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.008132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.009204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.009836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.010428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.016874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.016874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.017190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.017781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.018253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.018687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.178444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:52.189033 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d03db443-fe2d-4def-bab0-8f2267164f6f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 0.194658 Aug 29 16:03:52.189786 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2655/5193] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:51 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:52.410577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:52.421084 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a5b9d4c7-d670-4d86-bc98-796b65839ef7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1364 microversion: 2.1 time: 0.423228 Aug 29 16:03:52.442264 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2539/5194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:51 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1364 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:52.625290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:52.626284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:52.634829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.635757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.636653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.637657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:52.639081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:52.639730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:52.825293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:52.865105 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc2a3e12-fab9-4124-83b7-a4ead1a1b6df tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1508 microversion: 2.1 time: 0.251745 Aug 29 16:03:52.866469 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2656/5195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:52 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:53.012866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-05203a92-067b-4562-8bbf-2e8fdff17cfb req-1be21928-b765-46ca-86fc-173fa2ac82b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:53.049397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-05203a92-067b-4562-8bbf-2e8fdff17cfb req-1be21928-b765-46ca-86fc-173fa2ac82b0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:53.051937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-05203a92-067b-4562-8bbf-2e8fdff17cfb req-1be21928-b765-46ca-86fc-173fa2ac82b0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:53.053412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-05203a92-067b-4562-8bbf-2e8fdff17cfb req-1be21928-b765-46ca-86fc-173fa2ac82b0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:53.079860 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-05203a92-067b-4562-8bbf-2e8fdff17cfb req-1be21928-b765-46ca-86fc-173fa2ac82b0 service nova] Creating event network-changed:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h2-836830-13 Aug 29 16:03:53.086060 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-05203a92-067b-4562-8bbf-2e8fdff17cfb req-1be21928-b765-46ca-86fc-173fa2ac82b0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080178 Aug 29 16:03:53.087394 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2540/5196] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:53.231842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:53.233057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:53.251537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:53.253710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:53.255471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:53.258867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:53.259614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:53.262900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:53.451536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:53.452578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:53.460219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:53.461093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:53.461763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:53.462698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:53.463459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:53.464118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:53.699307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:53.715801 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c874163b-6ffa-49ff-9034-96439d5b4ba2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 0.505778 Aug 29 16:03:53.719588 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2657/5197] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:53 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:54.168161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:54.177745 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1ab1697-cb2d-44c4-8672-3484e3b0f9b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1552 microversion: 2.1 time: 0.738434 Aug 29 16:03:54.182060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2541/5198] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:53 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1552 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:54.199507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:54.200103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:54.213109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:54.213657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:54.214654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.217975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:54.219480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:54.220393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.391827 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd7b2632-e386-4c62-a7e0-8dde2a883e99 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196988 Aug 29 16:03:54.393313 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2658/5199] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:03:54 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:54.744686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:54.745678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:54.755722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:54.756228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:54.756665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.758413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:54.759695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:54.760128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:54.987974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:55.010882 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5e7d9d2-2544-4e32-96ba-99c1d046e4d3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 0.271775 Aug 29 16:03:55.012390 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2542/5200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:54 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:56.029485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:56.030263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:56.035702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:56.037405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:56.054302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:56.054732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:56.055208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:56.055934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:56.056394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:56.056823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:56.633383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:56.649545 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d594426e-ef0e-4731-9295-eef262684b7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 0.620634 Aug 29 16:03:56.650144 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2659/5201] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:56 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:03:57.542823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:03:57.565800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c80acac2-8610-4def-868c-64a0c808c46b"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:57.569066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:57.594175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.598674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.599251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.601043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.602999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.602999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.614451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e9b0f712-fa7b-49ed-88f3-6051b5d80e53 req-432f9d68-2d99-4fd4-aa8f-a2cefe0afa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:03:57.626144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e9b0f712-fa7b-49ed-88f3-6051b5d80e53 req-432f9d68-2d99-4fd4-aa8f-a2cefe0afa29 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.626943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e9b0f712-fa7b-49ed-88f3-6051b5d80e53 req-432f9d68-2d99-4fd4-aa8f-a2cefe0afa29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.627610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e9b0f712-fa7b-49ed-88f3-6051b5d80e53 req-432f9d68-2d99-4fd4-aa8f-a2cefe0afa29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.639993 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e9b0f712-fa7b-49ed-88f3-6051b5d80e53 req-432f9d68-2d99-4fd4-aa8f-a2cefe0afa29 service nova] Creating event network-changed:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:03:57.646499 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e9b0f712-fa7b-49ed-88f3-6051b5d80e53 req-432f9d68-2d99-4fd4-aa8f-a2cefe0afa29 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117106 Aug 29 16:03:57.647893 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2543/5202] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:57.694271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:57.695282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:57.710619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.711441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.712099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:57.714671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:57.715350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:57.717941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:58.222221 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dd8424ea-44ed-4094-8b43-89a014e57561 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.664051 Aug 29 16:03:58.232785 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2660/5203] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:03:57 2022] POST /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:03:58.245762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:58.247435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:58.275950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:58.283035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:58.285285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:58.291739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:58.293275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:58.297591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:58.390962 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7f97a7b-6bc1-4204-b35e-0692d616cb6f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/ips" status: 200 len: 151 microversion: 2.1 time: 0.155999 Aug 29 16:03:58.412876 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2661/5204] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:03:58 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/ips => generated 151 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:03:58.826831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:03:58.847273 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0d970d5-c06c-4a41-903c-890523335e89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 1.157688 Aug 29 16:03:58.869077 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2544/5205] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:57 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:03:59.896900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:03:59.904961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:03:59.939143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:59.943064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:59.948917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:03:59.950020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:03:59.953969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:03:59.954825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:01.549247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "373b5b07-0151-4369-9192-286d3b1fc69c"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:01.553264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:01.574833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:01.575423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:01.583854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:01.585103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:01.585962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:01.586883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:02.155322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:02.173561 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a3194b0-8b86-4ac0-b83a-088be2991826 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 2.277176 Aug 29 16:04:02.183498 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a75e600f-6d3b-4f86-b9e6-35ea9bc2424f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "POST /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.639338 Aug 29 16:04:02.197456 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2662/5206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:03:59 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:02.218067 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2545/5207] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:04:01 2022] POST /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:03.200180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:03.202932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:03.252605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:03.263714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:03.264599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:03.266039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:03.267144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:03.267944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:03.309401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9c873916-1a21-439d-935a-10e30c1d667b req-3203473f-c0a9-41bb-9ed8-a6950e8cfe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "name": "network-vif-plugged", "status": "completed", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:03.347699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9c873916-1a21-439d-935a-10e30c1d667b req-3203473f-c0a9-41bb-9ed8-a6950e8cfe5e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:03.350326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9c873916-1a21-439d-935a-10e30c1d667b req-3203473f-c0a9-41bb-9ed8-a6950e8cfe5e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:03.352250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9c873916-1a21-439d-935a-10e30c1d667b req-3203473f-c0a9-41bb-9ed8-a6950e8cfe5e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:03.384584 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9c873916-1a21-439d-935a-10e30c1d667b req-3203473f-c0a9-41bb-9ed8-a6950e8cfe5e service nova] Creating event network-vif-plugged:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h2-836830-13 Aug 29 16:04:03.398608 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9c873916-1a21-439d-935a-10e30c1d667b req-3203473f-c0a9-41bb-9ed8-a6950e8cfe5e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093860 Aug 29 16:04:03.401866 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2546/5208] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:04.076940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:04.099825 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e14781b-7925-44d3-a464-912435869e54 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 0.908546 Aug 29 16:04:04.103684 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2663/5209] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:03 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:05.130831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:05.131629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:05.148874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:05.149440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:05.149885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:05.150612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:05.154243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:05.168982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:05.394711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:05.406774 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d51fdffb-7f21-4470-9c9d-5f701d00b245 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1391 microversion: 2.1 time: 0.283642 Aug 29 16:04:05.409115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2547/5210] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:05 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:06.432316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:06.433481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:06.441644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:06.442677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:06.443303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:06.445186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:06.445838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:06.446432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:07.142899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:07.162171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-651eed5c-c180-4fdf-9bc0-170a2d3b3c70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1563 microversion: 2.1 time: 0.733845 Aug 29 16:04:07.171053 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2664/5211] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:06 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1563 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:07.198476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:07.200080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:07.245338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:07.245806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:07.246254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:07.260863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:07.261874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:07.262342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:08.090199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:08.104361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6e19b29-159c-42ce-8fe6-32d017cdf8e6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1563 microversion: 2.1 time: 0.906117 Aug 29 16:04:08.122129 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2548/5212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:07 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1563 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:13.118070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:13.118070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:13.128214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:13.128717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:13.129531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:13.130258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:13.130832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:13.131251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:13.138253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d8c0d541-11c2-4fe8-be1e-c10ce4743d58 req-4658377c-afb8-4ffb-bdc2-f08628c40151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:13.160554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d8c0d541-11c2-4fe8-be1e-c10ce4743d58 req-4658377c-afb8-4ffb-bdc2-f08628c40151 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:13.161044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d8c0d541-11c2-4fe8-be1e-c10ce4743d58 req-4658377c-afb8-4ffb-bdc2-f08628c40151 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:13.161484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d8c0d541-11c2-4fe8-be1e-c10ce4743d58 req-4658377c-afb8-4ffb-bdc2-f08628c40151 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:13.176744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d8c0d541-11c2-4fe8-be1e-c10ce4743d58 req-4658377c-afb8-4ffb-bdc2-f08628c40151 service nova] Creating event network-changed:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h2-836830-13 Aug 29 16:04:13.183373 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d8c0d541-11c2-4fe8-be1e-c10ce4743d58 req-4658377c-afb8-4ffb-bdc2-f08628c40151 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049752 Aug 29 16:04:13.184546 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2549/5213] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:13.748287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:13.778961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57ed9ad4-91ae-41a9-9229-f68cc2a3dc9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1563 microversion: 2.1 time: 0.672667 Aug 29 16:04:13.812918 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2665/5214] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:13 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1563 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:20.881120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:20.894278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:20.901197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=40 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:20.904303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:20.910179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:20.910947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:20.911886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:20.912493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:20.913472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:20.919381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:20.971610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lazy-loading 'flavor' on Instance uuid 877d07e1-ab80-48ee-abda-805c63efa629 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:04:21.340790 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b45ae655-3b89-4803-a6ad-902dfb915343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/action" status: 200 len: 32 microversion: 2.1 time: 0.463937 Aug 29 16:04:21.345015 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2550/5215] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:04:20 2022] POST /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:04:21.353890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:21.355163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:21.358473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:21.378804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:21.381786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:21.382440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.384056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:21.392014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:21.392828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:21.400587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:21.706863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:21.723805 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c3d68ab-7b50-464e-9827-17500bcc246c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.373908 Aug 29 16:04:21.735051 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2666/5216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:21 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:22.750711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:22.751479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:22.765408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:22.765907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:22.774465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:22.775542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:22.778132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:22.783374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:23.568181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:23.597596 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75da2fa2-60aa-4647-8161-6bad71bfaa9d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.853026 Aug 29 16:04:23.600407 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2551/5217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:22 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:24.335578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63e56399-2733-45f0-a8bb-b1438251b4b3 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Action: 'create', calling method: .version_select at 0x7f32ed27e040>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:24.393646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-63e56399-2733-45f0-a8bb-b1438251b4b3 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Getting quotas for project d0feabff683942e39790dd9c2db4c756. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:04:24.416888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-63e56399-2733-45f0-a8bb-b1438251b4b3 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Getting quotas for user 5e4172de0cf949438bd642c9086caa9e and project d0feabff683942e39790dd9c2db4c756. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:04:24.551264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:24.551815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:24.554234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-63e56399-2733-45f0-a8bb-b1438251b4b3 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Getting quotas for project d0feabff683942e39790dd9c2db4c756. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:04:24.573071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.575717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-63e56399-2733-45f0-a8bb-b1438251b4b3 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Getting quotas for user 5e4172de0cf949438bd642c9086caa9e and project d0feabff683942e39790dd9c2db4c756. Resources: {'server_groups'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:04:24.579145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.579608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:24.582416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.599675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.600203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:24.629174 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-63e56399-2733-45f0-a8bb-b1438251b4b3 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] 10.222.0.83 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.538427 Aug 29 16:04:24.629800 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2667/5218] 10.222.0.83 () {62 vars in 1214 bytes} [Mon Aug 29 16:04:24 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:04:24.645706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:24.646328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:24.660364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.672286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.672998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:24.674022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:24.675784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:24.676392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:24.847641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lazy-loading 'services' on Instance uuid 00d339d7-3d48-4b7a-849b-90bfd8088fe5 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:04:25.017512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:25.031620 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79e77bea-9abe-40ce-89fa-26a1d1644e79 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.400045 Aug 29 16:04:25.032880 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2668/5219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:24 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:25.056110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-66642089-3cbc-407a-8800-174e58d0255c tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:25.074290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-66642089-3cbc-407a-8800-174e58d0255c tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.024860 Aug 29 16:04:25.075506 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2669/5220] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 16:04:25 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:04:25.082173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94d665ed-e21f-4905-8054-fa32a47e2c70 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments/373b5b07-0151-4369-9192-286d3b1fc69c" status: 202 len: 0 microversion: 2.1 time: 0.535545 Aug 29 16:04:25.087263 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2552/5221] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:04:24 2022] DELETE /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments/373b5b07-0151-4369-9192-286d3b1fc69c => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:04:25.094225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d46d0643-24a9-4d4a-aa21-52a50d1dc16d tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:25.103462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:25.108761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:25.140313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:25.142741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:25.145183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:25.145657 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d46d0643-24a9-4d4a-aa21-52a50d1dc16d tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] 10.222.0.83 "GET /compute/v2.1/os-server-groups/092ed066-8a04-466f-a91e-884f4555574f" status: 200 len: 235 microversion: 2.64 time: 0.060390 Aug 29 16:04:25.148008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:25.148466 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2670/5222] 10.222.0.83 () {60 vars in 1304 bytes} [Mon Aug 29 16:04:25 2022] GET /compute/v2.1/os-server-groups/092ed066-8a04-466f-a91e-884f4555574f => generated 235 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:04:25.149168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:25.150636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:25.167929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-688e26b1-db5f-4e3a-90b9-f1c66c6bc662 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:25.229754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-688e26b1-db5f-4e3a-90b9-f1c66c6bc662 tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/092ed066-8a04-466f-a91e-884f4555574f" status: 204 len: 0 microversion: 2.64 time: 0.074723 Aug 29 16:04:25.232535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2671/5223] 10.222.0.83 () {60 vars in 1307 bytes} [Mon Aug 29 16:04:25 2022] DELETE /compute/v2.1/os-server-groups/092ed066-8a04-466f-a91e-884f4555574f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:04:25.240546 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f3364b69-fcf1-40d9-a4a6-afe55f70ed27 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149799 Aug 29 16:04:25.251502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb08bdf1-5d8c-48da-8c4b-18b52e05e6fa tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:25.254882 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2553/5224] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:25 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:25.289263 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-cb08bdf1-5d8c-48da-8c4b-18b52e05e6fa tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] HTTP exception thrown: Instance group 092ed066-8a04-466f-a91e-884f4555574f could not be found. Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb08bdf1-5d8c-48da-8c4b-18b52e05e6fa tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Request method failure captured: Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/os-server-groups/092ed066-8a04-466f-a91e-884f4555574f HTTP/1.1 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOOHRu4hj4Urwog3XNaFnxijrB4FIiOPK-gbKF8Aw_hwFKVwxIudbumtOUv3CDPPNBL3Ie7jFbgo9aR_zBYKZjYlQJJ01vUIhilPkPTT9sSm1jfkKCxNOQCTpSOtdTXYggwTTbJvccdNDwxZyAA0q2WS9PCreVpwpe0JNeOtfXUL5SA Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.64 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: d0feabff683942e39790dd9c2db4c756 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerGroup264TestJSON-163856768 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d0feabff683942e39790dd9c2db4c756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d0feabff683942e39790dd9c2db4c756", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d0feabff683942e39790dd9c2db4c756"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d0feabff683942e39790dd9c2db4c756"}]}] Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerGroup264TestJSON-163856768 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: d0feabff683942e39790dd9c2db4c756 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerGroup264TestJSON-163856768 Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerGroup264TestJSON-163856768-project Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 5e4172de0cf949438bd642c9086caa9e Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerGroup264TestJSON-163856768-project Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance group 092ed066-8a04-466f-a91e-884f4555574f could not be found. Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '092ed066-8a04-466f-a91e-884f4555574f'} Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 092ed066-8a04-466f-a91e-884f4555574f could not be found. Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 092ed066-8a04-466f-a91e-884f4555574f could not be found. Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:25.291790 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:25.295697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:25.295697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:25.295697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:04:25.295697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:04:25.295697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 092ed066-8a04-466f-a91e-884f4555574f could not be found. Aug 29 16:04:25.295697 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:25.297650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb08bdf1-5d8c-48da-8c4b-18b52e05e6fa tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] Returning 404 to user: Instance group 092ed066-8a04-466f-a91e-884f4555574f could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:04:25.299376 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb08bdf1-5d8c-48da-8c4b-18b52e05e6fa tempest-ServerGroup264TestJSON-163856768 tempest-ServerGroup264TestJSON-163856768-project] 10.222.0.83 "DELETE /compute/v2.1/os-server-groups/092ed066-8a04-466f-a91e-884f4555574f" status: 404 len: 117 microversion: 2.64 time: 0.057348 Aug 29 16:04:25.300170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2672/5225] 10.222.0.83 () {60 vars in 1307 bytes} [Mon Aug 29 16:04:25 2022] DELETE /compute/v2.1/os-server-groups/092ed066-8a04-466f-a91e-884f4555574f => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:04:26.054234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:26.054865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:26.074731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:26.076825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:26.077290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:26.078093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:26.078564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:26.078999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:26.267477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:26.270563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:26.305190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:26.305795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:26.306386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:26.307361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:26.308162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:26.308713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:26.420216 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67755d34-916f-47e5-b3d5-2b7881aa9ddf tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155662 Aug 29 16:04:26.427749 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2673/5226] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:26 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:26.784605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:26.840354 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9cb08c93-673c-4cdc-8b75-13317160edf1 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.788080 Aug 29 16:04:26.841001 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2554/5227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:26 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:27.434885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:27.451882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:27.461502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:27.462307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:27.462920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:27.464921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:27.465572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:27.467058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:27.539392 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a1d74287-7bd6-40fa-b544-47d9dd040de0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106439 Aug 29 16:04:27.547517 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2674/5228] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:27 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:27.862797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:27.863339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:27.885402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:27.885933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:27.891790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:27.893123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:27.893618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:27.895795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:28.553230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:28.556441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:28.574295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:28.577071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:28.579813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:28.580866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:28.582803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:28.585936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:28.672810 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e616d257-6499-4e17-ab05-59c0c02c89e7 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123793 Aug 29 16:04:28.681751 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2675/5229] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:28 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:28.698141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:28.710272 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0472f243-af85-41da-844c-7491024d7043 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.851322 Aug 29 16:04:28.720160 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2555/5230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:27 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:29.462213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b4fc40-dc16-476a-8728-8aa0472b625f", "device": "/dev/sdb"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:29.465266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:29.474797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.475607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.476268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:29.477388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.490384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.491195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:29.693527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:29.697096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:29.711709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.712217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.712654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:29.713372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.713824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.714250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:29.807286 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dc59579d-30bb-49f3-8349-e631c4fcbb97 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112612 Aug 29 16:04:29.808536 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2556/5231] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:29 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:29.817672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:29.819362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:29.841612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.842085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.842541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:29.844651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:29.845152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:29.846103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.000140 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9fb3509b-3a18-4b08-be9b-b553cda06256 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "POST /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535996 Aug 29 16:04:30.000850 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2676/5232] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:04:29 2022] POST /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:30.025235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:30.031415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:30.042697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.045349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.046063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.046962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.047607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.048302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.364573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:30.377367 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aead2393-a5c4-4799-8043-8b6e4bdeb1fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.372346 Aug 29 16:04:30.377982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2677/5233] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:30 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:30.403709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:30.404359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:30.418794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.424204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.424678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.425495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.425977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.426571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.806797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:30.822926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:30.824693 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d2d17802-4663-4b10-8c9b-c11b537ffc38 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 1.014231 Aug 29 16:04:30.828527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2557/5234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:29 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:30.835016 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4865cd00-5338-472e-a675-6f1845f59bf5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.437021 Aug 29 16:04:30.838386 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2678/5235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:30 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:30.839795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:30.856059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:30.865330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:30.866783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:30.877440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.878252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.878930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.879929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.880606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.880713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.881212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.881469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.882106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.882969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:30.883598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:30.884171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:30.956457 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e630e9bc-c18a-40ad-86e6-4ecb1f684c59 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116043 Aug 29 16:04:30.965063 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2558/5236] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:30 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:31.320093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:31.330138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e980dfc-e5f3-4e23-a6bb-2462a3df8024 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.468658 Aug 29 16:04:31.332431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2679/5237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:30 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:31.368162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-908967869"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:31.376736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:31.388238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:31.389448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:31.391381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:31.392521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:31.393161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:31.394906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:31.797385 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b3822c25-9084-4700-b339-333741392e1c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.446596 Aug 29 16:04:31.798350 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2559/5238] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:04:31 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 16:04:31.861169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:31.861802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:31.877303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:31.878683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:31.881049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:31.882750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:31.884605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:31.885802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:31.973379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:31.976176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:31.992479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:31.996042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:31.997792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:31.998709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:32.000206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:32.000810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:32.071538 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c653cc50-eb7c-4162-a857-d96f0846e2a9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104844 Aug 29 16:04:32.072509 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2560/5239] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:31 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:32.142175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:32.153449 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e9b90611-be7a-4f67-a9f1-9d9367660821 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.297444 Aug 29 16:04:32.155379 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2680/5240] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:31 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:33.090142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:33.099097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:33.111142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:33.113305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:33.114561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:33.115537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:33.117409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:33.119438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:33.176283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:33.177369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:33.182694 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0922217-3950-4d34-9ebb-7523db2162e8 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102572 Aug 29 16:04:33.183821 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2561/5241] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:33 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:33.191900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:33.192633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:33.193372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:33.194363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:33.194974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:33.195884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:33.456364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:33.464889 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d04c5a4-be99-4ec2-8914-555b52e4a57f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.292479 Aug 29 16:04:33.479431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2681/5242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:33 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:34.194950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:34.197258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:34.205291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:34.205785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:34.206294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:34.207008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:34.208132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:34.208730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:34.240635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:34.244297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4caabe23-aee8-4504-8772-00423b8c4064 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053322 Aug 29 16:04:34.250224 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2562/5243] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:34 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:34.486183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:34.487462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:34.499803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:34.503349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:34.503986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:34.504883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:34.505504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:34.507072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:34.612848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:34.769032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:34.782509 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a1e69e30-cee3-4936-a264-3691a8ee52bc tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.300534 Aug 29 16:04:34.787174 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2682/5244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:34 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:35.261997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:35.266121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:35.286439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:35.286945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:35.287437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:35.288168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:35.288639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:35.289079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:35.348193 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3b3e12fe-efb7-4ba0-a92b-ab9bae350f85 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094275 Aug 29 16:04:35.349145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2563/5245] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:35 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:04:35.805094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:35.806239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:35.816738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:35.817241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:35.817688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:35.818400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:35.818862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:35.819333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:36.134525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:36.149211 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c745e4cc-dfce-4479-8e84-6ba42034e6d5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.348142 Aug 29 16:04:36.165116 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2683/5246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:35 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:36.362308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:36.366808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:36.411451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:36.412318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:36.413547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:36.416478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:36.421853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:36.422247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:36.526974 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-beda37a5-72ac-474d-adf5-13916f54e5dd tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.170253 Aug 29 16:04:36.527620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2564/5247] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:04:36 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:04:36.678909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:36.679515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:36.692801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:36.693310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:36.693758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:36.698799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:36.701890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:36.702574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:36.779835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:04:36.919763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:36.999130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd9c34ab-dcc2-48b5-9349-b46c327da44f tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 204 len: 0 microversion: 2.1 time: 0.333833 Aug 29 16:04:37.003277 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2684/5248] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:04:36 2022] DELETE /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:04:37.008315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:37.009126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:37.030187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:37.034820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:37.052454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:37.067665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:37.068283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:37.068732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:37.176018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:37.176740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:37.196878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:37.197691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:37.198306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:37.201240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:37.202318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:37.203473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:37.469571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:37.504153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf385367-7c75-4d0d-a512-a36f82d49549 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1682 microversion: 2.1 time: 0.498954 Aug 29 16:04:37.505952 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2565/5249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:37 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1682 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:37.599091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:37.608414 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-94cb4e76-8df2-4668-9e7d-55ce6bf66a19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.438194 Aug 29 16:04:37.624804 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2685/5250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:37 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:04:38.531764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:38.533023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:38.550440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:38.561134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:38.567715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:38.577238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:38.581353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:38.582103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:38.634859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:38.636131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:38.670249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:38.673904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:38.675849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:38.677629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:38.678479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:38.680381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:39.148412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:39.169513 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17c7ac93-6e4e-4207-ba2b-6d48705ec11c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.538433 Aug 29 16:04:39.193483 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2686/5251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:38 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:39.476473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:39.485930 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d5dba09-ed50-4b38-b346-d16ec1f379b5 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1682 microversion: 2.1 time: 0.962797 Aug 29 16:04:39.505991 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2566/5252] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:38 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1682 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:40.192493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:40.193785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:40.205578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:40.206067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:40.209082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:40.211733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:40.212533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:40.214787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:40.510950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:40.512205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:40.530095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:40.534458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:40.536499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:40.540919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:40.550297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:40.554510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:40.578255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:40.588489 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa81ad0c-d309-4127-8dc3-b0ff469e35e6 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.399993 Aug 29 16:04:40.589710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2687/5253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:40 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:41.003571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ac395285-b570-45c7-9da4-04b9e87dd93a req-1184fad7-aff3-4f25-85ef-bd1dd9bf2a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-plugged", "status": "completed", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:41.032708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ac395285-b570-45c7-9da4-04b9e87dd93a req-1184fad7-aff3-4f25-85ef-bd1dd9bf2a70 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.033420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ac395285-b570-45c7-9da4-04b9e87dd93a req-1184fad7-aff3-4f25-85ef-bd1dd9bf2a70 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.035063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ac395285-b570-45c7-9da4-04b9e87dd93a req-1184fad7-aff3-4f25-85ef-bd1dd9bf2a70 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.065899 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ac395285-b570-45c7-9da4-04b9e87dd93a req-1184fad7-aff3-4f25-85ef-bd1dd9bf2a70 service nova] Creating event network-vif-plugged:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:04:41.081792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ac395285-b570-45c7-9da4-04b9e87dd93a req-1184fad7-aff3-4f25-85ef-bd1dd9bf2a70 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082627 Aug 29 16:04:41.086920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2688/5254] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:41.364215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:41.388350 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81893b3a-8f95-4e97-8509-b40113270c46 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1682 microversion: 2.1 time: 0.865370 Aug 29 16:04:41.391653 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2567/5255] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:40 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1682 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:04:41.620353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:41.620994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:41.649446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.649959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.650412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:41.651179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:41.651649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:41.652093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:42.112615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c2080dcf-b0e3-4fbc-adba-2b3b4daa0f81 req-7ad7ec43-6fbb-44c7-b29b-1dc52087bf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d339d7-3d48-4b7a-849b-90bfd8088fe5", "name": "network-vif-deleted", "tag": "bfc0d741-ac38-475d-9dcb-b439dc11c07f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:42.128336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c2080dcf-b0e3-4fbc-adba-2b3b4daa0f81 req-7ad7ec43-6fbb-44c7-b29b-1dc52087bf66 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:42.134347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c2080dcf-b0e3-4fbc-adba-2b3b4daa0f81 req-7ad7ec43-6fbb-44c7-b29b-1dc52087bf66 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:42.134944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c2080dcf-b0e3-4fbc-adba-2b3b4daa0f81 req-7ad7ec43-6fbb-44c7-b29b-1dc52087bf66 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:42.163589 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c2080dcf-b0e3-4fbc-adba-2b3b4daa0f81 req-7ad7ec43-6fbb-44c7-b29b-1dc52087bf66 service nova] Creating event network-vif-deleted:bfc0d741-ac38-475d-9dcb-b439dc11c07f for instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 on n-h2-836830-13 Aug 29 16:04:42.176816 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c2080dcf-b0e3-4fbc-adba-2b3b4daa0f81 req-7ad7ec43-6fbb-44c7-b29b-1dc52087bf66 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068196 Aug 29 16:04:42.182430 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2568/5256] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:04:42.416763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:42.418740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:42.434781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:42.439409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:42.440162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:42.440295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:42.441689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:42.442358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:42.442979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:42.469459 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f43c200b-9f6d-44ab-b271-3bc488a5525a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.847093 Aug 29 16:04:42.493035 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2689/5257] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:41 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:42.567333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:42.568307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:42.569081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:42.569780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lazy-loading 'fault' on Instance uuid 00d339d7-3d48-4b7a-849b-90bfd8088fe5 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:04:42.695644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1c8b71252e84112bb1fd0513cf49f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b585ff61700d433e8b6c74e059537135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:42.732773 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-51c70d42-0d5c-4db1-8d35-8bd1b3ec96c9 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 200 len: 1331 microversion: 2.1 time: 0.313905 Aug 29 16:04:42.736106 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2569/5258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:42 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 1331 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:43.498170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:43.498786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:43.517951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.518520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.518973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:43.519726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.520215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.520653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:43.758487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:43.759163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:43.775717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.776316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.776773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:43.777609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:43.778067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:43.778492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:43.849702 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 HTTP/1.1 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '00d339d7-3d48-4b7a-849b-90bfd8088fe5'} Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:43.855655 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:43.859690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:43.859690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:43.859690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:43.859690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:04:43.859690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:04:43.859690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:43.859690 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:43.861786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:04:43.862800 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9a648da-2dcb-48da-a5ce-af194314a485 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 404 len: 111 microversion: 2.1 time: 0.109292 Aug 29 16:04:43.863408 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2570/5259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:43 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:04:43.889422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-017ee804-10e2-473d-929f-756d20c11c33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '.version_select at 0x7f32edc0faf0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:43.945023 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-017ee804-10e2-473d-929f-756d20c11c33 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873209268" status: 202 len: 0 microversion: 2.1 time: 0.070099 Aug 29 16:04:43.946301 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2571/5260] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 16:04:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873209268 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:04:44.085504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:44.094307 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-727003de-7e4c-40a4-80da-ba8e0ec7cff2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.599846 Aug 29 16:04:44.103556 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2690/5261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:43 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:45.127210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:45.128348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:45.147639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:45.149887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:45.152476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:45.154526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:45.158014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:45.160497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:46.568885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:46.582668 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9aba88ef-61bf-46d1-a094-73b650d542f7 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 1.460536 Aug 29 16:04:46.614008 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2572/5262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:45 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:46.624579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:46.627197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:46.643674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:46.649192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:46.650168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:46.652601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:46.657206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:46.658513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:46.759219 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-94fc2ce7-83b4-416d-af1c-fe17eb991678 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action" status: 200 len: 24550 microversion: 2.1 time: 0.138392 Aug 29 16:04:46.760672 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2691/5263] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:04:46 2022] POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action => generated 24550 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:04:47.610739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:47.611410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:47.626181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:47.626690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:47.634791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:47.637865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:47.638366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:47.638810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:48.007747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:48.019038 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69f94308-c339-4cb0-94bc-b056ca68fe19 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.412931 Aug 29 16:04:48.023382 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2573/5264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:47 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:49.050930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:49.051692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:49.087723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:49.088428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:49.089034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:49.096125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:49.096617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:49.097059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:49.475237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:49.493834 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-00285135-5e93-4ec6-b4d6-428227818df5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.450055 Aug 29 16:04:49.497308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2692/5265] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:49 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:50.524104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:50.525404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:50.538674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:50.542302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:50.543150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:50.544037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:50.544808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:50.546279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:51.070914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:51.095867 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0dfc1e81-1a56-4bfd-875e-f249f97d0343 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1737 microversion: 2.1 time: 0.576165 Aug 29 16:04:51.115484 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2574/5266] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:50 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1737 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:52.122345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:52.122903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:52.127512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:52.162113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.162626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.167360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.168136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.168625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.179624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.509545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:52.532624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-80830198-0547-41f9-959d-16af40e8b928 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1717 microversion: 2.1 time: 0.416207 Aug 29 16:04:52.536110 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2693/5267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:52 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1717 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:52.698739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:52.699322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:52.712477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:04:52.721424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.721939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.722389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.741537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.742045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.742572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.772070 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 HTTP/1.1 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '00d339d7-3d48-4b7a-849b-90bfd8088fe5'} Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:04:52.773679 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.777130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:04:52.787458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-350bf0bd-c2cc-4fc2-a185-12bbee4af4d1 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 404 len: 111 microversion: 2.1 time: 0.080662 Aug 29 16:04:52.798371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:52.798998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 00d339d7-3d48-4b7a-849b-90bfd8088fe5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:52.804145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2575/5268] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:04:52 2022] DELETE /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:04:52.814506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.816624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.817233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.818120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.819393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.820617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.836353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:52.837082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:52.863720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.864223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.869046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.870175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:52.872118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:52.873956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:52.894078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 HTTP/1.1 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '00d339d7-3d48-4b7a-849b-90bfd8088fe5'} Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:52.895810 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 00d339d7-3d48-4b7a-849b-90bfd8088fe5 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-451935ad-146e-458b-9ed8-7538f6556a2a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5" status: 404 len: 111 microversion: 2.1 time: 0.104649 Aug 29 16:04:52.901920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2694/5269] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:52 2022] GET /compute/v2.1/servers/00d339d7-3d48-4b7a-849b-90bfd8088fe5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:04:53.107707 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Cannot 'detach_volume' instance 877d07e1-ab80-48ee-abda-805c63efa629 while it is in vm_state rescued Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments/c80acac2-8610-4def-868c-64a0c808c46b HTTP/1.1 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'detach_volume' instance 877d07e1-ab80-48ee-abda-805c63efa629 while it is in vm_state rescued Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': '877d07e1-ab80-48ee-abda-805c63efa629', 'id': 'c80acac2-8610-4def-868c-64a0c808c46b'} Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 877d07e1-ab80-48ee-abda-805c63efa629 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 877d07e1-ab80-48ee-abda-805c63efa629 while it is in vm_state rescued Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:53.122396 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:04:53.130869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:04:53.130869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:04:53.130869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:04:53.130869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:04:53.130869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 877d07e1-ab80-48ee-abda-805c63efa629 while it is in vm_state rescued Aug 29 16:04:53.130869 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:04:53.141700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 409 to user: Cannot 'detach_volume' instance 877d07e1-ab80-48ee-abda-805c63efa629 while it is in vm_state rescued {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:04:53.150135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17c4ab65-ad16-4176-bcc8-1f3df7d2e78a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "DELETE /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments/c80acac2-8610-4def-868c-64a0c808c46b" status: 409 len: 152 microversion: 2.1 time: 0.313785 Aug 29 16:04:53.152497 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2576/5270] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:04:52 2022] DELETE /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments/c80acac2-8610-4def-868c-64a0c808c46b => generated 152 bytes in 322 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 16:04:53.161153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:04:53.162410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:53.189035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:53.192501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:53.194795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:53.196030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:53.199762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:53.203319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:53.538556 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc38dc09-fc75-442e-a5a6-82c4cebc9e83 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/action" status: 202 len: 0 microversion: 2.1 time: 0.376442 Aug 29 16:04:53.553325 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2695/5271] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:04:53 2022] POST /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:04:53.563352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:53.564211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:53.594898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:53.597990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:53.598663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:53.604824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:53.607782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:53.609742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:54.024536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:54.036088 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cc16238f-d16f-4677-a0c0-2c8c6fa3aa62 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1725 microversion: 2.1 time: 0.480956 Aug 29 16:04:54.048441 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2577/5272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:53 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1725 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:55.070737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:55.074367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:55.116295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:55.119505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:55.125799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:55.133425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:55.158467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:55.161409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:56.107879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:56.126222 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2cdadf6a-a210-4a05-84b3-a7756769041f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1725 microversion: 2.1 time: 1.060810 Aug 29 16:04:56.148366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2696/5273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:55 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1725 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:57.171864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:57.174345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:57.194760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.195308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.195746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:57.204788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.205325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.205776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:57.607436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:04:57.619579 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62ddc1a7-86a1-4224-aa57-cc8da68f8653 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1731 microversion: 2.1 time: 0.452813 Aug 29 16:04:57.625813 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2578/5274] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:04:57 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1731 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:04:57.664499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:04:57.665024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:04:57.691373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.693174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.694159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:57.696297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:04:57.699120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:04:57.700464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:04:58.033787 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a48d172b-84e1-42ee-b519-3550da2b57c8 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.380065 Aug 29 16:04:58.035206 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2697/5275] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:04:57 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-interface => generated 285 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:01.375656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:01.376182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:01.390020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.415068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.416166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.417087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.421766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.422483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.538027 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 HTTP/1.1 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '65fc5de0-11ee-454e-a7d9-941f08fef311'} Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:01.539691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:01.543229 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-93e7d51c-7533-426d-b89d-0593ed8c08ae tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 404 len: 111 microversion: 2.1 time: 0.170782 Aug 29 16:05:01.553330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:01.554130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 65fc5de0-11ee-454e-a7d9-941f08fef311] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:01.577677 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2579/5276] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:01 2022] DELETE /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:01.584076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.584684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.585120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.585832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.586283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.586702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.702883 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 HTTP/1.1 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '65fc5de0-11ee-454e-a7d9-941f08fef311'} Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:01.717266 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.724672 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.724672 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:01.724672 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:01.724672 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:01.724672 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:01.724672 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. Aug 29 16:05:01.724672 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.727970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 65fc5de0-11ee-454e-a7d9-941f08fef311 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:01.740692 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76944f5a-3ca5-4a7e-84b4-642360293098 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311" status: 404 len: 111 microversion: 2.1 time: 0.192326 Aug 29 16:05:01.746975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2698/5277] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:01 2022] GET /compute/v2.1/servers/65fc5de0-11ee-454e-a7d9-941f08fef311 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:01.757911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:01.758645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:01.776855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.787881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.788570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.789518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.790143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.791106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.837671 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c HTTP/1.1 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e7124a92-4c7c-4c37-b7c8-82a9555d234c'} Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:01.849006 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:01.852922 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:01.854839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:01.856629 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aa40d49b-29fc-4ceb-a8ef-bcd32e202b6b tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 404 len: 111 microversion: 2.1 time: 0.107593 Aug 29 16:05:01.857751 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2580/5278] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:01 2022] DELETE /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:01.869797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:01.886430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: e7124a92-4c7c-4c37-b7c8-82a9555d234c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:01.919319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.920923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.925286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:01.927636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:01.945185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:01.948056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.015529 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c HTTP/1.1 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'e7124a92-4c7c-4c37-b7c8-82a9555d234c'} Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:02.024826 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:02.028821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance e7124a92-4c7c-4c37-b7c8-82a9555d234c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:02.031232 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6bb098a7-fecb-436d-81d7-2eeaec45ad8a tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c" status: 404 len: 111 microversion: 2.1 time: 0.168249 Aug 29 16:05:02.037012 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2699/5279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:01 2022] GET /compute/v2.1/servers/e7124a92-4c7c-4c37-b7c8-82a9555d234c => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:05:02.396357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:02.398713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:02.407886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fee7b1f7-c923-4f83-a7cc-1a8fa372a04b req-1ea503f1-a6d1-4a8c-8ed0-dad48b49281e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877d07e1-ab80-48ee-abda-805c63efa629", "tag": "2210e537-a1a0-4e7d-b359-02a48cb5d032"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:02.430032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.434429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.435470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.439327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.442015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fee7b1f7-c923-4f83-a7cc-1a8fa372a04b req-1ea503f1-a6d1-4a8c-8ed0-dad48b49281e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:02.442178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.442737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.448147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fee7b1f7-c923-4f83-a7cc-1a8fa372a04b req-1ea503f1-a6d1-4a8c-8ed0-dad48b49281e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:02.449924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fee7b1f7-c923-4f83-a7cc-1a8fa372a04b req-1ea503f1-a6d1-4a8c-8ed0-dad48b49281e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:02.516947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fee7b1f7-c923-4f83-a7cc-1a8fa372a04b req-1ea503f1-a6d1-4a8c-8ed0-dad48b49281e service nova] Creating event network-changed:2210e537-a1a0-4e7d-b359-02a48cb5d032 for instance 877d07e1-ab80-48ee-abda-805c63efa629 on n-h1-836830-13 Aug 29 16:05:02.540621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fee7b1f7-c923-4f83-a7cc-1a8fa372a04b req-1ea503f1-a6d1-4a8c-8ed0-dad48b49281e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131354 Aug 29 16:05:02.541294 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2700/5280] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:03.034789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:03.043734 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-12b49eea-d166-42db-a60d-673bd95616aa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.663932 Aug 29 16:05:03.048152 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2581/5281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:02 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:04.073019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:04.074647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:04.090048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.090861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.093959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.095105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.101420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.102244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.585010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-831b80f5-d6e6-44cb-b0fc-6a7657084731 req-78c10231-d2d6-4fde-b541-ea169b11ff92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877d07e1-ab80-48ee-abda-805c63efa629", "tag": "2210e537-a1a0-4e7d-b359-02a48cb5d032"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:04.608700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-831b80f5-d6e6-44cb-b0fc-6a7657084731 req-78c10231-d2d6-4fde-b541-ea169b11ff92 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.613358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-831b80f5-d6e6-44cb-b0fc-6a7657084731 req-78c10231-d2d6-4fde-b541-ea169b11ff92 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.615806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-831b80f5-d6e6-44cb-b0fc-6a7657084731 req-78c10231-d2d6-4fde-b541-ea169b11ff92 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.640135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-831b80f5-d6e6-44cb-b0fc-6a7657084731 req-78c10231-d2d6-4fde-b541-ea169b11ff92 service nova] Creating event network-changed:2210e537-a1a0-4e7d-b359-02a48cb5d032 for instance 877d07e1-ab80-48ee-abda-805c63efa629 on n-h1-836830-13 Aug 29 16:05:04.664885 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-831b80f5-d6e6-44cb-b0fc-6a7657084731 req-78c10231-d2d6-4fde-b541-ea169b11ff92 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084800 Aug 29 16:05:04.666524 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2582/5282] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:04.677294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:04.690772 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7321aa64-dd84-45ae-b791-c7521113a8f5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.624082 Aug 29 16:05:04.694812 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2701/5283] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:04 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:04.723586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2115069701"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:04.730390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:04.769594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.772546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.773370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:04.774217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:04.774998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:04.777489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:05.295084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:05.407147 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-91be0445-3bc2-4307-b140-2e4081594ff0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.689157 Aug 29 16:05:05.412985 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2583/5284] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:04 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 29 16:05:06.757002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e87374f1-2e1a-42fb-9280-81c19ddf9540 req-908f4877-b60a-46df-9a35-e9db19a54aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:06.780305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e87374f1-2e1a-42fb-9280-81c19ddf9540 req-908f4877-b60a-46df-9a35-e9db19a54aea service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:06.780795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e87374f1-2e1a-42fb-9280-81c19ddf9540 req-908f4877-b60a-46df-9a35-e9db19a54aea service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:06.781226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e87374f1-2e1a-42fb-9280-81c19ddf9540 req-908f4877-b60a-46df-9a35-e9db19a54aea service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:06.848181 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e87374f1-2e1a-42fb-9280-81c19ddf9540 req-908f4877-b60a-46df-9a35-e9db19a54aea service nova] Creating event network-vif-unplugged:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:05:06.865480 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e87374f1-2e1a-42fb-9280-81c19ddf9540 req-908f4877-b60a-46df-9a35-e9db19a54aea service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110158 Aug 29 16:05:06.866993 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2702/5285] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:07.964841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:07.966662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:07.984169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:07.985631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:07.986324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:07.988189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:07.990052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:07.991243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:08.020165 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b HTTP/1.1 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1437eae0-dfed-4046-b2a9-3ac8b9783e9b'} Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:08.024387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.027721 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.030283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:08.031425 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82e6ff39-cf2c-4e3f-be17-ccfa6e0e9fe0 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 404 len: 111 microversion: 2.1 time: 0.074640 Aug 29 16:05:08.032520 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2584/5286] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:07 2022] DELETE /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:08.042410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:08.043318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] [instance: 1437eae0-dfed-4046-b2a9-3ac8b9783e9b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:08.055129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:08.055638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:08.056079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:08.056794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:08.057252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:08.057683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:08.070458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=85,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:08.102044 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] HTTP exception thrown: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Request method failure captured: Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b HTTP/1.1 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOF03Vs5hO0H8Ck13Rf7F35OK8Bgi9DbmSTRDQ_xYOrM4j93tySr-Xunu7UUWRtjS2ShuaCsgdeSJ-WS2Im275hny4naB0zH0aFqSrV4i9KGAKYOKw3GkDu3Y4YDkX1tBvOMi-NNj1Y1jI5ewowcYpoy2s_yeGgjeB94Nkf-sp5tbBQ Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b585ff61700d433e8b6c74e059537135", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b585ff61700d433e8b6c74e059537135"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b585ff61700d433e8b6c74e059537135"}]}] Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b585ff61700d433e8b6c74e059537135 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1561489256 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c1c8b71252e84112bb1fd0513cf49f69 Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeNegativeTest-1561489256-project Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '1437eae0-dfed-4046-b2a9-3ac8b9783e9b'} Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:08.104448 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:08.110558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] Returning 404 to user: Instance 1437eae0-dfed-4046-b2a9-3ac8b9783e9b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:08.111914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f527356e-ad77-43f3-8013-e744000ac606 tempest-AttachVolumeNegativeTest-1561489256 tempest-AttachVolumeNegativeTest-1561489256-project] 10.222.0.83 "GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b" status: 404 len: 111 microversion: 2.1 time: 0.072666 Aug 29 16:05:08.113126 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2703/5287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:08 2022] GET /compute/v2.1/servers/1437eae0-dfed-4046-b2a9-3ac8b9783e9b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:12.470529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a2f6d771-1fc0-436b-ac9a-442fd7aa2646 req-7ab27a03-b64e-4d49-b0c4-6f0f39c04e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-plugged", "status": "completed", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:12.509110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a2f6d771-1fc0-436b-ac9a-442fd7aa2646 req-7ab27a03-b64e-4d49-b0c4-6f0f39c04e94 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:12.510409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a2f6d771-1fc0-436b-ac9a-442fd7aa2646 req-7ab27a03-b64e-4d49-b0c4-6f0f39c04e94 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:12.523174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a2f6d771-1fc0-436b-ac9a-442fd7aa2646 req-7ab27a03-b64e-4d49-b0c4-6f0f39c04e94 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:12.539407 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a2f6d771-1fc0-436b-ac9a-442fd7aa2646 req-7ab27a03-b64e-4d49-b0c4-6f0f39c04e94 service nova] Creating event network-vif-plugged:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:05:12.559966 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a2f6d771-1fc0-436b-ac9a-442fd7aa2646 req-7ab27a03-b64e-4d49-b0c4-6f0f39c04e94 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093295 Aug 29 16:05:12.564098 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2585/5288] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:17.766746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:17.768858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:17.796385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:17.797171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:17.799339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:17.804095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:17.804736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:17.806427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:18.001887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lazy-loading 'services' on Instance uuid caf96bbf-ec37-465c-816c-2ecbf0b3263a {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:05:18.225786 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae604d76-23bd-4726-ae27-7f85a86e97e9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "DELETE /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a/os-volume_attachments/99b4fc40-dc16-476a-8728-8aa0472b625f" status: 202 len: 0 microversion: 2.1 time: 0.471991 Aug 29 16:05:18.227433 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2704/5289] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:05:17 2022] DELETE /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a/os-volume_attachments/99b4fc40-dc16-476a-8728-8aa0472b625f => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:05:25.552113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=21 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:25.554202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:25.577083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:25.582798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:25.613460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:25.614378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:25.618177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:25.619271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:25.621985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:25.624163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:26.734173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2255c5ae-471e-481d-b937-01c7e0eb6f8d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1835 microversion: 2.1 time: 1.183176 Aug 29 16:05:26.743907 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2586/5290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:25 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1835 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:26.758948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:26.760109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:26.775230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=24 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:26.784790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:26.785448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:26.785908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:26.786650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:26.787152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:26.787602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:27.518992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:27.560124 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a26db09-9ca2-4834-87a3-4fcf36bcdde4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1682 microversion: 2.1 time: 0.802507 Aug 29 16:05:27.581163 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2705/5291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:26 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1682 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:27.896612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:27.899365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:27.929315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:27.936656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:27.940917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:27.941966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:27.947069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:27.950253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:28.097091 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bb37f6d5-057b-4bf5-9d93-5b94c6682ca5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action" status: 200 len: 32627 microversion: 2.1 time: 0.205246 Aug 29 16:05:28.098668 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2587/5292] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:27 2022] POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action => generated 32627 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:05:28.242371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:28.242929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:28.252333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:28.253087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:28.253698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:28.254586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:28.255222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:28.255854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:28.914479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eaf0b86011214b97b4f024c97dba2422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4555b1319975418da819b6e0eefb32cf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:28.915366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] flavor_id is None. Assuming migration. {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 16:05:28.916221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:05:29.776354 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b3bc3059-92b3-4e22-ad57-57b1b8cb58c2 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action" status: 202 len: 0 microversion: 2.1 time: 1.534743 Aug 29 16:05:29.780521 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2706/5293] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:28 2022] POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action => generated 0 bytes in 1542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:05:29.789133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:29.789508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:29.805381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:29.811008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:29.812303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:29.813251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:29.813734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:29.814171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:29.997524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:29.998151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:30.010771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:30.011555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:30.012316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:30.023337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:30.027944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:30.028663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:30.130496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:30.182740 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e14f1c22-639d-47bc-b837-948524c2cb7e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1691 microversion: 2.1 time: 0.394112 Aug 29 16:05:30.182953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:05:30.191536 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2588/5294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:29 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1691 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:30.387257 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a567b6dc-21a0-4b25-ac69-19521cd4beb2 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "DELETE /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 204 len: 0 microversion: 2.1 time: 0.393811 Aug 29 16:05:30.388651 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2707/5295] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:29 2022] DELETE /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:05:30.415464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:30.416604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:30.432774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:30.433567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:30.434382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:30.435716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:30.437191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:30.439422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:30.688602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:30.697669 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e5fd2eaf-6798-40fd-a830-29b4043c4c9c tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1514 microversion: 2.1 time: 0.304758 Aug 29 16:05:30.722148 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2589/5296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:30 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:31.222341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:31.223161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:31.238573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.243588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.244089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:31.244854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.251259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.251924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:31.539613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:31.555694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd5dd869-5c55-489e-8600-d5aab6940126 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1691 microversion: 2.1 time: 0.340345 Aug 29 16:05:31.557923 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2708/5297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:31 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1691 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:31.730509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:31.733464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:31.770650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.774044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.774668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:31.775855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.778885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.780033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:31.925427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:31.926018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:31.939945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.941782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.943154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:31.944445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:31.946094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:31.948908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:32.193114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lazy-loading 'services' on Instance uuid 877d07e1-ab80-48ee-abda-805c63efa629 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:05:32.397108 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c08e6e4-c3fb-49b0-826d-f97d90c92c2f tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "DELETE /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments/c80acac2-8610-4def-868c-64a0c808c46b" status: 202 len: 0 microversion: 2.1 time: 0.477439 Aug 29 16:05:32.398961 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2709/5298] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:05:31 2022] DELETE /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments/c80acac2-8610-4def-868c-64a0c808c46b => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:05:32.408486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:32.416101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:32.430279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:32.430788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:32.434607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:32.439383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:32.440134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:32.440732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:32.515177 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0fa2c8cf-018c-45e5-a0da-b59e834093c4 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111231 Aug 29 16:05:32.520489 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2710/5299] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:32 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:32.580547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:32.581926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:32.595347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:32.598271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:32.603011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:32.604090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:32.605111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:32.607999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:32.688006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:32.696583 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-357f21d3-3fe7-41ef-a89f-305aace8d6fb tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1514 microversion: 2.1 time: 0.979774 Aug 29 16:05:32.699768 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2590/5300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:31 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1514 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:32.947572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:32.958151 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57c10a6a-c996-4de1-b07c-de879d97e009 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1691 microversion: 2.1 time: 0.382739 Aug 29 16:05:32.959266 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2711/5301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:32 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1691 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:33.532665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:33.535693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:33.551452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:33.551958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:33.552385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:33.553090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:33.555628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:33.556889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:33.660719 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8ffffe8-868a-4851-b4be-1a0f11a09bc5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132256 Aug 29 16:05:33.666761 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2591/5302] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:33 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:33.721598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:33.722217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:33.738662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:33.755467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:33.756313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:33.757262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:33.757885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:33.758462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:33.831339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-64694bfd-4fd9-4e76-8e56-af39c84079df req-b86066f1-710b-4bab-b585-21c79619882c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf96bbf-ec37-465c-816c-2ecbf0b3263a", "name": "network-vif-deleted", "tag": "a9571ca3-08af-4062-8b99-029b7d9d9177"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:33.853446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-64694bfd-4fd9-4e76-8e56-af39c84079df req-b86066f1-710b-4bab-b585-21c79619882c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:33.858152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-64694bfd-4fd9-4e76-8e56-af39c84079df req-b86066f1-710b-4bab-b585-21c79619882c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:33.860124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-64694bfd-4fd9-4e76-8e56-af39c84079df req-b86066f1-710b-4bab-b585-21c79619882c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:33.888070 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-64694bfd-4fd9-4e76-8e56-af39c84079df req-b86066f1-710b-4bab-b585-21c79619882c service nova] Creating event network-vif-deleted:a9571ca3-08af-4062-8b99-029b7d9d9177 for instance caf96bbf-ec37-465c-816c-2ecbf0b3263a on n-h2-836830-13 Aug 29 16:05:33.902091 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-64694bfd-4fd9-4e76-8e56-af39c84079df req-b86066f1-710b-4bab-b585-21c79619882c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075036 Aug 29 16:05:33.908565 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2592/5303] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:33.985678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:33.992798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:33.998532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:34.012722 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2834c3c-f21f-4c28-bd95-c061c9e985ab tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 200 len: 1472 microversion: 2.1 time: 0.289158 Aug 29 16:05:34.013389 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2712/5304] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:33 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:34.029121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:34.044293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:34.044859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:34.046205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:34.057283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:34.062532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:34.455830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:34.477565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e16f787-c13c-4815-8c60-5e4ec16d485e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1691 microversion: 2.1 time: 0.499200 Aug 29 16:05:34.479873 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2593/5305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:33 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1691 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:34.674469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:34.677485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:34.693459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:34.696488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:34.707461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:34.709260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:34.709923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:34.710751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:34.768454 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-351f3a52-848d-49ae-9e1e-3a832d11612a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098174 Aug 29 16:05:34.771305 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2713/5306] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:34 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:35.038292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:35.041497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: caf96bbf-ec37-465c-816c-2ecbf0b3263a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:35.086227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.088053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.090418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.092576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.093240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.096218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.131659 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] HTTP exception thrown: Instance caf96bbf-ec37-465c-816c-2ecbf0b3263a could not be found. Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Request method failure captured: Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a HTTP/1.1 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLkfxkD-GnZzDSb1ugnRPgjz96c7W2r3WCuUjJhXlQ7KoNABkcQVpc7qGukQ1RvNc_7aDswJsjVOxU8aALheGA6m_ttFslTdhfVs8OQxASPOgeoc-8HuVqVu7dhj-qOlNJWmIlr1xT8126TwYY_rt7Qg8b-AF-9T7kt6TlDPOlRz6I Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 315f3de5e40e4a0ca12713b37c555371 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505794695 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/315f3de5e40e4a0ca12713b37c555371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_315f3de5e40e4a0ca12713b37c555371", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/315f3de5e40e4a0ca12713b37c555371"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/315f3de5e40e4a0ca12713b37c555371"}]}] Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505794695 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 315f3de5e40e4a0ca12713b37c555371 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505794695 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesSnapshotTestJSON-1505794695-project Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e9cd9c0bd017459cb630823a39e8bd17 Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505794695-project Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance caf96bbf-ec37-465c-816c-2ecbf0b3263a could not be found. Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'caf96bbf-ec37-465c-816c-2ecbf0b3263a'} Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf96bbf-ec37-465c-816c-2ecbf0b3263a could not be found. Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf96bbf-ec37-465c-816c-2ecbf0b3263a could not be found. Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:35.136327 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.141554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:35.141554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:35.141554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:35.141554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:35.141554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:35.141554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf96bbf-ec37-465c-816c-2ecbf0b3263a could not be found. Aug 29 16:05:35.141554 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:35.150295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Returning 404 to user: Instance caf96bbf-ec37-465c-816c-2ecbf0b3263a could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:35.151553 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6eec207b-ab0e-43be-a630-544bce8ef7f7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a" status: 404 len: 111 microversion: 2.1 time: 0.119883 Aug 29 16:05:35.152619 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2594/5307] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:35 2022] GET /compute/v2.1/servers/caf96bbf-ec37-465c-816c-2ecbf0b3263a => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:05:35.449986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:35.450785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:35.464832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.465590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.466284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.467931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.468752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.470954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.500504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:35.501124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:35.512069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.515985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.516766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.517665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.519713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.520306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.666068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:35.676255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7ff9e9f-d4d3-4b43-bc28-e7d0453f885e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.231157 Aug 29 16:05:35.677850 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2714/5308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:35 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:35.784483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:35.790303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:35.809422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.810274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.812515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.815845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:35.816600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:35.817970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:35.929060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:35.953669 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-240b01d6-a65b-48d7-b53c-f17ddb1e5e21 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173760 Aug 29 16:05:35.959282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2715/5309] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:35 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:35.984929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:36.013402 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a04338e-2856-4003-84fe-e68cd80bd78e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1691 microversion: 2.1 time: 0.517539 Aug 29 16:05:36.013867 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2595/5310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:35 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1691 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:36.710311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:36.711155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:36.726063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.728727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:36.730657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:36.733081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.734055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:36.734671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:36.971886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:36.975745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:36.993543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.994362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:36.995770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:36.996882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:36.997748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.001534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.049545 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1801155-e8ff-49e7-b63b-0bbfced6906d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087153 Aug 29 16:05:37.055677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:37.058936 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2596/5311] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:36 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:05:37.064453 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a60fa883-130b-4597-81fb-0657078e0dca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.366275 Aug 29 16:05:37.065251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:37.066345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:37.075208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.076130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.077735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.079107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.079909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.080803 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2716/5312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:36 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:37.081731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.089914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1279181246"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:37.094863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:37.113050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.116107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.116796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.118342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.120154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.122342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.430152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:37.447540 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78e2e949-38f5-45b0-8ee5-52ec105c5387 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.385345 Aug 29 16:05:37.451146 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2597/5313] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:37 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:37.525852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce0b4917-8ad8-43d4-a1eb-da6210259050 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.441806 Aug 29 16:05:37.531690 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2717/5314] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:37 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 29 16:05:37.540232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:37.541095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:37.560860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.562928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.563523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.564481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:37.566008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:37.566743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:37.822335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:37.835073 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-20e811b0-c585-4154-8b5f-81e5542cf649 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.301834 Aug 29 16:05:37.836829 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2598/5315] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:37 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:38.065027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:38.067903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:38.091228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.092059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.093163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.094189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.094841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.095491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.164728 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ccb78d14-f992-459b-9d2b-081accbb5faa tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105134 Aug 29 16:05:38.173615 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2718/5316] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:38 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:38.472577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:38.476328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:38.485443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.486156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.486753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.487702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.488384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.488992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.859595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:38.861263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:38.877864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.879673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.880487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.881215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:38.883932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:38.887784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:38.891183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:38.894988 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be7cacd0-2e66-4cf8-bc85-cb9b93061791 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.427202 Aug 29 16:05:38.896225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2599/5317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:38 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:39.187640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:39.189713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:39.207256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:39.207855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:39.208314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:39.209062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:39.209514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:39.214456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:39.257162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:39.270512 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e73ca389-0682-41aa-bd1d-2b696094313a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1689 microversion: 2.1 time: 0.416674 Aug 29 16:05:39.271795 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2719/5318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:38 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1689 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:39.328686 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f89cbc3-2504-40ca-8fd3-9b762a675d4c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153406 Aug 29 16:05:39.335446 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2600/5319] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:39 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:39.918802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:39.919610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:39.936476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:39.938686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:39.939173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:39.940312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:39.940777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:39.941206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.295879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:40.298009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:40.323232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.323870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:40.325993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.327478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.328430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.330200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.331266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.333066 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fef46f8c-acba-43f4-bd91-0d84c03737b8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.418896 Aug 29 16:05:40.352130 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2720/5320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:39 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:40.375624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:40.381287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:40.410717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.428943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.431631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.432600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:40.433085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:40.433513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:40.630365 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b401c50-b587-450a-855e-1b7418ec8e09 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.253967 Aug 29 16:05:40.634933 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2721/5321] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:40 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:40.707837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:40.724401 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a128be2-6f57-4545-8e3f-9818c5d6581d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1689 microversion: 2.1 time: 0.435784 Aug 29 16:05:40.727389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2601/5322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:40 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1689 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:41.225474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-0b8640b9-4c00-49f4-ade8-03c4de00bba5 req-7752f681-c3d8-42da-a947-82c3c49b8cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:41.247772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0b8640b9-4c00-49f4-ade8-03c4de00bba5 req-7752f681-c3d8-42da-a947-82c3c49b8cd9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.248292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0b8640b9-4c00-49f4-ade8-03c4de00bba5 req-7752f681-c3d8-42da-a947-82c3c49b8cd9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.271751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-0b8640b9-4c00-49f4-ade8-03c4de00bba5 req-7752f681-c3d8-42da-a947-82c3c49b8cd9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.304627 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-0b8640b9-4c00-49f4-ade8-03c4de00bba5 req-7752f681-c3d8-42da-a947-82c3c49b8cd9 service nova] Creating event network-vif-unplugged:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:05:41.324412 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-0b8640b9-4c00-49f4-ade8-03c4de00bba5 req-7752f681-c3d8-42da-a947-82c3c49b8cd9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097228 Aug 29 16:05:41.326016 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2722/5323] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:41.368907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:41.370192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:41.402386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.406018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.409365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.412030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.416162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.417981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.647811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:41.650190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:41.700426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.705794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.708484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.709271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.709741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.710164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.808528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-df5bdf2c-39ee-4de1-95db-6f7dded59a53 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168917 Aug 29 16:05:41.810023 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2723/5324] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:41 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:41.822973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:41.824358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:41.845845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.847166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.851947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.853050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:41.855719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:41.856178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:41.903054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:41.923125 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26072d70-ad15-4f78-95a9-0e7ab660cc6d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.556799 Aug 29 16:05:41.926258 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2602/5325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:41 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:42.422084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:42.438732 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c08982b-5cc9-4a86-b2e9-579aa65bbda7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.621064 Aug 29 16:05:42.441332 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2724/5326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:41 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:42.833100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:42.837576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:42.868646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:42.869521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:42.870272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:42.877677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:42.878564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:42.879355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:42.957991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:42.958969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:42.976484 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bdbaa963-8b45-44e9-93f5-f7bb648a8a11 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.157745 Aug 29 16:05:42.984916 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2603/5327] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:05:42 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:05:43.012460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.013034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.013475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.021638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.027190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.027770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.140881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:43.144640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:43.166941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.170040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.171720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.173833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.177432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.178205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.241211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:43.259632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Cannot 'reboot' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action HTTP/1.1 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 28 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: {"reboot": {"type": "HARD"}} Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'reboot' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b298b8a5-3dc2-4fa7-bd5a-c664295f4127', 'body': {'reboot': {'type': 'HARD'}}} Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 16:05:43.267299 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.271649 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.276119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 409 to user: Cannot 'reboot' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:43.278331 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d52765b-ce66-4467-b649-396f2e4773d2 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action" status: 409 len: 145 microversion: 2.1 time: 0.144008 Aug 29 16:05:43.280798 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2604/5328] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:43 2022] POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action => generated 145 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:05:43.304209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:43.309820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:43.325047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.329561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.331376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.332569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.333437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.335972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.401207 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Cannot 'rebuild' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action HTTP/1.1 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 65 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: exception: Cannot 'rebuild' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b298b8a5-3dc2-4fa7-bd5a-c664295f4127', 'body': {'rebuild': {'imageRef': '648e7a49-e66c-42cf-859c-64f1df130787'}}} Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:05:43.412170 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued Aug 29 16:05:43.417776 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:05:43.421784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 409 to user: Cannot 'rebuild' instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 while it is in vm_state rescued {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:43.426289 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f51a3dfd-3c78-4a34-993c-2695aef02e7b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action" status: 409 len: 146 microversion: 2.1 time: 0.130992 Aug 29 16:05:43.428442 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2605/5329] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:05:43 2022] POST /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127/action => generated 146 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:05:43.435758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:43.446655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:43.448744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:43.455525 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c84c412-0220-4d3e-bf35-676003d7a57b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.508272 Aug 29 16:05:43.462776 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2725/5330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:42 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:43.463946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.465739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.466841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.468718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.474773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.475584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.490955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:43.491643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:43.544186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.546211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.547518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:05:43.553335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.560498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.563517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.566720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.750842 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e342253-efdc-44e2-b60a-53c0a5911536 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "DELETE /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 204 len: 0 microversion: 2.1 time: 0.316576 Aug 29 16:05:43.753621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2606/5331] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:05:43 2022] DELETE /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:05:43.768391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:43.770212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:43.809702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.815343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.818299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.819574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:43.821866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:43.823149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:43.981257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:43.992689 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73f68f79-65a8-44d0-9584-6ff4dec66674 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.528731 Aug 29 16:05:44.018162 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2726/5332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:43 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:44.387255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:44.400648 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6777df60-1141-42c2-a896-a3d3ef3afec5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1691 microversion: 2.1 time: 0.641229 Aug 29 16:05:44.401618 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2607/5333] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:43 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1691 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:44.485829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:44.486510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:44.512117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:44.512617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:44.513051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:44.513792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:44.514239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:44.514777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:44.864259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-82093f04-f6b8-4905-8a6f-1f0b3738d61f req-d676b73f-9249-42b3-9c17-c96be59adbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-plugged", "status": "completed", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:44.914545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-82093f04-f6b8-4905-8a6f-1f0b3738d61f req-d676b73f-9249-42b3-9c17-c96be59adbb2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:44.918114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-82093f04-f6b8-4905-8a6f-1f0b3738d61f req-d676b73f-9249-42b3-9c17-c96be59adbb2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:44.922082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-82093f04-f6b8-4905-8a6f-1f0b3738d61f req-d676b73f-9249-42b3-9c17-c96be59adbb2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:44.953881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:44.964508 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3cf445b0-5e45-4678-b35f-fb006c1d3757 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.480933 Aug 29 16:05:44.968690 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2727/5334] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:44 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:44.998505 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-82093f04-f6b8-4905-8a6f-1f0b3738d61f req-d676b73f-9249-42b3-9c17-c96be59adbb2 service nova] Creating event network-vif-plugged:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:05:45.018575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:45.020236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:45.026448 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-82093f04-f6b8-4905-8a6f-1f0b3738d61f req-d676b73f-9249-42b3-9c17-c96be59adbb2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161631 Aug 29 16:05:45.028778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:45.031582 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2608/5335] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:45.037459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:45.038534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.039191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:45.039706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:45.040143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.235059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:45.244980 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f494c7e-c078-4b0b-a175-4cdb5d86027c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.235243 Aug 29 16:05:45.247395 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2728/5336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:45 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:45.423681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:45.424717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:45.439887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:45.445557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:45.447826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.448970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:45.452605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:45.454990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:45.939605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:45.968118 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c6d7fed8-bcf8-432f-a0ae-8c0d99f41944 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1691 microversion: 2.1 time: 0.543217 Aug 29 16:05:45.987921 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2609/5337] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:45 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1691 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:45.992762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:45.994045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:46.010742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:46.016687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:46.018776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:46.019623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:46.020863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:46.021580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:46.273694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:46.274715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:46.286006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:46.286909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:46.289134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:46.291655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:46.295576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:46.296286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:46.331719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:46.340389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-798f1974-3bff-4ecc-9a3b-142fd5942377 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.351583 Aug 29 16:05:46.341316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2729/5338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:45 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:46.554436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:46.564361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07ec04eb-1ba0-4b5a-834c-793e838b2db2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.294501 Aug 29 16:05:46.584908 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2610/5339] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:46 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:46.995555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:46.996436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:47.011477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.013721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.017407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.022323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.023162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.030390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.374766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:47.376310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:47.396436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.397695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.399494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.406752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.407649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.408354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.444501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:47.467676 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83e2b16d-33d8-4f96-9150-53564a82451d tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1691 microversion: 2.1 time: 0.475973 Aug 29 16:05:47.478542 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2730/5340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:46 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1691 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:47.601379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:47.602364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:47.611300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.612803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.614754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:47.616408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:47.619826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:47.621229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:48.235408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:48.247256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:48.257753 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3ee8053c-10b1-4248-9361-17d22c2ea60f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.658386 Aug 29 16:05:48.258490 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2731/5341] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:47 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:48.508857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:48.510625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:48.525209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:48.537000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:48.539272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:48.540697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:48.541987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:48.543551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:48.552179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:48.566071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11c2af91-89d0-4dbf-aca2-64d8532f98f9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 1.202087 Aug 29 16:05:48.567449 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2611/5342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:47 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:48.634713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1640595372", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "6ea2b694-452f-4d82-b3fa-48824b11ca34"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:48.778093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] validate_networks() for [('6ea2b694-452f-4d82-b3fa-48824b11ca34', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:05:48.936101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:48.949104 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f2d7dd1-3801-4a54-bf2d-0ad07225d830 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1691 microversion: 2.1 time: 0.446985 Aug 29 16:05:48.952876 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2732/5343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:48 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1691 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:49.292551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:49.293167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:49.316759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.317755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.319438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.322197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.323612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.325325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.777918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:49.798965 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-021619f0-40fa-4998-9834-3a2dc470b939 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.511217 Aug 29 16:05:49.820391 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2733/5344] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:49 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:49.839413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:49.844197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:49.870471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.872451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.874782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:49.876084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:49.878376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:49.883825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.234705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:50.256954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ddf420ee-5cc2-4cae-b9a9-8e9bd49e1139 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.431152 Aug 29 16:05:50.273402 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2734/5345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:49 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:50.278549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:05:50.279007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:05:50.280172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:05:50.280544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:05:50.280967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:05:50.304118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:50.304689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:50.307415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.307888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.308324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.309047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.309500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.309929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.342910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.346595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.346735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.356738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.359481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.361540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.407184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Getting quotas for project 315f3de5e40e4a0ca12713b37c555371. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:05:50.422584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Getting quotas for user e9cd9c0bd017459cb630823a39e8bd17 and project 315f3de5e40e4a0ca12713b37c555371. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:05:50.473486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:05:50.475872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:05:50.661604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:50.682715 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f10c2336-2782-4014-a0d8-5f6aa045224b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1623 microversion: 2.1 time: 0.407302 Aug 29 16:05:50.685390 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2735/5346] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:50 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1623 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:50.713140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-31488b6b-4903-454d-8e74-ecd35bdddc4b req-1713b170-7bed-4ba8-92d0-2490d779bc70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877d07e1-ab80-48ee-abda-805c63efa629", "name": "network-vif-deleted", "tag": "2210e537-a1a0-4e7d-b359-02a48cb5d032"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:50.746891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31488b6b-4903-454d-8e74-ecd35bdddc4b req-1713b170-7bed-4ba8-92d0-2490d779bc70 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.751575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31488b6b-4903-454d-8e74-ecd35bdddc4b req-1713b170-7bed-4ba8-92d0-2490d779bc70 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.758612 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [f96cc638-3bba-4c0f-8553-473c7cdc4d44] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:05:50.759635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31488b6b-4903-454d-8e74-ecd35bdddc4b req-1713b170-7bed-4ba8-92d0-2490d779bc70 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.812327 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-31488b6b-4903-454d-8e74-ecd35bdddc4b req-1713b170-7bed-4ba8-92d0-2490d779bc70 service nova] Creating event network-vif-deleted:2210e537-a1a0-4e7d-b359-02a48cb5d032 for instance 877d07e1-ab80-48ee-abda-805c63efa629 on n-h1-836830-13 Aug 29 16:05:50.827310 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-31488b6b-4903-454d-8e74-ecd35bdddc4b req-1713b170-7bed-4ba8-92d0-2490d779bc70 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137267 Aug 29 16:05:50.828479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2736/5347] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:50.835483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:50.836476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:50.845178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.846064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.846728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:50.847740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:50.848444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:50.849096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.030376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:51.041687 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e362033-b821-420b-8e00-b920654b9f1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.211382 Aug 29 16:05:51.055050 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2737/5348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:50 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:51.281338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:51.281996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:51.299949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:51.300403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:51.300846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.306496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:51.308913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:51.311246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.615625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:51.627302 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-48b462d1-c7da-42c3-8a9e-1513fc8a5b1d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.351177 Aug 29 16:05:51.631677 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2738/5349] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:51 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:51.716245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:51.717011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:51.729005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:51.729500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:51.729944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.732128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:51.736771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:51.737037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.781478 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [f96cc638-3bba-4c0f-8553-473c7cdc4d44] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 48300. Aug 29 16:05:51.796562 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0dbeb1bd-6449-4d47-a751-0eb542f77e5a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.166112 Aug 29 16:05:51.797224 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2612/5350] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:05:51.808292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d87a37a7-2c2a-49d8-85bf-a62307ed789e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:51.808922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d87a37a7-2c2a-49d8-85bf-a62307ed789e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:51.910860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:51.911381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:51.911819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:51.912272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lazy-loading 'fault' on Instance uuid 877d07e1-ab80-48ee-abda-805c63efa629 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:05:52.115754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d87a37a7-2c2a-49d8-85bf-a62307ed789e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:52.118479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:52.123723 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d87a37a7-2c2a-49d8-85bf-a62307ed789e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1219 microversion: 2.1 time: 0.318721 Aug 29 16:05:52.133006 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2613/5351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:51 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1219 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:52.143956 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ab21215-8574-43d5-8215-d38dbab75a2a tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 200 len: 1336 microversion: 2.1 time: 0.435992 Aug 29 16:05:52.148998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2739/5352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:51 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 1336 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:52.156697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:52.160676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:52.188038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.191074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.195323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.196242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.197243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.201407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.667807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:52.669219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:52.693388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.697125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.699726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.702919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:52.705015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:52.705802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:52.957855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:52.966770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f22fc3d7-ddf4-4f65-8915-6e688e84546a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.830602 Aug 29 16:05:52.967613 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2614/5353] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:52 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:53.008401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:53.019544 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b79ebde-9a2e-4e9a-9f61-e8015b659d5b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.358758 Aug 29 16:05:53.031430 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2740/5354] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:52 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:53.153014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:53.153659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:53.162672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.163397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.163638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.164374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.164834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.165299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.168455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:53.169317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 877d07e1-ab80-48ee-abda-805c63efa629] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:53.178296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.178790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.179256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.179955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:53.180404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:53.195204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:53.238263 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Instance 877d07e1-ab80-48ee-abda-805c63efa629 could not be found. Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 HTTP/1.1 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 877d07e1-ab80-48ee-abda-805c63efa629 could not be found. Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '877d07e1-ab80-48ee-abda-805c63efa629'} Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877d07e1-ab80-48ee-abda-805c63efa629 could not be found. Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877d07e1-ab80-48ee-abda-805c63efa629 could not be found. Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:53.239958 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877d07e1-ab80-48ee-abda-805c63efa629 could not be found. Aug 29 16:05:53.243918 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:05:53.245950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 404 to user: Instance 877d07e1-ab80-48ee-abda-805c63efa629 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:05:53.247242 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3caccb43-1c10-46a1-88ae-775c97a023c5 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629" status: 404 len: 111 microversion: 2.1 time: 0.082623 Aug 29 16:05:53.252622 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2741/5355] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:53 2022] GET /compute/v2.1/servers/877d07e1-ab80-48ee-abda-805c63efa629 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:05:53.258662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c3784f04-9682-4c70-a391-dae5ea4d275c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '.version_select at 0x7f32ed0cbb80>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:53.293387 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c3784f04-9682-4c70-a391-dae5ea4d275c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987182539" status: 202 len: 0 microversion: 2.1 time: 0.039167 Aug 29 16:05:53.298416 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2742/5356] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:05:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1987182539 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:05:53.448056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:53.457033 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2dbeba7e-356e-4747-b550-7fc8a4a598ae tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1223 microversion: 2.1 time: 0.308199 Aug 29 16:05:53.474557 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2615/5357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:53 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1223 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:53.990133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:53.990907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:54.028095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.028851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.031334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.045450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:54.047160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:54.050613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.051648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.055913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.079178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.081585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.083490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.086943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.088796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.089915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.813306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:54.842709 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42fcf863-9b10-403b-9940-d1a9dc6a01be tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1696 microversion: 2.1 time: 0.800048 Aug 29 16:05:54.845601 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2616/5358] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:54 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1696 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:54.852678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:54.860349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:54.897255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.902886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.905530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.910810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:54.915964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:54.917433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:54.969673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:54.983453 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3051c458-4cc1-40c7-9356-15939c18854f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.993568 Aug 29 16:05:54.988314 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2743/5359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:53 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:55.236594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:55.257191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f1bcded-43dd-462e-bfcc-dba10194c0b1 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1271 microversion: 2.1 time: 0.400844 Aug 29 16:05:55.257913 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2617/5360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:54 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1271 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:55.868505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:55.869134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:55.908463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.910268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.911612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:55.912551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:55.915112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:55.915735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.005608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:56.006268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:56.023688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:56.030052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:56.030934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:56.031588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.034581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:56.035294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:56.035959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.408123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:56.424131 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0a0153fd-dd7e-437e-ab6a-997f66d671fc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1695 microversion: 2.1 time: 0.559353 Aug 29 16:05:56.431435 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2744/5361] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:55 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1695 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:56.444898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:56.451930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:56.476850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:56.480247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:56.480711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.481456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:56.487759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:56.491133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:56.660103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:56.676445 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea164e50-e91d-4099-9504-ac46c8182235 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1277 microversion: 2.1 time: 0.242342 Aug 29 16:05:56.679505 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2745/5362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:56 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:57.459123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:57.461681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:57.504825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:05:57.522419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.527865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.533144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:57.545665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.546214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.546841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:57.873651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:57.884434 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-16390df4-3ece-4a76-a3a6-2acc100ab0dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 1.883426 Aug 29 16:05:57.912063 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2618/5363] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:55 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:57.924211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:57.925275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:57.941318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.944089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.944723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:57.945666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:57.947790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:57.952367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:58.160637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:58.170064 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e3d0e19-99d7-4a6d-a1aa-4babb1692ac3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1695 microversion: 2.1 time: 0.718637 Aug 29 16:05:58.183364 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2746/5364] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:57 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1695 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:05:58.265555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:58.274736 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3a2f69c-a9f5-46e2-8974-a6d7bdde1ac9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1277 microversion: 2.1 time: 0.361182 Aug 29 16:05:58.292517 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2619/5365] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:57 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1277 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:58.919201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:58.921469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:58.948984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:58.948984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:58.957465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:58.957465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:58.957465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:58.957465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.201838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:59.203237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:59.217230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.218596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.220661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.221778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.225675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.226375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.527375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:05:59.550417 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-444d5064-d84f-4efa-a5cd-57b50957783d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.635496 Aug 29 16:05:59.559672 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2747/5366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:58 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:05:59.574653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-398aef8d-8d61-41ec-be20-8a56f99bf320 req-86365db4-e1fb-4fb6-a56f-4883e7c38d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "name": "network-vif-unplugged", "status": "completed", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:05:59.619520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-398aef8d-8d61-41ec-be20-8a56f99bf320 req-86365db4-e1fb-4fb6-a56f-4883e7c38d47 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.620418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-398aef8d-8d61-41ec-be20-8a56f99bf320 req-86365db4-e1fb-4fb6-a56f-4883e7c38d47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.621043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-398aef8d-8d61-41ec-be20-8a56f99bf320 req-86365db4-e1fb-4fb6-a56f-4883e7c38d47 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.663281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-398aef8d-8d61-41ec-be20-8a56f99bf320 req-86365db4-e1fb-4fb6-a56f-4883e7c38d47 service nova] Creating event network-vif-unplugged:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h1-836830-13 Aug 29 16:05:59.690658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-398aef8d-8d61-41ec-be20-8a56f99bf320 req-86365db4-e1fb-4fb6-a56f-4883e7c38d47 service nova] Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:05:59.745362 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-398aef8d-8d61-41ec-be20-8a56f99bf320 req-86365db4-e1fb-4fb6-a56f-4883e7c38d47 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182172 Aug 29 16:05:59.750743 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2748/5367] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:05:59.761758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:05:59.770837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:05:59.787662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.792653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.796681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:05:59.799409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:05:59.800012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:05:59.800709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:00.197264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:00.209598 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f37dcfe6-5a7e-4ff2-8b40-fa78c6199d86 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.457289 Aug 29 16:06:00.210827 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2749/5368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:59 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:00.365106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:00.587144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:00.588239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:00.615219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:00.628372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:00.631459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:00.635788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:00.640920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:00.641837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:01.047783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:01.062255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:01.077143 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f9345fb-46d7-46c0-94b2-127c2d75e603 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.488717 Aug 29 16:06:01.095772 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2750/5369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:00 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:01.237078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:01.238943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:01.256496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:01.258071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:01.261482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:01.262671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:01.263333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:01.267993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:01.728005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:01.744760 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1e04358-b51b-442c-9fc9-03e5a8cb736c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1695 microversion: 2.1 time: 2.544938 Aug 29 16:06:01.763092 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2620/5370] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:05:59 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1695 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:01.781130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:01.790190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f53d9f65-79c3-457d-85b4-8c8d890d0364 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.558814 Aug 29 16:06:01.816842 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2751/5371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:01 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:02.109160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:02.110007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:02.130636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:02.133206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.134184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.135002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.136029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.136651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.137225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.771418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:02.773025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:02.783877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.784380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.784823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.786145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:02.787177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:02.788020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:02.943305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:02.955501 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-83890525-1d19-4f91-9fd7-b1d2122123bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.850830 Aug 29 16:06:02.963581 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2621/5372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:02 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:02.983202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:02.994108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:03.023358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.023864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.042509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:03.043405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:03.043904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:03.051270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:03.124396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:03.808483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:03.838747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31b576e8-edb1-462f-a861-6f63640fe357 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1695 microversion: 2.1 time: 1.071792 Aug 29 16:06:03.851194 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2752/5373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:02 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1695 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:03.997452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:03.999973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:04.017596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.018767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.020189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.021176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.022254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.023206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.598463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:04.610581 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbd8d84a-7f22-4e4f-80ac-37560e42b469 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 1.644185 Aug 29 16:06:04.611247 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2622/5374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:02 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:04.637368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f47fbd56-9d78-4a5c-88ba-2e10ee74311f req-702f3298-6eb0-4c96-842e-64db0a6c31ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:04.667269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f47fbd56-9d78-4a5c-88ba-2e10ee74311f req-702f3298-6eb0-4c96-842e-64db0a6c31ae service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.668139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f47fbd56-9d78-4a5c-88ba-2e10ee74311f req-702f3298-6eb0-4c96-842e-64db0a6c31ae service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.668953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f47fbd56-9d78-4a5c-88ba-2e10ee74311f req-702f3298-6eb0-4c96-842e-64db0a6c31ae service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.719005 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f47fbd56-9d78-4a5c-88ba-2e10ee74311f req-702f3298-6eb0-4c96-842e-64db0a6c31ae service nova] Creating event network-changed:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h1-836830-13 Aug 29 16:06:04.731208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-f47fbd56-9d78-4a5c-88ba-2e10ee74311f req-702f3298-6eb0-4c96-842e-64db0a6c31ae service nova] Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:06:04.757586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f47fbd56-9d78-4a5c-88ba-2e10ee74311f req-702f3298-6eb0-4c96-842e-64db0a6c31ae service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129975 Aug 29 16:06:04.767015 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2623/5375] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:04.771428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:04.788186 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-266690f8-4f6c-40cf-bee6-a71ffbb51713 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.797784 Aug 29 16:06:04.808743 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2753/5376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:03 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:04.876975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:04.877766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:04.905496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.909344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.917218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:04.918163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:04.918667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:04.919185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:05.635615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:05.637043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:05.657171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:05.660555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:05.663168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:05.666198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:05.667310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:05.669031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.018254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:06.033590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a8ea062-9d28-49a2-950d-e4534639e378 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.404623 Aug 29 16:06:06.043068 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2754/5377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:05 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:06.049323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:06.049323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:06.065054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.066237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.066688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.069704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:06.070196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:06.072594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:06.434588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:06.453720 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28267b71-b559-4a3a-a016-a9a9d882a327 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.411254 Aug 29 16:06:06.469960 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2755/5378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:06 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:06.703804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:06.728537 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-98157937-81bf-456f-816c-d9ff868436e8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1695 microversion: 2.1 time: 1.859674 Aug 29 16:06:06.729830 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2624/5379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:04 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1695 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:07.057196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:07.057813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:07.072448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.072935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.073370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.074080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.075538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.075538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.479859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:07.480477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:07.500534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.501036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.510789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.516906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.517762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.526270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.526841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:07.538208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-50708616-4c80-4b26-9fca-98e9c8377ee7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.484969 Aug 29 16:06:07.540759 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2756/5380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:07 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:07.758079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:07.758967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:07.779554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.780493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.780950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:07.789770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:07.790346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:07.790785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.144738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:08.175418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce8979d9-fcc6-4c33-b36d-329bf28d4e44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.699267 Aug 29 16:06:08.179924 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2625/5381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:07 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:08.269365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:08.277429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10be4b45-0bf7-4746-8742-bedece601327 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1695 microversion: 2.1 time: 0.523722 Aug 29 16:06:08.278025 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2757/5382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:07 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1695 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:08.459880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8d8b5fc9-a504-4f05-8fee-d7d43c183068 req-df3e3ebd-caf0-4f9f-9f09-08000cddaf5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8598d46c-b815-45a6-8444-4194180bd3ec", "tag": "83bb5361-1b12-4a2b-91a8-b6e1672069fa"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:08.487440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8d8b5fc9-a504-4f05-8fee-d7d43c183068 req-df3e3ebd-caf0-4f9f-9f09-08000cddaf5e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.489048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8d8b5fc9-a504-4f05-8fee-d7d43c183068 req-df3e3ebd-caf0-4f9f-9f09-08000cddaf5e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.489877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8d8b5fc9-a504-4f05-8fee-d7d43c183068 req-df3e3ebd-caf0-4f9f-9f09-08000cddaf5e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.527153 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8d8b5fc9-a504-4f05-8fee-d7d43c183068 req-df3e3ebd-caf0-4f9f-9f09-08000cddaf5e service nova] Creating event network-changed:83bb5361-1b12-4a2b-91a8-b6e1672069fa for instance 8598d46c-b815-45a6-8444-4194180bd3ec on n-h2-836830-13 Aug 29 16:06:08.538259 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8d8b5fc9-a504-4f05-8fee-d7d43c183068 req-df3e3ebd-caf0-4f9f-9f09-08000cddaf5e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083165 Aug 29 16:06:08.541756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2626/5383] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:08.562140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:08.562942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:08.581311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.584166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.591927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:08.596689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:08.602822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:08.603674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.055522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:09.074469 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3684b7d0-b94b-4e35-87a0-c94617b83bee tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.517610 Aug 29 16:06:09.078941 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2758/5384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:08 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:09.199816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:09.200539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:09.214116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.214897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.220609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.221604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.222238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.222824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.313735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:09.314369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:09.339931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.345744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.349068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.349893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:09.350385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:09.350826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:09.692377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:09.706469 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2d5ae913-bed9-4b40-92de-ce678aec540d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.511465 Aug 29 16:06:09.707087 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2627/5385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:09 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:10.103550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:10.108420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:10.142512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:10.150688 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29127b5b-1971-46bd-8085-85e11c088e19 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1693 microversion: 2.1 time: 0.842385 Aug 29 16:06:10.155053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:10.155053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:10.155053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:10.155053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:10.155053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:10.166005 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2759/5386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:09 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1693 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:10.170513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:10.735328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:10.736048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:10.756198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:10.759983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:10.760510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:10.765772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:10.766273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:10.766719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.132629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:11.147779 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e4b4cce-65b9-45ac-a89b-1d9b1f0fc845 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 1.051218 Aug 29 16:06:11.164193 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2628/5387] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:10 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:11.194712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:11.195427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:11.211181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.211771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.212210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.212924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.213383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.213810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.277253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:11.292915 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b4a915e-1db9-4cc0-b0ab-0706a483b49a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.562133 Aug 29 16:06:11.294008 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2760/5388] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:10 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:11.394902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:11.395764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:11.403010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.403732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.410082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.411850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.412725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.413390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.469914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:11.673770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb59402b-d1fa-422d-9377-4c108c0f13ce tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 204 len: 0 microversion: 2.1 time: 0.282445 Aug 29 16:06:11.674594 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2761/5389] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:11 2022] DELETE /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:11.683937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:11.687088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:11.706758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.709379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.710745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:11.713998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:11.715673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:11.716952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.287763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:12.317507 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-646d4479-7839-4a39-8f95-589751c343e3 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1509 microversion: 2.1 time: 0.638418 Aug 29 16:06:12.321578 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2762/5390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:11 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1509 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:12.336717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:12.340262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:12.356444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.359734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.363871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.365621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.366378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.366965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.531772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:12.554399 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-92d5fb6a-15ff-4a9c-a832-c4575a3f307c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 1.368188 Aug 29 16:06:12.556675 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2629/5391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:11 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:12.579761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:12.607630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:12.607630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.607630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.607630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.607630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.607630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.607630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.769297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:12.803521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a345329-889f-42a1-b5d8-c3b7e4a2c751 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.479872 Aug 29 16:06:12.827375 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2763/5392] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:12 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:12.853593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:12.858017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:12.893816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.898420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.899400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:12.900329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:12.903000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:12.909433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.069282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:13.153637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-066811e4-f505-4cf6-9993-e279ec961a0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action" status: 204 len: 0 microversion: 2.1 time: 0.322629 Aug 29 16:06:13.158666 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2764/5393] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:06:12 2022] POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:13.195923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:13.202339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:13.232312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.238322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.241665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.242717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.246636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.248555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.422027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:13.446053 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-452be644-3d8d-486a-9575-1bdd5527dc03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.888438 Aug 29 16:06:13.452281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2630/5394] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:12 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:13.472074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:13.473948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:13.508848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.509894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.512911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.514974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.518213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.522476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.761806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:13.774014 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eec90404-6d31-4cfc-acbb-323afe2b02bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 0.600619 Aug 29 16:06:13.779578 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2765/5395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:13 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:13.839468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:13.841894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:13.854776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.858455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.859570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:13.864099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:13.864786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:13.865437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.273287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:14.287557 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e5a2c75-67e1-4e45-b1a7-d7eab63c4202 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.450987 Aug 29 16:06:14.300896 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2766/5396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:13 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:14.473899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:14.475087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:14.503076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.503961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.507895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:14.512944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:14.516158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:14.517431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.050357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:15.058818 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3dde48cd-9870-4190-964f-6df018a00f42 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.589091 Aug 29 16:06:15.059433 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2767/5397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:14 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:15.080627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:15.081680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:15.098570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.103395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:15.105886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.111732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.112737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.113453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.115651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.117059 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a9218f90-73a0-434d-97ce-84b70f186c90 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1509 microversion: 2.1 time: 1.663055 Aug 29 16:06:15.118870 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2631/5398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:13 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1509 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:15.313414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:15.313952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:15.328553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.331684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.332176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.332918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:15.333388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:15.333816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:15.493101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:15.503056 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01c5eacc-ab84-4ce7-846b-1430e65652fa tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 0.431624 Aug 29 16:06:15.510519 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2768/5399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:15 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:16.102464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:16.103424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:16.123466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.123963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.124577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.125483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.126117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.126798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.411706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:16.425599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c63facba-c514-4bea-b232-12c4841835e4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1684 microversion: 2.1 time: 0.337532 Aug 29 16:06:16.429643 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2769/5400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:16 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1684 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:16.435253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:16.436363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:16.445627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.447618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.448340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:16.449814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.452296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.453889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.454640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.457431 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84bfd0b1-8e88-470e-b8be-7c537da5e82a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 1.149117 Aug 29 16:06:16.464282 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2632/5401] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:15 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:16.535888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:16.536664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:16.551612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:16.555776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.556514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.557085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.559685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.562788 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e06cc29b-d8c4-4f5a-b00b-2ff1137b1033 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 200 len: 1467 microversion: 2.1 time: 0.131396 Aug 29 16:06:16.564187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.567078 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2770/5402] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:16 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 1467 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:16.567247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.807611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d92fd160-cd61-47dc-b030-6a27103d4486 req-f6fb0c04-f727-4d75-a39f-392631066639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b298b8a5-3dc2-4fa7-bd5a-c664295f4127", "name": "network-vif-deleted", "tag": "1d53e89f-4d18-494d-b868-dd6686eb78e8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:16.839272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d92fd160-cd61-47dc-b030-6a27103d4486 req-f6fb0c04-f727-4d75-a39f-392631066639 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:16.840057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d92fd160-cd61-47dc-b030-6a27103d4486 req-f6fb0c04-f727-4d75-a39f-392631066639 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:16.840651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d92fd160-cd61-47dc-b030-6a27103d4486 req-f6fb0c04-f727-4d75-a39f-392631066639 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:16.864385 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d92fd160-cd61-47dc-b030-6a27103d4486 req-f6fb0c04-f727-4d75-a39f-392631066639 service nova] Creating event network-vif-deleted:1d53e89f-4d18-494d-b868-dd6686eb78e8 for instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 on n-h1-836830-13 Aug 29 16:06:16.870359 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d92fd160-cd61-47dc-b030-6a27103d4486 req-f6fb0c04-f727-4d75-a39f-392631066639 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067264 Aug 29 16:06:16.883428 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2771/5403] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:17.450268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.462375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:17.467918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:17.479947 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5ea0a39-92cd-4d77-ba79-b64b1a298e62 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 0.947477 Aug 29 16:06:17.502749 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2633/5404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:16 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:17.506134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.506639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.507207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.508252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.520545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.522916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:17.523727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:17.523943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.550789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.556352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.557175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.558298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.558823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.563201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.884613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:17.899223 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-32cf532c-bf3a-4561-a40c-b44b83876f7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.452631 Aug 29 16:06:17.900617 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2772/5405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:17 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:17.907372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-561b98eb-dcae-4b0f-bb2a-d2957135222c req-c1f3eb2b-9cef-4eb5-b35e-fc510b621ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "name": "network-vif-plugged", "status": "completed", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:17.919303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-561b98eb-dcae-4b0f-bb2a-d2957135222c req-c1f3eb2b-9cef-4eb5-b35e-fc510b621ec0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:17.922697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-561b98eb-dcae-4b0f-bb2a-d2957135222c req-c1f3eb2b-9cef-4eb5-b35e-fc510b621ec0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:17.924135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-561b98eb-dcae-4b0f-bb2a-d2957135222c req-c1f3eb2b-9cef-4eb5-b35e-fc510b621ec0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:17.956949 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-561b98eb-dcae-4b0f-bb2a-d2957135222c req-c1f3eb2b-9cef-4eb5-b35e-fc510b621ec0 service nova] Creating event network-vif-plugged:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h1-836830-13 Aug 29 16:06:17.965077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-561b98eb-dcae-4b0f-bb2a-d2957135222c req-c1f3eb2b-9cef-4eb5-b35e-fc510b621ec0 service nova] Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:06:18.014855 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-561b98eb-dcae-4b0f-bb2a-d2957135222c req-c1f3eb2b-9cef-4eb5-b35e-fc510b621ec0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109975 Aug 29 16:06:18.016973 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2773/5406] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:18.025886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:18.031206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: b298b8a5-3dc2-4fa7-bd5a-c664295f4127] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:18.041990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.043708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.045281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.046650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.047300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.048151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.068954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 could not be found. Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 HTTP/1.1 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 could not be found. Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b298b8a5-3dc2-4fa7-bd5a-c664295f4127'} Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 could not be found. Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 could not be found. Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:18.071782 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 could not be found. Aug 29 16:06:18.076098 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:18.077868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 404 to user: Instance b298b8a5-3dc2-4fa7-bd5a-c664295f4127 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:06:18.079167 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c2f43fe-2dd0-44e5-8cd7-496a24e81628 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127" status: 404 len: 111 microversion: 2.1 time: 0.061013 Aug 29 16:06:18.080039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2774/5407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:18 2022] GET /compute/v2.1/servers/b298b8a5-3dc2-4fa7-bd5a-c664295f4127 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:18.090126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:18.090936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:18.099509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.100407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.101041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.102809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.103601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.104191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.161604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:18.204640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:18.217615 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b08e8f3b-6c9d-45ce-b879-3f4ed4611fed tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.707624 Aug 29 16:06:18.226405 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2634/5408] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:17 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:18.338484 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bf50310d-6272-484b-be71-daf34fb1fe85 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "DELETE /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 204 len: 0 microversion: 2.1 time: 0.251947 Aug 29 16:06:18.342876 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2775/5409] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:18 2022] DELETE /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:18.348683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:18.349995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:18.366781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.370564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.371423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.372394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.374432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.374986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.507009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:18.508447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:18.521989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.526504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.528104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.528938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:18.531715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:18.532165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:18.634293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:18.644455 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ba66c36-12ec-4e8b-aa3b-5c13e0642d61 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.300066 Aug 29 16:06:18.646580 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2635/5410] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:18 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:18.924927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:18.937937 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eb211c63-710a-4340-966a-9bbd0cf8c43a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 0.435791 Aug 29 16:06:18.939233 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2776/5411] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:18 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:19.246108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:19.246746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:19.271593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.272103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.272678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.275539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.276289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.278618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.490539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:19.501901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-436f193f-51dc-41cb-902c-128eae2dc986 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.260183 Aug 29 16:06:19.502475 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2636/5412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:19 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:19.671228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:19.671847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:19.682804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.683329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.683769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.684532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.684910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.685965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.879689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:19.893914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2acfd882-ef74-4edc-bb64-bc2911f0c759 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.226315 Aug 29 16:06:19.895124 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2777/5413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:19 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:19.966895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:19.967812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:19.981187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.982083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.982611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:19.983792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:19.984423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:19.985015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.052017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-63b69407-a8e4-4697-901c-50c07647a6c1 req-80668491-b4e6-452c-98d7-c87f0f410d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8598d46c-b815-45a6-8444-4194180bd3ec", "name": "network-vif-plugged", "status": "completed", "tag": "83bb5361-1b12-4a2b-91a8-b6e1672069fa"}, {"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-unplugged", "status": "completed", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:20.094811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-63b69407-a8e4-4697-901c-50c07647a6c1 req-80668491-b4e6-452c-98d7-c87f0f410d29 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.097353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-63b69407-a8e4-4697-901c-50c07647a6c1 req-80668491-b4e6-452c-98d7-c87f0f410d29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.098959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-63b69407-a8e4-4697-901c-50c07647a6c1 req-80668491-b4e6-452c-98d7-c87f0f410d29 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.140653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-63b69407-a8e4-4697-901c-50c07647a6c1 req-80668491-b4e6-452c-98d7-c87f0f410d29 service nova] Creating event network-vif-plugged:83bb5361-1b12-4a2b-91a8-b6e1672069fa for instance 8598d46c-b815-45a6-8444-4194180bd3ec on n-h2-836830-13 Aug 29 16:06:20.142304 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-63b69407-a8e4-4697-901c-50c07647a6c1 req-80668491-b4e6-452c-98d7-c87f0f410d29 service nova] Creating event network-vif-unplugged:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:06:20.161269 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-63b69407-a8e4-4697-901c-50c07647a6c1 req-80668491-b4e6-452c-98d7-c87f0f410d29 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.119089 Aug 29 16:06:20.163068 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2778/5414] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:20.256621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:20.257938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:20.279120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.286220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.287180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.288537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.290662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.293875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.304401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:20.314637 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9878f49d-364c-4581-a13c-3cb12362d22f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 0.353896 Aug 29 16:06:20.318909 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2637/5415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:19 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:20.522909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:20.523912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:20.535171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.535891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.536487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.538808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.539467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.543298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.799510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:20.810999 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e2f5513-d29d-4636-b9d3-462ad2c10c21 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.291441 Aug 29 16:06:20.815693 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2638/5416] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:20 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:20.839339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:20.853090 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c02675a8-938f-40dd-bebb-a0ac1e648591 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.607727 Aug 29 16:06:20.854330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2779/5417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:20 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:20.931229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:20.931846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:20.966278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.967508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.968038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:20.968420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:20.968881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:20.969308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.313773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:21.317351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:21.327944 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-349029cb-5f76-49f1-86e7-fb7fc6d3b71b tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.415331 Aug 29 16:06:21.328544 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2639/5418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:20 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:21.353161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:21.354399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:21.369777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.372454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.373832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.374654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.375743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.376994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.650755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:21.670459 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c8be6f1-4a23-459d-970a-9f779f84558e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 0.322519 Aug 29 16:06:21.671123 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2780/5419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:21 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:21.833960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:21.834683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:21.845584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.846154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.846596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:21.847341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:21.847813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:21.848230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.186222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:22.199422 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46dfa49d-e71b-456f-9553-3873eb9c9a7a tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.369520 Aug 29 16:06:22.203951 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2640/5420] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:21 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:22.350045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:22.350748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:22.361176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.362194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.362905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.366328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.368873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.372246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.609278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:22.616691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:22.620030 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c48f3a4-6aa7-4c7b-af84-ecec5f51ce33 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1521 microversion: 2.1 time: 0.273742 Aug 29 16:06:22.623086 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2781/5421] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:22 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:22.692053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:22.692663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:22.711418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.712119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.712710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.713573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:22.714183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:22.714765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:22.895008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:22.910287 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bdd8174-b1a8-4a98-abab-4206126a77dc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1690 microversion: 2.1 time: 0.220520 Aug 29 16:06:22.911592 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2641/5422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:22 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:23.225461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:23.226097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:23.242154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.242699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.243180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.243915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.244392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.244810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.557930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:23.572258 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-21131616-11dd-4667-9dee-638ebabfa243 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1319 microversion: 2.1 time: 0.352157 Aug 29 16:06:23.578863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:23.579602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:23.589830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.590340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.592056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.592056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.592610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.593045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.601099 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2782/5423] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:23 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:23.642491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:23.644245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:23.663172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.663677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.664147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.674692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.675337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.675909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.885844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:23.899792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-95ce8a40-1434-4324-83dc-0a3d573cdb5c tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1479 microversion: 2.1 time: 0.261750 Aug 29 16:06:23.900982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2783/5424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:23 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1479 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:23.937656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:23.938693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:23.953224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.954441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.957980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:23.958967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:23.960195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:23.960808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.189148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.208490 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e13f34b-cf84-4ac2-a8f1-59996599ff95 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.634633 Aug 29 16:06:24.219735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2642/5425] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:23 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:24.227600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-fe05e6fc-c9a9-4b8e-a077-8bc3850daa98 req-7a7c9bf4-9013-4025-81a6-aafd7159a9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f1caeb-d314-411b-8e0a-e9762b370f5c", "name": "network-vif-deleted", "tag": "4bd4633f-3a03-4008-8d43-9b4e86477ab3"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:24.236849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fe05e6fc-c9a9-4b8e-a077-8bc3850daa98 req-7a7c9bf4-9013-4025-81a6-aafd7159a9d4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.237546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fe05e6fc-c9a9-4b8e-a077-8bc3850daa98 req-7a7c9bf4-9013-4025-81a6-aafd7159a9d4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.238090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fe05e6fc-c9a9-4b8e-a077-8bc3850daa98 req-7a7c9bf4-9013-4025-81a6-aafd7159a9d4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.257887 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-fe05e6fc-c9a9-4b8e-a077-8bc3850daa98 req-7a7c9bf4-9013-4025-81a6-aafd7159a9d4 service nova] Creating event network-vif-deleted:4bd4633f-3a03-4008-8d43-9b4e86477ab3 for instance 38f1caeb-d314-411b-8e0a-e9762b370f5c on n-h2-836830-13 Aug 29 16:06:24.267844 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-fe05e6fc-c9a9-4b8e-a077-8bc3850daa98 req-7a7c9bf4-9013-4025-81a6-aafd7159a9d4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050411 Aug 29 16:06:24.269311 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2643/5426] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:24.282720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:24.283756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.315908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.318404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.319082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.319234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.320440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.321482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.327533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.339195 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-543b4a3e-6f66-42b3-88c0-cd1d23fdcddd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1682 microversion: 2.1 time: 0.411097 Aug 29 16:06:24.340182 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2784/5427] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:23 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1682 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:24.562040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.572081 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8eb0cb46-219e-432d-9fa0-8e9ac9deba17 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.301192 Aug 29 16:06:24.572669 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2644/5428] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:24 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:24.599963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:24.600586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.615307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.615842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.616285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.617019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.617490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.618151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.630692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:24.632423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.641235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.642412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.643362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.644394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.645096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.645614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.851653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.862531 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b755e1b-3994-4623-a416-0c55b96b939b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.267427 Aug 29 16:06:24.863199 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2785/5429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:24 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:24.885555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:24.892329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.900750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.901501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.902128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.903221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.903932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.905181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.917030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:24.930223 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf08743b-04e5-44e5-afa8-1dfe4ccb0098 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1507 microversion: 2.1 time: 0.302919 Aug 29 16:06:24.934175 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2645/5430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:24 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:24.947678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:24.950329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:24.962542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.963925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.965456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:24.966864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:24.973963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:24.974634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.028617 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-62d46c11-1692-4757-9ff4-7504ac76803b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.149019 Aug 29 16:06:25.031659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2786/5431] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:06:24 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:06:25.051178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd43b5b7-f733-4318-94c0-e50ae4678e4b", "device": "/dev/sdb"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:25.056761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.058777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.059422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:25.060008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.061178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lazy-loading 'fault' on Instance uuid 38f1caeb-d314-411b-8e0a-e9762b370f5c {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:06:25.075116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.078119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.078877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.079776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.080850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.083476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.147533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd426ac002048bf9db072739a81c2e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9fe4b710cb46779f13a142f1301567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:25.163231 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5e3f398-70e2-4632-931d-6f943f48f562 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 200 len: 1311 microversion: 2.1 time: 0.225529 Aug 29 16:06:25.166848 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2646/5432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:24 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:25.186488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:25.187370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:25.200623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.204185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.204903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.206569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:25.207596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:25.209343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:25.535551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:25.559330 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b69ac6b9-a990-40ce-b80f-87bae89e571b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1673 microversion: 2.1 time: 0.391061 Aug 29 16:06:25.561255 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2647/5433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:25 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1673 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:25.601882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91ee6f08-89fd-4fbe-a3a1-4fa2419f74e7 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "POST /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.565279 Aug 29 16:06:25.603626 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2787/5434] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:06:25 2022] POST /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:26.583261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:26.584380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:26.608778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:26.609372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:26.609710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:26.610427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:26.610895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:26.611343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:26.977113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:26.991147 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cfc3682b-b28c-4d07-ab1c-e4f9ba65846c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1673 microversion: 2.1 time: 0.413177 Aug 29 16:06:26.994900 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2788/5435] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:26 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1673 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:27.081116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:27.088897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] [instance: 38f1caeb-d314-411b-8e0a-e9762b370f5c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:27.100921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=62 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:27.156968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.158346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.160469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.167847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:27.168707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:27.174455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:27.270679 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] HTTP exception thrown: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c could not be found. Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Request method failure captured: Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c HTTP/1.1 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLVZODH8u-bFP34t3RBVIzLkJWiuS3bLHSO7bkjCGh1KWrt_IH6mplHolJonguxi8lWUhqy7QV9VZmoEgt0MkyZOmnb3175H9wLsHRWdBYSAtNAmyjdOxirVMoeJBy_4JwguT69RZmd8lm-cI4-375xLNJbKEDLI90iFjTS86f-Ud0 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_eb9fe4b710cb46779f13a142f1301567", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/eb9fe4b710cb46779f13a142f1301567"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/eb9fe4b710cb46779f13a142f1301567"}]}] Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: eb9fe4b710cb46779f13a142f1301567 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-291768349 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: dcd426ac002048bf9db072739a81c2e4 Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerRescueNegativeTestJSON-291768349-project Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c could not be found. Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '38f1caeb-d314-411b-8e0a-e9762b370f5c'} Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c could not be found. Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c could not be found. Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:06:27.280564 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c could not be found. Aug 29 16:06:27.289196 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:06:27.292020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] Returning 404 to user: Instance 38f1caeb-d314-411b-8e0a-e9762b370f5c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:06:27.303218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c32f0d27-e2f9-4fa0-8872-71b0ff6f3b24 tempest-ServerRescueNegativeTestJSON-291768349 tempest-ServerRescueNegativeTestJSON-291768349-project] 10.222.0.83 "GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c" status: 404 len: 111 microversion: 2.1 time: 1.113289 Aug 29 16:06:27.312055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2648/5436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:26 2022] GET /compute/v2.1/servers/38f1caeb-d314-411b-8e0a-e9762b370f5c => generated 111 bytes in 1123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:28.027374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:28.028720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:28.036974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:28.091330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:28.095936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:28.100237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:28.101626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:28.102442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:28.103235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:28.875288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:28.888381 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-05d2df1d-055e-4bec-b43a-8824866acd28 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.870129 Aug 29 16:06:28.893282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2789/5437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:28 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:28.918317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:28.920711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:28.937159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:28.938092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:28.955567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:28.959831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:28.963465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:28.963931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.157631 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3fde5bcd-1967-435c-a085-f94245d30497 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 200 len: 322 microversion: 2.1 time: 0.244804 Aug 29 16:06:29.158788 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2649/5438] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:06:28 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:29.182064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:29.184830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:29.212950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.214720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.215440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.217275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.218306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.224294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.614545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-434731601", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:29.817661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:06:29.929146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:29.945450 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6470383d-dcbf-4ec0-b03f-f3027d2a87a8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.777028 Aug 29 16:06:29.946972 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2790/5439] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:29 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:29.969120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:29.970070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:29.977677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.978437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.979156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:29.980066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:29.980705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:29.981309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:30.319586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:30.334827 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0fe0f723-4810-4c84-bdaf-930017afabaf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.370395 Aug 29 16:06:30.337261 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2791/5440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:29 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:30.361506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:30.362513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:30.378058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:30.378811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:30.379821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:30.385556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:30.386534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:30.390520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:30.436573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:06:30.437146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:06:30.437751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:06:30.438324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:06:30.439152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:06:30.465696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:30.468664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:30.469992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:30.475868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:30.477190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:30.479775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:30.558973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Getting quotas for project 3e18c8f49fef4b79b9b9dfa05bec73a0. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:30.582155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Getting quotas for user 4de4105e1d104fd3a2301272eadb7d57 and project 3e18c8f49fef4b79b9b9dfa05bec73a0. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:30.616363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:06:30.624648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:06:30.719982 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0718df1a-3f8e-40c0-8a7e-38b0769d43fe tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116214 Aug 29 16:06:30.725470 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2650/5441] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:06:30.737456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0fe716a-d6c7-401b-a2b3-91d0660b241b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:30.740080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d0fe716a-d6c7-401b-a2b3-91d0660b241b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:30.866309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d0fe716a-d6c7-401b-a2b3-91d0660b241b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:30.879720 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d0fe716a-d6c7-401b-a2b3-91d0660b241b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1214 microversion: 2.1 time: 0.146508 Aug 29 16:06:30.882293 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2651/5442] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:30 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:31.553517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:31.570294 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82aa4504-de4b-4e45-a00c-8e83b6b6fcf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.214204 Aug 29 16:06:31.588429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2792/5443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:30 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:31.600777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:31.602260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:31.642363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:31.642841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:31.651699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:31.669974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:31.670569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:31.671129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:31.923096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-421d1d30-0e20-4227-887d-f4b78807bac9 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:31.923930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-421d1d30-0e20-4227-887d-f4b78807bac9 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:32.164549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:32.180666 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9e5c82e-593d-4876-a833-7ddd73bdabd8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.582942 Aug 29 16:06:32.182800 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2652/5444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:31 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:32.209362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-421d1d30-0e20-4227-887d-f4b78807bac9 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:32.222998 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-421d1d30-0e20-4227-887d-f4b78807bac9 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1214 microversion: 2.1 time: 0.304145 Aug 29 16:06:32.235981 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2793/5445] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:31 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1214 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:32.636874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-184880502", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f86097cf-c2ec-48f3-b00c-ae541e26f7ef"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:32.756631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] validate_networks() for [('f86097cf-c2ec-48f3-b00c-ae541e26f7ef', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:06:33.252857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:33.255460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:33.275718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:33.281164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:33.282354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:33.286837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:33.288221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:33.290339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:33.889649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:33.912542 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b6d448a-2f8c-4c47-a813-4203407ee66a tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1284 microversion: 2.1 time: 0.664430 Aug 29 16:06:33.919072 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2794/5446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:33 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1284 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:34.351684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:06:34.352697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:06:34.353393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:06:34.354064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:06:34.354920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:06:34.372586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:34.373959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:34.376058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:34.380553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:34.382017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:34.383083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:34.418290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:06:34.427071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for user f075974a803f46eda667db6d754453ba and project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:06:34.449850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:06:34.453382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:06:34.526894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80752186-0fd3-4d8d-9e54-f101428b288b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.897477 Aug 29 16:06:34.533069 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2653/5447] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:06:34.543218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d6905607-07fb-4090-956a-8b214e8d0b5b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:34.545436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d6905607-07fb-4090-956a-8b214e8d0b5b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:34.700499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d6905607-07fb-4090-956a-8b214e8d0b5b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:34.718483 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d6905607-07fb-4090-956a-8b214e8d0b5b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1214 microversion: 2.1 time: 0.178891 Aug 29 16:06:34.720699 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2795/5448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:34 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:34.942868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:34.943878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:34.959261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:34.963634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:34.964149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:34.964902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:34.968125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:34.968890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:35.740950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d343813-e76e-430e-94b9-de5d32ff477a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:35.742110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d343813-e76e-430e-94b9-de5d32ff477a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:35.894903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:35.933502 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d87eba8-fa9f-412e-9f78-519719359087 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.995261 Aug 29 16:06:35.952145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2654/5449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:34 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:36.186805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d343813-e76e-430e-94b9-de5d32ff477a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:36.203284 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d343813-e76e-430e-94b9-de5d32ff477a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1214 microversion: 2.1 time: 0.467131 Aug 29 16:06:36.220226 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2796/5450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:35 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1214 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:36.593655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:36.596303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:36.622968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:36.624841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:36.625369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:36.626646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:36.628933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:36.629458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:36.729251 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-436794e5-e2b2-469e-b2bb-7b6f11f6d6b4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action" status: 200 len: 24573 microversion: 2.1 time: 0.140686 Aug 29 16:06:36.730229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2655/5451] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:06:36 2022] POST /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b/action => generated 24573 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:06:36.962211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:36.963599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:36.981520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:36.985956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:36.986657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:36.987671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:36.988837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:36.990683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:37.231095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:37.233879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:37.249049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:37.249786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:37.250332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:37.253305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:37.254078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:37.254921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:37.395342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:37.412191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ba2459f-2a1a-491e-9592-e5b803ec3f45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1284 microversion: 2.1 time: 0.187201 Aug 29 16:06:37.422397 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2656/5452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:37 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:37.670663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:37.690006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-95515e83-e9b8-496c-a9a6-72c4dfadc99b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.730274 Aug 29 16:06:37.691989 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2797/5453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:36 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:38.076114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7ebdbc98-29be-4420-bad0-392985db9303 req-2d7e77fd-33a9-4dac-8a4d-d20450ecba7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b859d8b3-75f1-4865-a9d7-1af14ee915f9", "tag": "a37fd13c-6d1c-49a9-92a1-fc64e7833f52"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:38.109505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7ebdbc98-29be-4420-bad0-392985db9303 req-2d7e77fd-33a9-4dac-8a4d-d20450ecba7b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:38.118965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7ebdbc98-29be-4420-bad0-392985db9303 req-2d7e77fd-33a9-4dac-8a4d-d20450ecba7b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:38.120037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7ebdbc98-29be-4420-bad0-392985db9303 req-2d7e77fd-33a9-4dac-8a4d-d20450ecba7b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:38.155624 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7ebdbc98-29be-4420-bad0-392985db9303 req-2d7e77fd-33a9-4dac-8a4d-d20450ecba7b service nova] Creating event network-changed:a37fd13c-6d1c-49a9-92a1-fc64e7833f52 for instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 on n-h1-836830-13 Aug 29 16:06:38.168609 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7ebdbc98-29be-4420-bad0-392985db9303 req-2d7e77fd-33a9-4dac-8a4d-d20450ecba7b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094911 Aug 29 16:06:38.172259 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2657/5454] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:38.440097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:38.440994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:38.463246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:38.463750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:38.464188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:38.464907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:38.465365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:38.465792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:38.648569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:38.659340 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e74355f-f57e-4824-b501-9c6d76f1aa24 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1272 microversion: 2.1 time: 0.226591 Aug 29 16:06:38.679550 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2798/5455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:38 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:38.718750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:38.719801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:38.733615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:38.737766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:38.740017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:38.741073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:38.741881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:38.742533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:39.690466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:39.692300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:39.701897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:39.702902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:39.703596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:39.704649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:39.705349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:39.705992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:39.714310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:39.748791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:39.760162 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-254e34bd-9b1e-46e6-82e6-eb410273a47e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 1.052605 Aug 29 16:06:39.775123 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2658/5456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:38 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:39.832798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:39.843661 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e36c9ad9-fd79-4748-bad5-bccf91a59e47 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1272 microversion: 2.1 time: 0.158318 Aug 29 16:06:39.872749 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2799/5457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:39 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:40.783849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:40.785051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:40.803214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.803911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.804634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:40.805560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.806240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.806880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:40.867048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:40.868780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:40.883832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.885002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.886212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:40.887355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:40.889159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:40.889823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:41.149119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:41.158437 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-31365513-f66f-45e6-a96f-c4dc658159c0 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.380721 Aug 29 16:06:41.161609 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2659/5458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:40 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:41.166469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:41.175720 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a6547257-887c-4896-aae3-51a35c468f81 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 0.313857 Aug 29 16:06:41.176316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2800/5459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:40 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:41.473518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-cc5a66a4-99ec-4d73-8c09-4f71161260ac req-068c9b0c-66b5-44e9-b225-c9087eb554b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afca80aa-1bdf-4d3e-aac4-c088da983f70", "tag": "7d51e30e-7af8-4689-bd97-d2a5113fc11d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:41.495295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cc5a66a4-99ec-4d73-8c09-4f71161260ac req-068c9b0c-66b5-44e9-b225-c9087eb554b7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:41.496878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cc5a66a4-99ec-4d73-8c09-4f71161260ac req-068c9b0c-66b5-44e9-b225-c9087eb554b7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:41.497748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cc5a66a4-99ec-4d73-8c09-4f71161260ac req-068c9b0c-66b5-44e9-b225-c9087eb554b7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:41.531382 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-cc5a66a4-99ec-4d73-8c09-4f71161260ac req-068c9b0c-66b5-44e9-b225-c9087eb554b7 service nova] Creating event network-changed:7d51e30e-7af8-4689-bd97-d2a5113fc11d for instance afca80aa-1bdf-4d3e-aac4-c088da983f70 on n-h2-836830-13 Aug 29 16:06:41.537920 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-cc5a66a4-99ec-4d73-8c09-4f71161260ac req-068c9b0c-66b5-44e9-b225-c9087eb554b7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068440 Aug 29 16:06:41.539793 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2660/5460] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:42.181754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:42.183092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:42.195489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.196319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.196976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.197915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.198617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.199287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.201697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:42.203341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:42.224940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.225776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.228014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.229129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:42.230783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:42.232535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:42.390680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:42.400952 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76fc759b-1c5e-47e3-8251-9eb843346c52 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.223062 Aug 29 16:06:42.401782 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2801/5461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:42 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:42.532805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:42.536686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:42.542836 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-629aae4b-1d48-4f1e-8b38-8161dc11bd2d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 0.347399 Aug 29 16:06:42.545984 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2661/5462] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:42 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:43.285516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:43.286129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:43.314333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.317033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.318833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.322863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.329733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.331647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.427787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:43.429252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:43.445051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.446902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.448453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.450280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.451801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.457738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.698123 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-906dded1-9bac-4a32-a12c-16edf6617f6c tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1835 microversion: 2.1 time: 0.416603 Aug 29 16:06:43.699136 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2802/5463] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:43 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1835 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:43.719461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:43.720461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:43.727940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.729163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.730117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.731170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:43.734565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:43.735449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:43.990294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:44.003152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:44.009591 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d27568b-cfd8-4c7b-85ae-941d35dc835e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.586290 Aug 29 16:06:44.022386 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7fae23b3-63ea-49c7-baf5-6cbdb04ea645 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 0.321916 Aug 29 16:06:44.022979 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2803/5464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:43 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:44.031102 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2662/5465] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:43 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:45.036987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:45.038953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:45.041157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:45.042292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=14 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:45.052764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:45.054174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:45.070567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.072692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.086819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.093279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.094461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.097810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.098489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.100389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.101067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.116284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:45.116765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:45.120781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:45.518112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:45.532301 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc1c1ee9-22db-4fd9-aab4-ae037b6c4983 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.499510 Aug 29 16:06:45.555735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2663/5466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:45 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:46.192600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:46.290050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:46.303849 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f88df97-49ea-495c-8f6b-3b010f0cd0bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 1.252598 Aug 29 16:06:46.304594 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2804/5467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:45 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:46.562212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:46.563444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:46.577694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.581730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.582393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.583324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.583946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.584537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.733093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:46.733999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:46.745000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.745507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.756892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.758978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:46.764366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:46.764564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:46.854700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:47.157092 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c70ee611-1710-47c7-abef-b8d10bdaffba tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 204 len: 0 microversion: 2.1 time: 0.428929 Aug 29 16:06:47.187824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2805/5468] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:46 2022] DELETE /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:47.220473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d49e1ae2-a2a4-4395-b958-1a407f3131a9 req-8a5dc915-ab5c-49c9-92b9-e8bd74d4bcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:47.225625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:47.236454 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1a9a88da-ec60-4a08-b144-c5d6a224e374 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.678511 Aug 29 16:06:47.243251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2664/5469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:46 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:47.251481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:47.252103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:47.269275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d49e1ae2-a2a4-4395-b958-1a407f3131a9 req-8a5dc915-ab5c-49c9-92b9-e8bd74d4bcc2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.270032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d49e1ae2-a2a4-4395-b958-1a407f3131a9 req-8a5dc915-ab5c-49c9-92b9-e8bd74d4bcc2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.270712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d49e1ae2-a2a4-4395-b958-1a407f3131a9 req-8a5dc915-ab5c-49c9-92b9-e8bd74d4bcc2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.308841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d49e1ae2-a2a4-4395-b958-1a407f3131a9 req-8a5dc915-ab5c-49c9-92b9-e8bd74d4bcc2 service nova] Creating event network-changed:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h1-836830-13 Aug 29 16:06:47.314238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.314775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.315265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.316014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.316477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.316905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.321789 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d49e1ae2-a2a4-4395-b958-1a407f3131a9 req-8a5dc915-ab5c-49c9-92b9-e8bd74d4bcc2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128696 Aug 29 16:06:47.328730 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2806/5470] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:47.339993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:47.344550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:47.361602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.365304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.368801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:47.371393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:47.372197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:47.372927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.110203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:48.158693 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c4f04fcf-ca5f-4add-a752-1284459135fe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 0.827555 Aug 29 16:06:48.164959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2807/5471] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:47 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:48.252660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1da8c647-ce7b-4d97-bb41-80484038f0cb req-da092a61-f11e-4b8e-b9b2-54b5d18a23ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b859d8b3-75f1-4865-a9d7-1af14ee915f9", "name": "network-vif-plugged", "status": "completed", "tag": "a37fd13c-6d1c-49a9-92a1-fc64e7833f52"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:48.284879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1da8c647-ce7b-4d97-bb41-80484038f0cb req-da092a61-f11e-4b8e-b9b2-54b5d18a23ec service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.288240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1da8c647-ce7b-4d97-bb41-80484038f0cb req-da092a61-f11e-4b8e-b9b2-54b5d18a23ec service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.292986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1da8c647-ce7b-4d97-bb41-80484038f0cb req-da092a61-f11e-4b8e-b9b2-54b5d18a23ec service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.342363 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1da8c647-ce7b-4d97-bb41-80484038f0cb req-da092a61-f11e-4b8e-b9b2-54b5d18a23ec service nova] Creating event network-vif-plugged:a37fd13c-6d1c-49a9-92a1-fc64e7833f52 for instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 on n-h1-836830-13 Aug 29 16:06:48.358724 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1da8c647-ce7b-4d97-bb41-80484038f0cb req-da092a61-f11e-4b8e-b9b2-54b5d18a23ec service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109866 Aug 29 16:06:48.361534 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2808/5472] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:48.375524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:48.377363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:48.390777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.394894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.396217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.398731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:48.399928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:48.401150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:48.991203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:49.011355 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0962f16-b758-4e61-bd80-17a0b0f10915 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.643669 Aug 29 16:06:49.015273 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2809/5473] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:48 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:49.185293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:49.186116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:49.200645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.201516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.201669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.205170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:49.205887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:49.209365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:49.571684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:49.594917 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1244c263-5b48-4ce8-9dfd-864355563ad4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 0.413454 Aug 29 16:06:49.609381 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2810/5474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:49 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:49.850435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:49.876206 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3eb7329e-67b7-4f73-8013-4410959cdb65 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1688 microversion: 2.1 time: 2.631589 Aug 29 16:06:49.894367 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2665/5475] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:47 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1688 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:50.040796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:50.046465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:50.063287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.064512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.065893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.068377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.069776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.070688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.389377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:50.399152 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2e58f42-700a-4362-bc53-a1684d25f7f2 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1314 microversion: 2.1 time: 0.366650 Aug 29 16:06:50.400705 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2811/5476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:50 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:50.619389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:50.621592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:50.645901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.648462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.649652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.653056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.656091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.657954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.757594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7be9c179-8be6-4a41-affa-1c203296b3d8 req-aa090606-dfb0-4aea-b0df-0b9aa715ce13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afca80aa-1bdf-4d3e-aac4-c088da983f70", "name": "network-vif-plugged", "status": "completed", "tag": "7d51e30e-7af8-4689-bd97-d2a5113fc11d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:50.773396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7be9c179-8be6-4a41-affa-1c203296b3d8 req-aa090606-dfb0-4aea-b0df-0b9aa715ce13 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.773881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7be9c179-8be6-4a41-affa-1c203296b3d8 req-aa090606-dfb0-4aea-b0df-0b9aa715ce13 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.774319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7be9c179-8be6-4a41-affa-1c203296b3d8 req-aa090606-dfb0-4aea-b0df-0b9aa715ce13 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.790647 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7be9c179-8be6-4a41-affa-1c203296b3d8 req-aa090606-dfb0-4aea-b0df-0b9aa715ce13 service nova] Creating event network-vif-plugged:7d51e30e-7af8-4689-bd97-d2a5113fc11d for instance afca80aa-1bdf-4d3e-aac4-c088da983f70 on n-h2-836830-13 Aug 29 16:06:50.798317 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7be9c179-8be6-4a41-affa-1c203296b3d8 req-aa090606-dfb0-4aea-b0df-0b9aa715ce13 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047711 Aug 29 16:06:50.799949 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2812/5477] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:50.903809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:50.903809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:50.916328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.917028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.922288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:50.926939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:50.929066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:50.930393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.254368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:51.265277 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e2685fd-c720-4afd-b1fa-6a7509e4b1a0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1688 microversion: 2.1 time: 0.370853 Aug 29 16:06:51.269394 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2813/5478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:50 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1688 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:51.409208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:51.418626 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e353cba-113f-43aa-addd-7a1e488cc373 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 0.804621 Aug 29 16:06:51.423305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:51.424499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:51.443057 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2666/5479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:50 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:51.452112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.454976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.455990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.458348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:51.460037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:51.461073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:51.892045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:51.905971 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e6ab402-c9d2-47a5-ad69-b7c3555ce2f7 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1464 microversion: 2.1 time: 0.484101 Aug 29 16:06:51.907097 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2814/5480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:51 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1464 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:52.007133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.010883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.031327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.033086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.033609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.035461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.037760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.038416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.092407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:06:52.128480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e7335b55-ba88-467f-a6bb-1b804540b004 req-de4fc872-b8ff-412f-80f0-644729466675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6ef01-24e5-4ed7-bd44-645abe19619b", "name": "network-vif-deleted", "tag": "1e4ec391-22e6-4748-aeee-6e9910ad1a0a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:52.158039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e7335b55-ba88-467f-a6bb-1b804540b004 req-de4fc872-b8ff-412f-80f0-644729466675 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.161817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e7335b55-ba88-467f-a6bb-1b804540b004 req-de4fc872-b8ff-412f-80f0-644729466675 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.163547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e7335b55-ba88-467f-a6bb-1b804540b004 req-de4fc872-b8ff-412f-80f0-644729466675 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.193956 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e7335b55-ba88-467f-a6bb-1b804540b004 req-de4fc872-b8ff-412f-80f0-644729466675 service nova] Creating event network-vif-deleted:1e4ec391-22e6-4748-aeee-6e9910ad1a0a for instance dbe6ef01-24e5-4ed7-bd44-645abe19619b on n-h1-836830-13 Aug 29 16:06:52.221358 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e7335b55-ba88-467f-a6bb-1b804540b004 req-de4fc872-b8ff-412f-80f0-644729466675 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099675 Aug 29 16:06:52.223369 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2815/5481] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:06:52.292967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.293593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.313355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.314893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.316748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.317515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.317919 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80feb10a-ec15-4a13-baa0-848df89b84dd tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 204 len: 0 microversion: 2.1 time: 0.320661 Aug 29 16:06:52.319281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2667/5482] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:06:51 2022] DELETE /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:06:52.320075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.320700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.332414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.335308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.352745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.355063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.355591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.362108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.362747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.363322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.404895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.417424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.420508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.421166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lazy-loading 'fault' on Instance uuid dbe6ef01-24e5-4ed7-bd44-645abe19619b {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:06:52.430341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:52.523588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:52.533626 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b6a6d5b5-be57-4c91-aab5-5bd17075f94c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1355 microversion: 2.1 time: 0.246373 Aug 29 16:06:52.534218 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2816/5483] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1355 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:06:52.563510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:52.564468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:52.572004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.572796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.573796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.574711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:52.575833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:52.576530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:52.886004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:52.886565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:52.894978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9aad4105-fe7e-4e58-8361-7adc1a4a0a2e tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1470 microversion: 2.1 time: 0.570987 Aug 29 16:06:52.897990 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-99b22590-481f-4ffb-93ee-75a0529e7ab9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1314 microversion: 2.1 time: 0.344323 Aug 29 16:06:52.898722 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2668/5484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1470 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:52.899687 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2817/5485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:52 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:53.557471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:53.558127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:53.583359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.588839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.598300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.599218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.599708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.600181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.707749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.708729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.709409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.710220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lazy-loading 'fault' on Instance uuid dbe6ef01-24e5-4ed7-bd44-645abe19619b {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:06:53.841893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:53.852189 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9759be79-2522-4c17-a242-063275c408ad tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 200 len: 1355 microversion: 2.1 time: 0.298607 Aug 29 16:06:53.866480 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2669/5486] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:53 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 1355 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:53.933202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:53.934058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:53.940089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:53.942866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:53.958683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.960341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.961827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.962125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.962563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.963642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.964105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.964533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.965005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:53.967281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:53.968484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:53.969666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.215474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:54.234416 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-92a4eba7-49fa-426c-8fe2-405f1643a0e3 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1470 microversion: 2.1 time: 0.321581 Aug 29 16:06:54.236782 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2818/5487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:53 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:54.852417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:54.860857 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5802333d-6336-4653-9f90-a048a7547bd4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1502 microversion: 2.1 time: 0.937816 Aug 29 16:06:54.873807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:54.874426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: dbe6ef01-24e5-4ed7-bd44-645abe19619b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:54.878027 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2670/5488] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:53 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1502 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:54.897540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.898386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.899123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.900077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.900732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.904490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.907685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-db0d0c34-54e8-4793-9c6d-a98c51e2064c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:54.936177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db0d0c34-54e8-4793-9c6d-a98c51e2064c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:54.936787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db0d0c34-54e8-4793-9c6d-a98c51e2064c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:54.939180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db0d0c34-54e8-4793-9c6d-a98c51e2064c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:54.940226 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] HTTP exception thrown: Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b could not be found. Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Request method failure captured: Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b HTTP/1.1 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDONG2yb9mOHKeSltTvDyEcQiLtYQbcBPTxy0x3FxNBGEXH1-i_wA8cuOZwd2nh_mlieUYhV6h68joQSnzP2mBZSWo_OXVfZhWFJZt3PmVDpW23gIlfq-AEevegrGoX_S4C-hfVnJi8_8nBLzj4KsqpP-tAe80eHDwGKZwj5vloWUvXM Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_18bd3c1e18644293a3cc974c300efd06", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/18bd3c1e18644293a3cc974c300efd06"}]}] Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e1ce5d3d668743d5b8843936f77c0150 Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b could not be found. Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'dbe6ef01-24e5-4ed7-bd44-645abe19619b'} Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b could not be found. Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b could not be found. Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:54.949010 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b could not be found. Aug 29 16:06:54.954286 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:54.956078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Returning 404 to user: Instance dbe6ef01-24e5-4ed7-bd44-645abe19619b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:06:54.961096 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-56e27fd2-7cac-4b49-bd15-120e137c666d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b" status: 404 len: 111 microversion: 2.1 time: 0.087580 Aug 29 16:06:54.962363 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2819/5489] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:54 2022] GET /compute/v2.1/servers/dbe6ef01-24e5-4ed7-bd44-645abe19619b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:06:55.002656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-db0d0c34-54e8-4793-9c6d-a98c51e2064c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Going to try to stop instance {{(pid=129132) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:06:55.122073 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-db0d0c34-54e8-4793-9c6d-a98c51e2064c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70/action" status: 202 len: 0 microversion: 2.1 time: 0.217751 Aug 29 16:06:55.123644 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2671/5490] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:06:54 2022] POST /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:06:55.131951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:55.132649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:55.146773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:55.147765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:55.148328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.149285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:55.151010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:55.151720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.260963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:55.261510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:55.282601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:55.286051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:55.286656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.291546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:55.292111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:55.292812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:55.928491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:55.938175 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bf04e5cf-174a-46f7-aa3f-4c12700cdb21 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.810466 Aug 29 16:06:55.943251 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2820/5491] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:55 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:56.166789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e2f77549-c721-411a-92df-e8ff9af0b218 req-27f64f39-9c97-4fb0-ad2b-746b5e094173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b859d8b3-75f1-4865-a9d7-1af14ee915f9", "name": "network-vif-deleted", "tag": "a37fd13c-6d1c-49a9-92a1-fc64e7833f52"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:06:56.192715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:56.201521 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a5043891-1672-4d17-80fd-840cd8d460e8 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1470 microversion: 2.1 time: 0.946720 Aug 29 16:06:56.208437 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2672/5492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:55 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1470 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:56.208754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e2f77549-c721-411a-92df-e8ff9af0b218 req-27f64f39-9c97-4fb0-ad2b-746b5e094173 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:56.210137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e2f77549-c721-411a-92df-e8ff9af0b218 req-27f64f39-9c97-4fb0-ad2b-746b5e094173 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:56.214038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e2f77549-c721-411a-92df-e8ff9af0b218 req-27f64f39-9c97-4fb0-ad2b-746b5e094173 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:56.263494 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e2f77549-c721-411a-92df-e8ff9af0b218 req-27f64f39-9c97-4fb0-ad2b-746b5e094173 service nova] Creating event network-vif-deleted:a37fd13c-6d1c-49a9-92a1-fc64e7833f52 for instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 on n-h1-836830-13 Aug 29 16:06:56.274427 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e2f77549-c721-411a-92df-e8ff9af0b218 req-27f64f39-9c97-4fb0-ad2b-746b5e094173 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109797 Aug 29 16:06:56.277535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2821/5493] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:06:56.964380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:56.965381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:56.996584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:56.997121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:56.998879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:57.002998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:57.004990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:57.006451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:57.259103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:57.264188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:57.310468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:57.319987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:57.335478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:57.336709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:57.340046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:57.349519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:57.445716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:57.446543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:57.447321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:57.451162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lazy-loading 'fault' on Instance uuid b859d8b3-75f1-4865-a9d7-1af14ee915f9 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:06:57.597519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:57.639292 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-93b23652-4ae3-4613-b943-ec7421e931d6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.674795 Aug 29 16:06:57.644756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2673/5494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:56 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:57.756945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de4105e1d104fd3a2301272eadb7d57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e18c8f49fef4b79b9b9dfa05bec73a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:57.771622 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-601f95d0-2bd5-4fcb-947b-21337448ba0b tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 200 len: 1304 microversion: 2.1 time: 0.540810 Aug 29 16:06:57.778273 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2822/5495] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:57 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 1304 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:06:58.673554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:58.674478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:58.685762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:58.695322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:58.696832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:58.698824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:58.699675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:58.701410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:58.702623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:58.816456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:06:58.817183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] [instance: b859d8b3-75f1-4865-a9d7-1af14ee915f9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:06:58.820089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:06:58.835593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:58.842381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:58.842873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:58.843679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:06:58.851458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:06:58.852509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:06:58.888213 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] HTTP exception thrown: Instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 could not be found. Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Request method failure captured: Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 HTTP/1.1 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOQBWm4dhxfbn7fjtAGPpkj3q4gjtXhgF1NLDvyTEUkY0YWf9aqE8nUaAgm6KkEjULNPAGM-0Z0g8kwjiN3lgsAU4UWTABLGjHmWLce7zrGJ1Bk9WH_O5E5Fd1rvZ-f0KBaPgGkDrwjMVcArjyikbdanb1tH6CWvVoKVAFr8l4bbbhc Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e18c8f49fef4b79b9b9dfa05bec73a0 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesNegativeTest-375440981 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e18c8f49fef4b79b9b9dfa05bec73a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e18c8f49fef4b79b9b9dfa05bec73a0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e18c8f49fef4b79b9b9dfa05bec73a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e18c8f49fef4b79b9b9dfa05bec73a0"}]}] Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesNegativeTest-375440981 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e18c8f49fef4b79b9b9dfa05bec73a0 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesNegativeTest-375440981 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesNegativeTest-375440981-project Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 4de4105e1d104fd3a2301272eadb7d57 Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesNegativeTest-375440981-project Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 could not be found. Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b859d8b3-75f1-4865-a9d7-1af14ee915f9'} Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 could not be found. Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 could not be found. Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:06:58.896351 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:58.901047 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:06:58.901047 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:06:58.901047 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:06:58.901047 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:06:58.901047 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:06:58.901047 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 could not be found. Aug 29 16:06:58.901047 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:06:58.906887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] Returning 404 to user: Instance b859d8b3-75f1-4865-a9d7-1af14ee915f9 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:06:58.907980 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6598d97f-2262-4a91-91ac-ca18f8b15339 tempest-VolumesNegativeTest-375440981 tempest-VolumesNegativeTest-375440981-project] 10.222.0.83 "GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9" status: 404 len: 111 microversion: 2.1 time: 0.095550 Aug 29 16:06:58.908734 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2823/5496] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:58 2022] GET /compute/v2.1/servers/b859d8b3-75f1-4865-a9d7-1af14ee915f9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:06:59.829613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:06:59.843353 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d85e17a-3d54-414a-9539-528b82354814 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 1.175556 Aug 29 16:06:59.843965 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2674/5497] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:06:58 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:00.868124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:00.870419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:00.881123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:00.881264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:00.881658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:00.888185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:00.888894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:00.889484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:02.459940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:02.490380 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3eb0cc53-63c3-4003-93ea-943c833832e2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 1.626480 Aug 29 16:07:02.499908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2824/5498] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:00 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:03.514510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:03.515380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:03.552334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:03.553488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:03.553957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:03.556973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:03.557752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:03.561081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:03.619617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:04.329683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:04.343267 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bb6223f6-d19a-4426-932e-ba76885a16eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.833498 Aug 29 16:07:04.346881 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2675/5499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:03 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:05.398622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:05.402238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:05.441957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:05.447579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:05.448100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:05.451829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:05.455463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:05.460434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:06.341782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:06.355992 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-93191256-016f-4ebf-9334-caa7c6dbd239 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.986971 Aug 29 16:07:06.357580 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2825/5500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:05 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:06.589193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0bd21c1a-6046-4a64-8d48-ba15fe57feb9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '.version_select at 0x7f32eeacf670>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:06.602900 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0bd21c1a-6046-4a64-8d48-ba15fe57feb9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [6b603f2e-4390-4c19-8092-7bea3372dd18] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:07:07.378454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:07.378989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:07.398755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:07.398972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:07.399626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:07.402868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:07.404557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:07.408131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:07.631264 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [None req-0bd21c1a-6046-4a64-8d48-ba15fe57feb9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [6b603f2e-4390-4c19-8092-7bea3372dd18] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50756. Aug 29 16:07:07.691878 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0bd21c1a-6046-4a64-8d48-ba15fe57feb9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-981313937" status: 202 len: 0 microversion: 2.1 time: 1.107239 Aug 29 16:07:07.692575 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2676/5501] 10.222.0.83 () {58 vars in 1281 bytes} [Mon Aug 29 16:07:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-981313937 => generated 0 bytes in 1113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:07:07.721851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:07.722471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:07.754772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:07.755402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:07.755861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:07.756589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:07.761573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:07.762184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:07.816875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:07.826575 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5fd17137-4f63-473d-8897-c8bafcf365d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.451811 Aug 29 16:07:07.828928 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2826/5502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:07 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:07.835159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b97b6b1-08c2-4796-b9ed-a7be9775a119 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: .version_select at 0x7f32ed27edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1740408394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJWN4LPrdTXZIRAQvPrtFo6mfDB54BXZlshXBedXTKepbkpOBIeekRi7M1YM2yCBFT5UG+cLLyKVhW4mRZ88CDUVb51oCv0sWdYf8PvTAzjEqb5MXGtw/+48JZ6Ob0myw=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:07.855302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3b97b6b1-08c2-4796-b9ed-a7be9775a119 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:07.866216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3b97b6b1-08c2-4796-b9ed-a7be9775a119 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:07.941264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b97b6b1-08c2-4796-b9ed-a7be9775a119 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.110779 Aug 29 16:07:07.942213 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2827/5503] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:07:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:08.094874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lazy-loading 'services' on Instance uuid 8598d46c-b815-45a6-8444-4194180bd3ec {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:08.284871 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9330204d-b154-4eeb-8c80-3cdf9d7338f6 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec/os-volume_attachments/fd43b5b7-f733-4318-94c0-e50ae4678e4b" status: 202 len: 0 microversion: 2.1 time: 0.582515 Aug 29 16:07:08.289543 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2677/5504] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:07:07 2022] DELETE /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec/os-volume_attachments/fd43b5b7-f733-4318-94c0-e50ae4678e4b => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:07:08.854936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:08.855961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:08.878189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:08.879412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:08.881592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:08.882354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:08.884835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:08.885760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:09.817524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:09.832660 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a53edf8f-82b6-4d51-8e64-e4341d0b5830 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.981206 Aug 29 16:07:09.850999 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2828/5505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:08 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:10.860209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:10.861646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:10.888388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:10.891377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:10.892604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:10.896699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:10.899290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:10.899929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:11.793331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:11.805024 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d79f59f-ed7e-40e9-854b-f4331253e385 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.951003 Aug 29 16:07:11.817773 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2678/5506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:10 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:12.838936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:12.840427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:12.857487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:12.870736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:12.871455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:12.872508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:12.873864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:12.875547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:13.622800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:13.644020 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d0648813-3496-4bc1-95c8-538ce5e32a4d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.801633 Aug 29 16:07:13.644676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2829/5507] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:12 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:14.665394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:14.666561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:14.680203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:14.683882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:14.687292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:14.689324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:14.689809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:14.690242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:15.445580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:15.454988 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c87688f8-fff0-4110-88cc-285864ff3b11 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.793310 Aug 29 16:07:15.455622 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2679/5508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:14 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:16.477325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:16.481238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:16.510080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:16.522661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:16.522661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:16.522661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:16.522661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:16.522661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:17.107223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:17.119469 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-03c47fa7-aabb-4202-9403-b8c0a46164d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.646918 Aug 29 16:07:17.124171 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2830/5509] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:16 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:17.932871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1979810543", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "79db31bc-925d-42e3-baae-d0208fc9fe43"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:18.119275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] validate_networks() for [('79db31bc-925d-42e3-baae-d0208fc9fe43', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:07:18.148550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:18.149955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:18.155791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:18.163769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.164396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.165986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:18.169306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:18.174629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:18.175837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:19.187321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:07:19.188025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:07:19.188930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:07:19.189683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:07:19.190421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:07:19.248065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:19.248992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:19.249780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:19.251217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:19.255667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:19.256507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:19.318489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Getting quotas for project b30e1134a82b4fdc8e7f84e6ce4faf76. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:19.336433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Getting quotas for user 4bb54ce3cfac4eb7b9095f3733745cf1 and project b30e1134a82b4fdc8e7f84e6ce4faf76. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:19.369839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:07:19.375175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:07:19.553340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f3059c7c-3958-4edd-95e9-43ddc39be17d tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.071653 Aug 29 16:07:19.559119 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2680/5510] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:07:19.560788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:19.581314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4faed5f-1dc5-4ddc-afaf-c799c81ee5ee tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:19.582452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4faed5f-1dc5-4ddc-afaf-c799c81ee5ee tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:19.584480 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e42042be-02da-4bed-a04f-df3beb9f2a69 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 1.435063 Aug 29 16:07:19.587715 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2831/5511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:18 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:19.776487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4faed5f-1dc5-4ddc-afaf-c799c81ee5ee tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:19.785774 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4faed5f-1dc5-4ddc-afaf-c799c81ee5ee tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1228 microversion: 2.1 time: 0.216989 Aug 29 16:07:19.788292 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2681/5512] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:19 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1228 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:20.008539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:20.009158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:20.024607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.027345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.031456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.033559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.053748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.055209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.160898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:07:20.449521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1add72e2-dd54-421d-bf62-083780402f45 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 204 len: 0 microversion: 2.1 time: 0.443057 Aug 29 16:07:20.482530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:20.484131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:20.488633 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2832/5513] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:07:20 2022] DELETE /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:07:20.506193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.508325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.508987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.510108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.510606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.511136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.611213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:20.612672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:20.630583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.631591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.632285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:20.636675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:20.638797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:20.642354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:21.147698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:21.159827 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57d00727-8614-49ce-8ae6-1a40b2f0d207 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1513 microversion: 2.1 time: 0.683797 Aug 29 16:07:21.168687 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2682/5514] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:20 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1513 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:21.187637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:21.189769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:21.225534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:21.227623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:21.231003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:21.231990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:21.234987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:21.241298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:21.242012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:21.250694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b692c20-6824-47c7-b76d-e8e13ae5b9bb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1512 microversion: 2.1 time: 0.645031 Aug 29 16:07:21.255349 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2833/5515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:20 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1512 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:21.550392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:21.560743 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e565344f-042d-4429-a6cc-892486a00be8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1224 microversion: 2.1 time: 0.389221 Aug 29 16:07:21.567468 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2683/5516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:21 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1224 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:22.183809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:22.185165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:22.217637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:22.220711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:22.221240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:22.226179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:22.228299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:22.229839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:22.279636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:22.280457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:22.299368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:22.300469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:22.302675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:22.305563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:22.307427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:22.309192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:22.333895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:22.902210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:22.938594 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d9f44a0-56a8-440e-b8e9-698d12777f2e tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1513 microversion: 2.1 time: 0.759825 Aug 29 16:07:22.939400 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2834/5517] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:22 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1513 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:22.954686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:22.957268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:22.975268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:22.977188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:22.984876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:22.988581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:22.989070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:22.993766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.234555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:23.256132 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-893c995f-a7c0-402c-8733-85f6e91695b7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1286 microversion: 2.1 time: 0.314565 Aug 29 16:07:23.257971 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2835/5518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:22 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1286 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:23.359827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:23.370898 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d0886a07-3dfc-4ab2-973b-50134db35564 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1489 microversion: 2.1 time: 1.097653 Aug 29 16:07:23.384878 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2684/5519] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:22 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1489 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:23.404336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:23.414382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:23.440709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.442806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.442806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.442806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.443084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.469628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.577155 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1519809b-9a7b-4150-9a8a-c58e48ac43ef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 200 len: 144 microversion: 2.1 time: 0.174691 Aug 29 16:07:23.580343 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2836/5520] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:07:23 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 144 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:23.588120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:23.588745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:23.599615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.600119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.600563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.601277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.601736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.602168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.963284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:23.964365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:23.976854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.977345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.977781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:23.978481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:23.978931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:23.979388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.108967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:24.131734 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6be62081-b00c-434a-8c70-55f379d7afc6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.546001 Aug 29 16:07:24.133766 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2685/5521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:23 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:24.178749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:24.182503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:24.198370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.202232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.205026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.206098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.207612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.209444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.336089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:24.358636 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa2b36aa-957f-4533-a72c-c19ff1f8a509 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1513 microversion: 2.1 time: 0.399373 Aug 29 16:07:24.359370 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2837/5522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:23 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:24.366116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:24.367109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:24.373876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.374915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.377042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.377941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.378556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.379712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.504868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:24.526454 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ac0ad3e7-ae43-40b1-9b1f-23d888d61453 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1286 microversion: 2.1 time: 0.165618 Aug 29 16:07:24.555701 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2838/5523] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:24 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1286 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:24.812936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:24.825919 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e175a14-88a7-4772-bece-4366133726f4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.659532 Aug 29 16:07:24.831663 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2686/5524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:24 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:24.855222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:24.856079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:24.876955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.882826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.884145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.886133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:24.890017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:24.890494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:24.941095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1029151058", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "050d9e52-1783-4856-93ed-542ef8c5246b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1740408394", "security_groups": [{"name": "tempest-secgroup-smoke-984314581"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:25.735736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] validate_networks() for [('050d9e52-1783-4856-93ed-542ef8c5246b', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:07:25.798987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:25.811197 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fbc6c67e-a0e2-4fbc-b65d-39ad5102dd1d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.960588 Aug 29 16:07:25.817473 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2839/5525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:24 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:25.829086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:25.833484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:25.862661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:25.863196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:25.863635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:25.872402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:25.874753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:25.879104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:25.959344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:25.960206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:25.960803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:25.961429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lazy-loading 'fault' on Instance uuid 8598d46c-b815-45a6-8444-4194180bd3ec {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:07:26.045558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd9c0bd017459cb630823a39e8bd17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315f3de5e40e4a0ca12713b37c555371', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:26.073517 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-99bca2f9-a66d-4264-b73a-4118957197c9 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 200 len: 1309 microversion: 2.1 time: 0.253752 Aug 29 16:07:26.077017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2840/5526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:25 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:26.110397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:26.111356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:26.120055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:26.120814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:26.121442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:26.122917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:26.124074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:26.124677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.379845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:27.391603 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ac7992bd-2671-4392-a449-6c81e88e96ca tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 1.290998 Aug 29 16:07:27.398964 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2841/5527] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:26 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:27.408509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-77d6e750-482e-47d6-81cd-a337d0783281 req-4b2eff1e-1e8f-4ba8-8300-b66fdea2ced3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8598d46c-b815-45a6-8444-4194180bd3ec", "name": "network-vif-deleted", "tag": "83bb5361-1b12-4a2b-91a8-b6e1672069fa"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:27.452524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-77d6e750-482e-47d6-81cd-a337d0783281 req-4b2eff1e-1e8f-4ba8-8300-b66fdea2ced3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.457385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-77d6e750-482e-47d6-81cd-a337d0783281 req-4b2eff1e-1e8f-4ba8-8300-b66fdea2ced3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.457952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-77d6e750-482e-47d6-81cd-a337d0783281 req-4b2eff1e-1e8f-4ba8-8300-b66fdea2ced3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.502128 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-77d6e750-482e-47d6-81cd-a337d0783281 req-4b2eff1e-1e8f-4ba8-8300-b66fdea2ced3 service nova] Creating event network-vif-deleted:83bb5361-1b12-4a2b-91a8-b6e1672069fa for instance 8598d46c-b815-45a6-8444-4194180bd3ec on n-h2-836830-13 Aug 29 16:07:27.519489 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-77d6e750-482e-47d6-81cd-a337d0783281 req-4b2eff1e-1e8f-4ba8-8300-b66fdea2ced3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114851 Aug 29 16:07:27.522399 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2842/5528] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:27.534727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:27.535806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:27.560014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.560927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.561563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:27.563850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:27.564511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:27.567951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.494567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:07:28.496440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:07:28.498051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:07:28.498688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:07:28.500337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:07:28.529028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.529729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.530756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.532676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.534552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.535193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.595207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:28.605040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:28.647921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:07:28.654704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:07:28.783723 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc264643-8078-4e91-b994-12e3b977b2c5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.845850 Aug 29 16:07:28.784680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2687/5529] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:07:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 3850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:07:28.799056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:28.801278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] [instance: 8598d46c-b815-45a6-8444-4194180bd3ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:28.818425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:28.826321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.827886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.828948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.830021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.830635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.847546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.917281 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] HTTP exception thrown: Instance 8598d46c-b815-45a6-8444-4194180bd3ec could not be found. Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Request method failure captured: Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec HTTP/1.1 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOLkfxkD-GnZzDSb1ugnRPgjz96c7W2r3WCuUjJhXlQ7KoNABkcQVpc7qGukQ1RvNc_7aDswJsjVOxU8aALheGA6m_ttFslTdhfVs8OQxASPOgeoc-8HuVqVu7dhj-qOlNJWmIlr1xT8126TwYY_rt7Qg8b-AF-9T7kt6TlDPOlRz6I Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 315f3de5e40e4a0ca12713b37c555371 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505794695 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/315f3de5e40e4a0ca12713b37c555371"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_315f3de5e40e4a0ca12713b37c555371", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/315f3de5e40e4a0ca12713b37c555371"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/315f3de5e40e4a0ca12713b37c555371"}]}] Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505794695 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 315f3de5e40e4a0ca12713b37c555371 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505794695 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesSnapshotTestJSON-1505794695-project Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e9cd9c0bd017459cb630823a39e8bd17 Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505794695-project Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 8598d46c-b815-45a6-8444-4194180bd3ec could not be found. Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '8598d46c-b815-45a6-8444-4194180bd3ec'} Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8598d46c-b815-45a6-8444-4194180bd3ec could not be found. Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8598d46c-b815-45a6-8444-4194180bd3ec could not be found. Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:28.922370 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:28.927356 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:28.927356 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:28.927356 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:28.927356 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:07:28.927356 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:07:28.927356 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8598d46c-b815-45a6-8444-4194180bd3ec could not be found. Aug 29 16:07:28.927356 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:28.931352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] Returning 404 to user: Instance 8598d46c-b815-45a6-8444-4194180bd3ec could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:07:28.933346 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1a9508e-27fd-4aff-a8bb-5dae6b649579 tempest-VolumesSnapshotTestJSON-1505794695 tempest-VolumesSnapshotTestJSON-1505794695-project] 10.222.0.83 "GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec" status: 404 len: 111 microversion: 2.1 time: 0.145980 Aug 29 16:07:28.935559 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2688/5530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:28 2022] GET /compute/v2.1/servers/8598d46c-b815-45a6-8444-4194180bd3ec => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:28.958030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:28.958620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:28.986200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.986776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.987194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:28.991790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:28.992278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:28.992722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:29.201065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:29.214688 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a18fc29-dca3-485f-bd70-38c75bffea00 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.686338 Aug 29 16:07:29.244126 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2843/5531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:27 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:29.271776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49c29638-accf-4fb8-b715-bb82d77065bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:29.273992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-49c29638-accf-4fb8-b715-bb82d77065bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:29.278983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:29.553853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-49c29638-accf-4fb8-b715-bb82d77065bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:29.571647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:29.586348 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96a05d13-a95d-4a43-a08f-4e5e2a6aec2c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 0.649421 Aug 29 16:07:29.586978 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2689/5532] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:28 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:29.591490 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49c29638-accf-4fb8-b715-bb82d77065bd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1267 microversion: 2.1 time: 0.339674 Aug 29 16:07:29.593424 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2844/5533] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:29 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1267 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:29.803397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-702537908", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f86097cf-c2ec-48f3-b00c-ae541e26f7ef"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:29.971371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] validate_networks() for [('f86097cf-c2ec-48f3-b00c-ae541e26f7ef', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:07:30.613171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:30.613960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:30.638591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.656243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.656748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:30.657512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:30.673429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:30.673953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:31.829619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:31.844704 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82ecf065-54a1-46ff-bfb4-896be880f6fe tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 1.234494 Aug 29 16:07:31.848043 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2845/5534] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:30 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:31.859008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:31.861734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:31.871278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:31.872293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:31.872740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:31.873740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:31.874204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:31.874653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:31.971957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:07:31.973085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:07:31.977356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:07:31.978204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:07:31.978868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:07:32.003423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:32.004495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:32.005423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:32.010331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:32.011217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:32.011910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:32.060057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:07:32.072941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for user f075974a803f46eda667db6d754453ba and project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:07:32.108508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:07:32.113236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:07:32.169439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:32.183819 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc8707e5-96f1-4333-992f-03c4f173ab08 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1325 microversion: 2.1 time: 0.333001 Aug 29 16:07:32.185050 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2846/5535] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:31 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1325 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:32.199157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-139bb7fe-ae9e-4d02-8aa2-68df6a5d4d56 req-99d2fd15-a672-46c4-90b0-0fd804ebcf46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05966584-729c-4c34-b2a8-effba609f8d3", "tag": "889a1038-4f8a-426d-bb5c-1c98408d9323"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:32.243104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-139bb7fe-ae9e-4d02-8aa2-68df6a5d4d56 req-99d2fd15-a672-46c4-90b0-0fd804ebcf46 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:32.243598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-139bb7fe-ae9e-4d02-8aa2-68df6a5d4d56 req-99d2fd15-a672-46c4-90b0-0fd804ebcf46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:32.244033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-139bb7fe-ae9e-4d02-8aa2-68df6a5d4d56 req-99d2fd15-a672-46c4-90b0-0fd804ebcf46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:32.258694 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-625b5c82-ec0d-40ae-a11e-7c9c88ccf3c8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.460750 Aug 29 16:07:32.260582 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2690/5536] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:07:32.277421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-712e3b68-b7ff-417a-9444-6af45e3c18f6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:32.279687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-712e3b68-b7ff-417a-9444-6af45e3c18f6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:32.295236 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-139bb7fe-ae9e-4d02-8aa2-68df6a5d4d56 req-99d2fd15-a672-46c4-90b0-0fd804ebcf46 service nova] Creating event network-changed:889a1038-4f8a-426d-bb5c-1c98408d9323 for instance 05966584-729c-4c34-b2a8-effba609f8d3 on n-h1-836830-13 Aug 29 16:07:32.327200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-139bb7fe-ae9e-4d02-8aa2-68df6a5d4d56 req-99d2fd15-a672-46c4-90b0-0fd804ebcf46 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139721 Aug 29 16:07:32.333533 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2847/5537] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:32.504928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-712e3b68-b7ff-417a-9444-6af45e3c18f6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:32.519746 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-712e3b68-b7ff-417a-9444-6af45e3c18f6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1214 microversion: 2.1 time: 0.251683 Aug 29 16:07:32.536288 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2691/5538] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:32 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1214 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:32.875512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:32.879300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:32.901390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:32.907666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:32.908453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:32.909729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:32.910197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:32.911565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:33.207440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:33.207985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:33.224439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:33.225003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:33.225383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:33.226108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:33.226572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:33.227008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:33.585083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:33.594158 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e86a0a88-0a11-4b93-aa2b-583c0c25aa96 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1325 microversion: 2.1 time: 0.390655 Aug 29 16:07:33.594735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2692/5539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:33 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:33.611407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:33.612044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:33.635599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:33.639594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:33.641268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:33.642958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:33.644489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:33.647202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:33.719250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:33.750599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-965f3492-549e-4fa6-b80b-692fccac9430 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 0.885163 Aug 29 16:07:33.753732 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2848/5540] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:32 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:33.805384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:33.810057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:33.820910 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf4010d9-517c-43c5-a04b-3776a4fffbfb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1218 microversion: 2.1 time: 0.217525 Aug 29 16:07:33.821726 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2693/5541] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:33 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:34.625218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:34.626654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:34.640440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:34.641233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:34.644456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:34.645432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:34.647131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:34.649134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:34.779289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:34.781906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:34.805598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:34.806015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:34.816504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:34.818267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:34.820315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:34.826506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:35.099474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:35.110177 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f3b1dcc-2b14-4bd8-901e-73b6506389bc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.489383 Aug 29 16:07:35.110782 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2849/5542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:34 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:35.130660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:35.131595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:35.141746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:35.143618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:35.147663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:35.148430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:35.148910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:35.149367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:35.303728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:35.330449 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0105488c-9f57-41f7-825c-7c297d1b9959 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1274 microversion: 2.1 time: 0.210073 Aug 29 16:07:35.335711 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2850/5543] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:35 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:36.138172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:36.142487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:36.151197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:36.151927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:36.152555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:36.154281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:36.155630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:36.157781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:36.685572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:36.699295 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-288a19d2-6571-4221-990d-e8a6af6578cd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.567295 Aug 29 16:07:36.710190 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2851/5544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:36 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:36.724331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:36.725340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:36.742674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:36.744998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:36.745761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:36.746551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:36.750034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:36.750519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:36.869325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:36.880975 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cb0dafc-38a3-4428-92a6-bdcf4c50fda9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1272 microversion: 2.1 time: 0.169354 Aug 29 16:07:36.881576 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2852/5545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:36 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:36.943457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:36.955105 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-44992348-ac43-4cc3-82af-6d045dd9cfa8 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 2.180558 Aug 29 16:07:36.955664 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2694/5546] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:34 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:37.758918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:37.760512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:37.791153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:37.792508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:37.796155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:37.798827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:37.800889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:37.803429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:37.820529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:37.905481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:37.906246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:37.926646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:37.929770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:37.931433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:37.932674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:37.936401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:37.937107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:38.183747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:38.195839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a24194a1-6c56-4c6e-a924-e7ef8eb3e83c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.460072 Aug 29 16:07:38.196991 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2853/5547] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:37 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:38.221231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:38.222097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:38.228671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:38.229757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:38.230742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:38.232326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:38.233179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:38.233838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:38.547270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:38.558363 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e864585b-0393-4486-8e35-0b75b8af3ef3 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 0.348315 Aug 29 16:07:38.563343 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2854/5548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:38 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:38.884365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:38.895928 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-da4e194e-a8c9-4a0b-9433-66b8f8ff49c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1272 microversion: 2.1 time: 0.995444 Aug 29 16:07:38.896539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2695/5549] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:37 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1272 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:39.227779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:39.228374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:39.249545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:39.250020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:39.252968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:39.255816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:39.259240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:39.259789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:39.560627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:39.586164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:39.587395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:39.627402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:39.629126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:39.631282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:39.634060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:39.636256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:39.636900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:39.811793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:39.823863 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0b8249d-109f-4f19-9eff-6278549ec43c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.604685 Aug 29 16:07:39.824463 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2855/5550] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:39 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:39.921684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:39.922364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:39.936882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:39.937377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:39.937809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:39.944584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:39.945076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:39.951626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:40.137314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:40.150958 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-47094605-3cfa-4c1f-a2f5-6a1b7d0b6710 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1272 microversion: 2.1 time: 0.233079 Aug 29 16:07:40.152745 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2856/5551] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:39 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:40.337292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6ac67c0f-df58-4f58-8de4-f9893c06a66f req-da18777c-fac2-46fe-a904-351b7ea42537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05966584-729c-4c34-b2a8-effba609f8d3", "name": "network-vif-plugged", "status": "completed", "tag": "889a1038-4f8a-426d-bb5c-1c98408d9323"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:40.372572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ac67c0f-df58-4f58-8de4-f9893c06a66f req-da18777c-fac2-46fe-a904-351b7ea42537 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:40.375174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ac67c0f-df58-4f58-8de4-f9893c06a66f req-da18777c-fac2-46fe-a904-351b7ea42537 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:40.376415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ac67c0f-df58-4f58-8de4-f9893c06a66f req-da18777c-fac2-46fe-a904-351b7ea42537 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:40.414697 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6ac67c0f-df58-4f58-8de4-f9893c06a66f req-da18777c-fac2-46fe-a904-351b7ea42537 service nova] Creating event network-vif-plugged:889a1038-4f8a-426d-bb5c-1c98408d9323 for instance 05966584-729c-4c34-b2a8-effba609f8d3 on n-h1-836830-13 Aug 29 16:07:40.428081 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6ac67c0f-df58-4f58-8de4-f9893c06a66f req-da18777c-fac2-46fe-a904-351b7ea42537 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096757 Aug 29 16:07:40.431486 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2857/5552] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:07:40.850981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:40.852039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:40.870946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:40.876408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:40.877253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:40.880253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:40.885995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:40.892095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:40.933237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:40.945604 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8b9f98b-cc1a-470c-8673-9a59c756c618 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 1.362911 Aug 29 16:07:40.954210 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2696/5553] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:39 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:41.117707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-10a89f9a-38e5-4474-bc06-58404e7f0460 req-32558db8-0d74-479b-b7c0-26340a5569da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:41.146227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-10a89f9a-38e5-4474-bc06-58404e7f0460 req-32558db8-0d74-479b-b7c0-26340a5569da service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:41.146895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-10a89f9a-38e5-4474-bc06-58404e7f0460 req-32558db8-0d74-479b-b7c0-26340a5569da service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:41.147532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-10a89f9a-38e5-4474-bc06-58404e7f0460 req-32558db8-0d74-479b-b7c0-26340a5569da service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:41.183704 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-10a89f9a-38e5-4474-bc06-58404e7f0460 req-32558db8-0d74-479b-b7c0-26340a5569da service nova] Creating event network-changed:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:07:41.196892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-10a89f9a-38e5-4474-bc06-58404e7f0460 req-32558db8-0d74-479b-b7c0-26340a5569da service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082704 Aug 29 16:07:41.198260 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2697/5554] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:07:41.204530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:41.215276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:41.230764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:41.234931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:41.238547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:41.239843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:41.243167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:41.243821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:41.639947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:41.648749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b3f0028-c1a5-473f-b40e-3a5c4b11fb7d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.806232 Aug 29 16:07:41.660726 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2858/5555] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:40 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:41.971321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:41.972280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:41.986178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:41.989605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:41.992407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:42.000079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:42.002693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:42.003299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:42.026343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:42.470610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:42.492078 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04d3fba5-73b8-409c-bd78-150cd141a08c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 1.291308 Aug 29 16:07:42.518418 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2698/5556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:41 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:42.630278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:42.646249 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-605d6623-d90b-4532-b1c2-f3c6dcdab601 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1328 microversion: 2.1 time: 0.678802 Aug 29 16:07:42.647680 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2859/5557] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:41 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1328 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:42.689181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:42.690679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:42.718339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=22 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:42.727212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:42.727713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:42.733016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:42.734245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:42.734737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:42.735200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:43.516776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:43.517421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:43.531192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:43.531874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:43.532107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:43.532822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:43.533270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:43.573674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:43.869355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:43.880608 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b2fa41f0-fcf7-4a8f-8347-8a9e7c9f5c4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 1.201210 Aug 29 16:07:43.881201 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2699/5558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:42 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:43.905448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:43.906090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:43.937743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:43.938314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:43.938774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:43.939545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:43.940006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:43.940432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.678194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:44.691762 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d18b9ef7-27d7-42ff-af40-fc19a12eea5c tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1528 microversion: 2.1 time: 0.802531 Aug 29 16:07:44.712674 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2700/5559] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:43 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1528 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:44.720404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:44.722626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:44.742960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.743756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.744329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:44.745689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:44.749140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:44.749899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:45.079247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:45.091315 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8928447e-f09f-4e0e-bf9f-4283c63a24b1 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1528 microversion: 2.1 time: 0.375136 Aug 29 16:07:45.095755 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2701/5560] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:44 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1528 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:45.113864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:45.114784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:45.130236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:45.131310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:45.131922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:45.132921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:45.133577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:45.134201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:45.458156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:45.467767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a176cfd-5e17-4743-bdd9-5c2cfd09b629 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 1.955342 Aug 29 16:07:45.491423 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2860/5561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:43 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 1979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:45.497950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4fdd9f9e-7fd8-4ce3-8bc8-00bf2c023795 req-bdb94e89-922e-483a-9774-f62674708468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020570a0-16f4-400a-9565-2ceb2aa4da3d", "tag": "15d77e41-cd4e-466a-bfbc-894ff1a555c6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:45.530340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4fdd9f9e-7fd8-4ce3-8bc8-00bf2c023795 req-bdb94e89-922e-483a-9774-f62674708468 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:45.530992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4fdd9f9e-7fd8-4ce3-8bc8-00bf2c023795 req-bdb94e89-922e-483a-9774-f62674708468 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:45.531892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4fdd9f9e-7fd8-4ce3-8bc8-00bf2c023795 req-bdb94e89-922e-483a-9774-f62674708468 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:45.556820 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4fdd9f9e-7fd8-4ce3-8bc8-00bf2c023795 req-bdb94e89-922e-483a-9774-f62674708468 service nova] Creating event network-changed:15d77e41-cd4e-466a-bfbc-894ff1a555c6 for instance 020570a0-16f4-400a-9565-2ceb2aa4da3d on n-h1-836830-13 Aug 29 16:07:45.568939 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4fdd9f9e-7fd8-4ce3-8bc8-00bf2c023795 req-bdb94e89-922e-483a-9774-f62674708468 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075807 Aug 29 16:07:45.569957 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2861/5562] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:45.727140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:45.735444 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-63abfd00-5fec-43fd-8023-eba2d7ec5084 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.638480 Aug 29 16:07:45.751704 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2702/5563] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:45 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:46.094903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:46.095756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:46.108741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.109510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.110193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.112181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.114235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.116600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.144710 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] HTTP exception thrown: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Request method failure captured: Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 HTTP/1.1 Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOQ0mCueh6aIOeEW0UvyTk4vIi7Ui0ILk9IFdlluD3EqVqqzi3HYSHoPOJMs6URvipUxJhwEbhmiPYofxN1fWJwqIiupg30AfdSL922NrUYTSjh6kR4sKqvjc7YfyZEkax54keQ_00Zld7CmuY5FSum7KsINgl-YOFgsRJb8HLfekOU Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a214cd253d0949e980d11633ba5ae6ba Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-129360518 Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a214cd253d0949e980d11633ba5ae6ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a214cd253d0949e980d11633ba5ae6ba", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a214cd253d0949e980d11633ba5ae6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a214cd253d0949e980d11633ba5ae6ba"}]}] Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-129360518 Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a214cd253d0949e980d11633ba5ae6ba Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-129360518 Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestMultiTenantJSON-129360518-project Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a6b9bb23a4604eaabd5ba85cec428e4b Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-129360518-project Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '05966584-729c-4c34-b2a8-effba609f8d3'} Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:07:46.149077 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.153670 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.174920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Returning 404 to user: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:07:46.175946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4edd164f-945d-45db-b50c-08627fb5803a tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] 10.222.0.83 "DELETE /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 404 len: 111 microversion: 2.1 time: 0.604897 Aug 29 16:07:46.177432 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2862/5564] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:07:45 2022] DELETE /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 111 bytes in 607 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:46.190021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:46.190644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:46.198977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.200500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.201154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.202362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.203578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.204337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.508589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:46.509223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:46.519432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.522899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.523628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.524692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.526631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.527345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.578974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:46.598576 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1b37887-c4eb-4ac6-8286-c5186ce2d5b5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1528 microversion: 2.1 time: 0.404609 Aug 29 16:07:46.606580 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2703/5565] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:46 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1528 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:46.640231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Action: 'update', calling method: >, body: {"server": {"name": "05966584-729c-4c34-b2a8-effba609f8d3_new"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:46.643054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:46.650521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.651050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.651500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.652309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.652796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.653770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.711083 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] HTTP exception thrown: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Request method failure captured: Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: request: PUT /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 HTTP/1.1 Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 64 Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOQ0mCueh6aIOeEW0UvyTk4vIi7Ui0ILk9IFdlluD3EqVqqzi3HYSHoPOJMs6URvipUxJhwEbhmiPYofxN1fWJwqIiupg30AfdSL922NrUYTSjh6kR4sKqvjc7YfyZEkax54keQ_00Zld7CmuY5FSum7KsINgl-YOFgsRJb8HLfekOU Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a214cd253d0949e980d11633ba5ae6ba Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-129360518 Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a214cd253d0949e980d11633ba5ae6ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a214cd253d0949e980d11633ba5ae6ba", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a214cd253d0949e980d11633ba5ae6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a214cd253d0949e980d11633ba5ae6ba"}]}] Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-129360518 Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a214cd253d0949e980d11633ba5ae6ba Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-129360518 Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestMultiTenantJSON-129360518-project Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a6b9bb23a4604eaabd5ba85cec428e4b Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-129360518-project Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: {"server": {"name": "05966584-729c-4c34-b2a8-effba609f8d3_new"}} Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '05966584-729c-4c34-b2a8-effba609f8d3', 'body': {'server': {'name': '05966584-729c-4c34-b2a8-effba609f8d3_new'}}} Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:07:46.716501 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:07:46.720241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] Returning 404 to user: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:07:46.721378 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b7518aad-099f-4d17-8c6d-8230d84aa5ae tempest-ServersNegativeTestMultiTenantJSON-129360518 tempest-ServersNegativeTestMultiTenantJSON-129360518-project] 10.222.0.83 "PUT /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 404 len: 111 microversion: 2.1 time: 0.091834 Aug 29 16:07:46.724090 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2704/5566] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 16:07:46 2022] PUT /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:07:46.735010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:46.740130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:46.754288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.755402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.757749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.758727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:46.761397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:46.762868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:46.812553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:07:46.995377 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c62f5af0-b581-49ab-93a2-2e18509fd8d2 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "DELETE /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 204 len: 0 microversion: 2.1 time: 0.266768 Aug 29 16:07:46.998879 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2705/5567] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:07:46 2022] DELETE /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:07:47.014835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:47.015928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:47.031390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.031955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.034297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.035536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.036103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.037786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.228896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:47.239412 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0497ae13-4dd7-4050-9715-321e98a65e6b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.238524 Aug 29 16:07:47.240454 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2706/5568] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:46 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:47.246509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:47.248275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:47.255338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.257504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.257504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.257504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:47.257504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:47.257848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:47.272183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:47.285701 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-de8be4ba-d45e-41a6-86cc-f3acab911edb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 0.784778 Aug 29 16:07:47.289990 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2863/5569] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:46 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:47.600273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:47.615839 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6a130c8d-6087-4b30-9d17-ba26cae1a9e7 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1534 microversion: 2.1 time: 0.369051 Aug 29 16:07:47.635428 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2707/5570] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:47 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1534 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:48.265282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:48.266061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:48.296647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.300927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.306459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.317525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:48.321818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:48.326289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.332261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.333878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.365076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.366231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.367964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.370806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.373769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.374451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.784295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:48.798244 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8aa2dec3-f45a-4589-a17c-33e1d94e972f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.539709 Aug 29 16:07:48.815870 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2864/5571] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:48 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:48.829856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:48.832082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:48.850222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.854120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.855366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:48.857564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:48.860626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:48.861223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:49.499982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:49.512240 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cbe3a5f-781e-414e-86b3-40dbcf1be16a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 1.201776 Aug 29 16:07:49.526938 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2708/5572] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:48 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:49.544548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:49.557521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2e820a1-aa68-4f36-ad98-b9a2f8034aaf tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1534 microversion: 2.1 time: 0.740244 Aug 29 16:07:49.563801 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2865/5573] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:48 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1534 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:49.826037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:49.830520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:49.861024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:49.861629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:49.866351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:49.867414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:49.868436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:49.873660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:50.534581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:50.535231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:50.548071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.549297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.549934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:50.550868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.551615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.563729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:50.876568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:50.910744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-51bd82d5-3f1e-4a22-81cb-a6271c267f81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 1.086375 Aug 29 16:07:50.911623 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2709/5574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:49 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:50.932241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:50.933199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:50.951727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.953596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.954234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:50.955162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:50.956861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:50.958096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:51.044586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:07:51.336910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:51.350264 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0a50b8f-446c-497f-a3b4-12b9a7d0c0f4 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1534 microversion: 2.1 time: 0.436020 Aug 29 16:07:51.351125 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2710/5575] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:50 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1534 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:51.500444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:51.508931 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b567b306-78f7-470e-b06b-b2e62c120abe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 0.978114 Aug 29 16:07:51.517559 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2866/5576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:50 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:51.932328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:51.933008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:51.946546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:51.947075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:51.951738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:51.952729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:51.953373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:51.959636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:52.379389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:52.380142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:52.406168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:52.408167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:52.412950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:52.414803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:52.429308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:52.435942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.825478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:53.838268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d94713c-9fbf-4391-96da-64774a9643bf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 1.909901 Aug 29 16:07:53.838855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2711/5577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:51 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:53.855455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-04dc04ee-bef8-41b2-a0f1-c1930bc3e645 req-9da347e5-f801-4025-87f5-f1abc5fadbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05966584-729c-4c34-b2a8-effba609f8d3", "name": "network-vif-deleted", "tag": "889a1038-4f8a-426d-bb5c-1c98408d9323"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:53.872941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb54ce3cfac4eb7b9095f3733745cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30e1134a82b4fdc8e7f84e6ce4faf76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:53.884575 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-994ae091-b68a-46a6-b02c-9aa3d6ac0ad5 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 200 len: 1492 microversion: 2.1 time: 1.509478 Aug 29 16:07:53.887959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-04dc04ee-bef8-41b2-a0f1-c1930bc3e645 req-9da347e5-f801-4025-87f5-f1abc5fadbb5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.888480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-04dc04ee-bef8-41b2-a0f1-c1930bc3e645 req-9da347e5-f801-4025-87f5-f1abc5fadbb5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.888987 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2867/5578] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:52 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 1492 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:53.891998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-04dc04ee-bef8-41b2-a0f1-c1930bc3e645 req-9da347e5-f801-4025-87f5-f1abc5fadbb5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.900574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:53.916220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:53.918458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-04dc04ee-bef8-41b2-a0f1-c1930bc3e645 req-9da347e5-f801-4025-87f5-f1abc5fadbb5 service nova] Creating event network-vif-deleted:889a1038-4f8a-426d-bb5c-1c98408d9323 for instance 05966584-729c-4c34-b2a8-effba609f8d3 on n-h1-836830-13 Aug 29 16:07:53.932835 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-04dc04ee-bef8-41b2-a0f1-c1930bc3e645 req-9da347e5-f801-4025-87f5-f1abc5fadbb5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092513 Aug 29 16:07:53.935555 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2712/5579] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:53.936485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.937242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.937838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.938717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:53.939416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:53.939988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:53.984098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4456e8c4-ef27-4954-97e9-72234e26ed57 req-c8aa40d2-6397-4835-a932-59223a201814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "name": "network-vif-plugged", "status": "completed", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:54.014789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4456e8c4-ef27-4954-97e9-72234e26ed57 req-c8aa40d2-6397-4835-a932-59223a201814 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.015734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4456e8c4-ef27-4954-97e9-72234e26ed57 req-c8aa40d2-6397-4835-a932-59223a201814 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.016606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4456e8c4-ef27-4954-97e9-72234e26ed57 req-c8aa40d2-6397-4835-a932-59223a201814 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.038553 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4456e8c4-ef27-4954-97e9-72234e26ed57 req-c8aa40d2-6397-4835-a932-59223a201814 service nova] Creating event network-vif-plugged:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:07:54.046071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4456e8c4-ef27-4954-97e9-72234e26ed57 req-c8aa40d2-6397-4835-a932-59223a201814 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091219 Aug 29 16:07:54.046902 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2713/5580] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:07:54.855174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:54.869841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:54.876773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:54.892157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dacd6519-3ec6-4655-a981-b0442d05e06b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 1.002002 Aug 29 16:07:54.893681 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2868/5581] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:53 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:54.899143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.900197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.902467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.904633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.905297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.907589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.917250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:54.918044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] [instance: 05966584-729c-4c34-b2a8-effba609f8d3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:54.928419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.929155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.930015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.931472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:54.934897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:54.935836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:54.987175 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] HTTP exception thrown: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Request method failure captured: Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 HTTP/1.1 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOQiajexpc4JyGurgxZcOoKGXKVyOfV-XXMNHQMzHv1re4JepSIU_jQAZyaYaVUUxLMerpxMbeXtheb3O-Mht2dzddQfUZgn2shLEdxha52cvr-QEOPgW5SAfjWXw6zV3set-4ZR21PFa0fsxEqmBFMeO61PUowHiAmqxCQXCpG2kfE Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: b30e1134a82b4fdc8e7f84e6ce4faf76 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1400273384 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b30e1134a82b4fdc8e7f84e6ce4faf76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_b30e1134a82b4fdc8e7f84e6ce4faf76", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/b30e1134a82b4fdc8e7f84e6ce4faf76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/b30e1134a82b4fdc8e7f84e6ce4faf76"}]}] Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1400273384 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: b30e1134a82b4fdc8e7f84e6ce4faf76 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1400273384 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1400273384-project Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 4bb54ce3cfac4eb7b9095f3733745cf1 Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1400273384-project Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '05966584-729c-4c34-b2a8-effba609f8d3'} Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:54.989067 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. Aug 29 16:07:54.992978 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:07:54.995414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] Returning 404 to user: Instance 05966584-729c-4c34-b2a8-effba609f8d3 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:07:55.001056 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2404a299-d86c-4343-a51d-3990fbae3bd0 tempest-ServersNegativeTestMultiTenantJSON-1400273384 tempest-ServersNegativeTestMultiTenantJSON-1400273384-project] 10.222.0.83 "GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3" status: 404 len: 111 microversion: 2.1 time: 0.088903 Aug 29 16:07:55.002148 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2869/5582] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:54 2022] GET /compute/v2.1/servers/05966584-729c-4c34-b2a8-effba609f8d3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:07:55.752604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:55.774583 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e6ced7c-23c4-47bb-a3ab-5be99593d532 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1392 microversion: 2.1 time: 0.909883 Aug 29 16:07:55.788145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2714/5583] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:54 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1392 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:55.919367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:55.921096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:55.939945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.941587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.943504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:55.948438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:55.951475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:55.954192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.093003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-fcc08f39-a61e-410e-8245-b78dc623474f req-f421ee67-a9d0-446b-b066-474c9358c692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020570a0-16f4-400a-9565-2ceb2aa4da3d", "name": "network-vif-plugged", "status": "completed", "tag": "15d77e41-cd4e-466a-bfbc-894ff1a555c6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:07:56.145998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fcc08f39-a61e-410e-8245-b78dc623474f req-f421ee67-a9d0-446b-b066-474c9358c692 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.150520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fcc08f39-a61e-410e-8245-b78dc623474f req-f421ee67-a9d0-446b-b066-474c9358c692 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.154549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fcc08f39-a61e-410e-8245-b78dc623474f req-f421ee67-a9d0-446b-b066-474c9358c692 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.206381 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-fcc08f39-a61e-410e-8245-b78dc623474f req-f421ee67-a9d0-446b-b066-474c9358c692 service nova] Creating event network-vif-plugged:15d77e41-cd4e-466a-bfbc-894ff1a555c6 for instance 020570a0-16f4-400a-9565-2ceb2aa4da3d on n-h1-836830-13 Aug 29 16:07:56.226876 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-fcc08f39-a61e-410e-8245-b78dc623474f req-f421ee67-a9d0-446b-b066-474c9358c692 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137445 Aug 29 16:07:56.231457 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2715/5584] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:07:56.804896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:56.805607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:56.823299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.823738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.826112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:56.827836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:56.832957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:56.833838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.092723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:57.138384 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e61dec8-ff1b-4755-ba9f-003fede29ed6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 1.219697 Aug 29 16:07:57.142617 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2870/5585] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:55 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:57.694104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:57.786741 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee817ba7-60c2-4e7d-bcbe-edaf08357cbc tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1564 microversion: 2.1 time: 0.982909 Aug 29 16:07:57.787895 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2716/5586] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:56 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1564 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:07:57.820376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:57.821864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:57.879770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.880645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.885213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:57.927924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:57.930298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:57.932701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:58.168196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:07:58.171109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:07:58.228611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:58.240445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:58.249003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:58.265324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:07:58.267961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:07:58.269198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:07:58.949264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:58.993665 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-489f463d-14ee-49a2-8355-78f60c2ef82a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1314 microversion: 2.1 time: 0.832575 Aug 29 16:07:58.999310 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2717/5587] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:58 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:07:59.213625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:07:59.266549 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-93447868-e513-452d-8b31-00cb7762d482 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1564 microversion: 2.1 time: 1.460672 Aug 29 16:07:59.270766 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2871/5588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:07:57 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1564 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:00.026040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:00.027562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:00.048369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:00.050353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:00.051186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:00.051917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:00.053264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:00.053956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:00.054882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.727574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:01.785989 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b03ea4e8-36d6-4623-a076-86998a718e66 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1502 microversion: 2.1 time: 1.746035 Aug 29 16:08:01.786746 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2718/5589] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:00 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1502 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:01.814928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:01.818538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:01.847150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=58 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:01.849011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:01.849676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:01.852394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.853318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:01.853973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:01.863764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:01.938336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:01.968505 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67841719-541b-4024-9943-0be69b1801dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 14 microversion: 2.1 time: 0.161660 Aug 29 16:08:01.969750 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2872/5590] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:01 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:08:02.980485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:02.983113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:03.000751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:03.001608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:03.005797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:03.009735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:03.010350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:03.010889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:03.093168 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a503ff7-b345-4e37-8bac-bf29559cdc5e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 14 microversion: 2.1 time: 0.114948 Aug 29 16:08:03.095610 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2719/5591] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:02 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:08:04.105291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:04.108512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:04.146230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:04.149621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:04.153322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:04.154931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:04.158117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:04.160843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:04.301040 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-955c973f-ae97-436b-91c4-3984d9e18547 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 14 microversion: 2.1 time: 0.199977 Aug 29 16:08:04.315747 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2873/5592] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:04 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:08:05.322621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:05.326223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:05.340904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:05.349200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:05.350040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:05.351105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:05.351799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:05.352480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:05.445237 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-91c44f0b-c622-468f-96fe-d7b4e0796479 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 14 microversion: 2.1 time: 0.128190 Aug 29 16:08:05.446997 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2720/5593] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:05 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:08:06.466024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:06.472592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:06.533384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:06.538155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:06.540522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:06.546105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:06.549313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:06.565280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:06.689054 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ed37d05-f9d6-4c24-862c-89a5e4fa869e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 14 microversion: 2.1 time: 0.232581 Aug 29 16:08:06.696366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2874/5594] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:06 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:08:07.708760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:07.719163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:07.742213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.745746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.748476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.752251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:07.755369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:07.756589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:07.885839 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-97d7e683-7e0c-4d11-b5d4-9a4b31a75c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 14 microversion: 2.1 time: 0.185948 Aug 29 16:08:07.893196 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2721/5595] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:07 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 14 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:08:08.175880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:08.176790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:08.220522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a160363e-9045-400d-8ef2-9390b55fb503 req-69f14297-2560-478a-99fd-f4ee146372cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:08.225911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.229418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.233354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.236637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.237138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.241877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.281756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a160363e-9045-400d-8ef2-9390b55fb503 req-69f14297-2560-478a-99fd-f4ee146372cf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.282545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a160363e-9045-400d-8ef2-9390b55fb503 req-69f14297-2560-478a-99fd-f4ee146372cf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.283058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a160363e-9045-400d-8ef2-9390b55fb503 req-69f14297-2560-478a-99fd-f4ee146372cf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.321146 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a160363e-9045-400d-8ef2-9390b55fb503 req-69f14297-2560-478a-99fd-f4ee146372cf service nova] Creating event network-changed:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:08:08.339662 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a160363e-9045-400d-8ef2-9390b55fb503 req-69f14297-2560-478a-99fd-f4ee146372cf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125484 Aug 29 16:08:08.342410 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2722/5596] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:08.810945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:08.832332 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3b7da265-0357-413f-83dc-45034880d339 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1564 microversion: 2.1 time: 0.665794 Aug 29 16:08:08.833468 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2875/5597] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:08 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1564 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:08.908701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:08.917656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:08.962594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.968322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.969185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:08.970340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:08.971073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:08.971652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:09.037420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-05e77cbb-3c00-41d1-a107-d2337882a606 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 14 microversion: 2.1 time: 0.142304 Aug 29 16:08:09.040748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2723/5598] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:08 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:08:10.053787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:10.056769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:10.078673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.079202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.080496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:10.082220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.082706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.084970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:10.220451 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c4bf57ee-0783-4357-ad6c-e5e455687bd1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action" status: 200 len: 8205 microversion: 2.1 time: 0.174400 Aug 29 16:08:10.221147 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2876/5599] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:10 2022] POST /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d/action => generated 8205 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:10.232989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:10.235129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:10.257837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.267286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.269046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:10.276953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:10.277672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:10.278308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.144503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:11.160014 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b87ad700-a273-45b6-ad3e-4e3bdcb0e3d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.932740 Aug 29 16:08:11.161195 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2724/5600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:10 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:11.196237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:11.199221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:11.228290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:11.233391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:11.233891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.234653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:11.235189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:11.235629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:11.977682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:11.991014 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10d07a32-b7c6-4f07-81e8-32c0cfe79e97 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.806744 Aug 29 16:08:12.003631 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2877/5601] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:11 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:12.017357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:12.018215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:12.033774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.047239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.048409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:12.051815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.053031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.056407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:12.729561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:12.740375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8252b4e5-3a5e-4022-89b1-b6c468c73015 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.728453 Aug 29 16:08:12.744734 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2725/5602] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:12 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:12.767641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:12.768265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:12.782157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.782724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.783228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:12.784009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:12.784471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:12.784902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:13.574991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:13.587565 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c4632db3-2b64-4152-9405-c14709bbd7d3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.824383 Aug 29 16:08:13.588193 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2878/5603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:12 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:13.614973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:13.616202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:13.628670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:13.630183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:13.635721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:13.636966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:13.637726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:13.638531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:13.765354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Locking {{(pid=129132) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 29 16:08:13.930295 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4faa8efc-2e0c-48bd-a54f-dfa3ae5aa818 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.320278 Aug 29 16:08:13.932218 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2726/5604] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:13 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:13.941518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:13.942075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:13.953245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:13.954755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:13.956486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:13.958187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:13.959593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:13.960965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:14.413933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:14.441347 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e84dc2e3-435e-44f5-aab5-f83b3a71ae6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.504720 Aug 29 16:08:14.452610 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2879/5605] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:13 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:14.476813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:14.490289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:14.490807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:14.491292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:14.545041 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] HTTP exception thrown: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 is locked Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Request method failure captured: Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action HTTP/1.1 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 15 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDONHKzAWTDNEQQXuETEK6x53NyUExCw9qInVFT-7DfuM7QA5vlZzdEN0fMVvcm599ByeouR2fPnwP-v1_H6kCJbFUFIS-kArPtacSK6nEXdffPWWQwnncmf--iFR9nN9XyybYZcHW9TcVCTYBHU3JcxJOnJji4eYc2M2rONylYJY2hQ Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8cf22730fb014345a7ed2aeb866bbe61", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8cf22730fb014345a7ed2aeb866bbe61"}]}] Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f075974a803f46eda667db6d754453ba Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: {"os-stop": {}} Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 is locked Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'b3f160ac-9dfa-479c-9cd7-d183bddfb6a5', 'body': {'os-stop': {}}} Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 is locked Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 is locked Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 is locked Aug 29 16:08:14.546691 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:14.554565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Returning 409 to user: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 is locked {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:14.554565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e55989c6-b89f-4c7a-a567-516edfed6a45 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 409 len: 107 microversion: 2.1 time: 0.075425 Aug 29 16:08:14.554565 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2727/5606] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:14 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 107 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:08:14.557436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:14.557988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:14.565399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:14.565904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:14.566345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:14.573188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:14.573844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:14.574701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:14.670680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Unlocking {{(pid=129133) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 16:08:14.766861 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-656cb538-4af5-4e7e-9e7e-0e57940e5e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.212986 Aug 29 16:08:14.767878 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2880/5607] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:14 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:08:14.776443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc481750-6a71-48fe-97a4-884e896d440d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:14.787707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc481750-6a71-48fe-97a4-884e896d440d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:14.790971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc481750-6a71-48fe-97a4-884e896d440d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:14.791631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc481750-6a71-48fe-97a4-884e896d440d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:14.856641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:14.865283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc481750-6a71-48fe-97a4-884e896d440d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Going to try to stop instance {{(pid=129132) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:08:14.972417 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc481750-6a71-48fe-97a4-884e896d440d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.199416 Aug 29 16:08:14.974916 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2728/5608] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:14 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:14.983748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:14.984385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:14.999921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:15.000886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:15.001342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:15.002090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:15.002547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:15.002974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:15.811187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:15.820921 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce73aec1-d697-48ac-9fd3-dc091c404536 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.841944 Aug 29 16:08:15.827909 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2881/5609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:14 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:16.851898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:16.853854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:16.869382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:16.870438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:16.872063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:16.874216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:16.878473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:16.878692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:17.335308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:17.343813 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b3ad13ff-9322-488f-9c00-20089d08ffb8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.497583 Aug 29 16:08:17.359817 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2729/5610] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:16 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:18.368732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:18.372136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:18.394092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:18.395779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:18.396736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:18.397841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:18.398960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:18.400697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:18.464073 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:08:18.465438 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 (ip 10.222.0.83) !!! Aug 29 16:08:19.508384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:19.529926 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8524782-be3d-4028-8f58-99289fc70197 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 1.166748 Aug 29 16:08:19.548344 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2882/5611] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:18 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:21.341444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:21.343113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:21.354791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:21.359279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:21.366144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:21.367263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:21.372399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:21.375215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:22.081359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:22.112261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-178c61a8-ca84-463d-9778-ba73dae4c282 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 1.554014 Aug 29 16:08:22.114728 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2730/5612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:20 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:23.141528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:23.142555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:23.158875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:23.160567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:23.161036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:23.163435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:23.165106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:23.167215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:23.191385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-549345330", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "97e609f4-3ea5-48a5-93a5-ddcc176e8136"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:23.352732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] validate_networks() for [('97e609f4-3ea5-48a5-93a5-ddcc176e8136', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:23.673047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:23.689621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd78f84d-e7b0-4486-968a-fe988b9e8a41 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.555015 Aug 29 16:08:23.693200 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2883/5613] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:23 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:24.227774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:24.228502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:24.228979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:24.229391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:24.229802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:24.243858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:24.244350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:24.244788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:24.245524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:24.245976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:24.247009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:24.346383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Getting quotas for project 4c81ef7b2ac644b394ffa1c04c11ea45. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:24.369497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Getting quotas for user c4dc9da48de7438598c1aa4bc8d238ce and project 4c81ef7b2ac644b394ffa1c04c11ea45. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:24.436757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:24.439660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:24.588260 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-58c0046c-ff30-45e6-8d3b-278e7e17a836 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.402452 Aug 29 16:08:24.601594 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2731/5614] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:08:24.603621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37d7664d-dd14-49fb-9a9b-bfdb219d41ad tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:24.604983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37d7664d-dd14-49fb-9a9b-bfdb219d41ad tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:24.723455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:24.724398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:24.731136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:24.731821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:24.732463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:24.733193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:24.733657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:24.734085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:24.740735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37d7664d-dd14-49fb-9a9b-bfdb219d41ad tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:24.751927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37d7664d-dd14-49fb-9a9b-bfdb219d41ad tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1213 microversion: 2.1 time: 0.152124 Aug 29 16:08:24.755783 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2884/5615] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:24 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:25.386030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:25.400013 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0fa1b766-4a77-4bb4-bcd4-a129944bcc5c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.680444 Aug 29 16:08:25.408025 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2732/5616] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:24 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:25.781953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:25.783359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:25.808264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:25.809171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:25.815651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:25.816648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:25.817469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:25.818048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:25.958215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:25.972513 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ba5b0b8-b900-47aa-ab0a-38250ce9347d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1217 microversion: 2.1 time: 0.199029 Aug 29 16:08:25.974221 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2885/5617] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:25 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:26.433150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:26.435259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:26.449423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:26.453265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:26.456553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:26.458603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:26.462874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:26.462874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.011366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:27.011366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:27.016430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.016926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.017361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.021212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:27.023209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:27.023664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:27.170726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:27.181224 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2fa91bb0-b309-4e17-8f7d-c813b77ab385 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1273 microversion: 2.1 time: 0.185839 Aug 29 16:08:27.182195 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2886/5618] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:26 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:27.664926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ead702a-1c56-4f71-ba5f-c3743eff3ba0 tempest-ExtensionsTest-1247349801 tempest-ExtensionsTest-1247349801-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:27.666618 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ead702a-1c56-4f71-ba5f-c3743eff3ba0 tempest-ExtensionsTest-1247349801 tempest-ExtensionsTest-1247349801-project] 10.222.0.83 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.236586 Aug 29 16:08:27.667613 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2887/5619] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 29 16:08:27 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:27.683197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c573050-130e-4d10-95b7-de5e8efd8115 tempest-ExtensionsTest-1247349801 tempest-ExtensionsTest-1247349801-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:27.694005 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c573050-130e-4d10-95b7-de5e8efd8115 tempest-ExtensionsTest-1247349801 tempest-ExtensionsTest-1247349801-project] 10.222.0.83 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012656 Aug 29 16:08:27.696133 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2888/5620] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 16:08:27 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:08:28.213541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:28.215229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:28.227007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.229375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.231264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.234120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.235480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.236129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.414105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:28.430205 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-22ed2ea3-727e-422a-b7ba-3fee286cd17b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1271 microversion: 2.1 time: 0.225527 Aug 29 16:08:28.435656 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2889/5621] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:28 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:28.460105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:28.493872 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c93ac1d1-555e-488a-8d7f-56ddb99e7625 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1658 microversion: 2.1 time: 2.061402 Aug 29 16:08:28.498818 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2733/5622] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:26 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1658 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:28.518278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b66cee3c-51bd-41de-b7b5-df9de1270ae6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:28.533944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b66cee3c-51bd-41de-b7b5-df9de1270ae6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.534455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b66cee3c-51bd-41de-b7b5-df9de1270ae6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.537831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b66cee3c-51bd-41de-b7b5-df9de1270ae6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.634530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b66cee3c-51bd-41de-b7b5-df9de1270ae6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Going to try to start instance {{(pid=129133) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:08:28.666602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:28.738577 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b66cee3c-51bd-41de-b7b5-df9de1270ae6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.224736 Aug 29 16:08:28.751557 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2890/5623] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:28 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:28.760298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:28.760926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:28.833220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.834924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.837173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:28.843253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:28.846844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:28.847336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.463578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:29.464508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:29.485499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.486550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.487195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.489054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:29.491918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:29.492664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:29.732991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:29.763339 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-352f3100-598f-45d4-b550-389248718bcc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1271 microversion: 2.1 time: 0.306043 Aug 29 16:08:29.764218 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2891/5624] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:29 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:30.044265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:30.064605 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cfa8b085-c5e7-4fa8-8ff1-b1525961619b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1667 microversion: 2.1 time: 1.308556 Aug 29 16:08:30.065670 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2734/5625] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:28 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1667 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:30.792013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:30.794144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:30.806719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.807254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.809823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:30.810811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:30.812634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:30.813245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.086883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:31.087569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:31.091543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:31.107931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.108434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.108964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.109743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:31.110207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:31.110636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:31.190151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:31.200556 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8cfe3744-a500-493b-8b8f-e051d3172ed6 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 0.414414 Aug 29 16:08:31.208963 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2892/5626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:30 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:31.711699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:31.733643 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-044174e6-aae2-43ba-9b52-f048b6b64cc1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1667 microversion: 2.1 time: 0.651602 Aug 29 16:08:31.740495 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2735/5627] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:31 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1667 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:32.222100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:32.223426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:32.234072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=40 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:32.243961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.244788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.246909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.248019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.248567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.249073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.757599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:32.768003 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f33a9837-b2e9-406f-9568-9d83aebd39dd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 0.550010 Aug 29 16:08:32.798513 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2893/5628] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:32 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:32.823908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:32.823908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:32.844503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.845613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.846069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.848934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.849423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.852319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.883790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-366d8725-6f59-45cb-a4eb-35894cb827b6 req-cbd5c574-a93d-43fa-b0be-3f8f05076099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e30db7-a372-4741-807a-606f50e6de70", "tag": "d22907f7-c845-48e7-a3ee-eda2e42a418b"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:32.902411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-366d8725-6f59-45cb-a4eb-35894cb827b6 req-cbd5c574-a93d-43fa-b0be-3f8f05076099 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:32.906261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-366d8725-6f59-45cb-a4eb-35894cb827b6 req-cbd5c574-a93d-43fa-b0be-3f8f05076099 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:32.906886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-366d8725-6f59-45cb-a4eb-35894cb827b6 req-cbd5c574-a93d-43fa-b0be-3f8f05076099 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:32.947771 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-366d8725-6f59-45cb-a4eb-35894cb827b6 req-cbd5c574-a93d-43fa-b0be-3f8f05076099 service nova] Creating event network-changed:d22907f7-c845-48e7-a3ee-eda2e42a418b for instance 26e30db7-a372-4741-807a-606f50e6de70 on n-h2-836830-13 Aug 29 16:08:32.956595 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-366d8725-6f59-45cb-a4eb-35894cb827b6 req-cbd5c574-a93d-43fa-b0be-3f8f05076099 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.617507 Aug 29 16:08:32.958100 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2736/5629] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:33.425738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:33.442903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4b28cc0c-ef46-4073-b9bb-f07ececbb865 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.642333 Aug 29 16:08:33.447136 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2894/5630] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:32 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:33.477809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:33.478543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:33.501684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.502236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.502769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:33.505845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:33.507602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:33.509832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.029029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:34.041667 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c92d7540-11a3-4383-87d9-6fb45149b16b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.577379 Aug 29 16:08:34.049224 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2737/5631] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:33 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:34.067355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:34.069226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.081366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.083268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.084097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.085365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.086370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.086952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.235662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:34.238811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.249619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.250458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.251146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.252231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.252894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.253780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.311269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:34.427043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:34.515047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:34.527546 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1afc0dda-3407-4615-8956-4399fd8cf369 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 0.475283 Aug 29 16:08:34.528576 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2738/5632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:34 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:34.540639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:34.541189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.551240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.551677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.552116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.552823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.553274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.553697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.654560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Unlocking {{(pid=129132) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 29 16:08:34.752130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:34.777747 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e681a2e-ebd4-44c3-9822-5f140f4e2aad tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.247886 Aug 29 16:08:34.778480 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2739/5633] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:34 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:34.788957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:34.789580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:34.797919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.798414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.798850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:34.812079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:34.812821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:34.813425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.478543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:35.496954 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a9b5a6a-155f-461c-9fd1-5a41314ae747 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.711442 Aug 29 16:08:35.497991 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2740/5634] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:34 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:35.522035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:35.523116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:35.537093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.537809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.538438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.539377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.540047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.540524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.919980 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7284f2aa-031d-488c-a92c-55d20a860f7a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action" status: 200 len: 24572 microversion: 2.1 time: 2.188640 Aug 29 16:08:35.921180 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2895/5635] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:33 2022] POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action => generated 24572 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:08:35.926928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:35.935191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:35.953335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.958392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.959867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:35.961629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:35.962109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:35.962543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.364008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:36.377672 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-885bcf49-78b9-4b04-80e1-6b1fcfbc0b93 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 0.455247 Aug 29 16:08:36.379170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2896/5636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:35 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:36.638260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:36.654563 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5e1e071-dc2f-4bbf-a653-9aded4c6d054 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.136058 Aug 29 16:08:36.655205 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2741/5637] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:35 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:36.697584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:36.700608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:36.725526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.726227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.726764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:36.727667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:36.729198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:36.729871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.136084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:37.150252 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-39b3efb3-ea14-4207-8860-5dae02c65fb6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.470767 Aug 29 16:08:37.154154 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2897/5638] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:36 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:37.178440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:37.178990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:37.189931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.191562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.195422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.196246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.196798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.197239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.359186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:37.411702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:37.423906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:37.425750 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b5fc3e1-c700-4c30-b554-7fe71ca97e3f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.252024 Aug 29 16:08:37.426736 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2742/5639] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:37 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:37.440587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:37.441817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:37.451802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.452477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.453103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.454162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.455129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.456344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.463609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.464191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.464792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:37.473691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:37.474366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:37.475370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:38.130164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:38.157018 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0f4423c-879a-4e71-ab37-67b7d3c07f68 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1676 microversion: 2.1 time: 0.725485 Aug 29 16:08:38.162324 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2743/5640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:37 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1676 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:38.385490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:38.398714 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be948a9b-433b-49d0-a888-ab54a4ccd9b4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 1.004376 Aug 29 16:08:38.415334 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2898/5641] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:37 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:39.185775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.187141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:39.196247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.197005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.197681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.198721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.200449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.201144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.428199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.429249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:39.444282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.444771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.445701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.446568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.447381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.447969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.695668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:39.713569 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d165c5fd-ba95-4dd5-b844-cf9b3d73f434 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1656 microversion: 2.1 time: 0.533133 Aug 29 16:08:39.714190 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2744/5642] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1656 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:39.738560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:39.739444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:39.768099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.768526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.768974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.769695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.770155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.770808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.955509 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5bf6a150-3c64-4cad-a996-e7200722d7d0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.223269 Aug 29 16:08:39.957416 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2745/5643] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:08:39 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:08:39.968392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:39.969364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:39.983986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.986100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.988933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:39.991971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:39.992821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:39.993494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:40.339592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:40.350736 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ecb843c3-784a-452b-a8a6-ba6412aed7b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1663 microversion: 2.1 time: 0.388686 Aug 29 16:08:40.363227 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2746/5644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1663 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:40.553201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:40.568728 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8dc12f8e-9980-4a7b-a2de-5b6774d8a2f0 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 1.145740 Aug 29 16:08:40.569699 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2899/5645] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:39 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:41.386423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:41.391411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:41.420534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.422167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.423522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.427727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.429197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.432591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.592312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:41.593017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:41.608840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.609350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.615313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.616727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:41.617379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:41.618349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:41.925511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:41.934712 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b255b890-3179-40a3-bc32-d5f39e7dc4bc tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 0.346601 Aug 29 16:08:41.939724 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2900/5646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:41 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:42.031810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:42.048895 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a9cf66b3-0d74-4cd7-b623-5c8fb9861d7b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.678428 Aug 29 16:08:42.050069 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2747/5647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:41 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:42.078967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:42.080014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:42.096886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.097814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.098487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.099841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.103092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.103831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.734715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:42.766503 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b7cecac-bf67-4357-914e-c691e7eb062a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.692078 Aug 29 16:08:42.767317 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2901/5648] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:42 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:42.796693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:42.797909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:42.812525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.813222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.814245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.816859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.819042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.821017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.963629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:42.964273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:42.988439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.988439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.988439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:42.988439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:42.988439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:42.988439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.221863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:43.231015 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f3f5a4b1-b5ea-4eb4-bc0e-0b6621bc2c44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.438860 Aug 29 16:08:43.232389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2748/5649] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:42 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:43.339415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2df32f94-6275-45c5-a8a4-58288ca06bc9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'create', calling method: .version_select at 0x7f32ef0f7ee0>, body: {"keypair": {"name": "tempest-keypair-93064840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsAmNo9oS8LNP7rLSdK1QdAVt/P2zrojRIUnqBMuca6aYm3ZR3s/fi4lyAFjoqFG5T8hKbly/mEjZVdD8hjU7tfNcl6HBcI9IZFhFOY69OLvjrqhl3BhtLYLMSjM57xQQ=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:43.380172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2df32f94-6275-45c5-a8a4-58288ca06bc9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for project a32ab2f89fcf4b3ab01be67165388175. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:43.392577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2df32f94-6275-45c5-a8a4-58288ca06bc9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for user 884be770746c44d29f50c099613f08ed and project a32ab2f89fcf4b3ab01be67165388175. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:43.459156 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2df32f94-6275-45c5-a8a4-58288ca06bc9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.225455 Aug 29 16:08:43.460421 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2749/5650] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 16:08:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 16:08:43.471842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:43.473475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:43.486006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:43.488136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.488849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.489453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.491940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.492408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.495675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.495833 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ba3699c-775a-4e1f-8b68-1fead8eb5dd9 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 0.536524 Aug 29 16:08:43.507123 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2902/5651] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:42 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:43.854420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:43.872177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3e8f07dc-32c2-4e80-9afa-aeb53ab8e5a6 req-648bd854-2fe7-4911-8441-b7d681987f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e30db7-a372-4741-807a-606f50e6de70", "name": "network-vif-plugged", "status": "completed", "tag": "d22907f7-c845-48e7-a3ee-eda2e42a418b"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:43.878853 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06fdb5d3-038c-4282-82f4-3914275f3afa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.417149 Aug 29 16:08:43.880264 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2750/5652] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:43 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:43.903885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3e8f07dc-32c2-4e80-9afa-aeb53ab8e5a6 req-648bd854-2fe7-4911-8441-b7d681987f70 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.904673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3e8f07dc-32c2-4e80-9afa-aeb53ab8e5a6 req-648bd854-2fe7-4911-8441-b7d681987f70 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.905321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3e8f07dc-32c2-4e80-9afa-aeb53ab8e5a6 req-648bd854-2fe7-4911-8441-b7d681987f70 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.905668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:43.906406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:43.921085 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3e8f07dc-32c2-4e80-9afa-aeb53ab8e5a6 req-648bd854-2fe7-4911-8441-b7d681987f70 service nova] Creating event network-vif-plugged:d22907f7-c845-48e7-a3ee-eda2e42a418b for instance 26e30db7-a372-4741-807a-606f50e6de70 on n-h2-836830-13 Aug 29 16:08:43.921855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.922486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.924537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.928773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:43.929656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3e8f07dc-32c2-4e80-9afa-aeb53ab8e5a6 req-648bd854-2fe7-4911-8441-b7d681987f70 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071062 Aug 29 16:08:43.930313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:43.931053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:43.931830 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2903/5653] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:44.358003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:44.378545 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-847d30fa-b56b-4110-add3-8f26ef63e372 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.481334 Aug 29 16:08:44.391264 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2751/5654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:43 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:44.408265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:44.408920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:44.430415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.434980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.435706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:44.439437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.440426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.454585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:44.521640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:44.522455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:44.533633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.537718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.538313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:44.545738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:44.546400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:44.549304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:45.021172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:45.034307 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e2a5a4a-419e-45d6-ad8c-b35bd0c814dc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.634775 Aug 29 16:08:45.063114 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2904/5655] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:44 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:45.077993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:45.089414 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e2bab33-f3d6-450e-8aee-b5778c0ad271 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1313 microversion: 2.1 time: 0.571982 Aug 29 16:08:45.090207 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2752/5656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:44 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:46.153407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:46.154067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:46.187479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:46.188006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:46.190887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:46.192540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:46.193074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:46.193533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:46.734024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:46.756365 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-12b54152-602e-4010-bea8-1f4823ad367b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1498 microversion: 2.1 time: 0.633689 Aug 29 16:08:46.756958 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2905/5657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:46 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1498 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:47.582467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:47.583094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:47.598754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.601818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.602652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:47.603442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.603907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.614854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:47.677321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:08:47.883517 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6cfa420b-c3fe-4b3a-b3af-fef42fd60978 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "DELETE /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 204 len: 0 microversion: 2.1 time: 0.304902 Aug 29 16:08:47.884427 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2753/5658] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:08:47 2022] DELETE /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:08:47.894405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:47.895414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:47.913923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.914427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.914863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:47.915617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:47.916077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:47.916505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:48.325620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1319336692", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933040d4-e26a-4652-bb1d-25e9b999aa42"}], "security_groups": [{"name": "tempest-securitygroup--643726183"}], "key_name": "tempest-keypair-93064840", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:48.335606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:48.348796 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c689207-c46a-41c8-8ea8-28889ab6fbc4 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1504 microversion: 2.1 time: 0.459333 Aug 29 16:08:48.349403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2906/5659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:47 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1504 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:48.579445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] validate_networks() for [('933040d4-e26a-4652-bb1d-25e9b999aa42', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:49.380694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:49.381469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:49.394125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:49.396361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:49.398130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:49.399411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:49.400138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:49.401882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:49.445916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:49.446445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:49.446813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:49.448707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:49.449751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:49.463084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:49.463870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:49.464881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:49.466583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:49.467278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:49.467886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:49.491445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for project a32ab2f89fcf4b3ab01be67165388175. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:49.499635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for user 884be770746c44d29f50c099613f08ed and project a32ab2f89fcf4b3ab01be67165388175. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:49.517264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:49.521425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:49.673634 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-817d5a10-b7a2-4d5d-b192-cb02238998f4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.349553 Aug 29 16:08:49.678568 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2754/5660] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 16:08:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 16:08:49.695799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0df33567-5668-4c32-aec6-d6a5f3c5f32f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:49.697646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0df33567-5668-4c32-aec6-d6a5f3c5f32f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:50.468284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:50.485502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:50.495396 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9d21f2e-6921-4459-9c6c-c973f28e2b32 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1504 microversion: 2.1 time: 1.118776 Aug 29 16:08:50.503277 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2907/5661] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:49 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1504 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:50.598967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0df33567-5668-4c32-aec6-d6a5f3c5f32f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:50.635212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0df33567-5668-4c32-aec6-d6a5f3c5f32f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:50.640643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0df33567-5668-4c32-aec6-d6a5f3c5f32f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:50.648336 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0df33567-5668-4c32-aec6-d6a5f3c5f32f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1280 microversion: 2.20 time: 0.960385 Aug 29 16:08:50.650545 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2755/5662] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:08:49 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1280 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:08:50.999483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4b4d3708-9ca7-40d4-a4c9-817d2dd2246c req-10d1f96c-16b1-44a7-aad2-21d3cc29bcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e30db7-a372-4741-807a-606f50e6de70", "name": "network-vif-deleted", "tag": "d22907f7-c845-48e7-a3ee-eda2e42a418b"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:51.047192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4b4d3708-9ca7-40d4-a4c9-817d2dd2246c req-10d1f96c-16b1-44a7-aad2-21d3cc29bcb8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.063614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4b4d3708-9ca7-40d4-a4c9-817d2dd2246c req-10d1f96c-16b1-44a7-aad2-21d3cc29bcb8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.064252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4b4d3708-9ca7-40d4-a4c9-817d2dd2246c req-10d1f96c-16b1-44a7-aad2-21d3cc29bcb8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.127195 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4b4d3708-9ca7-40d4-a4c9-817d2dd2246c req-10d1f96c-16b1-44a7-aad2-21d3cc29bcb8 service nova] Creating event network-vif-deleted:d22907f7-c845-48e7-a3ee-eda2e42a418b for instance 26e30db7-a372-4741-807a-606f50e6de70 on n-h2-836830-13 Aug 29 16:08:51.156720 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4b4d3708-9ca7-40d4-a4c9-817d2dd2246c req-10d1f96c-16b1-44a7-aad2-21d3cc29bcb8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162475 Aug 29 16:08:51.162807 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2908/5663] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:08:51.521604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:51.522394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:51.543792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.550618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.552557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.554324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.561475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.561949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.634381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.634973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.635255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.635727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lazy-loading 'fault' on Instance uuid 26e30db7-a372-4741-807a-606f50e6de70 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:08:51.680020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:51.682663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:51.717620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.720680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.721856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.724227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:51.725498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:51.728619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:51.732614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:51.749413 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ca2c9c92-5dc4-4cbd-a54a-aab48978a76d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 200 len: 1303 microversion: 2.1 time: 0.233715 Aug 29 16:08:51.762515 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2756/5664] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:51 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:51.879051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:51.895871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:51.897684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:51.901259 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef691280-a115-4bb2-acc4-0467b4fefbd6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1332 microversion: 2.20 time: 0.228040 Aug 29 16:08:51.904991 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2909/5665] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:08:51 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1332 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:08:52.777323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:52.778664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 26e30db7-a372-4741-807a-606f50e6de70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:52.800724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:52.801418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:52.802144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:52.803109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:52.803771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:52.805695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:52.846774 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] HTTP exception thrown: Instance 26e30db7-a372-4741-807a-606f50e6de70 could not be found. Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Request method failure captured: Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 HTTP/1.1 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDORywoAffmq4htPrlHgQRXU2JXNf5gHxRfAY6FKUrwOcUtqVkQIfsv_Siq6OF9S3af7MGrguxxms99xF_nqeAmLb31BixAkSCeUVsW2VWDHH9GL9A_xE2Ur7b2ykt2QgJQSiN9IwrTnTsGn4hOK0FQvBy1mWXvNWuAf3mw9Cw3yUFIw Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 4c81ef7b2ac644b394ffa1c04c11ea45 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-VolumesActionsTest-817774329 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4c81ef7b2ac644b394ffa1c04c11ea45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4c81ef7b2ac644b394ffa1c04c11ea45", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4c81ef7b2ac644b394ffa1c04c11ea45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4c81ef7b2ac644b394ffa1c04c11ea45"}]}] Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-VolumesActionsTest-817774329 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 4c81ef7b2ac644b394ffa1c04c11ea45 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-VolumesActionsTest-817774329 Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-VolumesActionsTest-817774329-project Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: c4dc9da48de7438598c1aa4bc8d238ce Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-VolumesActionsTest-817774329-project Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 26e30db7-a372-4741-807a-606f50e6de70 could not be found. Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '26e30db7-a372-4741-807a-606f50e6de70'} Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e30db7-a372-4741-807a-606f50e6de70 could not be found. Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e30db7-a372-4741-807a-606f50e6de70 could not be found. Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:08:52.852005 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e30db7-a372-4741-807a-606f50e6de70 could not be found. Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:08:52.859111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Returning 404 to user: Instance 26e30db7-a372-4741-807a-606f50e6de70 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:08:52.860218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ada0a58f-4258-470a-abd0-a2d7f7dc25b7 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70" status: 404 len: 111 microversion: 2.1 time: 0.078159 Aug 29 16:08:52.870759 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2757/5666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:52 2022] GET /compute/v2.1/servers/26e30db7-a372-4741-807a-606f50e6de70 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:08:52.948140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:52.950811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:52.986384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:52.988461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.011104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.012232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:53.021288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:53.024904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:53.178766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-616351290", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "97e609f4-3ea5-48a5-93a5-ddcc176e8136"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:53.294874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:53.311786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:53.312305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] validate_networks() for [('97e609f4-3ea5-48a5-93a5-ddcc176e8136', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:08:53.333720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:53.336459 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a56ae8bf-be1b-42fa-a97d-67a2791aa3f0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1338 microversion: 2.20 time: 0.411993 Aug 29 16:08:53.345507 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2910/5667] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:08:52 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1338 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:08:54.368839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:54.369643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:54.393368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:54.396789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:54.397254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:54.398016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:54.398479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:54.398913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:54.831612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:54.864446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:54.865835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:54.877687 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3dec1751-3d4e-4784-bd7c-1faa354f2bd9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.513113 Aug 29 16:08:54.879007 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2911/5668] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:08:54 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:08:55.906070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:55.906731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:55.927396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:55.927988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:55.928442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:55.929191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:55.929656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:55.930092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:56.038245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:08:56.038758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:08:56.040233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:08:56.040750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:08:56.041285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:08:56.060862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:56.061887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:56.064651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:56.065555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:56.067285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:56.068392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:56.132397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Getting quotas for project 4c81ef7b2ac644b394ffa1c04c11ea45. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:08:56.138847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Getting quotas for user c4dc9da48de7438598c1aa4bc8d238ce and project 4c81ef7b2ac644b394ffa1c04c11ea45. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:08:56.154115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:08:56.156862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:08:56.228931 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab6b7de8-baa9-4414-b9eb-b68d1f66445c tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.054302 Aug 29 16:08:56.235813 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2758/5669] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:08:56.259257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:56.262130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21be0637-2b5c-42c4-854d-2eadc0b7504e tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:56.263076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21be0637-2b5c-42c4-854d-2eadc0b7504e tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:56.275332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:56.284070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:56.297117 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4945f35e-eaef-4fc3-ac5a-543e581637f5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.384079 Aug 29 16:08:56.298346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:56.315161 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2912/5670] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:08:55 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:08:56.464598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21be0637-2b5c-42c4-854d-2eadc0b7504e tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:56.481487 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21be0637-2b5c-42c4-854d-2eadc0b7504e tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1213 microversion: 2.1 time: 0.233708 Aug 29 16:08:56.504472 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2759/5671] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:56 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1213 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:08:56.899696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d14ce04e-f5a4-494a-a1bf-456482709bb7 req-a9e9944e-c97e-43ac-a9f2-e411fb5227b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:08:56.938240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d14ce04e-f5a4-494a-a1bf-456482709bb7 req-a9e9944e-c97e-43ac-a9f2-e411fb5227b6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:56.938830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d14ce04e-f5a4-494a-a1bf-456482709bb7 req-a9e9944e-c97e-43ac-a9f2-e411fb5227b6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:56.944288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d14ce04e-f5a4-494a-a1bf-456482709bb7 req-a9e9944e-c97e-43ac-a9f2-e411fb5227b6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:56.980253 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d14ce04e-f5a4-494a-a1bf-456482709bb7 req-a9e9944e-c97e-43ac-a9f2-e411fb5227b6 service nova] Creating event network-changed:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h1-836830-13 Aug 29 16:08:57.007069 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d14ce04e-f5a4-494a-a1bf-456482709bb7 req-a9e9944e-c97e-43ac-a9f2-e411fb5227b6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113019 Aug 29 16:08:57.014154 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2913/5672] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:08:57.335093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:57.337704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:57.370396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:57.373437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:57.375341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:57.377777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:57.379518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:57.383844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:57.521342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:57.522773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:57.537346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:57.540941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:57.545014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:57.546069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:57.547499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:57.549169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:57.734715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:57.780858 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-de9e1e7f-b56a-41bf-af1d-70304fc53b04 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1209 microversion: 2.1 time: 0.265239 Aug 29 16:08:57.782220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2914/5673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:57 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1209 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:57.950336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:57.969605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:08:57.995472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:58.003257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:58.008974 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1246fa50-cb6e-44c7-b598-696bd72848c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.685645 Aug 29 16:08:58.014559 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2760/5674] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:08:57 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:08:58.812597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:58.813214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:58.831874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:58.852350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:58.853034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:58.856711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:58.857356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:58.858016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:59.043920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:08:59.044871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:08:59.067087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:59.068051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:59.068816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:59.069723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:08:59.072229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:08:59.072960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:08:59.085229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:59.101679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75b140a9-5e62-4dfb-b7a0-6379d7149613 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1271 microversion: 2.1 time: 0.286903 Aug 29 16:08:59.111070 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2915/5675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:08:58 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:08:59.975562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:59.984808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:59.986324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:08:59.992529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08fb476d-5ae4-4d1c-988c-0de85e3e72c2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.953318 Aug 29 16:08:59.999956 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2761/5676] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:08:59 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:00.137135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:00.138568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:00.157475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:00.158241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:00.159006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:00.160012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:00.161171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:00.162492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:00.510705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:00.527501 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c722fa1c-89ee-4a0e-99a9-69b6f5682cec tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1271 microversion: 2.1 time: 0.396996 Aug 29 16:09:00.531534 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2916/5677] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:00 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1271 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:01.024185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:01.025772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:01.055068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.056766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.059635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.061112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.062185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.064852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.552732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:01.557527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:01.564338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:01.598587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:01.600908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.604230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:01.604510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.606669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:01.608248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:01.610270 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae6c3104-10d7-44d0-bf5d-d89506bdaff9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.590505 Aug 29 16:09:01.610471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:01.635334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2762/5678] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:01 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:01.636306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:02.114269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:02.131100 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9ef5ba2-0d1d-4d21-8aba-2946853ee018 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1313 microversion: 2.1 time: 0.582858 Aug 29 16:09:02.136110 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2917/5679] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:01 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:02.642027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:02.642769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:02.687456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:02.689256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:02.691620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:02.692587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:02.693761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:02.695875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.020625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-bad38586-0c8f-4c92-b190-d9062be30450 req-0cd53e8e-aa4e-4d7e-9aea-80d3f7fdec84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b183d7-f006-4e4b-919b-686d46775369", "tag": "3e853ced-63cc-474b-8762-6de7685beefa"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:03.021129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:03.036655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:03.040939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=50 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:03.041262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:03.045820 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2904b4e6-29cf-413f-8a3f-df86f1534c3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.406582 Aug 29 16:09:03.048147 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2763/5680] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:02 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:03.054813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bad38586-0c8f-4c92-b190-d9062be30450 req-0cd53e8e-aa4e-4d7e-9aea-80d3f7fdec84 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.060257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bad38586-0c8f-4c92-b190-d9062be30450 req-0cd53e8e-aa4e-4d7e-9aea-80d3f7fdec84 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.061106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bad38586-0c8f-4c92-b190-d9062be30450 req-0cd53e8e-aa4e-4d7e-9aea-80d3f7fdec84 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.112301 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-bad38586-0c8f-4c92-b190-d9062be30450 req-0cd53e8e-aa4e-4d7e-9aea-80d3f7fdec84 service nova] Creating event network-changed:3e853ced-63cc-474b-8762-6de7685beefa for instance 96b183d7-f006-4e4b-919b-686d46775369 on n-h2-836830-13 Aug 29 16:09:03.139470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-bad38586-0c8f-4c92-b190-d9062be30450 req-0cd53e8e-aa4e-4d7e-9aea-80d3f7fdec84 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124129 Aug 29 16:09:03.142699 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2918/5681] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:03.153560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:03.154422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:03.161563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.162550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.163279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.164384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:03.165453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:03.166467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:03.757176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:03.777857 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce67b526-86d4-4265-bd1c-1d0c84f122f3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1313 microversion: 2.1 time: 0.624054 Aug 29 16:09:03.783655 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2764/5682] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:03 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:04.076357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:04.077727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:04.087306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.088044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.088748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.090208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.091260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.091709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.439323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:04.449336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:04.453665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:04.457065 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c76268d-6526-4d39-a735-2709b5d0f52d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.389924 Aug 29 16:09:04.461398 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2919/5683] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:04 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:04.803159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:04.803840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:04.814431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.814930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.815436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:04.816149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:04.816612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:04.817038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:05.238553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:05.266396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-600d133c-3fb5-4f40-8034-5b39cfeecb09 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1313 microversion: 2.1 time: 0.467037 Aug 29 16:09:05.274480 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2765/5684] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:04 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:05.483691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:05.484330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:05.504684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:05.505194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:05.505645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:05.506401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:05.506862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:05.507332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.143884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:06.162051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:06.169134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:06.174278 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4efdaf73-0c40-497c-99af-8f410a345cbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.694415 Aug 29 16:09:06.177385 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2920/5685] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:05 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:06.295260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:06.297304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:06.315409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:06.333992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.334989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.335679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.336620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.337300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.337960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.479094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=20 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:06.841932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:06.843298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:06.854966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.861222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.862317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:06.863371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:06.864088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:06.864765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.342164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:07.359335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78faf78f-3ff0-4e27-908e-ae3a3d774b66 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1313 microversion: 2.1 time: 1.069329 Aug 29 16:09:07.360635 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2766/5686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:06 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1313 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:07.445922 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b078e75a-cddb-45aa-a36f-7e8c545f7692 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1835 microversion: 2.1 time: 1.120506 Aug 29 16:09:07.449479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2921/5687] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:06 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1835 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:07.461806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:07.462754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:07.477565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.478543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.479777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.480947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.481720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.482377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.486775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f7961d63-1675-4ffb-a8b7-ed0b7cabe1b8 req-2b490372-d91f-431f-9ed0-63d5f95606a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "name": "network-vif-plugged", "status": "completed", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:07.519247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f7961d63-1675-4ffb-a8b7-ed0b7cabe1b8 req-2b490372-d91f-431f-9ed0-63d5f95606a5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.523585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f7961d63-1675-4ffb-a8b7-ed0b7cabe1b8 req-2b490372-d91f-431f-9ed0-63d5f95606a5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.524244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f7961d63-1675-4ffb-a8b7-ed0b7cabe1b8 req-2b490372-d91f-431f-9ed0-63d5f95606a5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.569668 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f7961d63-1675-4ffb-a8b7-ed0b7cabe1b8 req-2b490372-d91f-431f-9ed0-63d5f95606a5 service nova] Creating event network-vif-plugged:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h1-836830-13 Aug 29 16:09:07.578638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f7961d63-1675-4ffb-a8b7-ed0b7cabe1b8 req-2b490372-d91f-431f-9ed0-63d5f95606a5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216307 Aug 29 16:09:07.585234 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2767/5688] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:07.610623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:07.611907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:07.619977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.620798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.621598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.622787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:07.623475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:07.624111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:07.859564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:07.870328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:07.877956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:07.882145 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-84279549-a8a2-493c-a620-8800911f6f90 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.430114 Aug 29 16:09:07.883710 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2922/5689] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:07 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:08.187733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:08.190418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:08.197300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.197980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.198601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.200110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.200771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.201355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.302573 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a1e5b88-e306-400e-9a4b-cc4a6d263b8f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.118324 Aug 29 16:09:08.305024 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2923/5690] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:09:08 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:09:08.314942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:08.315925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:08.325191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.326467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.327228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.328186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.328796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.329379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.473503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:08.499397 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d47afa25-85e1-4b4f-941d-cc633bdfe8b6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1682 microversion: 2.1 time: 0.893742 Aug 29 16:09:08.506111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2768/5691] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:07 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1682 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:08.520582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:08.527432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:08.552058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.552996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.553667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.556807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.557836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.559446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.779735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:08.799496 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf97997f-b9b2-4a80-aa5a-48a42e1d4987 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1673 microversion: 2.1 time: 0.490462 Aug 29 16:09:08.801469 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2924/5692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:08 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1673 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:08.910384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:08.911013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:08.926521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.927330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.927930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.928805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:08.929419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:08.930006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:08.958997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:09.435716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:09.450083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:09.452505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:09.457049 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f565bdb0-ba2a-4852-adaa-8f223db09ccf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1405 microversion: 2.20 time: 0.552125 Aug 29 16:09:09.472918 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2925/5693] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:08 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:09:09.488508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:09.493593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:09.508601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.515655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.516179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.517355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.519746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.520202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.651071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-854d3276-fc90-4c38-b4f9-5bebc6b8fa41 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action" status: 200 len: 32639 microversion: 2.1 time: 0.176395 Aug 29 16:09:09.651789 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2926/5694] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:09:09 2022] POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action => generated 32639 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:09:09.827960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:09.829044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:09.844999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.848643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.849437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:09.853988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:09.858557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:09.859875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.116451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:10.125933 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf252ffd-92ae-466b-ac6d-d40c0c52199f tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1313 microversion: 2.1 time: 1.617635 Aug 29 16:09:10.130975 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2769/5695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:08 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1313 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:10.148544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:10.149437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:10.168739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.170817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.171529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.178956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.185136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.185136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.270235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eaf0b86011214b97b4f024c97dba2422', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4555b1319975418da819b6e0eefb32cf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:10.270909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] flavor_id is None. Assuming migration. {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 29 16:09:10.271390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:09:10.581008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:10.597452 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d62b6d3-3790-478f-8cd2-897b0f8a25ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1673 microversion: 2.1 time: 0.774823 Aug 29 16:09:10.615847 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2927/5696] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:09 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1673 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:10.627692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:10.631812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:10.651548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.654913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.656265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.657206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.658774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.659683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.969745 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-410b6f68-a060-419c-b7f8-61eb4f18bfdd tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action" status: 202 len: 0 microversion: 2.1 time: 0.830360 Aug 29 16:09:10.973470 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2770/5697] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:09:10 2022] POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:09:10.979415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:10.980879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:10.988444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.989018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.989523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:10.990387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:10.991484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:10.992140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:11.352129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:11.365675 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-24529f58-ebaf-40d9-a8f8-ec7cdc193e34 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1691 microversion: 2.1 time: 0.390787 Aug 29 16:09:11.386639 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2771/5698] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:10 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1691 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:11.395474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:11.397066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:11.418352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:11.419121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:11.420513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:11.421901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:11.423358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:11.424210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:11.812641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:11.826700 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6bd30d2-d34f-4361-a131-9dba260decc3 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1313 microversion: 2.1 time: 0.438234 Aug 29 16:09:11.876401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:11.905522 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2772/5699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:11 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:11.910658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a746553b-1b07-455d-aa05-1b6cbb639060 req-376f57fd-30c0-4a12-9762-21ff667f8fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b183d7-f006-4e4b-919b-686d46775369", "name": "network-vif-plugged", "status": "completed", "tag": "3e853ced-63cc-474b-8762-6de7685beefa"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:11.925793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:11.931598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:11.941347 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1759fa54-ba44-4d28-9fd1-e4fd7ba2a1b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1598 microversion: 2.20 time: 1.324090 Aug 29 16:09:11.947229 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2928/5700] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:10 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1598 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:11.972539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a746553b-1b07-455d-aa05-1b6cbb639060 req-376f57fd-30c0-4a12-9762-21ff667f8fe8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:11.988493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:11.989203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:11.992977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a746553b-1b07-455d-aa05-1b6cbb639060 req-376f57fd-30c0-4a12-9762-21ff667f8fe8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:11.993435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a746553b-1b07-455d-aa05-1b6cbb639060 req-376f57fd-30c0-4a12-9762-21ff667f8fe8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.033049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.033560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.042631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.047492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.048001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.048445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.060794 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a746553b-1b07-455d-aa05-1b6cbb639060 req-376f57fd-30c0-4a12-9762-21ff667f8fe8 service nova] Creating event network-vif-plugged:3e853ced-63cc-474b-8762-6de7685beefa for instance 96b183d7-f006-4e4b-919b-686d46775369 on n-h2-836830-13 Aug 29 16:09:12.078245 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a746553b-1b07-455d-aa05-1b6cbb639060 req-376f57fd-30c0-4a12-9762-21ff667f8fe8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170926 Aug 29 16:09:12.079406 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2773/5701] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:12.101717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:12.105275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:12.130308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.134839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.135705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.137401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.147959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.149507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.369835 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eab9a1b3-7d72-4a8a-8a93-395e5e9bc33c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.283533 Aug 29 16:09:12.375179 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2774/5702] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 16:09:12 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-interface => generated 285 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:09:12.389861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:12.392029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:12.400677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.410838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.411603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.412518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.422666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.423400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.913385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:12.924054 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8480786-1b81-47f9-9497-9f83d2d82597 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1678 microversion: 2.1 time: 0.974876 Aug 29 16:09:12.939715 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2929/5703] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:11 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1678 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:12.956649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:12.957562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:12.967668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.968931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.969532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:12.970438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:12.971689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:12.973321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.060161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:13.070052 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f44af0c-20d5-4d8b-8ec1-c8f6b8866543 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1691 microversion: 2.1 time: 0.684117 Aug 29 16:09:13.073254 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2775/5704] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:12 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1691 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:13.495252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:13.509925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15c76957-e0d2-44f7-aa13-50ea0e64819b tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1313 microversion: 2.1 time: 0.568548 Aug 29 16:09:13.527326 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2930/5705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:12 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:13.956738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:13.957583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:13.975610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.976247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.978193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:13.980769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:13.982092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:13.983335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.099235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:14.100024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:14.114045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.117526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.118177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.119276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.123738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.124543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.391948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:14.406866 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ad61a0ae-e8a7-468a-a108-7f9a78946b24 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1691 microversion: 2.1 time: 0.309708 Aug 29 16:09:14.407747 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2931/5706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:14 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1691 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:14.537184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:14.538685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:14.555337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.557876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.558929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.562624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:14.563402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:14.564552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:14.856474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:14.871124 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-48b7c718-d552-4cae-831f-e164c7a75d31 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1678 microversion: 2.1 time: 0.919986 Aug 29 16:09:14.871717 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2776/5707] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:13 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1678 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:14.928921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:14.939207 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-958bbf7e-456e-4e56-8047-07d33e89acfa tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1498 microversion: 2.1 time: 0.409302 Aug 29 16:09:14.953527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2932/5708] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:14 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1498 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:15.178690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a89f8608-21e8-4e88-88d1-210d1602f0b8 req-3762c150-115a-4fc2-a480-135c7a13df33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:15.239219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a89f8608-21e8-4e88-88d1-210d1602f0b8 req-3762c150-115a-4fc2-a480-135c7a13df33 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.241619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a89f8608-21e8-4e88-88d1-210d1602f0b8 req-3762c150-115a-4fc2-a480-135c7a13df33 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.242453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a89f8608-21e8-4e88-88d1-210d1602f0b8 req-3762c150-115a-4fc2-a480-135c7a13df33 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.268766 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a89f8608-21e8-4e88-88d1-210d1602f0b8 req-3762c150-115a-4fc2-a480-135c7a13df33 service nova] Creating event network-changed:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h1-836830-13 Aug 29 16:09:15.280439 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a89f8608-21e8-4e88-88d1-210d1602f0b8 req-3762c150-115a-4fc2-a480-135c7a13df33 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407276 Aug 29 16:09:15.281802 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2777/5709] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:15.434659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:15.443757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:15.457253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.459580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.460442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.461280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.468340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.468909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.903625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:15.905562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:15.940745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.941505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.942177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.951857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:15.952770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:15.953497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:15.983142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:16.244024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:16.260223 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4259fd55-7fe7-4239-81c2-7740b2215249 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1691 microversion: 2.1 time: 0.830350 Aug 29 16:09:16.260874 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2933/5710] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:15 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1691 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:16.273256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:16.274097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:16.282719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.283472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.284072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.285048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.285667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.286280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.333415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:09:16.499520 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46068f7c-ef5d-4874-8777-d24723d1fcdd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "DELETE /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 204 len: 0 microversion: 2.1 time: 0.236667 Aug 29 16:09:16.500850 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2934/5711] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:09:16 2022] DELETE /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:09:16.509768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:16.510475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:16.526513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.527071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.527581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.528305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:16.528765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:16.529195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:16.793824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:16.814935 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f135fa6-6430-43fd-878f-b906c344fc7c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1678 microversion: 2.1 time: 0.920341 Aug 29 16:09:16.831755 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2778/5712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:15 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1678 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:17.106787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:17.122850 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-519fc827-3e70-42b5-8a1c-25732788d3fd tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1504 microversion: 2.1 time: 0.617153 Aug 29 16:09:17.136828 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2935/5713] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:16 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1504 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:17.283211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:17.283825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:17.303891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.304391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.304833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.305550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.306001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.306427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.839302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:17.841048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:17.863437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.864608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.866765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:17.871998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:17.872712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:17.873305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:18.546086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:18.556152 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28ee2bd9-dc2d-427b-81e6-23cc8f7a273b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1691 microversion: 2.1 time: 1.276731 Aug 29 16:09:18.556745 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2779/5714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:17 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1691 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:18.570022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:18.570935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:18.585770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:18.592530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:18.593312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:18.594620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:18.595120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:18.595776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.201366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:19.217980 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e4aa41bd-a795-40f4-a5c5-5abd2bd1d49b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.379029 Aug 29 16:09:19.220735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2936/5715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:17 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:19.581623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:19.582929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:19.593406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:19.594789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:19.595456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.596499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:19.597137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:19.598050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:19.739288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:19.764188 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80c4e8e6-4466-4279-a0a0-5b8d8fe7777d tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1504 microversion: 2.1 time: 1.195771 Aug 29 16:09:19.780863 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2780/5716] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:18 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1504 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:20.015657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:20.025169 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-94f0a374-9679-4ff2-a4e8-3620a9ed2ffe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1691 microversion: 2.1 time: 0.449233 Aug 29 16:09:20.026352 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2937/5717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:19 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1691 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:20.790810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:20.791500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:20.811146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.811637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.812103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:20.812809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:20.813458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:20.813892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.025205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:21.028819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c922c8c6-28a1-43d9-802b-e01b8e42b3ac req-60a6190f-1610-42a8-95c6-90f13c61c315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b183d7-f006-4e4b-919b-686d46775369", "name": "network-vif-deleted", "tag": "3e853ced-63cc-474b-8762-6de7685beefa"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:21.042888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e048bfe-8b7d-41b8-a229-92ba2a3d0085 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1462 microversion: 2.1 time: 0.255424 Aug 29 16:09:21.044123 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2781/5718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:20 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1462 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:21.052994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c922c8c6-28a1-43d9-802b-e01b8e42b3ac req-60a6190f-1610-42a8-95c6-90f13c61c315 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:21.055319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c922c8c6-28a1-43d9-802b-e01b8e42b3ac req-60a6190f-1610-42a8-95c6-90f13c61c315 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:21.056040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c922c8c6-28a1-43d9-802b-e01b8e42b3ac req-60a6190f-1610-42a8-95c6-90f13c61c315 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.060234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:21.060888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:21.096314 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c922c8c6-28a1-43d9-802b-e01b8e42b3ac req-60a6190f-1610-42a8-95c6-90f13c61c315 service nova] Creating event network-vif-deleted:3e853ced-63cc-474b-8762-6de7685beefa for instance 96b183d7-f006-4e4b-919b-686d46775369 on n-h2-836830-13 Aug 29 16:09:21.103544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:21.106616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c922c8c6-28a1-43d9-802b-e01b8e42b3ac req-60a6190f-1610-42a8-95c6-90f13c61c315 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083176 Aug 29 16:09:21.107107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:21.107492 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2938/5719] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:21.108053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.108804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:21.109267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:21.110405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:21.482783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:21.499055 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42a4e50c-bc99-4800-bcd4-6a852e162615 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1691 microversion: 2.1 time: 0.449767 Aug 29 16:09:21.505414 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2782/5720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:21 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1691 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:22.068586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:22.069438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:22.099125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.101755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.102332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.103245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.106071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.114340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.211338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.225935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.226492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.228552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lazy-loading 'fault' on Instance uuid 96b183d7-f006-4e4b-919b-686d46775369 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:09:22.424906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc9da48de7438598c1aa4bc8d238ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c81ef7b2ac644b394ffa1c04c11ea45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:22.440009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d7e2217-c33d-4a8a-933e-a23febee1fde tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 200 len: 1303 microversion: 2.1 time: 0.378741 Aug 29 16:09:22.444722 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2939/5721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:22 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 1303 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:22.525165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:22.526410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:22.536280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.546509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.547269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.548188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:22.548807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:22.549411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:22.890354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:22.913758 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1cff4e84-26d2-4f45-8e68-88794768de5a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.392305 Aug 29 16:09:22.915168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2783/5722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:22 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:23.468321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:23.469604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] [instance: 96b183d7-f006-4e4b-919b-686d46775369] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:23.484443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.485059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.485756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:23.486691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.488994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.489789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:23.561914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] HTTP exception thrown: Instance 96b183d7-f006-4e4b-919b-686d46775369 could not be found. Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Request method failure captured: Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 HTTP/1.1 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDORywoAffmq4htPrlHgQRXU2JXNf5gHxRfAY6FKUrwOcUtqVkQIfsv_Siq6OF9S3af7MGrguxxms99xF_nqeAmLb31BixAkSCeUVsW2VWDHH9GL9A_xE2Ur7b2ykt2QgJQSiN9IwrTnTsGn4hOK0FQvBy1mWXvNWuAf3mw9Cw3yUFIw Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 4c81ef7b2ac644b394ffa1c04c11ea45 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesActionsTest-817774329 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4c81ef7b2ac644b394ffa1c04c11ea45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4c81ef7b2ac644b394ffa1c04c11ea45", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4c81ef7b2ac644b394ffa1c04c11ea45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4c81ef7b2ac644b394ffa1c04c11ea45"}]}] Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesActionsTest-817774329 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 4c81ef7b2ac644b394ffa1c04c11ea45 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesActionsTest-817774329 Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesActionsTest-817774329-project Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: c4dc9da48de7438598c1aa4bc8d238ce Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesActionsTest-817774329-project Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 96b183d7-f006-4e4b-919b-686d46775369 could not be found. Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '96b183d7-f006-4e4b-919b-686d46775369'} Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96b183d7-f006-4e4b-919b-686d46775369 could not be found. Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96b183d7-f006-4e4b-919b-686d46775369 could not be found. Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:09:23.570833 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:09:23.577033 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:09:23.577033 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:09:23.577033 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:09:23.577033 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:09:23.577033 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:09:23.577033 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96b183d7-f006-4e4b-919b-686d46775369 could not be found. Aug 29 16:09:23.577033 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:09:23.577866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] Returning 404 to user: Instance 96b183d7-f006-4e4b-919b-686d46775369 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:09:23.582216 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a753c84-b17a-4231-b699-7462b8d10d45 tempest-VolumesActionsTest-817774329 tempest-VolumesActionsTest-817774329-project] 10.222.0.83 "GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369" status: 404 len: 111 microversion: 2.1 time: 0.117982 Aug 29 16:09:23.588046 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2940/5723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:23 2022] GET /compute/v2.1/servers/96b183d7-f006-4e4b-919b-686d46775369 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:09:23.943936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:23.944600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:23.960202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.960739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.961190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:23.961904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:23.962365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:23.962794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:24.672323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:24.684094 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77bdab55-9574-4780-b97a-ff3a13950e47 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.745291 Aug 29 16:09:24.686727 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2784/5724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:23 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:25.709886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:25.710512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:25.722833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:25.723753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:25.724378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:25.727325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:25.732329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:25.733033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:26.132724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:26.135400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:26.173884 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d73f278-90a7-47f3-a5e4-9ba3ffd92b7f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.467991 Aug 29 16:09:26.174424 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2941/5725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:25 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:27.196602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:27.200399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:27.203518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=54 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:27.227844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:27.232033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:27.233161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:27.250008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:27.255089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:27.256151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:28.350020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:28.363186 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c384b462-11e7-40f5-9135-84a248f41992 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 1.170503 Aug 29 16:09:28.363786 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2785/5726] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:27 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:29.388992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:29.389440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:29.406564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:29.407099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:29.407553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:29.408288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:29.408752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:29.409209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:30.221380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:30.229772 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d2a90985-5ab2-4949-b068-c7cf075149f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.844888 Aug 29 16:09:30.240134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2942/5727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:29 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:31.265329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:31.265882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:31.294929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.295714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.296152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:31.296872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:31.297326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:31.297751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:32.354605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:32.393781 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30758404-59c5-4966-a96e-12fdbfd48f99 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 1.116489 Aug 29 16:09:32.396191 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2786/5728] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:31 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:33.419318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:33.420336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:33.423585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:33.448906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.461148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.471447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:33.472999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:33.473732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:33.476968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:34.663536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:34.676666 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60d610fd-63e8-49c7-81d5-b236fe5535d5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 1.262607 Aug 29 16:09:34.694800 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2943/5729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:33 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:35.704956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:35.705981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:35.736001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:35.736807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:35.737427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:35.738329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:35.738946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:35.755905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:36.213556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:36.228352 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02bb09a7-88d9-45ab-a35d-5d5e22063e67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.534564 Aug 29 16:09:36.232852 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2787/5730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:35 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:37.254175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:37.254800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:37.283592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:37.284495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:37.287523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:37.290900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:37.297409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:37.299619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:37.876396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:37.890729 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49cd265c-07eb-4c16-972d-7527c6b386b2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.634715 Aug 29 16:09:37.894291 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2944/5731] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:37 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:38.921186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:38.922840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:38.950471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:38.958528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:38.971199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:38.972040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:38.972535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:38.979314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:39.644898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:39.664919 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-56ba1c68-7155-4e52-96b4-c8579be9c362 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.747998 Aug 29 16:09:39.667692 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2788/5732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:38 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:40.704205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:40.707501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:40.719976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:40.721086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:40.721775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:40.722766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:40.723562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:40.724186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:41.002461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:41.014202 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e9abd0da-56ae-4db7-8cc4-df3f5c9cba70 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 0.325006 Aug 29 16:09:41.016073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2945/5733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:40 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:42.049246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:42.050500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:42.122859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:42.125407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:42.127685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:42.136685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:42.149119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:42.150458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:43.079133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:43.097049 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-52866593-2705-4c18-b7f7-dddec5ac176c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1696 microversion: 2.1 time: 1.053444 Aug 29 16:09:43.098111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2789/5734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:42 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1696 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:43.924403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:43.925451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:43.953941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:43.955331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:43.957990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:43.960532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:43.967718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:43.973955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:44.122694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:44.124213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:44.151409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:44.168798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:44.169967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:44.174241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:44.177801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:44.178720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:44.864086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:44.877684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94e31502-cdad-48b2-88d8-1355355df05f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1695 microversion: 2.1 time: 0.760130 Aug 29 16:09:44.896213 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2790/5735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:44 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1695 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:45.158339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:45.160812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:45.161316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:45.161797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:45.186218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:45.188898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:45.190071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:45.353236 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f996f8d2-ad25-4b8f-abf4-c61db2adb86f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.455675 Aug 29 16:09:45.396428 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2791/5736] 10.222.0.83 () {58 vars in 1185 bytes} [Mon Aug 29 16:09:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:45.734696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-648495380", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "availability_zone": "nova:n-h2-836830-13", "networks": [{"uuid": "3759c3b2-d4c3-4f25-aeb2-548093e23726"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:45.908425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] validate_networks() for [('3759c3b2-d4c3-4f25-aeb2-548093e23726', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:09:46.438752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:46.448658 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f05690f-bd2c-4fae-a2f0-918a92f5333c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 2.529476 Aug 29 16:09:46.457184 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2946/5737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:43 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:46.489293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-66173fba-c4e5-40b3-9652-8e3c1ef35b9e req-ae8ac29d-ace6-4368-adae-a60a2cc8b681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "name": "network-vif-unplugged", "status": "completed", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:46.533272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66173fba-c4e5-40b3-9652-8e3c1ef35b9e req-ae8ac29d-ace6-4368-adae-a60a2cc8b681 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:46.533832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66173fba-c4e5-40b3-9652-8e3c1ef35b9e req-ae8ac29d-ace6-4368-adae-a60a2cc8b681 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:46.534405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-66173fba-c4e5-40b3-9652-8e3c1ef35b9e req-ae8ac29d-ace6-4368-adae-a60a2cc8b681 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:46.555127 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-66173fba-c4e5-40b3-9652-8e3c1ef35b9e req-ae8ac29d-ace6-4368-adae-a60a2cc8b681 service nova] Creating event network-vif-unplugged:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h1-836830-13 Aug 29 16:09:46.603345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-66173fba-c4e5-40b3-9652-8e3c1ef35b9e req-ae8ac29d-ace6-4368-adae-a60a2cc8b681 service nova] Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:09:46.654323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-66173fba-c4e5-40b3-9652-8e3c1ef35b9e req-ae8ac29d-ace6-4368-adae-a60a2cc8b681 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168731 Aug 29 16:09:46.663611 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2947/5738] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:46.669865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:46.689173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:46.716950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:46.725819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:46.729066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:46.731566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:46.733524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:46.736559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:47.659196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:47.669437 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e87a02ae-8d2c-43c9-abe3-d8561687c33d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1695 microversion: 2.1 time: 1.004185 Aug 29 16:09:47.670047 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2948/5739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:46 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1695 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:47.697427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:47.723254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:47.763400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.767645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.769403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:47.772059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.776653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.777428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:47.912758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:09:47.913252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:09:47.913490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:09:47.914017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:09:47.914724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:09:47.962312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.962842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.963319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:47.972007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:47.972007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:47.972007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:48.002679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=80 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:48.020463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Getting quotas for project e4d5ce8b0cc1426dacca8b2f631a5949. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:48.035880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Getting quotas for user 6726e156cfb9479bbcca0d6a88f39566 and project e4d5ce8b0cc1426dacca8b2f631a5949. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:48.079566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:09:48.082322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:09:48.205833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b6b4e28e-fb91-4413-8b10-9c4ddd1cd594 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.475398 Aug 29 16:09:48.207099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2792/5740] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:09:48.217217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:48.228870 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6edd07d-1f22-49fe-8fad-736c690bac75 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.550418 Aug 29 16:09:48.231674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:48.232400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:48.239437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2949/5741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:47 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:48.251076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eef6c5e9-ddae-4bf0-905b-7c47b3c0bb48 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:48.257465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eef6c5e9-ddae-4bf0-905b-7c47b3c0bb48 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:48.261899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:48.266956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:48.267661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:48.268578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:48.270210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:48.271780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:48.349484 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fab17c11-ff23-4e9f-a639-be2ba92bfbf0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/ips" status: 200 len: 152 microversion: 2.20 time: 0.141081 Aug 29 16:09:48.350107 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2793/5742] 10.222.0.83 () {60 vars in 1289 bytes} [Mon Aug 29 16:09:48 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/ips => generated 152 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:09:48.372609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:48.373251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:48.408982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:48.409498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:48.409938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:48.410747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:48.411202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:48.411638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:48.473871 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eef6c5e9-ddae-4bf0-905b-7c47b3c0bb48 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1328 microversion: 2.1 time: 0.226875 Aug 29 16:09:48.474545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2950/5743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:48 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1328 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:48.694045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:48.694944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:48.718482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:48.719141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:48.719602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:48.720366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:48.720830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:48.721410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:49.603310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:49.641150 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0788ece4-086f-48bd-816d-8ccc796f4634 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.284834 Aug 29 16:09:49.641817 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2794/5744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:48 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:49.659288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c23437d7-22c0-4a44-a8dc-fca23686bf64 req-a14f1188-c83c-4ede-8a45-b6c4aee52a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:49.690743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c23437d7-22c0-4a44-a8dc-fca23686bf64 req-a14f1188-c83c-4ede-8a45-b6c4aee52a9e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:49.728208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c23437d7-22c0-4a44-a8dc-fca23686bf64 req-a14f1188-c83c-4ede-8a45-b6c4aee52a9e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:49.729070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c23437d7-22c0-4a44-a8dc-fca23686bf64 req-a14f1188-c83c-4ede-8a45-b6c4aee52a9e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:49.731703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:49.744770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2436a6d3-7ca3-4c3c-a996-49feae3baae8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1695 microversion: 2.1 time: 1.053900 Aug 29 16:09:49.747352 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2951/5745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:48 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1695 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:49.771095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:49.774945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:49.776970 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c23437d7-22c0-4a44-a8dc-fca23686bf64 req-a14f1188-c83c-4ede-8a45-b6c4aee52a9e service nova] Creating event network-changed:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h1-836830-13 Aug 29 16:09:49.804696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-c23437d7-22c0-4a44-a8dc-fca23686bf64 req-a14f1188-c83c-4ede-8a45-b6c4aee52a9e service nova] Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:09:49.809533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:49.814453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:49.817353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:49.827603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:49.828341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:49.830027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:49.844530 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c23437d7-22c0-4a44-a8dc-fca23686bf64 req-a14f1188-c83c-4ede-8a45-b6c4aee52a9e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197659 Aug 29 16:09:49.845139 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2795/5746] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:09:49.910312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:49.915180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:49.945701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:49.955585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:49.956461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:49.957682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:49.967564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:49.976000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:50.541725 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f710cd81-3049-4ab4-9eb4-959c630f0e22 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1345 microversion: 2.1 time: 0.792598 Aug 29 16:09:50.544634 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2952/5747] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:49 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1345 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:50.770535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:50.772728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:50.807463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:50.809997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:50.810796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:50.811992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:50.812675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:50.813399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:51.335786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:51.352305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52657f11-bc8e-4ce2-b47c-cba060712b1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1695 microversion: 2.1 time: 0.589135 Aug 29 16:09:51.367716 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2953/5748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:50 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1695 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:51.582398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:51.583603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:51.615812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:51.620346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:51.621803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:51.630021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:51.632005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:51.635041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:51.884412 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a881bd0a-9c8d-468d-ab51-004ccae5e8c1 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1425 microversion: 2.1 time: 0.305443 Aug 29 16:09:51.892162 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2954/5749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:51 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1425 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:52.388852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:52.398228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:52.418905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:52.422165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:52.423298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:52.424850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:52.425692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:52.427258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.065414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:53.082045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-44414389-1156-4a02-b6dd-1c916afa92dd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1695 microversion: 2.1 time: 0.697608 Aug 29 16:09:53.089208 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2955/5750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:52 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1695 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:53.097486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:53.099842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:53.121126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:53.122959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:53.126807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.128073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:53.128782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:53.129475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.292708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:53.318753 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-edabc78d-f037-4a28-8d96-6f9bab182c02 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 3.463989 Aug 29 16:09:53.321281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2796/5751] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:49 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 3468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:53.430636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:53.434377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:53.437579 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9fb20821-8dfe-4258-997c-489c6a583032 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1423 microversion: 2.1 time: 0.346753 Aug 29 16:09:53.446387 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2956/5752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:53 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1423 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:53.468260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:53.468777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:53.469226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.469962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:53.470422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:53.470850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:53.571598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lazy-loading 'flavor' on Instance uuid 3f73b215-d38d-4427-bc4b-181df4e8fa4d {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:09:53.653202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1514004392", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f86097cf-c2ec-48f3-b00c-ae541e26f7ef"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:09:53.743318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] validate_networks() for [('f86097cf-c2ec-48f3-b00c-ae541e26f7ef', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:09:54.077471 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ae9b1ba-a272-41aa-aeb2-d29659490b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/action" status: 202 len: 0 microversion: 2.20 time: 0.652367 Aug 29 16:09:54.081815 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2797/5753] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 16:09:53 2022] POST /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:09:54.104197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:54.107289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:54.125292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:54.125992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:54.126607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:54.130132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:54.130821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:54.132573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:54.814794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:54.833019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:54.834672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:54.835809 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-459830a7-0445-4ac7-ab0b-7cb104615e86 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 0.752611 Aug 29 16:09:54.851188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2798/5754] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:54 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:09:54.877715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:54.887127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:54.960082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:54.965416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:54.966186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:54.972030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:54.975993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:54.980479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.333496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:09:55.334003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:09:55.334452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:09:55.334873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:09:55.336033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:09:55.364869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.365457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.365907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.374321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.377447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.378604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.487929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:09:55.505505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for user f075974a803f46eda667db6d754453ba and project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:09:55.543849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:09:55.546877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:09:55.556014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:55.568143 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-344c9358-4d6a-4f74-b208-c71fb827cb76 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1695 microversion: 2.1 time: 0.706867 Aug 29 16:09:55.584816 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2799/5755] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:54 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1695 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:55.595712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:55.596713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:55.612244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.613418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.614765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.617063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.618370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.624038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.756029 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a1bdb8f1-c726-45ce-9488-8a443acacc79 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.105273 Aug 29 16:09:55.762430 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2957/5756] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:09:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:09:55.778705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1af11131-560d-4526-af83-41805e4ddaaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:55.783388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-633ae7e0-664a-448a-8d2b-111e126c7295 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1423 microversion: 2.1 time: 0.196984 Aug 29 16:09:55.784322 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2800/5757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:55 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1423 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:55.813820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1af11131-560d-4526-af83-41805e4ddaaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:55.862383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:55.863966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:55.875937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.882532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.883307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:55.886789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:55.887566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:55.888553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:56.196638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1af11131-560d-4526-af83-41805e4ddaaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:56.214505 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1af11131-560d-4526-af83-41805e4ddaaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1215 microversion: 2.1 time: 0.442846 Aug 29 16:09:56.217854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2958/5758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:55 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1215 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:56.592392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:56.593075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:56.615984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:56.616662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:56.617439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:56.624774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:56.625418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:56.626165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:56.871297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:56.880750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:56.885490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:56.892802 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f6091bb-7d0a-4aca-893c-a2678f005904 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 1.034352 Aug 29 16:09:56.907598 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2801/5759] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:55 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:09:56.934041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:56.934879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:56.963882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:56.970942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:56.977603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:56.982747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:56.986338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:56.987188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:57.936414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:57.951059 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97808afd-8a39-4d95-b9d3-3ead989dd606 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1693 microversion: 2.1 time: 1.362548 Aug 29 16:09:57.967260 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2959/5760] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:56 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1693 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:09:57.973772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:57.975576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:57.989079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:57.991977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:57.993763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:57.994767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:57.998456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.000523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.003695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:58.055404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:58.184445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:09:58.207250 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0f8c887-14ff-4d73-87f9-279ecce38bfa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1267 microversion: 2.1 time: 0.238178 Aug 29 16:09:58.208542 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2960/5761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:57 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:58.264813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:58.266654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:58.273881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.274620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.275308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.279794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:58.280805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:58.281341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:58.362719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:59.673218 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b4a285c-6955-4d7f-972c-e3ce3ca5736f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1465 microversion: 2.1 time: 2.760805 Aug 29 16:09:59.691762 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2802/5762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:56 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1465 bytes in 2784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:09:59.712974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:09:59.719585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:09:59.728380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:09:59.775038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.781835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.788564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:09:59.792496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:09:59.793245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:09:59.797311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.039745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:00.088566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:00.096475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:00.100966 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79d4262f-68f5-44d8-8a1a-c12cb4e99bc1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 1.891129 Aug 29 16:10:00.101936 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2961/5763] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:09:58 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:00.109465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:00.116440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:00.133370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.134141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.134785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.136299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.137779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.142697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.763922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:00.782100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a72baac3-9808-435d-9573-aeb097a5b923 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1690 microversion: 2.1 time: 1.080957 Aug 29 16:10:00.784100 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2803/5764] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:09:59 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1690 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:00.805999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:00.806767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:00.832249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.833938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.892613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.902514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:00.903045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:00.903494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:00.973420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:00.985007 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e0ddd4e-2f82-4cbc-8868-193a4d9bac03 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1273 microversion: 2.1 time: 0.881814 Aug 29 16:10:00.985617 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2962/5765] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:00 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1273 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:01.009195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:01.009993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:01.036026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:01.036542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:01.036989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:01.052234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:01.052934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:01.053179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:01.412288 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-772c401e-5626-4239-95b7-61f0d232873b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action" status: 202 len: 0 microversion: 2.1 time: 0.417461 Aug 29 16:10:01.413219 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2963/5766] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:10:00 2022] POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:10:01.438130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:01.439379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:01.454147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:01.456567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:01.457797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:01.459730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:01.461273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:01.461952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.032749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:02.055545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:02.057254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:02.070508 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-677e50c2-caf1-4b06-930e-84e4e13aa3c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 0.655798 Aug 29 16:10:02.074690 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2964/5767] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:01 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:02.079588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:02.094845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:02.133698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.135494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.139470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.140477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.140955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.141567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.477577 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2322eea7-a571-47d6-b414-38d6d796705c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1465 microversion: 2.1 time: 1.691315 Aug 29 16:10:02.478175 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2804/5768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:00 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1465 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:02.492895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-dcc341a7-3e40-4e96-bb24-7ace7a48f141 req-9e334bd0-dbcc-4aea-9f13-92a9dd5a3f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "name": "network-vif-plugged", "status": "completed", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:02.526302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dcc341a7-3e40-4e96-bb24-7ace7a48f141 req-9e334bd0-dbcc-4aea-9f13-92a9dd5a3f87 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.527140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dcc341a7-3e40-4e96-bb24-7ace7a48f141 req-9e334bd0-dbcc-4aea-9f13-92a9dd5a3f87 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.531673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dcc341a7-3e40-4e96-bb24-7ace7a48f141 req-9e334bd0-dbcc-4aea-9f13-92a9dd5a3f87 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.602134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-dcc341a7-3e40-4e96-bb24-7ace7a48f141 req-9e334bd0-dbcc-4aea-9f13-92a9dd5a3f87 service nova] Creating event network-vif-plugged:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h1-836830-13 Aug 29 16:10:02.634878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-dcc341a7-3e40-4e96-bb24-7ace7a48f141 req-9e334bd0-dbcc-4aea-9f13-92a9dd5a3f87 service nova] Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:10:02.668190 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-dcc341a7-3e40-4e96-bb24-7ace7a48f141 req-9e334bd0-dbcc-4aea-9f13-92a9dd5a3f87 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182362 Aug 29 16:10:02.671275 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2805/5769] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:02.683859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:02.689474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:02.709944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.710635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.711284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.712821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.713454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.714090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.892636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:02.905219 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78026966-ea46-4a4b-83cd-308b0669f83e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1273 microversion: 2.1 time: 0.230541 Aug 29 16:10:02.905219 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2806/5770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:02 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:02.916232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-89da00d4-9d23-49d4-b647-32cfc74aad47 req-6894632c-403c-442e-a9bc-0abba666b056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0da0122-b0ef-475d-ac21-0f8398d8fe1e", "tag": "6e6b0a6f-93b3-4221-bb1f-19179d956bef"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:02.928271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:02.937542 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9112c92a-b769-4f04-a0b3-4ad8656666b7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 0.861692 Aug 29 16:10:02.940473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-89da00d4-9d23-49d4-b647-32cfc74aad47 req-6894632c-403c-442e-a9bc-0abba666b056 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:02.941130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-89da00d4-9d23-49d4-b647-32cfc74aad47 req-6894632c-403c-442e-a9bc-0abba666b056 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:02.941559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-89da00d4-9d23-49d4-b647-32cfc74aad47 req-6894632c-403c-442e-a9bc-0abba666b056 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:02.957743 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2965/5771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:02 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:02.966978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-89da00d4-9d23-49d4-b647-32cfc74aad47 req-6894632c-403c-442e-a9bc-0abba666b056 service nova] Creating event network-changed:6e6b0a6f-93b3-4221-bb1f-19179d956bef for instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e on n-h2-836830-13 Aug 29 16:10:02.997012 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-89da00d4-9d23-49d4-b647-32cfc74aad47 req-6894632c-403c-442e-a9bc-0abba666b056 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091853 Aug 29 16:10:03.002509 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2807/5772] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:03.098072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:03.098732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:03.109337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:03.109839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:03.110284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:03.111006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:03.118126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:03.118630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:03.502418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:03.504097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:03.517900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:03.518876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:03.520403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:03.523683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:03.524947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:03.525649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:03.795799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:03.814099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:03.818632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:03.842823 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8d2fd5e-9c10-4e6f-8a99-424ecaa2ac13 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 0.748703 Aug 29 16:10:03.847712 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2966/5773] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:03 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:03.941085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:03.943359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:03.964370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:03.968123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:03.968635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:03.969084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:03.969811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:03.972244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:03.973256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:04.142420 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b525531-4f84-4f58-81f5-6be94faf7837 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1465 microversion: 2.1 time: 0.644158 Aug 29 16:10:04.143422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2808/5774] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:03 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1465 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:04.156874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:04.157842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:04.168041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:04.171327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:04.173742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:04.177110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:04.177693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:04.178203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:04.194416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:04.381984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:04.392537 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77ec73d5-81a1-446d-90c7-9c35e30f6e20 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 0.460976 Aug 29 16:10:04.406581 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2967/5775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:03 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:04.873277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:04.873911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:04.889808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:04.890311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:04.890829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:04.891572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:04.892036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:04.892466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:04.946264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:04.958165 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b4ce164-35af-480d-9928-c8a959a3e9bb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 0.813591 Aug 29 16:10:04.966327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2809/5776] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:04 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:05.171699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:05.172321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:05.185808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:05.186307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:05.187319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:05.189596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:05.190276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:05.190904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:05.272248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:05.286999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:05.294228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:05.307053 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-39392b1f-6af2-41eb-93a0-aeddfa17d7ab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1743 microversion: 2.20 time: 0.435381 Aug 29 16:10:05.312804 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2968/5777] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:04 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1743 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:05.430221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:05.430853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:05.441787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:05.443992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:05.444762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:05.445424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:05.446612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:05.448929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:05.449675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:05.759505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:05.782550 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78df7334-f590-4372-b159-b1beb82889ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 0.356268 Aug 29 16:10:05.789851 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2969/5778] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:05 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:05.990858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:05.991991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:06.039368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:06.043687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:06.048570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:06.052886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:06.053844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:06.057584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:06.203418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:06.761923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:06.781257 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f4deaeb-3e62-444d-8a36-e52f6ab5f023 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 0.795087 Aug 29 16:10:06.785975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2970/5779] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:05 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:06.797617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:06.813049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:06.834784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:06.839909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:06.841022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:06.841842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:06.842390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:06.843527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:07.213246 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b5b446f-f571-4f03-916d-013effa057ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1465 microversion: 2.1 time: 2.047372 Aug 29 16:10:07.214019 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2810/5780] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:05 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1465 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:07.242195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:07.247114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:07.276973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.280477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.280951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:07.284045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.285804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.289070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:07.922091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:07.936929 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84ec00c5-0118-45ce-b524-e669bc85c0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 0.704849 Aug 29 16:10:07.940279 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2811/5781] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:07 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:07.959709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:07.963394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:07.976868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.979548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.980394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:07.983688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:07.984593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:07.985218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:08.087989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:08.114818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:08.121343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:08.122791 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f29fea9-5fc1-46ff-beba-76f9b261f443 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1743 microversion: 2.20 time: 1.335489 Aug 29 16:10:08.128944 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2971/5782] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:06 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1743 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:08.240571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:08.241551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:08.297991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:08.303399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:08.304147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:08.308302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:08.310982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:08.317380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:08.711910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:08.722056 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbdaae8c-7965-43cf-ad52-e760682f2446 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 0.780400 Aug 29 16:10:08.734962 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2812/5783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:07 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:08.756690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6db32390-cbf0-4199-a915-7592b5b1aafe req-b55ccf32-4872-467f-9925-4f42456a3309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "name": "network-vif-plugged", "status": "completed", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:08.812327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6db32390-cbf0-4199-a915-7592b5b1aafe req-b55ccf32-4872-467f-9925-4f42456a3309 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:08.822136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6db32390-cbf0-4199-a915-7592b5b1aafe req-b55ccf32-4872-467f-9925-4f42456a3309 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:08.828659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6db32390-cbf0-4199-a915-7592b5b1aafe req-b55ccf32-4872-467f-9925-4f42456a3309 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:08.893280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6db32390-cbf0-4199-a915-7592b5b1aafe req-b55ccf32-4872-467f-9925-4f42456a3309 service nova] Creating event network-vif-plugged:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h1-836830-13 Aug 29 16:10:08.919329 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-740c2184-527e-49a8-8475-fc6f31e74131 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1465 microversion: 2.1 time: 0.684153 Aug 29 16:10:08.921334 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2972/5784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:08 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1465 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:08.923047 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6db32390-cbf0-4199-a915-7592b5b1aafe req-b55ccf32-4872-467f-9925-4f42456a3309 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178431 Aug 29 16:10:08.931706 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2813/5785] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:08.965393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:08.966354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:08.982008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:08.982606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:08.983093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:08.983817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:08.994594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:09.000159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:09.158171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:09.159246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:09.173785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:09.177157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:09.177887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:09.178803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:09.182297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:09.183659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:10.044051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:10.058326 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-accd8a00-f383-4849-a302-94c60dc51c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 1.096986 Aug 29 16:10:10.062579 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2973/5786] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:08 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:10.093449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-407e9926-c7d6-49cf-b74c-c6e8db580288 req-63563c17-298f-4a7b-b327-1e3ea1c490ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ee6aa8-2787-4074-971f-70af786527ee", "tag": "8f0c6bf6-1f2e-4915-b8cd-2922dde562d1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:10.122933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-407e9926-c7d6-49cf-b74c-c6e8db580288 req-63563c17-298f-4a7b-b327-1e3ea1c490ad service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:10.122933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-407e9926-c7d6-49cf-b74c-c6e8db580288 req-63563c17-298f-4a7b-b327-1e3ea1c490ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:10.123399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-407e9926-c7d6-49cf-b74c-c6e8db580288 req-63563c17-298f-4a7b-b327-1e3ea1c490ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:10.125037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:10.147711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:10.163823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:10.165191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ea5826e7-3844-4596-8334-0c1ba3b8827a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 1.014832 Aug 29 16:10:10.165794 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2814/5787] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:09 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:10:10.169743 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-407e9926-c7d6-49cf-b74c-c6e8db580288 req-63563c17-298f-4a7b-b327-1e3ea1c490ad service nova] Creating event network-changed:8f0c6bf6-1f2e-4915-b8cd-2922dde562d1 for instance 37ee6aa8-2787-4074-971f-70af786527ee on n-h1-836830-13 Aug 29 16:10:10.190887 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-407e9926-c7d6-49cf-b74c-c6e8db580288 req-63563c17-298f-4a7b-b327-1e3ea1c490ad service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106933 Aug 29 16:10:10.193135 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2974/5788] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:10.197418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:10.198637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:10.203845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:10.219678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:10.220022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:10.220730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:10.221389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:10.222284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:10.235100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:10.235922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:10.240393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:10.256289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:10.257436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:10.260323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:10.262644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:10.263321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:10.931343 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d2e55fc-b222-49d7-9c8c-9d4503dd0b73 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1465 microversion: 2.1 time: 0.734927 Aug 29 16:10:10.935526 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2975/5789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:10 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1465 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:10.997708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e607f0b8-f41a-4787-bed5-7b9f59d5fc36 req-8ad774ef-f713-4e8d-ae1b-b168b0e782d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0da0122-b0ef-475d-ac21-0f8398d8fe1e", "name": "network-vif-plugged", "status": "completed", "tag": "6e6b0a6f-93b3-4221-bb1f-19179d956bef"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:11.031929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e607f0b8-f41a-4787-bed5-7b9f59d5fc36 req-8ad774ef-f713-4e8d-ae1b-b168b0e782d3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:11.032787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e607f0b8-f41a-4787-bed5-7b9f59d5fc36 req-8ad774ef-f713-4e8d-ae1b-b168b0e782d3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:11.035357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e607f0b8-f41a-4787-bed5-7b9f59d5fc36 req-8ad774ef-f713-4e8d-ae1b-b168b0e782d3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:11.097521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e607f0b8-f41a-4787-bed5-7b9f59d5fc36 req-8ad774ef-f713-4e8d-ae1b-b168b0e782d3 service nova] Creating event network-vif-plugged:6e6b0a6f-93b3-4221-bb1f-19179d956bef for instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e on n-h2-836830-13 Aug 29 16:10:11.113376 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e607f0b8-f41a-4787-bed5-7b9f59d5fc36 req-8ad774ef-f713-4e8d-ae1b-b168b0e782d3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118798 Aug 29 16:10:11.117221 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2976/5790] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:11.152525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:11.153281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:11.198799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:11.223687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:11.228668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:11.233113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:11.236438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:11.237100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:11.306570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:11.656996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:11.665688 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ce1ce5a-e677-45fd-bfd9-64a84566e0d9 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 1.490871 Aug 29 16:10:11.666267 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2815/5791] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:10 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:11.678393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:11.679048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:11.712714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:11.713233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:11.714433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:11.715316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:11.715799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:11.716240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:12.302077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:12.337075 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-159e1154-f24f-4c12-ac43-e359f197082f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 1.218518 Aug 29 16:10:12.342409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2977/5792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:11 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:12.359174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:12.359982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:12.400526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:12.402739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:12.405030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:12.409127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:12.409770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:12.410331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:13.009035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:13.020126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:13.034132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:13.037632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5dfdd94b-64fc-4a72-a950-a9348a2f0d70 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 1.370139 Aug 29 16:10:13.055762 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2816/5793] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:11 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:13.069991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-955595c8-e766-416e-85f0-41d922e695f6 req-4398ec92-6139-4000-bd79-7d117c253bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "name": "network-vif-unplugged", "status": "completed", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:13.095335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-955595c8-e766-416e-85f0-41d922e695f6 req-4398ec92-6139-4000-bd79-7d117c253bc3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:13.096333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-955595c8-e766-416e-85f0-41d922e695f6 req-4398ec92-6139-4000-bd79-7d117c253bc3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:13.101000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-955595c8-e766-416e-85f0-41d922e695f6 req-4398ec92-6139-4000-bd79-7d117c253bc3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:13.123798 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-955595c8-e766-416e-85f0-41d922e695f6 req-4398ec92-6139-4000-bd79-7d117c253bc3 service nova] Creating event network-vif-unplugged:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:10:13.140650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-955595c8-e766-416e-85f0-41d922e695f6 req-4398ec92-6139-4000-bd79-7d117c253bc3 service nova] Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:10:13.177383 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-955595c8-e766-416e-85f0-41d922e695f6 req-4398ec92-6139-4000-bd79-7d117c253bc3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119708 Aug 29 16:10:13.184125 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2817/5794] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:13.189717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:13.191882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:13.208176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:13.208864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:13.209498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:13.215252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:13.219755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:13.220481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:13.229298 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45aba790-4734-45ef-8927-b91cb0cf4d78 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1465 microversion: 2.1 time: 0.885346 Aug 29 16:10:13.245706 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2978/5795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:12 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1465 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:13.360874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:13.361779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:13.374971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:13.375559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:13.376025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:13.376884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:13.377355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:13.378928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:14.006761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:14.016287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-083e2c95-ff78-4ab9-9acf-ee70a6251e98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 0.659396 Aug 29 16:10:14.017502 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2979/5796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:13 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:14.069284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:14.070063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:14.097480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:14.098086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:14.098766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:14.099812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:14.100361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:14.100870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:14.570395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:14.580951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:14.586672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:14.592793 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5f60490-9c18-4f56-ae84-d6039a845ce3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.527723 Aug 29 16:10:14.608668 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2980/5797] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:14 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:10:14.615712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:14.618411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:14.626459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:14.627362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:14.628040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:14.629580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:14.630261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:14.631222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:15.014995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:15.034209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-29c0df8a-60a1-41e9-a870-f979f0ab4b2b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 1.848547 Aug 29 16:10:15.036718 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2818/5798] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:13 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:15.048624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:15.051937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:15.067924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:15.074374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:15.080342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:15.081334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:15.082003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:15.082636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:15.320393 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d0ede7fe-143d-4fec-90c9-d42fceb519e4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1650 microversion: 2.1 time: 0.704765 Aug 29 16:10:15.327423 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2981/5799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:14 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1650 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:15.338162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8ac5f653-1145-4f1b-819c-8ee006085a1e req-265aa760-e121-4bc9-8418-b31baa92f62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:15.370582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8ac5f653-1145-4f1b-819c-8ee006085a1e req-265aa760-e121-4bc9-8418-b31baa92f62c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:15.371167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8ac5f653-1145-4f1b-819c-8ee006085a1e req-265aa760-e121-4bc9-8418-b31baa92f62c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:15.371617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8ac5f653-1145-4f1b-819c-8ee006085a1e req-265aa760-e121-4bc9-8418-b31baa92f62c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:15.421501 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8ac5f653-1145-4f1b-819c-8ee006085a1e req-265aa760-e121-4bc9-8418-b31baa92f62c service nova] Creating event network-changed:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:10:15.442642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-8ac5f653-1145-4f1b-819c-8ee006085a1e req-265aa760-e121-4bc9-8418-b31baa92f62c service nova] Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:10:15.496935 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8ac5f653-1145-4f1b-819c-8ee006085a1e req-265aa760-e121-4bc9-8418-b31baa92f62c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168046 Aug 29 16:10:15.502266 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2982/5800] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:15.517880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:15.518947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:15.535423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:15.536221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:15.536847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:15.539683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:15.540322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:15.543485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.004781 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae1d1192-4511-4648-84ea-2787d97b7a7f tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1650 microversion: 2.1 time: 0.500905 Aug 29 16:10:16.025403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2983/5801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:15 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1650 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:16.036318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:16.037134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:16.045010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.045774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.047321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.050378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.051243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.051911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.519347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:16.531092 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6fbfed4b-ae0f-433f-bb50-97def8088d6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 1.491600 Aug 29 16:10:16.532351 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2819/5802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:15 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:16.552927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:16.562048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:16.585567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.589394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.596718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.597879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.600125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.600741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.864556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:16.878421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:16.883547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:16.887240 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ac96a18-8dd6-42f0-a00c-d71c928e4df0 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.855743 Aug 29 16:10:16.889431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2984/5803] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:16 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:16.899975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:16.903289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:16.915157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.915665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.916120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:16.917056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:16.917683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:16.933481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:17.345826 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f22a254f-dbed-414d-a84d-c1bf8bf79d6b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1650 microversion: 2.1 time: 0.796425 Aug 29 16:10:17.353522 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2820/5804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:16 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1650 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:17.469944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1069392694", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "availability_zone": "nova:n-h1-836830-13", "networks": [{"uuid": "3759c3b2-d4c3-4f25-aeb2-548093e23726"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:17.572677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] validate_networks() for [('3759c3b2-d4c3-4f25-aeb2-548093e23726', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:10:17.716666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:17.726318 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e4e59e65-41f8-4acf-b927-5218b778654c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 0.835586 Aug 29 16:10:17.726920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2985/5805] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:16 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:17.780151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:17.780797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:17.805979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:17.806414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:17.806872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:17.815345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:17.815862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:17.816316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:18.483065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:10:18.483506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:10:18.483989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:10:18.484401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:10:18.485219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:10:18.501750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:18.503156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:18.503951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:18.505132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:18.506047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:18.507290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:18.536386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Getting quotas for project e4d5ce8b0cc1426dacca8b2f631a5949. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:10:18.545682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Getting quotas for user 6726e156cfb9479bbcca0d6a88f39566 and project e4d5ce8b0cc1426dacca8b2f631a5949. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:10:18.563580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:10:18.567217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:10:18.678696 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9f19d596-064e-451d-a152-4017effdcfb4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212999 Aug 29 16:10:18.687077 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2821/5806] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:10:18.698560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:18.707867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:18.718769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:18.719430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:18.719971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:18.720910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:18.721326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:18.721831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:19.014974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:19.025811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:19.036918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:19.038181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a695a8e3-da83-4d89-86ac-d40af7b39eed tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.346231 Aug 29 16:10:19.039082 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2822/5807] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:18 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:19.044175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dbcf7d45-f4d3-49d4-980b-575a87160d0c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:19.044296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dbcf7d45-f4d3-49d4-980b-575a87160d0c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:19.163419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dbcf7d45-f4d3-49d4-980b-575a87160d0c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1329 microversion: 2.1 time: 0.123202 Aug 29 16:10:19.170448 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2823/5808] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:19 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1329 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:19.199665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:19.200392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:19.215947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:19.216455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:19.216900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:19.217616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:19.218078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:19.218509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:19.234044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:19.267666 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a52a3af5-79ba-4b7c-a5ba-44baadd1868f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 1.487082 Aug 29 16:10:19.268379 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2986/5809] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:17 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:19.297505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-64760ca1-aa32-4e86-984c-016fcef6b67a req-95320ffa-07bf-4499-aa73-43576283ba82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6aa8-2787-4074-971f-70af786527ee", "name": "network-vif-plugged", "status": "completed", "tag": "8f0c6bf6-1f2e-4915-b8cd-2922dde562d1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:19.309203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-64760ca1-aa32-4e86-984c-016fcef6b67a req-95320ffa-07bf-4499-aa73-43576283ba82 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:19.309929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-64760ca1-aa32-4e86-984c-016fcef6b67a req-95320ffa-07bf-4499-aa73-43576283ba82 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:19.310518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-64760ca1-aa32-4e86-984c-016fcef6b67a req-95320ffa-07bf-4499-aa73-43576283ba82 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:19.323893 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-64760ca1-aa32-4e86-984c-016fcef6b67a req-95320ffa-07bf-4499-aa73-43576283ba82 service nova] Creating event network-vif-plugged:8f0c6bf6-1f2e-4915-b8cd-2922dde562d1 for instance 37ee6aa8-2787-4074-971f-70af786527ee on n-h1-836830-13 Aug 29 16:10:19.330713 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-64760ca1-aa32-4e86-984c-016fcef6b67a req-95320ffa-07bf-4499-aa73-43576283ba82 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044994 Aug 29 16:10:19.335186 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2987/5810] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:20.067995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:20.069270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:20.111508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:20.112535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:20.119763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:20.121004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:20.121637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:20.127835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:20.662105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:20.671816 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-edb2acf7-35e4-40b6-955b-f37616013941 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1689 microversion: 2.1 time: 1.490739 Aug 29 16:10:20.676619 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2824/5811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:19 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1689 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:20.688922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:20.690240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:20.705160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:20.705944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:20.709306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:20.710331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:20.715763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:20.716521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:21.028780 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd9bcba4-08ca-4704-8e72-d28ee8f575dd tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1418 microversion: 2.1 time: 0.350782 Aug 29 16:10:21.032304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2825/5812] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:20 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1418 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:21.057301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:21.057997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:21.070073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:21.070573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:21.071033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:21.071754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:21.072215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:21.072648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:21.648736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:21.665024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:21.669356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:21.675790 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f969056-f5ed-40e7-adea-130eddd5b86e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 1.610954 Aug 29 16:10:21.687903 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2988/5813] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:20 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:21.725265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:21.726145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:21.733894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:21.734666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:21.735297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:21.736196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:21.736810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:21.737395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:21.908580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:21.939917 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e767cb61-2bf8-4639-b81a-1d5945be87f2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1315 microversion: 2.1 time: 0.900221 Aug 29 16:10:21.943471 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2826/5814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:21 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:22.053322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:22.064357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:22.090178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:22.090808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:22.091361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:22.092091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:22.111405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:22.111862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:22.322822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7e5588d-5ae1-474d-9db2-1d3cbe87212e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1436 microversion: 2.1 time: 0.273642 Aug 29 16:10:22.323750 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2827/5815] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:22 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1436 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:22.715265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:22.716998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:22.749996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:22.754866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:22.755784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:22.759833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:22.761652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:22.765086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:22.802838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:23.121705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:23.130878 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-66f32adb-7f50-4572-83a6-4565532637a7 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1682 microversion: 2.1 time: 1.431521 Aug 29 16:10:23.147623 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2989/5816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:21 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1682 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:23.173039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:23.173685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:23.203717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:23.204513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:23.205381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:23.208132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:23.209432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:23.210029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:23.247204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:23.258470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:23.267473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:23.269722 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9f0df1c-4256-46f6-a039-791f32947136 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.560696 Aug 29 16:10:23.277633 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2828/5817] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:22 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:23.349198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:23.349903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:23.366731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:23.369463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:23.374500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:23.379589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:23.384890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:23.385480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:23.635372 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dfd063e5-b3a0-4eb5-a754-bc122b3a7f13 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1424 microversion: 2.1 time: 0.288246 Aug 29 16:10:23.641385 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2829/5818] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:23 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1424 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:24.258794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:24.268351 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f4f43bcc-c9b7-4a27-a617-0355542764fc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1502 microversion: 2.1 time: 1.119664 Aug 29 16:10:24.278563 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2990/5819] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:23 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1502 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:24.305471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:24.306464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:24.308448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:24.328537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:24.331106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:24.331823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:24.333691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:24.334706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:24.338388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:24.341535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:24.359856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:24.360369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:24.360825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:24.361562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:24.362028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:24.362466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:24.812331 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.network.security_group_api [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Removing security group 67c400d6-713b-4777-89c0-d2e446477e8f from port 8f0c6bf6-1f2e-4915-b8cd-2922dde562d1 Aug 29 16:10:25.081302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:25.096979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:25.109342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:25.117109 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-64a734d7-c09b-4737-83e4-f30c15d0b0f8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.815452 Aug 29 16:10:25.122232 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2991/5820] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:24 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:25.145850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:25.152172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:25.186639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:25.194165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:25.195911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:25.201816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:25.208547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:25.215730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:26.784026 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-546eca33-c971-4d85-a699-19c1235b7e5e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 1.659756 Aug 29 16:10:26.790919 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2992/5821] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:25 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:26.795871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:26.803728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:26.810438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:26.824345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:26.825051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:26.826032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:26.826696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:26.827357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.496062 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0de8fbc4-5464-4adc-a194-9314f6e5d018 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee/action" status: 202 len: 0 microversion: 2.1 time: 3.178552 Aug 29 16:10:27.496825 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2830/5822] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:10:24 2022] POST /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee/action => generated 0 bytes in 3200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:10:27.521918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-267838b2-d17f-43f2-87ab-c98a35d319e0 req-ab16aa6c-ba61-441a-80a2-0bf599c65bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "name": "network-vif-plugged", "status": "completed", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:27.556865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-267838b2-d17f-43f2-87ab-c98a35d319e0 req-ab16aa6c-ba61-441a-80a2-0bf599c65bc4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.558597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-267838b2-d17f-43f2-87ab-c98a35d319e0 req-ab16aa6c-ba61-441a-80a2-0bf599c65bc4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.559613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-267838b2-d17f-43f2-87ab-c98a35d319e0 req-ab16aa6c-ba61-441a-80a2-0bf599c65bc4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.580882 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-267838b2-d17f-43f2-87ab-c98a35d319e0 req-ab16aa6c-ba61-441a-80a2-0bf599c65bc4 service nova] Creating event network-vif-plugged:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:10:27.594671 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-267838b2-d17f-43f2-87ab-c98a35d319e0 req-ab16aa6c-ba61-441a-80a2-0bf599c65bc4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095011 Aug 29 16:10:27.595973 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2831/5823] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:27.608125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:27.611171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:27.627756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.631727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.632446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.637180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.637970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.638612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.848206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:27.857718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:27.869348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:27.873702 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7e53a53-87b2-45d2-9707-5bab3c1a9b51 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 1.081509 Aug 29 16:10:27.882614 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2993/5824] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:26 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:27.888235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1269b12e-ba9f-46be-919a-9dbdacfb0652 req-c310b6e3-bd87-4cf5-8aef-394e2189e4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ee6aa8-2787-4074-971f-70af786527ee", "tag": "8f0c6bf6-1f2e-4915-b8cd-2922dde562d1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:27.930376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1269b12e-ba9f-46be-919a-9dbdacfb0652 req-c310b6e3-bd87-4cf5-8aef-394e2189e4df service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.935004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1269b12e-ba9f-46be-919a-9dbdacfb0652 req-c310b6e3-bd87-4cf5-8aef-394e2189e4df service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.936260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1269b12e-ba9f-46be-919a-9dbdacfb0652 req-c310b6e3-bd87-4cf5-8aef-394e2189e4df service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.962185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1269b12e-ba9f-46be-919a-9dbdacfb0652 req-c310b6e3-bd87-4cf5-8aef-394e2189e4df service nova] Creating event network-changed:8f0c6bf6-1f2e-4915-b8cd-2922dde562d1 for instance 37ee6aa8-2787-4074-971f-70af786527ee on n-h1-836830-13 Aug 29 16:10:27.974206 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1269b12e-ba9f-46be-919a-9dbdacfb0652 req-c310b6e3-bd87-4cf5-8aef-394e2189e4df service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087306 Aug 29 16:10:27.975333 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2994/5825] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:27.985063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:27.986183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:27.992889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.993652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.994261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:27.995878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:27.996506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:27.998272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:28.152179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:28.167588 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-570c50cf-4498-4b23-83ae-f580c31ad30b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1460 microversion: 2.1 time: 0.569183 Aug 29 16:10:28.182658 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2832/5826] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:27 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1460 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:28.204368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:28.205087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:28.257127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.259335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.259805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:28.264081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.264562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.265000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:28.525122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:28.639506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:28.652156 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36b5483d-9e7b-48a8-bb1f-de9ae1469a89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.462825 Aug 29 16:10:28.653379 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2833/5827] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:28 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:28.717610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:28.718884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:28.728393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.731008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.732145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:28.733056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.733964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.734612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:28.847312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:28.850038 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc5c40bf-70be-4824-be7b-efca7dc36684 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.869006 Aug 29 16:10:28.877056 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2995/5828] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:27 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:28.911414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:28.912050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:28.933661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.934541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.935181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:28.936093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:28.936718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:28.937310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:29.159807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:29.201744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:29.214974 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e201d61-7d93-47a6-8c5d-a7d01aa270af tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.524769 Aug 29 16:10:29.216312 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2834/5829] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:28 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:29.236101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:29.237072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:29.247692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:29.248311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:29.251183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:29.252026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:29.252611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:29.253140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:29.587214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:29.605840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:29.613681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:29.615429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-893c0a0b-79f1-47b3-bb05-66f5a2ca8e25 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.708159 Aug 29 16:10:29.616567 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2996/5830] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:28 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:29.717817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:29.732390 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d742b42a-1890-4c09-bcb7-166223038ce9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.500047 Aug 29 16:10:29.769663 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2835/5831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:29 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:29.774711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:29.775716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:29.797885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:29.799860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:29.800726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:29.809058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:29.809902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:29.811427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:29.871870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:29.873071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:29.888290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:29.892411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:29.895707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:29.904521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:29.908155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:29.911350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:30.233662 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-299d0648-5f42-47ea-b149-f40d6680189c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.366460 Aug 29 16:10:30.255718 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2836/5832] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:29 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:30.626984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3a39e994-38e7-4b5f-a178-69126b97d9ba req-4a1fadf4-abb6-4f5b-843b-1aa8b7d9bb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd93b5cf-7d88-46dd-9a51-afc62ec666f8", "tag": "437f36e2-6507-404a-9f33-000ed91917ef"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:30.665365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:30.691259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3a39e994-38e7-4b5f-a178-69126b97d9ba req-4a1fadf4-abb6-4f5b-843b-1aa8b7d9bb46 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:30.692275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3a39e994-38e7-4b5f-a178-69126b97d9ba req-4a1fadf4-abb6-4f5b-843b-1aa8b7d9bb46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:30.693347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3a39e994-38e7-4b5f-a178-69126b97d9ba req-4a1fadf4-abb6-4f5b-843b-1aa8b7d9bb46 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:30.771585 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3a39e994-38e7-4b5f-a178-69126b97d9ba req-4a1fadf4-abb6-4f5b-843b-1aa8b7d9bb46 service nova] Creating event network-changed:437f36e2-6507-404a-9f33-000ed91917ef for instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 on n-h1-836830-13 Aug 29 16:10:30.794948 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3a39e994-38e7-4b5f-a178-69126b97d9ba req-4a1fadf4-abb6-4f5b-843b-1aa8b7d9bb46 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174514 Aug 29 16:10:30.802985 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2837/5833] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:10:30.829787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:30.835458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:30.862981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:30.863825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:30.864436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:30.869153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:30.870063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:30.871159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:30.943060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:30.961050 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6f1d16c2-da90-4318-91e2-b971c3837c8c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.192516 Aug 29 16:10:30.968672 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2997/5834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:29 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:31.283312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:31.284934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:31.318451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:31.328555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:31.333765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:31.337038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:31.338900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:31.342651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:31.468806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:31.504549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:31.515589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:31.521027 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-43bd2bfe-88eb-425d-8273-d403218fa890 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.715499 Aug 29 16:10:31.528092 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2838/5835] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:30 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:31.540759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-315202656", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f86097cf-c2ec-48f3-b00c-ae541e26f7ef"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:31.696746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] validate_networks() for [('f86097cf-c2ec-48f3-b00c-ae541e26f7ef', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:10:32.085954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-26abf864-45d1-4d87-8870-44a839f8c90b tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.809639 Aug 29 16:10:32.088584 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2998/5836] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:31 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:32.578479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:32.585854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:32.625249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:32.634425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:32.635258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:32.637934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:32.643539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:32.647853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.063781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:10:33.065359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:10:33.065359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:10:33.066071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:10:33.066536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:10:33.080609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.081458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.082495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.083539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.084857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.085800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.152342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:10:33.180217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Getting quotas for user f075974a803f46eda667db6d754453ba and project 8cf22730fb014345a7ed2aeb866bbe61. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:10:33.222299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:10:33.230642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:10:33.348433 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c6b43d42-b4f4-4bba-866f-391e1651bfdb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.818298 Aug 29 16:10:33.354160 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2839/5837] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:10:33.378689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:33.380539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:33.441837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.442828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.443470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.446171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:33.447042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:33.453358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:33.958808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32f4925e-ea14-441f-8549-efe3239f8107 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.602537 Aug 29 16:10:33.973160 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2840/5838] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:33 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:33.983667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-817d7bbb-3019-48c7-9f36-fb909755521a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:33.984669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-817d7bbb-3019-48c7-9f36-fb909755521a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:34.147675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-817d7bbb-3019-48c7-9f36-fb909755521a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:34.155692 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-817d7bbb-3019-48c7-9f36-fb909755521a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1214 microversion: 2.1 time: 0.178761 Aug 29 16:10:34.158756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2841/5839] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:33 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:34.202381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:34.224187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:34.228248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:34.236830 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cad42184-ed1e-42e7-9583-aa97a34859e3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 1.666826 Aug 29 16:10:34.242143 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 2999/5840] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:32 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:34.985164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:34.986036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:35.002344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.005163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.005633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.006367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.013862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.014695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.178672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:35.179604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:35.202430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=66 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:35.207042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.208766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.211378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.212859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.215261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.215792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.443565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:35.458160 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c585041a-da21-4eaa-a4a1-3c935662e5e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1266 microversion: 2.1 time: 0.283787 Aug 29 16:10:35.462068 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3000/5841] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:35 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:35.469746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:35.470723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:35.480641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.481668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.482228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.483133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:35.484278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:35.485398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:35.510039 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a2d5800-7e37-4741-b20b-4eccbb5915be tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.528684 Aug 29 16:10:35.519145 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2842/5842] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:34 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:36.226301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:36.245702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:36.247276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:36.248508 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-295b93ff-4656-4536-95a4-c5f044ac83b1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1738 microversion: 2.20 time: 0.784126 Aug 29 16:10:36.249081 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3001/5843] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:35 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1738 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:36.487424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:36.488170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:36.502680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.503050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.503520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.504241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.504725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.505145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.538913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:36.539753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:36.555308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.555836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.556286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.561266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:36.561776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:36.562220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:36.966836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:36.976291 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e0804d3-0edb-4caf-b2d3-6971b846a0cc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1284 microversion: 2.1 time: 0.492866 Aug 29 16:10:36.982789 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2843/5844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:36 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1284 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:37.276305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:37.276907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:37.288872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.289722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.292195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.294977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:37.295678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:37.298702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:37.692588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ad83036-aeca-485d-9f93-fe113ac316fb tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 1.159093 Aug 29 16:10:37.707054 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3002/5845] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:36 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:38.011552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:38.012847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:38.031382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:38.033218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:38.034856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:38.035873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:38.038386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:38.039562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:38.167129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:38.184797 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed4ed45c-d460-4a9e-855d-fbe83a7303a3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1272 microversion: 2.1 time: 0.181882 Aug 29 16:10:38.188952 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3003/5846] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:38 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:38.268025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:38.277973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:38.279586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:38.280903 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4636f7d-15f2-4ea8-bef3-8c162527b7ca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1720 microversion: 2.20 time: 1.008848 Aug 29 16:10:38.282564 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2844/5847] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:37 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1720 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:38.631467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2a60c19c-4b79-4adb-b03f-3e67bc525ab8 req-0b28dcaa-38b7-4294-a328-22283e9b0113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd93b5cf-7d88-46dd-9a51-afc62ec666f8", "name": "network-vif-plugged", "status": "completed", "tag": "437f36e2-6507-404a-9f33-000ed91917ef"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:38.659366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2a60c19c-4b79-4adb-b03f-3e67bc525ab8 req-0b28dcaa-38b7-4294-a328-22283e9b0113 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:38.659866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2a60c19c-4b79-4adb-b03f-3e67bc525ab8 req-0b28dcaa-38b7-4294-a328-22283e9b0113 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:38.660307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2a60c19c-4b79-4adb-b03f-3e67bc525ab8 req-0b28dcaa-38b7-4294-a328-22283e9b0113 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:38.685745 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2a60c19c-4b79-4adb-b03f-3e67bc525ab8 req-0b28dcaa-38b7-4294-a328-22283e9b0113 service nova] Creating event network-vif-plugged:437f36e2-6507-404a-9f33-000ed91917ef for instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 on n-h1-836830-13 Aug 29 16:10:38.707391 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2a60c19c-4b79-4adb-b03f-3e67bc525ab8 req-0b28dcaa-38b7-4294-a328-22283e9b0113 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082321 Aug 29 16:10:38.709380 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3004/5848] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:38.724120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:38.724747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:38.758469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:38.758963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:38.761570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:38.763113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:38.764920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:38.765545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:39.237443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:39.239788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:39.277624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:39.282524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:39.284022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:39.286881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:39.288753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:39.289859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:39.388565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-22b3ca1a-97ce-4db1-a52d-177d0f2c7a6c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.668237 Aug 29 16:10:39.393836 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2845/5849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:38 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:39.405860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:39.408034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:39.423602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:39.424441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:39.425290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:39.428320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:39.429029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:39.430474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:39.784919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:39.797609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:39.799518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:39.803305 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba3247c2-ded5-4a85-8cd9-83bfeb031a6c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1720 microversion: 2.20 time: 0.407781 Aug 29 16:10:39.804642 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2846/5850] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:39 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1720 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:39.922413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:39.932084 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23702ec3-46ec-4449-912f-03b410c1a159 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.721859 Aug 29 16:10:39.938856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3005/5851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:39 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:40.416066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:40.417279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:40.428432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.428912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.429348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.442564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.442964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.443437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.759327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-70274767-4d96-4529-a68f-240e5cff1c16 req-ae632d31-cbfe-4436-ab3e-41ce141a47ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "name": "network-vif-unplugged", "status": "completed", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:40.783396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-70274767-4d96-4529-a68f-240e5cff1c16 req-ae632d31-cbfe-4436-ab3e-41ce141a47ef service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.790230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-70274767-4d96-4529-a68f-240e5cff1c16 req-ae632d31-cbfe-4436-ab3e-41ce141a47ef service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.791059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-70274767-4d96-4529-a68f-240e5cff1c16 req-ae632d31-cbfe-4436-ab3e-41ce141a47ef service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.820426 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-834b3510-871f-404a-b78f-2d4d48e7a5ad tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.406831 Aug 29 16:10:40.825543 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2847/5852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:40 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:40.827648 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-70274767-4d96-4529-a68f-240e5cff1c16 req-ae632d31-cbfe-4436-ab3e-41ce141a47ef service nova] Creating event network-vif-unplugged:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h1-836830-13 Aug 29 16:10:40.839720 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-70274767-4d96-4529-a68f-240e5cff1c16 req-ae632d31-cbfe-4436-ab3e-41ce141a47ef service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084640 Aug 29 16:10:40.840846 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3006/5853] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:40.841576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:40.842246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:40.864124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.865882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.867537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.868424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.870863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.871489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.909767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:40.954705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:40.955512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:40.966047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.966550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.967003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:40.972293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:40.972815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:40.974013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:41.321948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:41.345141 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1788f36d-3f9d-4e0e-bc8a-2e6ee527db51 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.395289 Aug 29 16:10:41.346227 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3007/5854] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:40 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:41.383425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:41.396441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:41.398045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:41.400175 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0afaf109-b43a-4e85-a6bd-7e1176f41dab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1723 microversion: 2.20 time: 0.563360 Aug 29 16:10:41.403421 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2848/5855] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:40 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:10:41.431097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e713b6d7-7a4a-4e26-9b9f-5921616fd9e0"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:41.437731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:41.450362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:41.451740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:41.453857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:41.454927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:41.455748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:41.457146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:41.685038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-10101498-43f2-4d6c-accd-4f49a1d8ecf5 req-7668c72e-5b5f-4a45-8209-bc729748c1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ed993c-1565-425a-9dcd-5fb3635543b9", "tag": "69c49596-691f-47bd-8094-ff47d6fea908"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:41.750978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-10101498-43f2-4d6c-accd-4f49a1d8ecf5 req-7668c72e-5b5f-4a45-8209-bc729748c1e3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:41.756120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-10101498-43f2-4d6c-accd-4f49a1d8ecf5 req-7668c72e-5b5f-4a45-8209-bc729748c1e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:41.757430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-10101498-43f2-4d6c-accd-4f49a1d8ecf5 req-7668c72e-5b5f-4a45-8209-bc729748c1e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:41.785750 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-10101498-43f2-4d6c-accd-4f49a1d8ecf5 req-7668c72e-5b5f-4a45-8209-bc729748c1e3 service nova] Creating event network-changed:69c49596-691f-47bd-8094-ff47d6fea908 for instance 11ed993c-1565-425a-9dcd-5fb3635543b9 on n-h2-836830-13 Aug 29 16:10:41.805223 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-10101498-43f2-4d6c-accd-4f49a1d8ecf5 req-7668c72e-5b5f-4a45-8209-bc729748c1e3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124147 Aug 29 16:10:41.808909 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2849/5856] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:41.845148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:41.846557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:41.861578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:41.862766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:41.865014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:41.866095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:41.866836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:41.867506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.326171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7dcf763-bc35-47a3-93ed-8b437d094e74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.900008 Aug 29 16:10:42.333206 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3008/5857] 10.222.0.83 () {62 vars in 1364 bytes} [Mon Aug 29 16:10:41 2022] POST /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 188 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:10:42.365822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:42.366441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:42.370706 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e7d6a13-8abf-476a-81c7-b166824c49db tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1466 microversion: 2.1 time: 0.531838 Aug 29 16:10:42.374222 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2850/5858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:41 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1466 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:42.380977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.381478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.382557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.382691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.383072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.383494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.624659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:42.625748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:42.642877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.649395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.650050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.651742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:42.653147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:42.654646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:42.773615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129132) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 16:10:43.032138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:43.056199 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1022bcff-e45f-4434-aeb2-ed538926f9db tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.694273 Aug 29 16:10:43.060399 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3009/5859] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:42 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:43.400111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:43.401654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:43.437031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:43.445798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:43.446825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:43.447991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:43.452559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:43.454604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:43.457362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:43.486841 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6e1d7c4-546d-4a03-9b9f-a3fc8cc84cfd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/action" status: 202 len: 0 microversion: 2.20 time: 0.867399 Aug 29 16:10:43.487910 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2851/5860] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 16:10:42 2022] POST /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/action => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:43.497701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:43.500329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:43.510549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:43.512600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:43.513572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:43.514767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:43.517009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:43.517727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:43.845933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:43.859882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:43.869870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:43.873542 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a2c40dd-b2a5-421a-874b-96e7f7e5f0c6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1749 microversion: 2.20 time: 0.381730 Aug 29 16:10:43.877427 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2852/5861] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:43 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1749 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:44.078750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:44.079912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:44.091330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.094526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.097719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.098827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.099668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.100266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.136081 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bfdbba38-b197-43d3-8904-7cb59e7a2763 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1650 microversion: 2.1 time: 0.742664 Aug 29 16:10:44.152643 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3010/5862] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:43 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1650 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:44.157777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:44.185094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:44.194574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:44.206266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.206783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.210701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.214324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.215180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.215748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.229696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:44.600537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:44.636731 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d0941f52-042a-4514-bb5b-28d764b9f106 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.559861 Aug 29 16:10:44.639443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2853/5863] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:44 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:44.665234 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-afcef9ca-ea87-444d-a210-0eead4fa5597 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1650 microversion: 2.1 time: 0.488976 Aug 29 16:10:44.669677 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3011/5864] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:44 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1650 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:44.689886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:44.690021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:44.696667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.697178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.706992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.707983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.708374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.708950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.899835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:44.900623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:44.922088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.923272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.925266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:44.928549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:44.929926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:44.938338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.053003 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1a2afd43-a4ad-499a-9e13-7d7cc237b99c tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1650 microversion: 2.1 time: 0.367451 Aug 29 16:10:45.055855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2854/5865] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:44 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1650 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:45.087191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:45.089585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:45.125503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.143323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.144066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.149346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.152501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.157231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.284353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:10:45.463099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b20a41c-e12d-4009-a131-bcb5551c3b52 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "DELETE /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 204 len: 0 microversion: 2.1 time: 0.383189 Aug 29 16:10:45.466216 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2855/5866] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:10:45 2022] DELETE /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:45.494504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:45.496551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:45.507035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.507759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.508458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.510598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.511751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.513160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.594589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:45.609820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:45.618882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:45.622926 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff0deb73-5092-425a-a959-1404243e2331 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1749 microversion: 2.20 time: 0.728562 Aug 29 16:10:45.626433 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3012/5867] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:44 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1749 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:10:45.661933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:45.662840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:45.680347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.681569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.683702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:45.684748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:45.686770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:45.688628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:46.165974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:46.178694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42bd21ed-be54-42eb-ab38-c6a1e6c0cb89 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.521187 Aug 29 16:10:46.186916 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3013/5868] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:45 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:46.368978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1348d615-a059-46a9-86f0-0db2d5b3597e tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1656 microversion: 2.1 time: 0.891584 Aug 29 16:10:46.374122 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2856/5869] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:45 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1656 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:46.656012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:46.664260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:46.689099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.690236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.690673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:46.692468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:46.692925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:46.693529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.053851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:47.069537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:47.080139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:47.082811 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-df695dc2-9da2-4c5e-b0e4-69737aa0617b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.434777 Aug 29 16:10:47.091754 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3014/5870] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:46 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:47.213102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:47.214415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:47.248884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:47.254844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:47.261495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.266458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:47.267940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:47.270339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.397735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:47.398795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:47.409967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:47.413076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:47.414802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.419594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:47.420363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:47.423691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:47.862621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42ad13a5-72db-4215-895e-47ee850f880a tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1656 microversion: 2.1 time: 0.468511 Aug 29 16:10:47.879924 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3015/5871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:47 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1656 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:47.950231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:47.963880 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d612140-816c-486c-b301-64c8bf8da3c2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.754896 Aug 29 16:10:47.967988 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2857/5872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:47 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:48.122261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:48.122897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:48.158759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:48.159611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:48.168113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:48.169517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:48.170172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:48.170802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:48.222841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e7d8e253-7a6b-4fb9-82b8-2d895bba69da req-ea9d1847-7d38-45fb-9234-cb3f1e5f449b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd93b5cf-7d88-46dd-9a51-afc62ec666f8", "name": "network-vif-deleted", "tag": "437f36e2-6507-404a-9f33-000ed91917ef"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:48.270655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e7d8e253-7a6b-4fb9-82b8-2d895bba69da req-ea9d1847-7d38-45fb-9234-cb3f1e5f449b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:48.273378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e7d8e253-7a6b-4fb9-82b8-2d895bba69da req-ea9d1847-7d38-45fb-9234-cb3f1e5f449b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:48.274834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e7d8e253-7a6b-4fb9-82b8-2d895bba69da req-ea9d1847-7d38-45fb-9234-cb3f1e5f449b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:48.324277 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e7d8e253-7a6b-4fb9-82b8-2d895bba69da req-ea9d1847-7d38-45fb-9234-cb3f1e5f449b service nova] Creating event network-vif-deleted:437f36e2-6507-404a-9f33-000ed91917ef for instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 on n-h1-836830-13 Aug 29 16:10:48.336482 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e7d8e253-7a6b-4fb9-82b8-2d895bba69da req-ea9d1847-7d38-45fb-9234-cb3f1e5f449b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129745 Aug 29 16:10:48.356740 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2858/5873] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:48.719881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:48.735593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:48.748780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:48.750079 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-606fb4b0-cd5c-4890-88e0-797ec8948a15 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.633256 Aug 29 16:10:48.750675 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3016/5874] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:48 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:48.895042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:48.896445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:48.908983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:48.909940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:48.911651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:48.914325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:48.915199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:48.917511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:48.992467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:48.993123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:49.006898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.007546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.012514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.015652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.016378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.016901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.018652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.021199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.022302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.026823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lazy-loading 'fault' on Instance uuid fd93b5cf-7d88-46dd-9a51-afc62ec666f8 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:10:49.164037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-16fcd3f3-ce56-43ee-addf-914135c2f0ef tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 200 len: 1456 microversion: 2.1 time: 0.269810 Aug 29 16:10:49.184102 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2859/5875] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:48 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 1456 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:49.784122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:49.784763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:49.806550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.807861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.808498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.809444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:49.810616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:49.811305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:49.875982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:49.887853 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97aff1ec-2905-44c1-9171-e29ecbe7a484 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.900657 Aug 29 16:10:49.893241 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3017/5876] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:48 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:50.019164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:50.057953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:50.060282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:50.061822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee37ce6a-7cbf-41fe-b4bc-223918fba8a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.281663 Aug 29 16:10:50.068893 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2860/5877] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:49 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:50.189954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:50.191688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: fd93b5cf-7d88-46dd-9a51-afc62ec666f8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:50.206951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.207544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.207994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.208901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.209365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.210572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.238935 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] HTTP exception thrown: Instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 could not be found. Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Request method failure captured: Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 HTTP/1.1 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOTI2e1R42BSRp3OUdUbQ4xSqy0zLhlun-pMK1goEd72gDwiA_neCkczNeoAqW0VxygoHYGXpqoUb_RMkhY4O_0wBBsCo5bcaiAALDK4v7Xa0pw7JF1AKPE-wC7E8Qey4hneDrR4WnD2-SvAIHnK5tlZZ0FhAji58owRIFHK7InyUIk Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: e4d5ce8b0cc1426dacca8b2f631a5949 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestServerMultinode-1416714621 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e4d5ce8b0cc1426dacca8b2f631a5949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e4d5ce8b0cc1426dacca8b2f631a5949", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e4d5ce8b0cc1426dacca8b2f631a5949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e4d5ce8b0cc1426dacca8b2f631a5949"}]}] Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestServerMultinode-1416714621 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: e4d5ce8b0cc1426dacca8b2f631a5949 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestServerMultinode-1416714621 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestServerMultinode-1416714621-project-admin Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 6726e156cfb9479bbcca0d6a88f39566 Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestServerMultinode-1416714621-project-admin Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 could not be found. Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'fd93b5cf-7d88-46dd-9a51-afc62ec666f8'} Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 could not be found. Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 could not be found. Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:50.250628 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.256515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:50.256515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:50.256515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:50.256515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:10:50.256515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:10:50.256515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 could not be found. Aug 29 16:10:50.256515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:10:50.264164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Returning 404 to user: Instance fd93b5cf-7d88-46dd-9a51-afc62ec666f8 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:10:50.266898 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-85fce11d-98f5-46d8-854c-ccea5cb86fe4 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8" status: 404 len: 111 microversion: 2.1 time: 0.080974 Aug 29 16:10:50.275790 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3018/5878] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:50 2022] GET /compute/v2.1/servers/fd93b5cf-7d88-46dd-9a51-afc62ec666f8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:50.279373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:50.279899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:50.291840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.292360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.296883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.297962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.299528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.300000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.338293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:10:50.448851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:50.507980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-38143b7c-0a10-4ef4-b044-9a0e7aa982d4 req-8794b5e4-8a22-413f-b42e-85a94e589651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed993c-1565-425a-9dcd-5fb3635543b9", "name": "network-vif-plugged", "status": "completed", "tag": "69c49596-691f-47bd-8094-ff47d6fea908"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:50.524672 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c9e0d6db-47c2-40f3-9a9b-0da0e2a1e155 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "DELETE /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 204 len: 0 microversion: 2.1 time: 0.251581 Aug 29 16:10:50.525739 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2861/5879] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:10:50 2022] DELETE /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:10:50.535348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:50.536472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:50.540626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-38143b7c-0a10-4ef4-b044-9a0e7aa982d4 req-8794b5e4-8a22-413f-b42e-85a94e589651 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.541172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-38143b7c-0a10-4ef4-b044-9a0e7aa982d4 req-8794b5e4-8a22-413f-b42e-85a94e589651 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.542080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-38143b7c-0a10-4ef4-b044-9a0e7aa982d4 req-8794b5e4-8a22-413f-b42e-85a94e589651 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.563059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.563589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.564027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.564746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.565198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.565627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.582212 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-38143b7c-0a10-4ef4-b044-9a0e7aa982d4 req-8794b5e4-8a22-413f-b42e-85a94e589651 service nova] Creating event network-vif-plugged:69c49596-691f-47bd-8094-ff47d6fea908 for instance 11ed993c-1565-425a-9dcd-5fb3635543b9 on n-h2-836830-13 Aug 29 16:10:50.597153 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-38143b7c-0a10-4ef4-b044-9a0e7aa982d4 req-8794b5e4-8a22-413f-b42e-85a94e589651 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092894 Aug 29 16:10:50.598081 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3019/5880] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:10:50.918676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:50.919821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:50.945532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.946046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.946516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.956106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:50.956616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:50.957059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:50.961160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-676e4561-3ac7-4298-a69e-cb19403105ab tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1656 microversion: 2.1 time: 0.430772 Aug 29 16:10:50.969998 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2862/5881] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:50 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1656 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:51.086004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:51.086771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:51.101427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:51.103329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:51.104690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:51.105812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:51.108344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:51.109207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:51.271699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:51.284961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ef2279a-d2bf-459b-a810-77aea12eb5eb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.372226 Aug 29 16:10:51.287210 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3020/5882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:50 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:51.720727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:51.730549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:51.749962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:51.751801 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78c07702-73fc-42fb-b2ac-ffddd1f06f3b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.669996 Aug 29 16:10:51.752884 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2863/5883] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:51 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:10:51.992830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:51.993772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:52.004658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:52.006593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:52.007319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:52.008716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:52.009557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:52.010979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:52.309141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:52.309760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:52.318029 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e4c5f56b-f1ed-43b5-b8ca-e0c3e3de41e8 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1656 microversion: 2.1 time: 0.329794 Aug 29 16:10:52.326994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:52.328152 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3021/5884] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:51 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1656 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:10:52.339344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:52.340099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:52.341040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:52.341700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:52.342336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:52.653392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:52.669516 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d4151b64-df9a-49af-8bfe-273c069a65d7 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.367558 Aug 29 16:10:52.684072 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2864/5885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:52 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:52.786813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:52.788664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:52.814274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:52.815149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:52.815852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:52.816766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:52.817407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:52.818465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:53.185927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:53.199319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:53.204777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:53.208596 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3857e2c-af46-48e7-82d0-4f457c7a3363 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.431770 Aug 29 16:10:53.209500 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3022/5886] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:52 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:53.352525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:53.354560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:53.372748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:53.374379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:53.375394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:53.377568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:53.379740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:53.380504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:53.693654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:53.695865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:53.722035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:53.726041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:53.726823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:53.727811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:53.728476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:53.733966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:53.832531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fc700449-6d52-4e37-a596-80ac04449419 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1656 microversion: 2.1 time: 0.487216 Aug 29 16:10:53.837591 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2865/5887] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:53 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1656 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:54.163497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:54.188296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0802805-a55e-4bbd-bea6-f7082f6784c5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1314 microversion: 2.1 time: 0.498704 Aug 29 16:10:54.189420 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3023/5888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:53 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:54.234892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:54.235545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:54.251311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:54.251837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:54.252262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:54.252988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:54.253578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:54.254021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:54.548653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-388e3a37-0928-468b-98cb-3d5e8acd55cb req-716aa1c5-f95b-44a3-b549-a66eafce82e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0da0122-b0ef-475d-ac21-0f8398d8fe1e", "name": "network-vif-deleted", "tag": "6e6b0a6f-93b3-4221-bb1f-19179d956bef"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:54.585578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-388e3a37-0928-468b-98cb-3d5e8acd55cb req-716aa1c5-f95b-44a3-b549-a66eafce82e9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:54.586306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-388e3a37-0928-468b-98cb-3d5e8acd55cb req-716aa1c5-f95b-44a3-b549-a66eafce82e9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:54.587300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-388e3a37-0928-468b-98cb-3d5e8acd55cb req-716aa1c5-f95b-44a3-b549-a66eafce82e9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:54.638527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-388e3a37-0928-468b-98cb-3d5e8acd55cb req-716aa1c5-f95b-44a3-b549-a66eafce82e9 service nova] Creating event network-vif-deleted:6e6b0a6f-93b3-4221-bb1f-19179d956bef for instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e on n-h2-836830-13 Aug 29 16:10:54.659264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-388e3a37-0928-468b-98cb-3d5e8acd55cb req-716aa1c5-f95b-44a3-b549-a66eafce82e9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114640 Aug 29 16:10:54.663509 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3024/5889] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:10:54.705076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:54.737239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:54.741193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:54.742890 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-313084be-79f9-4c52-a921-e71a4c7cc4a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.513052 Aug 29 16:10:54.744239 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2866/5890] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:54 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:10:54.859629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:54.860916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:54.874616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:54.879609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:54.880544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:54.881447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:54.882069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:54.884027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:54.981713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:54.982214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:54.982657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:54.983148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lazy-loading 'fault' on Instance uuid e0da0122-b0ef-475d-ac21-0f8398d8fe1e {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:10:55.210736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:55.212061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:55.226456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:55.237810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:55.238710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:55.240711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:55.241397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:55.242061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:55.380216 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-067bba12-e4f6-46a4-a340-3601c411ac00 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 200 len: 1455 microversion: 2.1 time: 0.525095 Aug 29 16:10:55.381346 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3025/5891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:54 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 1455 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:55.768419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:55.769589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:55.778039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:55.779759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:55.780401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:55.781484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:55.782152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:55.782913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:56.068434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:56.080089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:56.081874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:56.083287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca8ff4b2-4ddc-4c57-ad75-ccfb0567a8fc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.318858 Aug 29 16:10:56.084510 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3026/5892] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:55 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:10:56.319700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:56.335587 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe7656ab-dbb4-46df-b5e6-9a5dd8c8655f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1502 microversion: 2.1 time: 1.129494 Aug 29 16:10:56.339411 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2867/5893] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:55 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1502 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:56.359009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:56.359589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:56.366845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:56.367778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:56.368371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:56.369329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:56.370174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:56.370926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:56.402939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:56.403840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] [instance: e0da0122-b0ef-475d-ac21-0f8398d8fe1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:56.413657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:56.414140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:56.419191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:56.420169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:56.420792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:56.423640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:56.452083 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] HTTP exception thrown: Instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e could not be found. Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Request method failure captured: Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e HTTP/1.1 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOTI2e1R42BSRp3OUdUbQ4xSqy0zLhlun-pMK1goEd72gDwiA_neCkczNeoAqW0VxygoHYGXpqoUb_RMkhY4O_0wBBsCo5bcaiAALDK4v7Xa0pw7JF1AKPE-wC7E8Qey4hneDrR4WnD2-SvAIHnK5tlZZ0FhAji58owRIFHK7InyUIk Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: e4d5ce8b0cc1426dacca8b2f631a5949 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestServerMultinode-1416714621 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e4d5ce8b0cc1426dacca8b2f631a5949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e4d5ce8b0cc1426dacca8b2f631a5949", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e4d5ce8b0cc1426dacca8b2f631a5949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e4d5ce8b0cc1426dacca8b2f631a5949"}]}] Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestServerMultinode-1416714621 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: e4d5ce8b0cc1426dacca8b2f631a5949 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestServerMultinode-1416714621 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestServerMultinode-1416714621-project-admin Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 6726e156cfb9479bbcca0d6a88f39566 Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestServerMultinode-1416714621-project-admin Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e could not be found. Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e0da0122-b0ef-475d-ac21-0f8398d8fe1e'} Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e could not be found. Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e could not be found. Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:10:56.454307 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:10:56.458488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:10:56.458488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:10:56.458488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:10:56.458488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:10:56.458488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:10:56.458488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e could not be found. Aug 29 16:10:56.458488 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:10:56.464896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] Returning 404 to user: Instance e0da0122-b0ef-475d-ac21-0f8398d8fe1e could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:10:56.468253 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e879a09b-1140-4fb9-b08b-d77186dfcfc7 tempest-TestServerMultinode-1416714621 tempest-TestServerMultinode-1416714621-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e" status: 404 len: 111 microversion: 2.1 time: 0.069916 Aug 29 16:10:56.470903 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2868/5894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:56 2022] GET /compute/v2.1/servers/e0da0122-b0ef-475d-ac21-0f8398d8fe1e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:10:56.535876 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0b5935c-22e6-4984-a7fd-9873ef016877 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9/action" status: 202 len: 0 microversion: 2.1 time: 0.178632 Aug 29 16:10:56.557687 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3027/5895] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:10:56 2022] POST /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:10:56.565313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:56.566289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:56.576368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:56.580846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:56.583551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:56.584124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:56.584923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:56.588387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:56.588982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:56.921848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:56.939748 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3e59e80-f073-4a74-86fe-254adff549d8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1507 microversion: 2.1 time: 0.378171 Aug 29 16:10:56.955466 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2869/5896] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:56 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:57.110605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:57.111427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:57.122014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:57.122774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:57.123402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:57.124301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:57.124920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:57.125576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:57.151454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:10:57.470697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:57.481487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:57.484605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:57.486037 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31a95fc1-b36d-4000-a741-58fa3a78a2a5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.381351 Aug 29 16:10:57.487125 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3028/5897] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:57 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:57.972272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:57.982375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:58.017248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.020430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.022829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.029665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.030909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.032384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.051309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:58.054170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:58.068551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.071707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.072329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.076581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.077506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.079839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.200675 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-27dd6e5a-109a-4eef-b8b8-3725645ee61c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action" status: 200 len: 63242 microversion: 2.1 time: 0.154265 Aug 29 16:10:58.202616 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3029/5898] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:10:58 2022] POST /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb/action => generated 63242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:10:58.514056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:58.514763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:58.533075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.534689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.536075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.536841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.538518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.541052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.752187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:58.762422 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b7dc35e-490c-4128-bdb1-fdc80acf08ce tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1487 microversion: 2.1 time: 0.799656 Aug 29 16:10:58.779697 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2870/5899] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:57 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1487 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:10:58.797166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:10:58.797873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:58.810935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.813904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.816348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.817234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:58.821109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:58.821735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:58.869770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lazy-loading 'flavor' on Instance uuid 11ed993c-1565-425a-9dcd-5fb3635543b9 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:10:59.258494 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7fa23abe-21b6-45b6-8c2a-dac4b045f8d5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9/action" status: 202 len: 0 microversion: 2.1 time: 0.471034 Aug 29 16:10:59.262488 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2871/5900] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:10:58 2022] POST /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:10:59.274275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:10:59.275283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:10:59.288234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:59.293711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:59.294595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:59.295539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:10:59.296324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:10:59.297219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:10:59.663977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:59.675517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:59.689579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:59.710396 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33c637f1-19f1-4cf1-8059-c23065b5accc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 1.201244 Aug 29 16:10:59.715843 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3030/5901] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:10:58 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:10:59.887622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:10:59.902956 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-12c19aa9-1da0-4104-9817-94537c70e23c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1493 microversion: 2.1 time: 0.638488 Aug 29 16:10:59.924341 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2872/5902] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:10:59 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1493 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:00.739106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:00.741195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:00.750950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:00.751753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:00.752752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:00.753623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:00.754236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:00.754818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:00.935192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:00.936468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:00.954914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:00.956377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:00.956823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:00.959743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:00.960400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:00.961512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:01.195654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:01.209619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:01.211117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:01.219869 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e630240-e00e-40fa-94c2-86cc83b57270 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.486405 Aug 29 16:11:01.236586 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3031/5903] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:00 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:01.241072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:01.256759 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b61b5687-18e8-45f6-91bf-99d97362d2ba tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1514 microversion: 2.1 time: 0.328849 Aug 29 16:11:01.274348 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2873/5904] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:00 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:02.248977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:02.253158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:02.272560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:02.295390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:02.296076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:02.304261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:02.309983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:02.312106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:02.312609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:02.323279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:02.332550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:02.333233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:02.333693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:02.334447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:02.342262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:02.342764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:02.627349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:02.651238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:02.652891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:02.657927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d296e92-c2b4-450c-bce0-43ccf8bce6d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.417832 Aug 29 16:11:02.674665 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3032/5905] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:02 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:03.664435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:03.684981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:03.685536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3cb8cb4f-ea68-489f-8de6-daf6de707cbb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1514 microversion: 2.1 time: 1.404589 Aug 29 16:11:03.686677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:03.692036 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2874/5906] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:02 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1514 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:03.695911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:03.696785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:03.698095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:03.699832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:03.700493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:03.702521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:04.151663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:04.165693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:04.200082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:04.203488 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5afe6bf-8481-48f6-a026-6704961a67a7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1751 microversion: 2.20 time: 0.523542 Aug 29 16:11:04.207406 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3033/5907] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:03 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1751 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:11:04.562833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6c512e26-5cf7-4a74-9e81-9c54136e7a20 req-6929ab0b-dd35-4324-ae8c-ff7059678257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed993c-1565-425a-9dcd-5fb3635543b9", "name": "network-vif-plugged", "status": "completed", "tag": "69c49596-691f-47bd-8094-ff47d6fea908"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:04.585134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6c512e26-5cf7-4a74-9e81-9c54136e7a20 req-6929ab0b-dd35-4324-ae8c-ff7059678257 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:04.585619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6c512e26-5cf7-4a74-9e81-9c54136e7a20 req-6929ab0b-dd35-4324-ae8c-ff7059678257 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:04.586053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6c512e26-5cf7-4a74-9e81-9c54136e7a20 req-6929ab0b-dd35-4324-ae8c-ff7059678257 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:04.615178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6c512e26-5cf7-4a74-9e81-9c54136e7a20 req-6929ab0b-dd35-4324-ae8c-ff7059678257 service nova] Creating event network-vif-plugged:69c49596-691f-47bd-8094-ff47d6fea908 for instance 11ed993c-1565-425a-9dcd-5fb3635543b9 on n-h2-836830-13 Aug 29 16:11:04.623907 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6c512e26-5cf7-4a74-9e81-9c54136e7a20 req-6929ab0b-dd35-4324-ae8c-ff7059678257 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064241 Aug 29 16:11:04.636174 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2875/5908] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:04.718055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:04.720047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:04.737001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:04.737510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:04.737952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:04.749118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:04.750068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:04.750986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:05.239738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:05.240604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:05.249330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:05.251494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:05.252601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:05.253925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:05.270189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:05.270652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:05.712268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:05.732921 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d4fc45e9-0010-4362-99ad-f5cbcbe6f3f1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1514 microversion: 2.1 time: 1.014006 Aug 29 16:11:05.741623 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3034/5909] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:04 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1514 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:06.255431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:06.282781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:06.286927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:06.296512 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1da7241-85be-47d4-a346-028eec50f692 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.063622 Aug 29 16:11:06.298395 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2876/5910] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:05 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:06.755349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:06.756268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:06.773776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=72 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:06.778777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:06.780913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:06.784826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:06.787412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:06.788721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:06.790320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:07.325080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:07.326099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:07.364995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:07.369426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:07.370923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:07.372303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:07.375622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:07.378404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:07.395848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:07.429873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29df7e91-db56-4da8-b5aa-e923351633da tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.678979 Aug 29 16:11:07.430462 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3035/5911] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:06 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:08.455720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:08.456669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:08.477700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:08.479942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:08.482786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:08.483777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:08.487539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:08.488298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:08.545934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:08.549173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:08.579556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:08.590013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:08.592832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-89111d96-559c-487a-aac7-49f1b4447ecf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.275370 Aug 29 16:11:08.598374 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2877/5912] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:07 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:08.632332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2c9b8c64-8d08-423f-b208-75226f01a86a req-bae6105a-60e0-4347-a887-a1196a7a90e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:08.662131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c9b8c64-8d08-423f-b208-75226f01a86a req-bae6105a-60e0-4347-a887-a1196a7a90e3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:08.664256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c9b8c64-8d08-423f-b208-75226f01a86a req-bae6105a-60e0-4347-a887-a1196a7a90e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:08.667133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c9b8c64-8d08-423f-b208-75226f01a86a req-bae6105a-60e0-4347-a887-a1196a7a90e3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:08.697002 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2c9b8c64-8d08-423f-b208-75226f01a86a req-bae6105a-60e0-4347-a887-a1196a7a90e3 service nova] Creating event network-changed:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h2-836830-13 Aug 29 16:11:08.735352 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2c9b8c64-8d08-423f-b208-75226f01a86a req-bae6105a-60e0-4347-a887-a1196a7a90e3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127020 Aug 29 16:11:08.736760 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2878/5913] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:09.297411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:09.315824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d070731-4141-4c42-93cd-7eb4d04fd4b8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.866616 Aug 29 16:11:09.333408 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3036/5914] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:08 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:09.635988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:09.637038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:09.646674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:09.647915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:09.648519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:09.649391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:09.650576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:09.651705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:10.343650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:10.344449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:10.404655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:10.405151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:10.405586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:10.408911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:10.409396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:10.409836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:10.453293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:10.488540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:10.490769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:10.492474 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ace6c683-f137-48cf-92be-cc08dd6444c7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.862189 Aug 29 16:11:10.498731 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2879/5915] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:09 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:10.916692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:10.922676 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9bce46a-53fd-463d-8ad3-ffe716993575 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.584810 Aug 29 16:11:10.931340 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3037/5916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:10 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:11.529620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:11.536906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:11.562368 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:11:11.562827 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d (ip 10.222.0.83) !!! Aug 29 16:11:11.565331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:11.567527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:11.573737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:11.574513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:11.574996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:11.579598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:11.960999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:11.961762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:11.985452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:11.985952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:11.986391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:11.987153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:12.011784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:12.012309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:12.645158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:12.667883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:12.670880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:12.675653 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a5553a9-ef91-4e28-bf9e-1a192f10886b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.150975 Aug 29 16:11:12.677804 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2880/5917] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:11 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:12.780677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:12.792100 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3a5d8d2-a052-4c83-9524-1998d55abe6a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.835813 Aug 29 16:11:12.798947 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3038/5918] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:11 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:13.706645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:13.707736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:13.726465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.727234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.727692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:13.730509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.731071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.734368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:13.823810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:13.825238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:13.855500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.857205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.858916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:13.862194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:13.863382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:13.865414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:14.525000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:14.542067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:14.546162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:14.550708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:14.555839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0c47306-dffe-4060-8f73-c47acf878787 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.744201 Aug 29 16:11:14.556463 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3039/5919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:13 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:14.560120 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ece0f6a-51b2-4084-aa0e-bdf75c3201d6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.853182 Aug 29 16:11:14.573966 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2881/5920] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:13 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:15.591529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:15.592381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:15.595585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:15.596203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:15.608367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:15.609021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:15.611668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:15.614763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:15.616958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:15.617675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:15.620448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:15.620979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:15.621416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:15.631791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:15.632774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:15.636593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:16.044530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:16.077152 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d9d3153-84b3-4f27-a68a-4fac1e3b81c3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.494272 Aug 29 16:11:16.079516 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3040/5921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:15 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:16.325084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:16.363646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:16.365272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:16.366473 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e2ad29b3-87ee-48ac-bfb9-3f116d2cd54a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.779716 Aug 29 16:11:16.367050 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2882/5922] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:15 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:11:17.101141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:17.101766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:17.125128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.125901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.126513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:17.128046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.128691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.129563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:17.399165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:17.399994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:17.419009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.424649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.425248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:17.426195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:17.426517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:17.427008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:18.065872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:18.075406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2c98d79-b368-4ee9-a20d-803fdb501bf0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.978050 Aug 29 16:11:18.079772 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3041/5923] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:17 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:18.643356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:18.662893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:18.664861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:18.666454 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7c1d427f-934e-4068-9aa1-8112dda1c170 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.271217 Aug 29 16:11:18.667684 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2883/5924] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:17 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:11:19.103971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:19.105257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:19.127667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:19.128369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:19.128984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:19.132405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:19.133114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:19.133739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:19.722855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:19.722855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:19.722855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:19.722855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:19.722855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:19.722855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:19.738155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:19.738900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:19.956565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:19.971617 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98ceff3c-ddd9-42ae-a5b6-15b90c005c1e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.871459 Aug 29 16:11:19.973370 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3042/5925] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:19 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:20.927823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:20.943120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:20.944928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:20.946361 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-53f01625-c468-46bb-9dbc-efe984bbdd0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.260025 Aug 29 16:11:20.948089 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2884/5926] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:19 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:20.975829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:20.976597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:20.990351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:20.991130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:20.998314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:20.999312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:21.003145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.005872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:21.006535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:21.007215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.010572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:21.014181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:21.014966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.019478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:21.020212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:21.026704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:21.486220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d10e6c69-55d4-4b98-a1a7-df80ac6572a7 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1835 microversion: 2.1 time: 0.500634 Aug 29 16:11:21.499074 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3043/5927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:20 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1835 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:21.555666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:21.566255 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-56644d08-e225-467d-b0f6-ae1d91835ffa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.572754 Aug 29 16:11:21.566848 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2885/5928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:20 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:21.973993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:21.976529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:22.009199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.014019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.018118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.022715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.026287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.027333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.593464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:22.594701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:22.610340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.626092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.626753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.627685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:22.629480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:22.637596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:22.937247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:22.968568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:22.970190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:22.971495 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6c148c2b-2163-423b-b320-ef3860e51806 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.001444 Aug 29 16:11:22.985160 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3044/5929] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:21 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:23.153572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:23.165877 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ab5bce3-7b0f-427d-b0c5-380ea8c7d85e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.577615 Aug 29 16:11:23.180954 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2886/5930] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:22 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:24.003491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:24.004114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:24.022347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:24.022854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:24.023332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:24.026418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:24.030215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:24.032803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:24.190344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:24.190969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:24.193396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:24.206504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:24.209667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:24.210557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:24.212251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:24.215814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:24.217138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:24.702448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:24.722602 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-83195778-5c3b-477d-9bc9-32566a941a80 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.536680 Aug 29 16:11:24.741933 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2887/5931] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:24 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:25.422936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:25.491293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:25.497482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:25.500656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-686db1a2-904c-4ac2-917f-798048883f35 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.501177 Aug 29 16:11:25.503362 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3045/5932] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:23 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:25.746087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:25.746773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:25.766376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:25.767227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:25.770415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:25.815733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:25.817464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:25.818145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.205279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:26.206276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:26.241452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:26.244774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:26.252392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.262362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:26.273938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:26.274861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.298336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:26.315452 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-678a5728-c834-448e-99e6-aa3de4f3f442 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.573455 Aug 29 16:11:26.317502 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2888/5933] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:25 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:26.334567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-550673a8-4003-423d-9382-1f23f7a4bcec req-3bc10abc-93f2-4b49-ba75-4834f677aaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:26.352845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:11:26.366137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-550673a8-4003-423d-9382-1f23f7a4bcec req-3bc10abc-93f2-4b49-ba75-4834f677aaa7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:26.366625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-550673a8-4003-423d-9382-1f23f7a4bcec req-3bc10abc-93f2-4b49-ba75-4834f677aaa7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:26.367101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-550673a8-4003-423d-9382-1f23f7a4bcec req-3bc10abc-93f2-4b49-ba75-4834f677aaa7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.409464 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-550673a8-4003-423d-9382-1f23f7a4bcec req-3bc10abc-93f2-4b49-ba75-4834f677aaa7 service nova] Creating event network-changed:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:11:26.433760 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-550673a8-4003-423d-9382-1f23f7a4bcec req-3bc10abc-93f2-4b49-ba75-4834f677aaa7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112355 Aug 29 16:11:26.434881 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2889/5934] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:26.536660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:26.537385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:26.547117 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e237c5a-54f3-4ccb-adc3-647a495de653 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 204 len: 0 microversion: 2.1 time: 0.349671 Aug 29 16:11:26.551682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:26.552397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:26.553002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.553862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:26.554460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:26.554594 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3046/5935] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:11:26 2022] DELETE /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:11:26.561766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.569303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:26.570258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:26.578319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:26.579343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:26.580012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.581211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:26.581888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:26.582550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:26.833726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:26.839845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:26.854577 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cedfbeaf-15e4-45e4-bffb-b45abab9370d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1688 microversion: 2.1 time: 0.297614 Aug 29 16:11:26.858344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:26.860080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:26.862704 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d82272c-6bd9-4f7d-9b20-91605814e326 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.330471 Aug 29 16:11:26.866124 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2890/5936] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:26 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:11:26.872071 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3047/5937] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:26 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1688 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:27.338911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:27.339992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:27.348667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=43 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:27.352409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:27.354799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:27.356694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:27.364214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:27.365207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:27.365905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:27.877894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:27.878761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:27.896738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:27.903725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:27.908130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:27.909231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:27.912922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:27.914142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:28.160097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:28.182341 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9108ade-c804-4fda-bd4e-c3cbf0444c2c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.845376 Aug 29 16:11:28.185243 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2891/5938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:27 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:28.205139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:28.206295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:28.218599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:28.221552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:28.222248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:28.224332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:28.225648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:28.226994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:28.668595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:28.685246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2d9c30c-55aa-446a-b21f-51cf26c46572 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1688 microversion: 2.1 time: 0.804918 Aug 29 16:11:28.689021 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3048/5939] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:27 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1688 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:28.769584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:28.802683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:28.804221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:28.805495 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2709fb2f-e42e-4b75-9e5a-5101e6010469 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.617020 Aug 29 16:11:28.826278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2892/5940] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:28 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:29.204781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:29.208477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:29.222565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:29.224654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:29.226298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:29.227545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:29.230588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:29.235406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:29.712847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:29.715293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:29.730643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:29.735976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:29.736856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:29.740477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:29.752126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:29.753144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:29.837088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:29.875841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b70ef285-b15b-405e-8815-11388a4ed153 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.673625 Aug 29 16:11:29.877109 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3049/5941] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:29 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:29.893689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:29.894796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:29.910162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:29.911639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:29.914536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:29.915616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:29.916950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:29.918079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:30.000423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:30.019847 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3d562f6-1b59-4044-826a-c8605ef3bb12 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1621 microversion: 2.1 time: 0.311017 Aug 29 16:11:30.045868 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2893/5942] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:29 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1621 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:30.528602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-58fe879a-edc1-4e15-88dc-8ed513671de7 req-47539484-fc25-48b9-99bd-81f446d96886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fdab9d1-0d8a-4ac8-9064-503b6616e9fb", "name": "network-vif-deleted", "tag": "8d30c406-d201-48b7-a9bf-4a3dfaeeb540"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:30.534417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:30.548793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-58fe879a-edc1-4e15-88dc-8ed513671de7 req-47539484-fc25-48b9-99bd-81f446d96886 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:30.551403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-58fe879a-edc1-4e15-88dc-8ed513671de7 req-47539484-fc25-48b9-99bd-81f446d96886 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:30.554885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-58fe879a-edc1-4e15-88dc-8ed513671de7 req-47539484-fc25-48b9-99bd-81f446d96886 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:30.583097 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-58fe879a-edc1-4e15-88dc-8ed513671de7 req-47539484-fc25-48b9-99bd-81f446d96886 service nova] Creating event network-vif-deleted:8d30c406-d201-48b7-a9bf-4a3dfaeeb540 for instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb on n-h2-836830-13 Aug 29 16:11:30.597312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:30.601984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:30.602259 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-58fe879a-edc1-4e15-88dc-8ed513671de7 req-47539484-fc25-48b9-99bd-81f446d96886 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079445 Aug 29 16:11:30.609210 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b35f754b-8b57-4cba-8190-ec0873ebc0f3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.730743 Aug 29 16:11:30.610168 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3050/5943] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:29 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:30.613518 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2894/5944] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:30.897235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:30.898171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:30.921041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:30.921633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:30.922692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:30.923868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:30.924385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:30.924749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:31.049413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:31.050680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:31.068627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:31.072265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:31.094070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:31.094883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:31.095386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:31.102180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:31.252672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:31.256424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:31.261819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:31.262514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lazy-loading 'fault' on Instance uuid 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:11:31.375148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:31.388428 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef21bc58-e766-4e68-944f-da36d70ef462 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1357 microversion: 2.1 time: 0.344265 Aug 29 16:11:31.389347 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2895/5945] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:31 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1357 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:31.526443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:31.547074 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a59b714b-c451-4589-afb8-10df577b6e73 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.651079 Aug 29 16:11:31.548788 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3051/5946] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:30 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:31.636667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:31.637290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:31.667931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:31.668442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:31.669004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:31.669733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:31.670278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:31.670716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:31.674379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:31.969924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:31.986001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:31.988034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:31.990047 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa2bb3b1-be62-4e85-8f21-e170be462e07 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.357518 Aug 29 16:11:31.991994 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2896/5947] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:31 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:32.415217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:32.416937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:32.452845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:32.455531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:32.456217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:32.458010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:32.470958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:32.471682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:32.574106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:32.575654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:32.583203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:32.584997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:32.589549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:32.594571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:32.596799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:32.599284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:32.599658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:32.600784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lazy-loading 'fault' on Instance uuid 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:11:32.604866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:32.606254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:32.761233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:32.774421 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-814779b3-7ab2-4ec8-b70b-31c7818aa486 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 200 len: 1508 microversion: 2.1 time: 0.363903 Aug 29 16:11:32.779580 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3052/5948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:32 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:32.811136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5271ec68-9db3-4dc1-bb0a-27feb74a3332 req-92476311-4cfb-4b4c-91a2-5a8674231e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed993c-1565-425a-9dcd-5fb3635543b9", "name": "network-vif-unplugged", "status": "completed", "tag": "69c49596-691f-47bd-8094-ff47d6fea908"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:32.829098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5271ec68-9db3-4dc1-bb0a-27feb74a3332 req-92476311-4cfb-4b4c-91a2-5a8674231e14 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:32.830089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5271ec68-9db3-4dc1-bb0a-27feb74a3332 req-92476311-4cfb-4b4c-91a2-5a8674231e14 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:32.830825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5271ec68-9db3-4dc1-bb0a-27feb74a3332 req-92476311-4cfb-4b4c-91a2-5a8674231e14 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:32.896754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5271ec68-9db3-4dc1-bb0a-27feb74a3332 req-92476311-4cfb-4b4c-91a2-5a8674231e14 service nova] Creating event network-vif-unplugged:69c49596-691f-47bd-8094-ff47d6fea908 for instance 11ed993c-1565-425a-9dcd-5fb3635543b9 on n-h2-836830-13 Aug 29 16:11:32.897026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:32.911793 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7e4935b-de09-482b-9b00-5ea35d2ffc25 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1509 microversion: 2.1 time: 0.343911 Aug 29 16:11:32.919780 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2897/5949] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:32 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:32.921822 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5271ec68-9db3-4dc1-bb0a-27feb74a3332 req-92476311-4cfb-4b4c-91a2-5a8674231e14 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116680 Aug 29 16:11:32.924691 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3053/5950] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:33.033820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:33.034529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:33.063199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:33.085048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:33.090119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:33.094765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:33.097507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:33.097970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:33.769483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:33.789010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:33.803385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:33.805727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:33.816255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:33.820335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e7ea665-a37f-42a2-9802-1b5f15ce2522 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.804006 Aug 29 16:11:33.826742 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2898/5951] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:33 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:33.829049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:33.829944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:33.831103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:33.832225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:33.833039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:33.833905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:33.891663 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] HTTP exception thrown: Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb could not be found. Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Request method failure captured: Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb HTTP/1.1 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDONG2yb9mOHKeSltTvDyEcQiLtYQbcBPTxy0x3FxNBGEXH1-i_wA8cuOZwd2nh_mlieUYhV6h68joQSnzP2mBZSWo_OXVfZhWFJZt3PmVDpW23gIlfq-AEevegrGoX_S4C-hfVnJi8_8nBLzj4KsqpP-tAe80eHDwGKZwj5vloWUvXM Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_18bd3c1e18644293a3cc974c300efd06", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/18bd3c1e18644293a3cc974c300efd06"}]}] Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e1ce5d3d668743d5b8843936f77c0150 Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb could not be found. Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5fdab9d1-0d8a-4ac8-9064-503b6616e9fb'} Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb could not be found. Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb could not be found. Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:11:33.897742 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb could not be found. Aug 29 16:11:33.904844 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:11:33.908695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Returning 404 to user: Instance 5fdab9d1-0d8a-4ac8-9064-503b6616e9fb could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:11:33.911351 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-08c43120-fe4f-43c1-af35-9a1f8814db73 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb" status: 404 len: 111 microversion: 2.1 time: 0.117181 Aug 29 16:11:33.912925 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3054/5952] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:33 2022] GET /compute/v2.1/servers/5fdab9d1-0d8a-4ac8-9064-503b6616e9fb => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:11:33.944488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:33.946031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:33.969783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:33.974063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:33.977293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:33.978232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:33.980062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:33.982439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:34.369845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:34.379977 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-48e41f8d-240e-495f-b109-b2bf5db3416b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1506 microversion: 2.1 time: 0.439659 Aug 29 16:11:34.380569 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2899/5953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:33 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1506 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:34.849158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:34.850721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:34.867443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:34.868219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:34.869606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:34.869811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:34.870128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:34.875197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:35.365601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:35.381017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:35.383183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:35.385055 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b31d49ff-fc3a-426d-a2cf-41b8f2c06389 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.540703 Aug 29 16:11:35.393316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3055/5954] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:34 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:35.411603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:35.412260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:35.425958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:35.427698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:35.428443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:35.429665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:35.431217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:35.435710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:35.765546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:35.775287 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f80141a3-74a9-46ee-9fba-fc732d50832c tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1506 microversion: 2.1 time: 0.370846 Aug 29 16:11:35.778423 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2900/5955] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:35 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:36.410928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:36.412372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:36.434958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:36.435830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:36.436445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:36.439314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:36.439947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:36.440653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:36.802846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:36.804218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:36.823471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:36.824206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:36.824840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:36.825774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:36.826466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:36.827168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:37.225602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:37.235255 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae3476bb-a167-4653-bc9f-1ce73ad386f8 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1506 microversion: 2.1 time: 0.438022 Aug 29 16:11:37.242014 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2901/5956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:36 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:37.643619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:37.658629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:37.665033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:37.668453 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98fdf027-a11f-48b6-8f73-76dfc45d188a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 1.262185 Aug 29 16:11:37.683901 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3056/5957] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:36 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:38.267735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:38.276127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:38.313504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.320058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.330280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:38.336018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.338240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.344783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:38.716466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:38.719054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:38.739186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:38.771712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.780182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.781777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:38.783232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:38.789468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:38.792185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:39.258012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:39.280450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:39.283265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:39.308716 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce313205-c485-46e1-a613-adfd072e4d78 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.597004 Aug 29 16:11:39.321066 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3057/5958] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:38 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:11:39.373819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:39.382014 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38b83806-769a-4c5d-995d-37330fa654ae tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 200 len: 1449 microversion: 2.1 time: 1.118638 Aug 29 16:11:39.382607 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2902/5959] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:38 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 1449 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:39.411765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:39.412478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:39.424570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:39.426355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:39.427624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:39.429738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:39.430425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:39.431606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:39.769925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:39.781348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88739408-e1f8-46e8-986f-eec6d1147080 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.376115 Aug 29 16:11:39.781936 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3058/5960] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:39 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:39.811982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:39.812879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:39.838980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:39.838980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:39.849620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:39.849620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:39.849620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:39.849904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:40.163388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:40.178808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5ebec2fb-c1bd-45fd-a61e-a444e7c196a0 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.367204 Aug 29 16:11:40.193038 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2903/5961] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:39 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:40.204906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:40.205715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:40.232059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:40.236202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:40.236982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:40.238298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:40.239153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:40.239946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:40.334438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:40.336106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:40.375505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:40.379835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:40.383551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:40.385041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:40.385938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:40.387899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.001173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:41.012067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:41.013515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:41.014710 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7042e9df-8490-40e9-98bf-c99e21ded29d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.684187 Aug 29 16:11:41.042833 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2904/5962] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:40 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:41.232630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:41.246822 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c16f7afd-8661-4886-a3b3-cfa9b28b3aaa tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.045262 Aug 29 16:11:41.247465 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3059/5963] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:40 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:41.276245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:41.277328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:41.291530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.292162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.293035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.295793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.299657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.300004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.751686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:41.764255 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-437b1b26-3a97-4ba7-b1d8-a5356127876a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.496695 Aug 29 16:11:41.765103 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2905/5964] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:41 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:41.786402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f7ec897e-5b53-4401-b8c2-348cac74e1a1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:41.803814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7ec897e-5b53-4401-b8c2-348cac74e1a1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.804575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7ec897e-5b53-4401-b8c2-348cac74e1a1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.805353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7ec897e-5b53-4401-b8c2-348cac74e1a1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.834259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f7ec897e-5b53-4401-b8c2-348cac74e1a1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Going to try to stop instance {{(pid=129133) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:11:41.879535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:41.925798 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f7ec897e-5b53-4401-b8c2-348cac74e1a1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.142466 Aug 29 16:11:41.937774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:41.938762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:41.945316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3060/5965] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:11:41 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:11:41.951248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.952186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.952983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:41.954356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:41.956064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:41.957026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:42.071866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:42.073038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:42.085166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:42.087935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:42.089467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:42.090913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:42.094456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:42.095258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:42.525119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:42.540576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:42.545503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:42.548279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:42.549837 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7714455b-54dc-4923-ba81-c23cefae30a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.483841 Aug 29 16:11:42.552200 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3061/5966] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:42 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:11:42.572727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5140c1f4-9a6a-4291-986a-b0d48385c55d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.641443 Aug 29 16:11:42.573333 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2906/5967] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:41 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:43.542515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46d144a8-ef9e-4eae-ad71-df89e5a43f6a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '.version_select at 0x7f32f2aab310>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:43.570276 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46d144a8-ef9e-4eae-ad71-df89e5a43f6a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1740408394" status: 202 len: 0 microversion: 2.1 time: 0.033888 Aug 29 16:11:43.580580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:43.581363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:43.590941 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3062/5968] 10.222.0.83 () {58 vars in 1284 bytes} [Mon Aug 29 16:11:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1740408394 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:11:43.598802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:43.600329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:43.607128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:43.607629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:43.608068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:43.608780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:43.609267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:43.609662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:43.611902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:43.612683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:43.613542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:43.614758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:43.615469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:43.616123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:43.875319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:43.890175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:43.897051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:43.898719 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b50ac200-9031-412d-ba22-9c69b6d7fba6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.324715 Aug 29 16:11:43.899854 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2907/5969] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:43 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:43.902252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:43.910284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0a76349-4a40-4ec6-96d5-ae832366fb28 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: .version_select at 0x7f32ed42c9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-15941267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1N+tmtq60EC/2s98RlpYkJTxouFRwd8D72G1zJrTQnPNZqBDi088K6Az2Zy7w5FXMsHXtaEutZq2TwS1GE2de/CtX6KYlZStsocXN95oLp+imv94KlOhn0Pq1gOV4K5A=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:43.912551 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb17703d-e3cb-4e86-bbe7-95df6d5bb3b5 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.319595 Aug 29 16:11:43.926577 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3063/5970] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:43 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:43.961970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0a76349-4a40-4ec6-96d5-ae832366fb28 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:11:43.979555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0a76349-4a40-4ec6-96d5-ae832366fb28 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:11:44.046358 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0a76349-4a40-4ec6-96d5-ae832366fb28 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.144820 Aug 29 16:11:44.047411 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2908/5971] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:11:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:44.934713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:44.935568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:44.935923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:44.937294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:44.947498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:44.948522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:44.949239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:44.950242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:44.950869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:44.951606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:44.956386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:44.956990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:44.959423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:44.960599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:44.961756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:44.964178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:45.183369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:45.193723 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3adee8ca-50a9-4146-963f-74711a94f8d2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.263556 Aug 29 16:11:45.194730 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2909/5972] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:44 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:45.319418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:45.334136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:45.336757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:45.339625 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3cc1c520-b2e2-4a95-8501-8613bdb176ec tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.413809 Aug 29 16:11:45.341481 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3064/5973] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:44 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:46.216761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:46.217625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:46.243343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:46.244456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:46.244955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:46.249429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:46.249941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:46.250397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:46.382415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:46.391500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:46.418712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:46.419332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:46.419866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:46.420617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:46.421282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:46.421872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:46.727476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:46.747267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:46.760219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:46.763422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:46.766916 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-256df74f-7646-41ad-9dba-3166b84e320f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.388484 Aug 29 16:11:46.768216 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3065/5974] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:46 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:46.773665 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-036b416a-0ff3-408a-8d30-26d759b53da2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.560800 Aug 29 16:11:46.778885 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2910/5975] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:46 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:47.790588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:47.792890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:47.802831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:47.803742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:47.816628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:47.820601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:47.821149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:47.822784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:47.823752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:47.824453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:47.829378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:47.829903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:47.830383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:47.832679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:47.833168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:47.833615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:48.047374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:48.055785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d10178c8-8a3a-4897-9a39-388e1ce32bbf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.257276 Aug 29 16:11:48.057046 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2911/5976] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:47 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:48.503660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:48.527831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:48.529976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:48.532200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4fba66ce-d17e-4a85-9147-f3eabc9cc050 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.745400 Aug 29 16:11:48.533722 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3066/5977] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:47 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:49.078153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:49.078827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:49.095675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:49.096058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:49.097970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:49.100208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:49.100862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:49.101466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:49.352576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:49.362496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e894732-b873-4f0f-b811-59b634a87fc4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.288444 Aug 29 16:11:49.364162 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2912/5978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:49 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:49.558066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:49.558694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:49.568966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:49.569468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:49.569914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:49.570636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:49.571123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:49.571575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:49.843215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:49.855012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:49.857760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:49.859457 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a339606-a023-40b2-8536-e1cfaa6a8ff2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.306060 Aug 29 16:11:49.860294 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3067/5979] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:49 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:50.409939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:50.409939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:50.413128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:50.425852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:50.426551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:50.427557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:50.428234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:50.432489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:50.886361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:50.889415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:50.906303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:50.906808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:50.907278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:50.913673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:50.919343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:50.919840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:50.998570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:50.998570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:51.012595 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9348f323-1b33-4bcd-b17c-8a86ffa7a356 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 0.624174 Aug 29 16:11:51.023673 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2913/5980] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:50 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:51.311868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:51.321468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:51.324188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:51.325688 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c636f163-4cf0-4924-b24c-64d9efcc9c01 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.444304 Aug 29 16:11:51.341791 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3068/5981] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:50 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:52.040683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:52.041828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:52.051684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:52.059824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:52.060283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:52.061033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:52.061530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:52.061989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:52.366197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:52.367276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:52.398983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:52.401740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:52.403360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:52.406064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:52.407360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:52.412372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:52.691957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:52.707619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:52.711870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:52.717563 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b73227e4-a7b1-4ff1-ae6d-77846029ffcc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.356665 Aug 29 16:11:52.719575 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3069/5982] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:52 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:53.481992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:53.493924 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e9ab39f1-eeac-47fc-9c97-60497d696e4a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1681 microversion: 2.1 time: 1.459651 Aug 29 16:11:53.498316 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2914/5983] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:52 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1681 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:53.751273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:53.752602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:53.764642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:53.765151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:53.767796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:53.774530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:53.777045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:53.777533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:54.517640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:54.518625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:54.521338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:54.552741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:54.553514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:54.555904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:54.558190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:54.560545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:54.567201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:54.573256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:54.591132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:54.612849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:54.622618 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4330bd37-ef2a-46b2-9906-7376bfc00cf1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.882494 Aug 29 16:11:54.643448 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3070/5984] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:53 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:55.100922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:55.115121 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fce92f36-0d27-4694-bdfa-2cf7a0fed01b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1658 microversion: 2.1 time: 0.597679 Aug 29 16:11:55.136729 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2915/5985] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:54 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1658 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:11:55.160623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8475d869-4561-42e7-82f2-2f398802458f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:55.185979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8475d869-4561-42e7-82f2-2f398802458f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:55.193777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8475d869-4561-42e7-82f2-2f398802458f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:55.196487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8475d869-4561-42e7-82f2-2f398802458f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:55.301932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8475d869-4561-42e7-82f2-2f398802458f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Going to try to start instance {{(pid=129133) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:11:55.495613 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8475d869-4561-42e7-82f2-2f398802458f tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.357479 Aug 29 16:11:55.502132 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3071/5986] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:11:55 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:11:55.513920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:55.514669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:55.549049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:55.567601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:55.570683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:55.573223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:55.588636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:55.589095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:55.651013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:55.651896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:55.679725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:55.683048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:55.683529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:55.688808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:55.689501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:55.690616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:56.426995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:56.460322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:56.462159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:56.464527 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1a6d4a1b-55b7-47a6-b0c0-3efd3e6a63b9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.818567 Aug 29 16:11:56.465855 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3072/5987] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:55 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:11:56.841019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:56.859955 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7344491-cb1e-43a9-be08-9b967721a6b6 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1667 microversion: 2.1 time: 1.345361 Aug 29 16:11:56.859955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2916/5988] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:55 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1667 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:57.494932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:57.496548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:57.515406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:57.516100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:57.519666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:57.521653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:57.522174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:57.524817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:57.851009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ab8b2281-0d0d-47b2-b69a-8ef52d2732aa req-2ae7102c-0604-4b21-acb4-c7d1555be7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "name": "network-vif-plugged", "status": "completed", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:57.874745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:11:57.889189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ab8b2281-0d0d-47b2-b69a-8ef52d2732aa req-2ae7102c-0604-4b21-acb4-c7d1555be7ad service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:57.891069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ab8b2281-0d0d-47b2-b69a-8ef52d2732aa req-2ae7102c-0604-4b21-acb4-c7d1555be7ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:57.891548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ab8b2281-0d0d-47b2-b69a-8ef52d2732aa req-2ae7102c-0604-4b21-acb4-c7d1555be7ad service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:57.911459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:57.921338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:57.944060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:57.945718 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be9c600d-32d9-4026-a986-e90758c412a3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.455787 Aug 29 16:11:57.950209 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3073/5989] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:57 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:57.956303 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ab8b2281-0d0d-47b2-b69a-8ef52d2732aa req-2ae7102c-0604-4b21-acb4-c7d1555be7ad service nova] Creating event network-vif-plugged:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h2-836830-13 Aug 29 16:11:57.961498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:57.963543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:57.976722 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ab8b2281-0d0d-47b2-b69a-8ef52d2732aa req-2ae7102c-0604-4b21-acb4-c7d1555be7ad service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128142 Aug 29 16:11:57.977943 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2917/5990] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:11:57.993479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:57.994833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:57.995674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:57.998113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:57.998634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:57.999662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:58.334620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:58.348370 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e49b8f8f-f8d0-4eeb-b0fc-98ed0b9b9e1a tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1667 microversion: 2.1 time: 0.396559 Aug 29 16:11:58.350065 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3074/5991] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:57 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1667 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:58.976858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:58.977584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:58.992759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:58.993394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:58.994461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:58.995414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:58.996169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:58.996706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.352524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:59.372257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:59.372868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:59.378824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:59.383541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:59.386535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.388442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38aee18a-ec19-46a7-a4f5-f72807fb8c27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.417167 Aug 29 16:11:59.390258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.391565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.394434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.395257 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2918/5992] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:11:58 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:11:59.396453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.399113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.735955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-796522001", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "b71ecdbe-91b0-4c4a-9683-fe90806b7920"}], "key_name": "tempest-TestNetworkAdvancedServerOps-15941267", "security_groups": [{"name": "tempest-secgroup-smoke-1351087191"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:11:59.788481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:11:59.803544 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-628c81fe-c489-4319-9019-179c2cc9fff9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.435669 Aug 29 16:11:59.809780 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3075/5993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:59 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:11:59.830845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:11:59.831427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:11:59.841601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.842102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.842540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.843288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:11:59.843805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:11:59.844234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:11:59.923063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] validate_networks() for [('b71ecdbe-91b0-4c4a-9683-fe90806b7920', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:12:00.215773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:00.228269 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c18ea23e-e19d-44cc-a299-ff399876ecb4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.401794 Aug 29 16:12:00.244888 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3076/5994] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:11:59 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:00.268278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:00.269225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:00.302885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:00.304079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:00.304624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:00.310891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:00.312824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:00.313956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:00.327693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:00.602764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:00.613420 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e82fc6ee-630c-4e35-89a9-2bead3992dda tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.354725 Aug 29 16:12:00.627451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3077/5995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:00 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:00.627451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:00.627451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:00.631084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:00.631084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:00.631371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:00.632065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:00.632523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:00.634521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:00.830860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:00.855008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:00.859672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:00.860167 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-668d9d09-0171-4c24-af9a-4ff6e0363390 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1807 microversion: 2.20 time: 0.242872 Aug 29 16:12:00.861724 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3078/5996] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:12:00 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:12:00.867147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:00.868084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:00.877294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:00.878702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:00.880374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:00.881888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:00.882616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:00.883347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.200850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:01.216135 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7b666d6-2a38-4ab8-8a4d-385a4231c45b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.353038 Aug 29 16:12:01.223499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3079/5997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:00 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:01.239304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:01.244772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:01.266347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.266860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.267335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.268067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.268531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.268972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.564772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:01.578671 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a76b0bc2-ba18-46e0-85c8-c863fb72712d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.345755 Aug 29 16:12:01.588230 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3080/5998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:01 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:01.603884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:01.604806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:01.617112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.617623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.618076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.618825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.619322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.623711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.679107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lazy-loading 'flavor' on Instance uuid b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:12:01.818138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b423a46-bee0-438e-b55c-5019c0b177b4 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.219428 Aug 29 16:12:01.819382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3081/5999] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:12:01 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:12:01.828924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:01.829943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:01.837135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.838424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.839320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:01.840397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:01.841244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:01.841804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:02.057197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:02.072874 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5929bf19-e382-4d16-973e-923a4edf0d46 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1679 microversion: 2.1 time: 0.248878 Aug 29 16:12:02.074625 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3082/6000] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:01 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:02.087997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:02.088983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:02.096191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:02.098667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:02.099457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:02.101024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:02.101725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:02.102373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:02.334029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:12:02.334569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:12:02.335063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:12:02.335697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:12:02.336121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:12:02.355269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:02.355490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:02.355609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:02.355794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:02.358858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:02.362096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:02.363114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:02.370231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:02.374459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:02.383516 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-50601706-beb1-4146-999c-eb1b6e03f839 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1794 microversion: 2.20 time: 0.306962 Aug 29 16:12:02.384585 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3083/6001] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:12:02 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1794 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:12:02.422466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:12:02.434667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:12:02.458611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:12:02.463827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:12:02.558650 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e84911e-7b2e-417e-a840-05a92f77abe8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.827291 Aug 29 16:12:02.559439 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2919/6002] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:11:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:12:02.571360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a751be41-8b09-4269-be25-3224c33e7942 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:02.572280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a751be41-8b09-4269-be25-3224c33e7942 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:02.734755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a751be41-8b09-4269-be25-3224c33e7942 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:02.750894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a751be41-8b09-4269-be25-3224c33e7942 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1264 microversion: 2.1 time: 0.183722 Aug 29 16:12:02.768644 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3084/6003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:02 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:03.102410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:03.105793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:03.132172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:03.133875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:03.141511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:03.143388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:03.143388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:03.155803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:03.775795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:03.776698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:03.823571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:03.824200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:03.825064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:03.829631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:03.839803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:03.842852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:03.947929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:03.957733 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f47ad82a-0c14-4593-ac9f-4b4cd1a92343 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1268 microversion: 2.1 time: 0.187352 Aug 29 16:12:03.965842 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3085/6004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:03 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:04.480243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:04.489331 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c81140ce-182b-4d32-a008-cc5f8116a851 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1662 microversion: 2.1 time: 1.392767 Aug 29 16:12:04.493791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2920/6005] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:03 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1662 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:04.523981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:04.525011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:04.539727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.540755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.542439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.543599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.545384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.546105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.661407 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-881cab9d-7484-4119-9cf7-20ab4a09127b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.147423 Aug 29 16:12:04.662663 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3086/6006] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:12:04 2022] POST /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:12:04.672759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:04.674875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:04.690032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.692882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.694036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.697750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:04.698537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:04.699183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:04.990128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:04.991550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:05.019999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:05.020523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:05.020980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:05.021714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:05.022175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:05.022601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:05.110060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:05.127958 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0beb32fb-64e0-4500-bfcd-439109c5a7e1 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1668 microversion: 2.1 time: 0.460866 Aug 29 16:12:05.129751 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2921/6007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:04 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:05.171241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:05.185179 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a69809c7-a179-4a96-b4b6-e4ed283931f2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1324 microversion: 2.1 time: 0.200299 Aug 29 16:12:05.201410 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3087/6008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:04 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:06.156977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:06.158216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:06.180097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:06.182109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:06.182924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:06.184249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:06.188049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:06.189544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:06.214371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:06.215703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:06.230737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:06.242111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:06.242864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:06.245821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:06.247720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:06.248546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:06.432869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:06.445287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79b47740-152b-4190-8074-237deff158f3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1322 microversion: 2.1 time: 0.235260 Aug 29 16:12:06.460558 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3088/6009] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:06 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:06.529942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:06.541645 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8206fbf9-8d27-4966-8f7c-8b34cbb20534 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1668 microversion: 2.1 time: 0.388015 Aug 29 16:12:06.545715 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2922/6010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:06 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:07.470241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:07.470890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:07.492742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:07.493387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:07.493895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:07.494707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:07.500025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:07.500491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:07.568986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:07.570486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:07.584722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:07.596374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:07.597083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:07.598067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:07.598761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:07.599484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:07.867766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:07.877606 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-65f29001-ae6b-4736-ac4a-b907d81d8b0e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.411628 Aug 29 16:12:07.883422 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3089/6011] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:07 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:08.139363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:08.150707 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38a60e98-6225-4ee3-82a1-8b6426588adb tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 0.585180 Aug 29 16:12:08.155520 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2923/6012] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:07 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:08.171854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:08.172489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:08.183851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:08.184466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:08.184997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:08.185733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:08.186198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:08.199921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:08.819843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84059bd5-7d52-4c52-8698-261ffaa7a081 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Action: 'create', calling method: .version_select at 0x7f32ee3db670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-449373120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKiD1qqRoV8KOap7PJChEDhZI9SNV+IhvKSiczTuxZXLaep0VR/VakpZScIg59TyLzId9T0nOwl1Q7vz5+qsYGlxXQOxVBqsQyAuBNlqrlmXUmYZr56XCdIlpZAH/uZJA=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:08.843880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-84059bd5-7d52-4c52-8698-261ffaa7a081 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Getting quotas for project 7b07be353bbc481cbd35a4304501c57e. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:12:08.853988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-84059bd5-7d52-4c52-8698-261ffaa7a081 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Getting quotas for user 35cca2c3486c4389a04f6a20b8d567e9 and project 7b07be353bbc481cbd35a4304501c57e. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:12:08.893730 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84059bd5-7d52-4c52-8698-261ffaa7a081 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.082930 Aug 29 16:12:08.896781 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2924/6013] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:12:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:08.922151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:08.924516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:08.935781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:08.936880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:08.937712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:08.938752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:08.939649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:08.940315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:09.366457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:09.383185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1f057aea-41bd-4257-b20a-483df67914ac tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1671 microversion: 2.1 time: 1.215145 Aug 29 16:12:09.390178 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3090/6014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:08 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1671 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:09.412934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4074cc01-a4a9-4c76-8bd2-15db61721000 req-ec206c3c-455f-451e-967f-f2fc1441ac69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8e79c5-da97-4231-989f-22816d6612cd", "tag": "98c2fb7e-c6fa-42db-b01d-706843714612"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:09.444304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:09.446293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4074cc01-a4a9-4c76-8bd2-15db61721000 req-ec206c3c-455f-451e-967f-f2fc1441ac69 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:09.446929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4074cc01-a4a9-4c76-8bd2-15db61721000 req-ec206c3c-455f-451e-967f-f2fc1441ac69 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:09.447674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4074cc01-a4a9-4c76-8bd2-15db61721000 req-ec206c3c-455f-451e-967f-f2fc1441ac69 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:09.469691 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4074cc01-a4a9-4c76-8bd2-15db61721000 req-ec206c3c-455f-451e-967f-f2fc1441ac69 service nova] Creating event network-changed:98c2fb7e-c6fa-42db-b01d-706843714612 for instance bc8e79c5-da97-4231-989f-22816d6612cd on n-h2-836830-13 Aug 29 16:12:09.485247 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4074cc01-a4a9-4c76-8bd2-15db61721000 req-ec206c3c-455f-451e-967f-f2fc1441ac69 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085627 Aug 29 16:12:09.486709 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3091/6015] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:09.495167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:09.496068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:09.506434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:09.507316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:09.508236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:09.510955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:09.512125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:09.513033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:09.551599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:09.555946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:09.564119 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.compute.api [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Working on deleting snapshot 122e8cd2-0710-4250-bd20-beebf8db179a from shelved instance... Aug 29 16:12:09.639876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:09.650675 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbf90c2d-e9cc-43bd-98d5-8049311a50db tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.751858 Aug 29 16:12:09.658268 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2925/6016] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:08 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:10.574075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Doing local delete in cell 28b8b8ff-80ab-47bc-a359-1c63b1ee12ee(cell1) {{(pid=129133) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 29 16:12:10.580262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:10.584254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:10.585322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:10.586058 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.compute.api [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 29 16:12:10.599467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] deallocate_for_instance() {{(pid=129133) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 29 16:12:10.684360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:10.685343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:10.711210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:10.712676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:10.712676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:10.713142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:10.713694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:10.714130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:11.013929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:11.028684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fca82212-c0ea-4075-a077-cf471ac6dd4a tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.348763 Aug 29 16:12:11.033713 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2926/6017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:10 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:12.058068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:12.058881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:12.068310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Updating instance_info_cache with network_info: [] {{(pid=129133) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 16:12:12.093057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:12.100524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:12.101423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:12.102092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:12.104221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:12.108182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:12.378459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:12.583084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:12.602471 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47443a70-3d2c-4f7d-9441-34a68ca31c1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.548736 Aug 29 16:12:12.604780 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2927/6018] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:12 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:12.618848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3093bceb-0766-4615-83d9-45c2fa7c2745 req-96f75d30-2c84-4ed5-9cac-3f1869e4dfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ed993c-1565-425a-9dcd-5fb3635543b9", "name": "network-vif-deleted", "tag": "69c49596-691f-47bd-8094-ff47d6fea908"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:12.639002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3093bceb-0766-4615-83d9-45c2fa7c2745 req-96f75d30-2c84-4ed5-9cac-3f1869e4dfd7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:12.640469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3093bceb-0766-4615-83d9-45c2fa7c2745 req-96f75d30-2c84-4ed5-9cac-3f1869e4dfd7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:12.641085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3093bceb-0766-4615-83d9-45c2fa7c2745 req-96f75d30-2c84-4ed5-9cac-3f1869e4dfd7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:12.660288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.server_external_events [req-3093bceb-0766-4615-83d9-45c2fa7c2745 req-96f75d30-2c84-4ed5-9cac-3f1869e4dfd7 service nova] Unable to find a host for instance 11ed993c-1565-425a-9dcd-5fb3635543b9. Dropping event network-vif-deleted {{(pid=129132) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 16:12:12.661804 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3093bceb-0766-4615-83d9-45c2fa7c2745 req-96f75d30-2c84-4ed5-9cac-3f1869e4dfd7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.055567 Aug 29 16:12:12.662682 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2928/6019] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 16:12:12.669840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1323253878", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "818eecbc-62bf-4f97-ad8c-407723877932", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-449373120", "security_groups": [{"name": "tempest-secgroup-smoke-99711326"}], "networks": [{"uuid": "fddaed15-7284-4876-b960-034bd0b71ac5"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:12.755425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:12.853639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] validate_networks() for [('fddaed15-7284-4876-b960-034bd0b71ac5', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:12:12.939714 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e56a7dc9-37be-418d-9f44-0d7955b11782 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "DELETE /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 204 len: 0 microversion: 2.1 time: 3.451072 Aug 29 16:12:12.944206 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3092/6020] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:09 2022] DELETE /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 0 bytes in 3453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:12.951260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:12.952142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 11ed993c-1565-425a-9dcd-5fb3635543b9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:12.959211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:12.960185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:12.960885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:12.961856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:12.963178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:12.963839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:12.984362 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] HTTP exception thrown: Instance 11ed993c-1565-425a-9dcd-5fb3635543b9 could not be found. Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Request method failure captured: Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 HTTP/1.1 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDONHKzAWTDNEQQXuETEK6x53NyUExCw9qInVFT-7DfuM7QA5vlZzdEN0fMVvcm599ByeouR2fPnwP-v1_H6kCJbFUFIS-kArPtacSK6nEXdffPWWQwnncmf--iFR9nN9XyybYZcHW9TcVCTYBHU3JcxJOnJji4eYc2M2rONylYJY2hQ Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8cf22730fb014345a7ed2aeb866bbe61", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8cf22730fb014345a7ed2aeb866bbe61"}]}] Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f075974a803f46eda667db6d754453ba Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 11ed993c-1565-425a-9dcd-5fb3635543b9 could not be found. Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '11ed993c-1565-425a-9dcd-5fb3635543b9'} Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ed993c-1565-425a-9dcd-5fb3635543b9 could not be found. Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ed993c-1565-425a-9dcd-5fb3635543b9 could not be found. Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:12.990115 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:12.997674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:12.997674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:12.997674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:12.997674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:12.997674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:12.997674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ed993c-1565-425a-9dcd-5fb3635543b9 could not be found. Aug 29 16:12:12.997674 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:13.000570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Returning 404 to user: Instance 11ed993c-1565-425a-9dcd-5fb3635543b9 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:13.004197 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c690c3fe-8fe3-4773-add8-acf52aa326ca tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9" status: 404 len: 111 microversion: 2.1 time: 0.058270 Aug 29 16:12:13.005198 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3093/6021] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:12 2022] GET /compute/v2.1/servers/11ed993c-1565-425a-9dcd-5fb3635543b9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:13.019514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:13.020990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:13.043292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.047685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.051036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:13.054906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.057097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.057803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:13.097865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:13.313323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52995fe6-bf3a-483c-9c13-429fa62d66ea tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "DELETE /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 204 len: 0 microversion: 2.1 time: 0.300670 Aug 29 16:12:13.318436 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3094/6022] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:13 2022] DELETE /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:13.340321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:13.345428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:13.364219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.367962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.369408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:13.371889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.373571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.374030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:13.592450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:13.614144 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a2ec168-5e3a-4a54-a035-ac551b2f134b tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1466 microversion: 2.1 time: 0.292638 Aug 29 16:12:13.622522 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3095/6023] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:13 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1466 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:13.638460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:13.642209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:13.659707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.660240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.660690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:13.668556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:13.668556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:13.668876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:14.229237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:14.241145 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30c1561d-f21a-43f6-bb2b-4cd2c7475756 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.617014 Aug 29 16:12:14.242913 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3096/6024] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:13 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:14.642652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:14.643310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:14.657535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:12:14.658095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:12:14.658846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:12:14.659281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:14.659690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:12:14.659919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:14.660499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:14.661083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:12:14.663538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:14.665299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:14.666744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:14.682172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:14.684868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:14.687547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:14.688389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:14.688929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:14.689571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:14.745344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Getting quotas for project 7b07be353bbc481cbd35a4304501c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:12:14.754908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Getting quotas for user 35cca2c3486c4389a04f6a20b8d567e9 and project 7b07be353bbc481cbd35a4304501c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:12:14.879509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:14.890493 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4e4d5e0-e41e-497d-afcf-dc76c2200f98 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1466 microversion: 2.1 time: 0.252068 Aug 29 16:12:14.906520 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3097/6025] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:14 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1466 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:14.966714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:12:14.968817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='818eecbc-62bf-4f97-ad8c-407723877932',volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:12:15.282009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:15.291004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:15.302711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fcc0908-9121-4cf7-acbe-15b886bbb252 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.636442 Aug 29 16:12:15.303701 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2929/6026] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:12:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:12:15.324389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c88ac28-a627-41ff-b438-8fb9dafae345 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:15.324575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:15.324938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:15.325387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:15.326258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:15.326759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:15.327261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:15.327848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2c88ac28-a627-41ff-b438-8fb9dafae345 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:15.544787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2c88ac28-a627-41ff-b438-8fb9dafae345 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:15.560183 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2c88ac28-a627-41ff-b438-8fb9dafae345 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1098 microversion: 2.1 time: 0.245840 Aug 29 16:12:15.565113 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2930/6027] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:15 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1098 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:15.912407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:15.913701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:15.938986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:15.954768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:15.958255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:15.960767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:15.965373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:15.967132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:16.074212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:16.094516 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7628c257-04b9-4c68-947b-eb017dc43cd2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.832325 Aug 29 16:12:16.097740 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3098/6028] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:15 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:16.284881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:16.296023 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d62aed8b-878f-4bbb-95d1-5279c3063138 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1466 microversion: 2.1 time: 0.388138 Aug 29 16:12:16.296625 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2931/6029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:15 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1466 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:16.444166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-50003171-1a0c-4714-a2aa-e2332c47aec6 req-93cb8d88-dfc4-495a-b273-589189c3e533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6aa8-2787-4074-971f-70af786527ee", "name": "network-vif-deleted", "tag": "8f0c6bf6-1f2e-4915-b8cd-2922dde562d1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:16.464176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-50003171-1a0c-4714-a2aa-e2332c47aec6 req-93cb8d88-dfc4-495a-b273-589189c3e533 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:16.464664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-50003171-1a0c-4714-a2aa-e2332c47aec6 req-93cb8d88-dfc4-495a-b273-589189c3e533 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:16.467167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-50003171-1a0c-4714-a2aa-e2332c47aec6 req-93cb8d88-dfc4-495a-b273-589189c3e533 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:16.492586 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-50003171-1a0c-4714-a2aa-e2332c47aec6 req-93cb8d88-dfc4-495a-b273-589189c3e533 service nova] Creating event network-vif-deleted:8f0c6bf6-1f2e-4915-b8cd-2922dde562d1 for instance 37ee6aa8-2787-4074-971f-70af786527ee on n-h1-836830-13 Aug 29 16:12:16.512459 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-50003171-1a0c-4714-a2aa-e2332c47aec6 req-93cb8d88-dfc4-495a-b273-589189c3e533 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070813 Aug 29 16:12:16.535980 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3099/6030] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:16.593902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:16.595135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:16.624139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:16.624597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:16.625045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:16.625765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:16.626218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:16.630685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:16.847877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:16.858753 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-20016636-28c1-437a-b854-55a3c7902e1b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1148 microversion: 2.1 time: 0.276336 Aug 29 16:12:16.863345 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2932/6031] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:16 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1148 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:17.120629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:17.121328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:17.148545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.151503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.159658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:17.160847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.163326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.163964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:17.318236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:17.318870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:17.335554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.336056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.336502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:17.337306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.337763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.338187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:17.460165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.460661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.461234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:17.461699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lazy-loading 'fault' on Instance uuid 37ee6aa8-2787-4074-971f-70af786527ee {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:12:17.559063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:17.577093 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb21b25b-b6c3-49ca-bd8d-c9d735a7a926 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 200 len: 1305 microversion: 2.1 time: 0.263047 Aug 29 16:12:17.583149 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2933/6032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:17 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:17.888829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:17.889945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:17.904612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.906300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.910358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:17.911688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:17.912332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:17.913236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.065299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:18.102339 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-33eaf6c2-2930-4328-8357-c8740d58a416 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.987108 Aug 29 16:12:18.103616 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3100/6033] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:17 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:18.266906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:18.272953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:18.283694 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11e144a1-f607-4d14-b7c9-a419674d007b tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1196 microversion: 2.1 time: 0.399661 Aug 29 16:12:18.289365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2934/6034] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:17 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1196 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:18.605126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:18.605453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 37ee6aa8-2787-4074-971f-70af786527ee] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:18.633566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.634593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.654681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.655686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.656177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.656619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.726869 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] HTTP exception thrown: Instance 37ee6aa8-2787-4074-971f-70af786527ee could not be found. Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Request method failure captured: Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee HTTP/1.1 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDONHKzAWTDNEQQXuETEK6x53NyUExCw9qInVFT-7DfuM7QA5vlZzdEN0fMVvcm599ByeouR2fPnwP-v1_H6kCJbFUFIS-kArPtacSK6nEXdffPWWQwnncmf--iFR9nN9XyybYZcHW9TcVCTYBHU3JcxJOnJji4eYc2M2rONylYJY2hQ Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8cf22730fb014345a7ed2aeb866bbe61", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8cf22730fb014345a7ed2aeb866bbe61"}]}] Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f075974a803f46eda667db6d754453ba Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 37ee6aa8-2787-4074-971f-70af786527ee could not be found. Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '37ee6aa8-2787-4074-971f-70af786527ee'} Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ee6aa8-2787-4074-971f-70af786527ee could not be found. Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ee6aa8-2787-4074-971f-70af786527ee could not be found. Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:18.741518 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:18.747613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:18.747613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:18.747613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:18.747613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:18.747613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:18.747613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ee6aa8-2787-4074-971f-70af786527ee could not be found. Aug 29 16:12:18.747613 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:18.764218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Returning 404 to user: Instance 37ee6aa8-2787-4074-971f-70af786527ee could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:18.765475 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-914bd541-a824-48ff-aca5-8d0109e8e72d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee" status: 404 len: 111 microversion: 2.1 time: 0.164655 Aug 29 16:12:18.772941 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3101/6035] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:18 2022] GET /compute/v2.1/servers/37ee6aa8-2787-4074-971f-70af786527ee => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:18.782744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:18.783919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:18.803731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.804192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.804650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.805333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:18.805793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:18.806267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:18.929468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:19.126807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:19.127806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:19.157093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:19.157607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:19.158048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:19.158762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:19.159245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:19.177169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:19.440631 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11485fe8-bb3c-42fe-9e0b-c685815326f9 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "DELETE /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 204 len: 0 microversion: 2.1 time: 0.659026 Aug 29 16:12:19.450601 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2935/6036] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:18 2022] DELETE /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:19.464903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:19.465665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:19.518400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:19.529198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:19.529715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:19.530542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:19.530952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:19.531435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:19.909573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:19.930671 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c60bb34e-d9ca-4231-8cd2-f29eb61a5674 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1214 microversion: 2.1 time: 0.472994 Aug 29 16:12:19.943427 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2936/6037] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:19 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1214 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:19.961146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:19.966335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:19.994271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:19.999606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:20.000456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:20.001706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:20.004228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:20.015778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:21.238141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:21.252644 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-80713c3a-0dae-4235-8a89-d8da731a679f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 2.130420 Aug 29 16:12:21.260885 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3102/6038] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:19 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:21.268633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:21.270746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:21.284314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:21.292026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:21.292780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:21.293710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:21.294588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:21.297347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:21.346922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:21.367815 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-928b52d2-4a56-499e-80bb-66258361396d tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1508 microversion: 2.1 time: 1.423046 Aug 29 16:12:21.376204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:21.377154 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2937/6039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:19 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1508 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:21.532020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:21.543667 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52780692-0b4c-4cd1-8d3a-7e5f2d198494 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1214 microversion: 2.1 time: 0.281451 Aug 29 16:12:21.550992 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3103/6040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:21 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:22.230362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-dc051b83-64bf-401b-ad01-a445c1761e58 req-f1448634-08cc-40d7-8092-0e0f1796c8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8e79c5-da97-4231-989f-22816d6612cd", "name": "network-vif-plugged", "status": "completed", "tag": "98c2fb7e-c6fa-42db-b01d-706843714612"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:22.258225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dc051b83-64bf-401b-ad01-a445c1761e58 req-f1448634-08cc-40d7-8092-0e0f1796c8c8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:22.258846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dc051b83-64bf-401b-ad01-a445c1761e58 req-f1448634-08cc-40d7-8092-0e0f1796c8c8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:22.260284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-dc051b83-64bf-401b-ad01-a445c1761e58 req-f1448634-08cc-40d7-8092-0e0f1796c8c8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:22.278954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:22.279604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:22.286510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:22.295822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:22.296581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:22.297852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:22.298748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:22.299385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:22.304738 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-dc051b83-64bf-401b-ad01-a445c1761e58 req-f1448634-08cc-40d7-8092-0e0f1796c8c8 service nova] Creating event network-vif-plugged:98c2fb7e-c6fa-42db-b01d-706843714612 for instance bc8e79c5-da97-4231-989f-22816d6612cd on n-h2-836830-13 Aug 29 16:12:22.327915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-dc051b83-64bf-401b-ad01-a445c1761e58 req-f1448634-08cc-40d7-8092-0e0f1796c8c8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101623 Aug 29 16:12:22.328998 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2938/6041] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:22.404818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:22.406338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:22.430283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:22.431682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:22.434698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:22.441436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:22.442528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:22.448125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:23.077510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:23.095986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-63caf39a-e597-4f8e-95e9-2fcb48e1bf1f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.820999 Aug 29 16:12:23.100082 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3104/6042] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:22 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:23.120682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:23.121500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:23.136285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:23.136950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:23.140320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:23.142406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:23.154581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:23.161776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:23.329735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:23.342000 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a566754a-8715-4551-8644-51c4aa4367f3 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1508 microversion: 2.1 time: 0.942532 Aug 29 16:12:23.345389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2939/6043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:22 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1508 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:23.730984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-56b8e299-41fd-4ad5-8fdd-7d6eb2971190 req-b40f510e-c175-4712-971d-fee081a568eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020570a0-16f4-400a-9565-2ceb2aa4da3d", "name": "network-vif-deleted", "tag": "15d77e41-cd4e-466a-bfbc-894ff1a555c6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:23.766464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-56b8e299-41fd-4ad5-8fdd-7d6eb2971190 req-b40f510e-c175-4712-971d-fee081a568eb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:23.777382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:23.790758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-56b8e299-41fd-4ad5-8fdd-7d6eb2971190 req-b40f510e-c175-4712-971d-fee081a568eb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:23.802864 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea23a368-76b9-40e3-a735-ba349cbbfe28 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1280 microversion: 2.1 time: 0.701441 Aug 29 16:12:23.803810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-56b8e299-41fd-4ad5-8fdd-7d6eb2971190 req-b40f510e-c175-4712-971d-fee081a568eb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:23.823574 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3105/6044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:23 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1280 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:23.859701 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-56b8e299-41fd-4ad5-8fdd-7d6eb2971190 req-b40f510e-c175-4712-971d-fee081a568eb service nova] Creating event network-vif-deleted:15d77e41-cd4e-466a-bfbc-894ff1a555c6 for instance 020570a0-16f4-400a-9565-2ceb2aa4da3d on n-h1-836830-13 Aug 29 16:12:23.892266 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-56b8e299-41fd-4ad5-8fdd-7d6eb2971190 req-b40f510e-c175-4712-971d-fee081a568eb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165952 Aug 29 16:12:23.896517 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2940/6045] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:24.125581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:24.126760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:24.142774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.143760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.144469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:24.146643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.150914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.155491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:24.368598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:24.369916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:24.372506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:24.400165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.409314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.409891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:24.411380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.418057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.418714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:24.554701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.555244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.555692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:24.556218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lazy-loading 'fault' on Instance uuid 020570a0-16f4-400a-9565-2ceb2aa4da3d {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:12:24.720389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:24.763487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:24.778785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b945b1aa-cd22-442f-999c-61e4cf8acf87 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 200 len: 1304 microversion: 2.1 time: 0.416502 Aug 29 16:12:24.785252 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2941/6046] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:24 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 1304 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:24.822826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:24.831071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb3d2318-4b79-4390-9ec9-a7085f52c929 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1390 microversion: 2.1 time: 0.710016 Aug 29 16:12:24.834197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:24.834861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:24.839958 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3106/6047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:24 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1390 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:24.852320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.857962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.861547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:24.863613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:24.867831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:24.875742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.229689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:25.248375 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32a55676-a52c-4af4-a164-315cc345a601 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1280 microversion: 2.1 time: 0.418971 Aug 29 16:12:25.259631 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2942/6048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:24 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1280 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:25.476825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-918d784b-8535-4315-a0d1-9eec0a907e8f req-3252b1c6-481f-4a62-9958-6ad0e9966354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24e2965-1e4e-487a-94ee-fcc5f60caef4", "tag": "3dd4d296-411f-4624-b4df-9c83aaf449cc"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:25.510291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-918d784b-8535-4315-a0d1-9eec0a907e8f req-3252b1c6-481f-4a62-9958-6ad0e9966354 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:25.511850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-918d784b-8535-4315-a0d1-9eec0a907e8f req-3252b1c6-481f-4a62-9958-6ad0e9966354 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:25.516534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-918d784b-8535-4315-a0d1-9eec0a907e8f req-3252b1c6-481f-4a62-9958-6ad0e9966354 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.558362 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-918d784b-8535-4315-a0d1-9eec0a907e8f req-3252b1c6-481f-4a62-9958-6ad0e9966354 service nova] Creating event network-changed:3dd4d296-411f-4624-b4df-9c83aaf449cc for instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 on n-h1-836830-13 Aug 29 16:12:25.573288 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-918d784b-8535-4315-a0d1-9eec0a907e8f req-3252b1c6-481f-4a62-9958-6ad0e9966354 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100938 Aug 29 16:12:25.574377 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3107/6049] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:25.806743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:25.808074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: 020570a0-16f4-400a-9565-2ceb2aa4da3d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:25.810738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=18 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:25.838532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:25.839440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:25.840171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.844048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:25.844902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:25.845594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.852848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:25.854763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:25.868457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:25.870698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:25.871447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.876034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:25.876918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:25.877617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.900388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] HTTP exception thrown: Instance 020570a0-16f4-400a-9565-2ceb2aa4da3d could not be found. Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Request method failure captured: Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d HTTP/1.1 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDONHKzAWTDNEQQXuETEK6x53NyUExCw9qInVFT-7DfuM7QA5vlZzdEN0fMVvcm599ByeouR2fPnwP-v1_H6kCJbFUFIS-kArPtacSK6nEXdffPWWQwnncmf--iFR9nN9XyybYZcHW9TcVCTYBHU3JcxJOnJji4eYc2M2rONylYJY2hQ Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8cf22730fb014345a7ed2aeb866bbe61", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8cf22730fb014345a7ed2aeb866bbe61"}]}] Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f075974a803f46eda667db6d754453ba Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 020570a0-16f4-400a-9565-2ceb2aa4da3d could not be found. Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '020570a0-16f4-400a-9565-2ceb2aa4da3d'} Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020570a0-16f4-400a-9565-2ceb2aa4da3d could not be found. Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020570a0-16f4-400a-9565-2ceb2aa4da3d could not be found. Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:25.903013 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020570a0-16f4-400a-9565-2ceb2aa4da3d could not be found. Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Returning 404 to user: Instance 020570a0-16f4-400a-9565-2ceb2aa4da3d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:25.909654 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5e97d19-7a7c-4cf5-9d88-3d847acd6703 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d" status: 404 len: 111 microversion: 2.1 time: 0.102640 Aug 29 16:12:25.924008 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2943/6050] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:25 2022] GET /compute/v2.1/servers/020570a0-16f4-400a-9565-2ceb2aa4da3d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:12:25.946802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:25.947558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:25.960565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:25.961497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:25.962756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:25.963760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:25.964464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:25.965132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.000765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:26.162664 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2a770bf-0d79-487f-9acb-72289d09f4b2 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "DELETE /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 204 len: 0 microversion: 2.1 time: 0.234101 Aug 29 16:12:26.166550 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2944/6051] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:25 2022] DELETE /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:26.173826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:26.174796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:26.183425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.184291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.184912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.186047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.186687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.187461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.388240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:26.403118 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c84c0f73-2ef4-498a-b2a0-b13c1ceea566 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1562 microversion: 2.1 time: 0.554565 Aug 29 16:12:26.407428 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3108/6052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:25 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1562 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:26.416726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:26.417687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:26.442252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.442771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.443373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.444230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.444819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.447200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.641936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:26.656280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b475b410-342c-43ed-94e4-71c1e52f7458 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1495 microversion: 2.1 time: 0.487854 Aug 29 16:12:26.668177 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2945/6053] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:26 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1495 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:26.685993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:26.686218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:26.710299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.710814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.711293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.712088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:26.712591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:26.712976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:26.810659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:26.819395 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e827cc8b-104b-4a8f-b649-887c251659ca tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1280 microversion: 2.1 time: 0.409855 Aug 29 16:12:26.819992 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3109/6054] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:26 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1280 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:27.076875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ebbb0046-b655-4016-9801-d566fbce49c6 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-160077013", "availability_zone": "foo_zone"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:27.081040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.aggregate [None req-ebbb0046-b655-4016-9801-d566fbce49c6 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Generated uuid 2b4be71d-e446-48ed-b27c-7641dea5cd03 for aggregate {{(pid=129133) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 29 16:12:27.144942 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ebbb0046-b655-4016-9801-d566fbce49c6 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.319602 Aug 29 16:12:27.145744 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3110/6055] 10.222.0.83 () {60 vars in 1164 bytes} [Mon Aug 29 16:12:26 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:27.158006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-caef9b9c-c473-483f-830d-3de9b25fb3ca tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:27.214674 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-caef9b9c-c473-483f-830d-3de9b25fb3ca tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.060821 Aug 29 16:12:27.215957 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3111/6056] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 16:12:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:27.235155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:27.252389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:27.253072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:27.253635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:27.254539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:27.255259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:27.255856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:27.297014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:27.311594 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-59064175-493f-4904-bb19-998f5ec3b783 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1562 microversion: 2.1 time: 0.640828 Aug 29 16:12:27.315935 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2946/6057] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:26 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1562 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:27.327817 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7a28dd5-e082-4164-810d-6e7a94f5c459 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.095274 Aug 29 16:12:27.327817 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3112/6058] 10.222.0.83 () {58 vars in 1176 bytes} [Mon Aug 29 16:12:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:27.346343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-63991a59-a527-4ba3-95a6-34009a6c8791 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:27.377548 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-63991a59-a527-4ba3-95a6-34009a6c8791 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.034859 Aug 29 16:12:27.380527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3113/6059] 10.222.0.83 () {58 vars in 1143 bytes} [Mon Aug 29 16:12:27 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:27.392655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1bc29d8c-cea9-4bf4-b4e5-82aaa662c73e tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-836830-13"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:27.407651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bc29d8c-cea9-4bf4-b4e5-82aaa662c73e tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:27.409697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bc29d8c-cea9-4bf4-b4e5-82aaa662c73e tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:27.410369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bc29d8c-cea9-4bf4-b4e5-82aaa662c73e tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:27.691850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:27.693027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:27.704472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:27.707362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:27.708495 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1bc29d8c-cea9-4bf4-b4e5-82aaa662c73e tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.317637 Aug 29 16:12:27.709154 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2947/6060] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 16:12:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:27.710122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:27.714298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:27.715072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:27.715760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:27.728631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f4ca62a-e3df-4219-96f6-883d914955d2 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:27.750966 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f4ca62a-e3df-4219-96f6-883d914955d2 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.026066 Aug 29 16:12:27.755074 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2948/6061] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 16:12:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:27.763444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c70852da-6c09-49b9-ba2b-e0f164594546 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1947222892", "availability_zone": "foo_zone"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:28.086497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:28.109899 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f29ae604-fb3b-4496-aa66-564988ad1f16 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1495 microversion: 2.1 time: 0.421038 Aug 29 16:12:28.114997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3114/6062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:27 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1495 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:28.129356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:28.132237 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c70852da-6c09-49b9-ba2b-e0f164594546 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.373081 Aug 29 16:12:28.139424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:28.140594 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2949/6063] 10.222.0.83 () {60 vars in 1173 bytes} [Mon Aug 29 16:12:27 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:28.155503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fd9a11b8-4766-4d27-9f4a-cc019555e728 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:28.162744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.163718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.164460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.166165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.166904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.167594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.220603 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fd9a11b8-4766-4d27-9f4a-cc019555e728 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.069127 Aug 29 16:12:28.221625 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2950/6064] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 16:12:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:28.238561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-87f0fd57-62e9-45ff-ae4d-dbeef1a7afa6 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:28.265654 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-87f0fd57-62e9-45ff-ae4d-dbeef1a7afa6 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.037137 Aug 29 16:12:28.272650 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2951/6065] 10.222.0.83 () {58 vars in 1152 bytes} [Mon Aug 29 16:12:28 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:28.288903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7f196bf-911d-4b64-8658-4bb7b9a2fd49 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-836830-13"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:28.315847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f196bf-911d-4b64-8658-4bb7b9a2fd49 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.318348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f196bf-911d-4b64-8658-4bb7b9a2fd49 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.319581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7f196bf-911d-4b64-8658-4bb7b9a2fd49 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.602557 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7f196bf-911d-4b64-8658-4bb7b9a2fd49 tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.319702 Aug 29 16:12:28.604812 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2952/6066] 10.222.0.83 () {60 vars in 1194 bytes} [Mon Aug 29 16:12:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:28.628035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd787526-770f-4f5f-80c1-770cdcc2e3ff tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:28.671803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:28.683604 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1cec7b80-c5ae-4c8a-8668-8575cab76fa5 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1284 microversion: 2.1 time: 0.566588 Aug 29 16:12:28.684866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3115/6067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:28 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1284 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:28.699421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-addc1e4b-31a7-4ca3-8dcc-4322b7e98d5d req-0e3bb2e9-1c34-4b75-b747-faf7be75c178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afca80aa-1bdf-4d3e-aac4-c088da983f70", "name": "network-vif-deleted", "tag": "7d51e30e-7af8-4689-bd97-d2a5113fc11d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:28.703371 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd787526-770f-4f5f-80c1-770cdcc2e3ff tempest-TestAggregatesBasicOps-1884571501 tempest-TestAggregatesBasicOps-1884571501-project-admin] 10.222.0.83 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.078931 Aug 29 16:12:28.704229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2953/6068] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 16:12:28 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 29 16:12:28.736677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-addc1e4b-31a7-4ca3-8dcc-4322b7e98d5d req-0e3bb2e9-1c34-4b75-b747-faf7be75c178 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:28.737207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-addc1e4b-31a7-4ca3-8dcc-4322b7e98d5d req-0e3bb2e9-1c34-4b75-b747-faf7be75c178 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:28.737641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-addc1e4b-31a7-4ca3-8dcc-4322b7e98d5d req-0e3bb2e9-1c34-4b75-b747-faf7be75c178 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:28.753004 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-addc1e4b-31a7-4ca3-8dcc-4322b7e98d5d req-0e3bb2e9-1c34-4b75-b747-faf7be75c178 service nova] Creating event network-vif-deleted:7d51e30e-7af8-4689-bd97-d2a5113fc11d for instance afca80aa-1bdf-4d3e-aac4-c088da983f70 on n-h2-836830-13 Aug 29 16:12:28.760590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-addc1e4b-31a7-4ca3-8dcc-4322b7e98d5d req-0e3bb2e9-1c34-4b75-b747-faf7be75c178 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072469 Aug 29 16:12:28.761848 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3116/6069] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:29.133050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:29.133608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:29.148317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:29.150433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:29.153089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:29.154117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:29.155891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:29.158047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:29.232035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:29.236879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:29.237995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:29.239592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lazy-loading 'fault' on Instance uuid afca80aa-1bdf-4d3e-aac4-c088da983f70 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:12:29.706071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:29.707588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:29.724871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:29.728813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:29.732592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:29.734281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:29.737836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:29.738549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:29.936236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:29.954127 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6c1a873-6ef4-4e83-9f6f-c47fae39b9bf tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 200 len: 1304 microversion: 2.1 time: 0.825218 Aug 29 16:12:29.954987 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2954/6070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:29 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 1304 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:30.976282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:30.976994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: afca80aa-1bdf-4d3e-aac4-c088da983f70] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:30.987197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:30.987699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:30.988145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:30.988859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:30.989313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:30.992664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:30.998780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:31.059592 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] HTTP exception thrown: Instance afca80aa-1bdf-4d3e-aac4-c088da983f70 could not be found. Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Request method failure captured: Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 HTTP/1.1 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDONHKzAWTDNEQQXuETEK6x53NyUExCw9qInVFT-7DfuM7QA5vlZzdEN0fMVvcm599ByeouR2fPnwP-v1_H6kCJbFUFIS-kArPtacSK6nEXdffPWWQwnncmf--iFR9nN9XyybYZcHW9TcVCTYBHU3JcxJOnJji4eYc2M2rONylYJY2hQ Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8cf22730fb014345a7ed2aeb866bbe61", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8cf22730fb014345a7ed2aeb866bbe61"}]}] Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f075974a803f46eda667db6d754453ba Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance afca80aa-1bdf-4d3e-aac4-c088da983f70 could not be found. Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'afca80aa-1bdf-4d3e-aac4-c088da983f70'} Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afca80aa-1bdf-4d3e-aac4-c088da983f70 could not be found. Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afca80aa-1bdf-4d3e-aac4-c088da983f70 could not be found. Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:31.061601 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afca80aa-1bdf-4d3e-aac4-c088da983f70 could not be found. Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Returning 404 to user: Instance afca80aa-1bdf-4d3e-aac4-c088da983f70 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb7dd87a-6d69-4e9e-a629-d28b74784956 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70" status: 404 len: 111 microversion: 2.1 time: 0.091194 Aug 29 16:12:31.071916 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2955/6071] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:30 2022] GET /compute/v2.1/servers/afca80aa-1bdf-4d3e-aac4-c088da983f70 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:12:31.083003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:31.083549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:31.106410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:31.106937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:31.107422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:31.108154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:31.108615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:31.109048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:31.176934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:12:31.191585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:31.202718 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-640f2642-3092-41bd-b80a-7d8d9acc60c1 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1280 microversion: 2.1 time: 1.500791 Aug 29 16:12:31.220287 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3117/6072] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:29 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1280 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:31.363051 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-915febe7-c913-4216-872e-cf07b0d6b12e tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 204 len: 0 microversion: 2.1 time: 0.293241 Aug 29 16:12:31.364288 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2956/6073] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:12:31 2022] DELETE /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:12:31.374988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:31.375927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:31.385510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:31.390157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:31.390877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:31.391839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:31.393783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:31.394401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:31.788214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:31.824205 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cc363fa4-226b-4f08-8ed8-63097849ba44 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1677 microversion: 2.1 time: 0.453129 Aug 29 16:12:31.825713 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3118/6074] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:31 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1677 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:32.229122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:32.230431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:32.243233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.244675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.249455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.250473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.251146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.251742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.848270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:32.849062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:32.864650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.868157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.869880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.873567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:32.874303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:32.875348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:32.940570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:32.952946 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-766d1235-99cb-467b-90d3-e5cf68e87758 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1280 microversion: 2.1 time: 0.728956 Aug 29 16:12:32.955901 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2957/6075] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:32 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1280 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:33.375450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:33.376144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:33.402353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:33.404898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:33.406260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:33.407961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:33.409530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:33.411462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:33.517674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:33.537692 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-971a82db-3a0f-4ef2-96e9-f9ddb71ebbbe tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1677 microversion: 2.1 time: 0.693567 Aug 29 16:12:33.538997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3119/6076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:32 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1677 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:33.547856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-77c022c6-353f-4b4c-badf-a3130b1af796 req-07d8ede9-2284-4914-8bf9-532e4a360ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8e79c5-da97-4231-989f-22816d6612cd", "tag": "98c2fb7e-c6fa-42db-b01d-706843714612"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:33.559922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-77c022c6-353f-4b4c-badf-a3130b1af796 req-07d8ede9-2284-4914-8bf9-532e4a360ce7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:33.560836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-77c022c6-353f-4b4c-badf-a3130b1af796 req-07d8ede9-2284-4914-8bf9-532e4a360ce7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:33.561441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-77c022c6-353f-4b4c-badf-a3130b1af796 req-07d8ede9-2284-4914-8bf9-532e4a360ce7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:33.579345 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-77c022c6-353f-4b4c-badf-a3130b1af796 req-07d8ede9-2284-4914-8bf9-532e4a360ce7 service nova] Creating event network-changed:98c2fb7e-c6fa-42db-b01d-706843714612 for instance bc8e79c5-da97-4231-989f-22816d6612cd on n-h2-836830-13 Aug 29 16:12:33.587860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-77c022c6-353f-4b4c-badf-a3130b1af796 req-07d8ede9-2284-4914-8bf9-532e4a360ce7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047032 Aug 29 16:12:33.588914 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3120/6077] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:33.914512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:33.928651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-803127dc-6017-4afc-b4f6-bdd1efef706d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1562 microversion: 2.1 time: 0.557205 Aug 29 16:12:33.930725 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2958/6078] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:33 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1562 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:33.981746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:33.984205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:34.020169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:34.020753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:34.021266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:34.022057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:34.022591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:34.023139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:34.311275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:34.346218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e591a903-e432-4550-b997-6a7154212791 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.371584 Aug 29 16:12:34.347561 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3121/6079] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:33 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:34.564231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:34.566050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:34.604986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:34.605860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:34.606515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:34.607722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:34.611988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:34.613454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:34.982534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:35.006133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2d59aa4b-d41f-4e16-a560-82a248fdbeef tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1609 microversion: 2.1 time: 0.444687 Aug 29 16:12:35.007091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2959/6080] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:34 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1609 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:35.382834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:35.383571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:35.404688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:35.405617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:35.406088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:35.413340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:35.413840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:35.414530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:35.777185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:35.787748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9b1c4e6-b1ee-49d0-bf61-bcba20fde216 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.415932 Aug 29 16:12:35.794071 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3122/6081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:35 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:35.956319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-cedded0f-c193-4995-99fa-3e3dba41d876 req-2ef8a5d4-a68a-4d60-89d9-f445c7282de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f160ac-9dfa-479c-9cd7-d183bddfb6a5", "name": "network-vif-deleted", "tag": "4b8f1619-bc55-4767-99d3-83da4cf7b739"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:35.974044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cedded0f-c193-4995-99fa-3e3dba41d876 req-2ef8a5d4-a68a-4d60-89d9-f445c7282de8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:35.974549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cedded0f-c193-4995-99fa-3e3dba41d876 req-2ef8a5d4-a68a-4d60-89d9-f445c7282de8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:35.974986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-cedded0f-c193-4995-99fa-3e3dba41d876 req-2ef8a5d4-a68a-4d60-89d9-f445c7282de8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:36.005033 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-cedded0f-c193-4995-99fa-3e3dba41d876 req-2ef8a5d4-a68a-4d60-89d9-f445c7282de8 service nova] Creating event network-vif-deleted:4b8f1619-bc55-4767-99d3-83da4cf7b739 for instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 on n-h1-836830-13 Aug 29 16:12:36.020915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-cedded0f-c193-4995-99fa-3e3dba41d876 req-2ef8a5d4-a68a-4d60-89d9-f445c7282de8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065451 Aug 29 16:12:36.022173 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2960/6082] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:36.032736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:36.033731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:36.044647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:36.045516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:36.046716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:36.048039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:36.049098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:36.050020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:36.104635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:36.105319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:36.107120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:36.107756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lazy-loading 'fault' on Instance uuid b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:12:36.324477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f075974a803f46eda667db6d754453ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf22730fb014345a7ed2aeb866bbe61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:36.334571 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-de9f808d-1c2f-4384-ac46-edcd8ff18ecc tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 200 len: 1328 microversion: 2.1 time: 0.306028 Aug 29 16:12:36.339082 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3123/6083] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:36 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 1328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:36.824798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:36.824798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:36.832207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:36.833597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:36.834610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:36.835707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:36.836946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:36.837881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:37.138663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:37.150724 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47578a79-5455-4d5a-b5bd-fabee6999283 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.337205 Aug 29 16:12:37.154133 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2961/6084] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:36 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:37.359975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:37.360511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] [instance: b3f160ac-9dfa-479c-9cd7-d183bddfb6a5] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:37.374220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:37.379831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:37.381110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:37.381587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:37.384606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:37.386230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:37.387680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:37.416058 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] HTTP exception thrown: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 could not be found. Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Request method failure captured: Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 HTTP/1.1 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDONHKzAWTDNEQQXuETEK6x53NyUExCw9qInVFT-7DfuM7QA5vlZzdEN0fMVvcm599ByeouR2fPnwP-v1_H6kCJbFUFIS-kArPtacSK6nEXdffPWWQwnncmf--iFR9nN9XyybYZcHW9TcVCTYBHU3JcxJOnJji4eYc2M2rONylYJY2hQ Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8cf22730fb014345a7ed2aeb866bbe61", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8cf22730fb014345a7ed2aeb866bbe61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8cf22730fb014345a7ed2aeb866bbe61"}]}] Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8cf22730fb014345a7ed2aeb866bbe61 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-1820088116 Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f075974a803f46eda667db6d754453ba Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-1820088116-project Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 could not be found. Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b3f160ac-9dfa-479c-9cd7-d183bddfb6a5'} Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 could not be found. Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 could not be found. Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:12:37.418105 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 could not be found. Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:12:37.423847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Returning 404 to user: Instance b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:12:37.424854 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-306b7804-adda-47d4-89d3-8099b2af3a55 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5" status: 404 len: 111 microversion: 2.1 time: 0.069073 Aug 29 16:12:37.431727 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3124/6085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:37 2022] GET /compute/v2.1/servers/b3f160ac-9dfa-479c-9cd7-d183bddfb6a5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:12:37.437642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-179771e7-91f4-47ff-b0dd-06a997ba2a86 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] Calling method '.version_select at 0x7f32ee993c10>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:37.463733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-179771e7-91f4-47ff-b0dd-06a997ba2a86 tempest-ServerActionsTestJSON-1820088116 tempest-ServerActionsTestJSON-1820088116-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623115461" status: 202 len: 0 microversion: 2.1 time: 0.030456 Aug 29 16:12:37.465121 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2962/6086] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:12:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623115461 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:12:38.174942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:38.175976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:38.184806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:38.186239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:38.187104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:38.188125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:38.188791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:38.189381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:38.437181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:38.449279 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e0068e26-d052-44bd-9729-7cbb04662d40 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.279193 Aug 29 16:12:38.467533 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3125/6087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:38 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:39.473684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:39.474297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:39.491637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:39.492147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:39.494686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:39.500336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:39.500839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:39.501552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:39.757801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:39.771243 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-105234a2-8d7e-42f1-b131-74d493f9593e tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.300281 Aug 29 16:12:39.772655 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2963/6088] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:39 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:40.798068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:40.799195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:40.807321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:40.809460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:40.810372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:40.811033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:40.812429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:40.813050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:40.813634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:40.823061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:41.328957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:41.341751 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2b9f4fe-18e2-45f5-bf02-aa7e3d807427 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.547930 Aug 29 16:12:41.346113 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3126/6089] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:40 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:42.367002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:42.367651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:42.386151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:42.386655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:42.387127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:42.387857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:42.388321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:42.388752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:42.961399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:42.990549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-351fbb36-1d52-45e8-b4ee-5b8debc2b013 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.625165 Aug 29 16:12:42.991147 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2964/6090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:42 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:44.016817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:44.018576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:44.032273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:44.034410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:44.037812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:44.040524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:44.042645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:44.044454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:44.322324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:44.330883 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0eb76bc-d89d-49c2-8fe9-7a82782cd6af tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.318944 Aug 29 16:12:44.347141 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3127/6091] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:44 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:45.354874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:45.355520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:45.365302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:45.365799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:45.383390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:45.385023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:45.387050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:45.387669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:45.522876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ee90f69a-726c-4aab-a3ef-5e88baf146fc req-3f1a083d-651e-4c41-994c-15349259b979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24e2965-1e4e-487a-94ee-fcc5f60caef4", "name": "network-vif-plugged", "status": "completed", "tag": "3dd4d296-411f-4624-b4df-9c83aaf449cc"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:45.556922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ee90f69a-726c-4aab-a3ef-5e88baf146fc req-3f1a083d-651e-4c41-994c-15349259b979 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:45.558082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ee90f69a-726c-4aab-a3ef-5e88baf146fc req-3f1a083d-651e-4c41-994c-15349259b979 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:45.559806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ee90f69a-726c-4aab-a3ef-5e88baf146fc req-3f1a083d-651e-4c41-994c-15349259b979 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:45.594425 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ee90f69a-726c-4aab-a3ef-5e88baf146fc req-3f1a083d-651e-4c41-994c-15349259b979 service nova] Creating event network-vif-plugged:3dd4d296-411f-4624-b4df-9c83aaf449cc for instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 on n-h1-836830-13 Aug 29 16:12:45.604952 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ee90f69a-726c-4aab-a3ef-5e88baf146fc req-3f1a083d-651e-4c41-994c-15349259b979 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086861 Aug 29 16:12:45.606911 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3128/6092] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:45.628367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:45.641558 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eb89b6d8-e8e9-40ad-9452-c66ab4d26dd7 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.290977 Aug 29 16:12:45.642088 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2965/6093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:45 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:46.663542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:46.664909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:46.701299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:46.702074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:46.703384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:46.705184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:46.706382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:46.709748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:47.011729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:47.028592 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-047f80d3-8f9b-408f-8f1c-05975348bf0f tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1268 microversion: 2.1 time: 0.370380 Aug 29 16:12:47.029369 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3129/6094] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:46 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1268 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:48.053432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:48.054503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:48.076419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:48.076952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:48.077417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:48.084980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:48.085521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:48.091016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:48.321083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:48.348927 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e5a52b97-e0e3-4865-9456-28836430f668 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1456 microversion: 2.1 time: 0.302850 Aug 29 16:12:48.355785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2966/6095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:48 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1456 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:48.376247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:48.377077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:48.391613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:48.392369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:48.393045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:48.394084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:48.394885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:48.395838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:48.600434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:48.611525 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d0513c7-9fa4-47af-9ca4-9fb93d6ccd09 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1456 microversion: 2.1 time: 0.238969 Aug 29 16:12:48.612470 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3130/6096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:48 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1456 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:12:53.679890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a15d9a69-fd87-4361-8769-6e253780b02e req-0804ae17-a4f2-4e72-8c3d-08cff61029ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24e2965-1e4e-487a-94ee-fcc5f60caef4", "tag": "3dd4d296-411f-4624-b4df-9c83aaf449cc"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:53.706029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:12:53.715239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a15d9a69-fd87-4361-8769-6e253780b02e req-0804ae17-a4f2-4e72-8c3d-08cff61029ff service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:53.717330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a15d9a69-fd87-4361-8769-6e253780b02e req-0804ae17-a4f2-4e72-8c3d-08cff61029ff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:53.717991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a15d9a69-fd87-4361-8769-6e253780b02e req-0804ae17-a4f2-4e72-8c3d-08cff61029ff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:53.733651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a15d9a69-fd87-4361-8769-6e253780b02e req-0804ae17-a4f2-4e72-8c3d-08cff61029ff service nova] Creating event network-changed:3dd4d296-411f-4624-b4df-9c83aaf449cc for instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 on n-h1-836830-13 Aug 29 16:12:53.754019 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a15d9a69-fd87-4361-8769-6e253780b02e req-0804ae17-a4f2-4e72-8c3d-08cff61029ff service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077542 Aug 29 16:12:53.755282 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2967/6097] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:55.860985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1346118921", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "065bf6f7-88ad-4fb8-b01f-9e00cfbc3503"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:56.132796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] validate_networks() for [('065bf6f7-88ad-4fb8-b01f-9e00cfbc3503', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:12:56.139496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e929fd15-7f51-4988-9335-8c36f1ff9c2c req-a5671ff0-eb13-4b92-b164-a4feb835cabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24e2965-1e4e-487a-94ee-fcc5f60caef4", "tag": "3dd4d296-411f-4624-b4df-9c83aaf449cc"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:56.169706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e929fd15-7f51-4988-9335-8c36f1ff9c2c req-a5671ff0-eb13-4b92-b164-a4feb835cabe service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:56.179648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e929fd15-7f51-4988-9335-8c36f1ff9c2c req-a5671ff0-eb13-4b92-b164-a4feb835cabe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:56.181880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e929fd15-7f51-4988-9335-8c36f1ff9c2c req-a5671ff0-eb13-4b92-b164-a4feb835cabe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:56.222082 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e929fd15-7f51-4988-9335-8c36f1ff9c2c req-a5671ff0-eb13-4b92-b164-a4feb835cabe service nova] Creating event network-changed:3dd4d296-411f-4624-b4df-9c83aaf449cc for instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 on n-h1-836830-13 Aug 29 16:12:56.228058 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e929fd15-7f51-4988-9335-8c36f1ff9c2c req-a5671ff0-eb13-4b92-b164-a4feb835cabe service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092377 Aug 29 16:12:56.228940 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2968/6098] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:12:57.261733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:12:57.262897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:12:57.263860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:12:57.264571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:12:57.265356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:12:57.286551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:57.288323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:57.291228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:57.293674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:57.295588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:57.296037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:57.320504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Getting quotas for project ac255c28da36470cbc14243137e75fea. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:12:57.328282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Getting quotas for user 69af47f499d34232b8c857f5d2fdf91f and project ac255c28da36470cbc14243137e75fea. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:12:57.345538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:12:57.348237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:12:57.425866 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6f582954-7d1d-4ee5-9511-3c1306fc85f4 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820767 Aug 29 16:12:57.429032 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3131/6099] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:12:57.449935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b50c8702-d6d9-44a6-8c67-3c6f2ab4fe5c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:57.450773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b50c8702-d6d9-44a6-8c67-3c6f2ab4fe5c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:57.996102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b50c8702-d6d9-44a6-8c67-3c6f2ab4fe5c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:58.007533 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b50c8702-d6d9-44a6-8c67-3c6f2ab4fe5c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1225 microversion: 2.1 time: 0.564301 Aug 29 16:12:58.008738 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2969/6100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:57 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1225 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:12:58.281904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5ee93ef1-fa93-4995-8c07-850ad3e32162 req-94b07f44-80a3-4e67-99f3-e50f47af8415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24e2965-1e4e-487a-94ee-fcc5f60caef4", "tag": "3dd4d296-411f-4624-b4df-9c83aaf449cc"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:12:58.299449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5ee93ef1-fa93-4995-8c07-850ad3e32162 req-94b07f44-80a3-4e67-99f3-e50f47af8415 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:58.300034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5ee93ef1-fa93-4995-8c07-850ad3e32162 req-94b07f44-80a3-4e67-99f3-e50f47af8415 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:58.300474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5ee93ef1-fa93-4995-8c07-850ad3e32162 req-94b07f44-80a3-4e67-99f3-e50f47af8415 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:58.326354 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5ee93ef1-fa93-4995-8c07-850ad3e32162 req-94b07f44-80a3-4e67-99f3-e50f47af8415 service nova] Creating event network-changed:3dd4d296-411f-4624-b4df-9c83aaf449cc for instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 on n-h1-836830-13 Aug 29 16:12:58.351188 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5ee93ef1-fa93-4995-8c07-850ad3e32162 req-94b07f44-80a3-4e67-99f3-e50f47af8415 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073758 Aug 29 16:12:58.354148 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3132/6101] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:12:59.029830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:12:59.031081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:12:59.047686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:59.052086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:59.052804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:59.058795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:12:59.059611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:12:59.060240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:12:59.231120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:12:59.241525 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a54bb4a1-8908-47d3-8cbc-bc40f0b9b732 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1277 microversion: 2.1 time: 0.216350 Aug 29 16:12:59.245935 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2970/6102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:12:59 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:00.267687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:00.269162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:00.278120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:00.279013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:00.279731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:00.280692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:00.286484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:00.287301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:00.676616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:00.689019 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-627fbbe0-7ffb-4833-bf9a-d1628d46c666 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1325 microversion: 2.1 time: 0.426633 Aug 29 16:13:00.691170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3133/6103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:00 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:01.406894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bc8f934b-bbf4-485b-bfba-017772e42ba2 req-47b40161-512f-4866-8885-16c523131c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "836a4c35-8402-4fa6-81b4-1f85d7d3aa5e", "tag": "18185fdd-1b47-4931-a454-944aca7037d7"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:01.418101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc8f934b-bbf4-485b-bfba-017772e42ba2 req-47b40161-512f-4866-8885-16c523131c1f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:01.427715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc8f934b-bbf4-485b-bfba-017772e42ba2 req-47b40161-512f-4866-8885-16c523131c1f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:01.427874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bc8f934b-bbf4-485b-bfba-017772e42ba2 req-47b40161-512f-4866-8885-16c523131c1f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:01.451069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:01.454617 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bc8f934b-bbf4-485b-bfba-017772e42ba2 req-47b40161-512f-4866-8885-16c523131c1f service nova] Creating event network-changed:18185fdd-1b47-4931-a454-944aca7037d7 for instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e on n-h1-836830-13 Aug 29 16:13:01.461409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bc8f934b-bbf4-485b-bfba-017772e42ba2 req-47b40161-512f-4866-8885-16c523131c1f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057935 Aug 29 16:13:01.463958 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2971/6104] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:01.715930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:01.717320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:01.724877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:01.727557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:01.729794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:01.731527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:01.732191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:01.733057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:01.963959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:01.990965 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a9f26f0-5fa1-4e8f-b92e-343e84147272 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1325 microversion: 2.1 time: 0.278959 Aug 29 16:13:01.991586 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3134/6105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:01 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:03.014111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:03.014828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:03.024218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:03.025135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:03.025708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:03.027252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:03.027739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:03.028448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:03.233226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:03.242870 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-42a1932d-c93e-4019-aad0-3b5dce7bf851 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1325 microversion: 2.1 time: 0.233549 Aug 29 16:13:03.244950 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2972/6106] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:03 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:04.267346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:04.268469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:04.279735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.280237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.280679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.281535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.282202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.282623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.443640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:04.453324 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f0b37473-4ce5-4f4f-b128-3667537ac727 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1325 microversion: 2.1 time: 0.191580 Aug 29 16:13:04.454268 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3135/6107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:04 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1325 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:04.733895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:04.741099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:04.749810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.750674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.751405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.752299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:04.752933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:04.753527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:04.842642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ef036926-ac6d-416c-b9aa-06ad5684fe52 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action" status: 200 len: 24573 microversion: 2.1 time: 0.113147 Aug 29 16:13:04.851113 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2973/6108] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:13:04 2022] POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action => generated 24573 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:05.141494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f73812ad-090b-4899-9456-d25af8f0e6d0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Action: 'create', calling method: .version_select at 0x7f32ed0bd430>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1486936364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8HpExA1g3Kjk4JUM316AESrUq3fg3CzL7L7iWQ0Do0x/Gktptr4wLwPJwrF9JGKGlN5kbAuXA59WMsPRlhmJ5nGcLGJ4y8z12Y9Tw78HCa6/anD0nW5FZ7ZeMuHRstqA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:05.169975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f73812ad-090b-4899-9456-d25af8f0e6d0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Getting quotas for project e8971b1ee2b842588adbd7dc5d7552a0. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:13:05.176336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f73812ad-090b-4899-9456-d25af8f0e6d0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Getting quotas for user 86ff3f40c7224251ae1346fc60f361f9 and project e8971b1ee2b842588adbd7dc5d7552a0. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:13:05.217263 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f73812ad-090b-4899-9456-d25af8f0e6d0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.281481 Aug 29 16:13:05.225131 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3136/6109] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:13:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:05.478217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:05.479013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:05.491460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.491958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.494083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.496251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.496721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.497216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.670784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:05.672000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:05.683171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.684124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.684799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.685906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.686599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.687708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.736061 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1056666a-a9f6-45e2-90c3-ed5a3983e0e9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments/e713b6d7-7a4a-4e26-9b9f-5921616fd9e0" status: 200 len: 194 microversion: 2.20 time: 0.069715 Aug 29 16:13:05.737176 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3137/6110] 10.222.0.83 () {60 vars in 1454 bytes} [Mon Aug 29 16:13:05 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments/e713b6d7-7a4a-4e26-9b9f-5921616fd9e0 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:13:05.738003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:05.756160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f8dca96-70f2-424d-89c3-265814cfaac1 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1325 microversion: 2.1 time: 0.283834 Aug 29 16:13:05.757047 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2974/6111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:05 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1325 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:05.827916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:05.829774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:05.839321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.840173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.840855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.841740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:05.842478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:05.843413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:05.949196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lazy-loading 'services' on Instance uuid 3f73b215-d38d-4427-bc4b-181df4e8fa4d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:13:06.030251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8fb71564-e5ca-4966-b360-9b6a8c62c12a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments/e713b6d7-7a4a-4e26-9b9f-5921616fd9e0" status: 202 len: 0 microversion: 2.20 time: 0.207083 Aug 29 16:13:06.030958 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3138/6112] 10.222.0.83 () {60 vars in 1457 bytes} [Mon Aug 29 16:13:05 2022] DELETE /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments/e713b6d7-7a4a-4e26-9b9f-5921616fd9e0 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:13:06.043816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:06.046579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:06.057457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.058297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.059000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:06.060158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.060834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.061414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:06.105364 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-985155f9-bab2-41bf-bc35-b31b374ca07a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069599 Aug 29 16:13:06.106010 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2975/6113] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:06 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:06.787179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:06.792394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:06.822297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.823634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.827399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:06.832147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:06.834505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:06.837800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.126344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:07.138486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:07.155316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.156922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.158021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.159847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.161018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.162103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.269415 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-af58691e-a433-496f-92d3-9a1dbee29e1c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.153505 Aug 29 16:13:07.276508 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2976/6114] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:07 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:07.310285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:07.311955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ffd00aad-f13c-46b9-af40-4a77f5fd3726 req-241046e7-036c-4e7d-bbfe-0facd5ad85fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836a4c35-8402-4fa6-81b4-1f85d7d3aa5e", "name": "network-vif-plugged", "status": "completed", "tag": "18185fdd-1b47-4931-a454-944aca7037d7"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:07.336271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ffd00aad-f13c-46b9-af40-4a77f5fd3726 req-241046e7-036c-4e7d-bbfe-0facd5ad85fd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:07.336835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ffd00aad-f13c-46b9-af40-4a77f5fd3726 req-241046e7-036c-4e7d-bbfe-0facd5ad85fd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:07.337246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ffd00aad-f13c-46b9-af40-4a77f5fd3726 req-241046e7-036c-4e7d-bbfe-0facd5ad85fd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:07.372066 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ffd00aad-f13c-46b9-af40-4a77f5fd3726 req-241046e7-036c-4e7d-bbfe-0facd5ad85fd service nova] Creating event network-vif-plugged:18185fdd-1b47-4931-a454-944aca7037d7 for instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e on n-h1-836830-13 Aug 29 16:13:07.382962 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ffd00aad-f13c-46b9-af40-4a77f5fd3726 req-241046e7-036c-4e7d-bbfe-0facd5ad85fd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078014 Aug 29 16:13:07.386965 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2977/6115] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:07.508224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:07.519740 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46409dcc-adcd-4dff-b9a9-334006b6181c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1325 microversion: 2.1 time: 0.741015 Aug 29 16:13:07.521329 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3139/6116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:06 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1325 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:08.295640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:08.298579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:08.309794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:08.313079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:08.314288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:08.321679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:08.323296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:08.324130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:08.324875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:08.365863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d9517d5-47b5-412a-b431-12d0e14102c5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079776 Aug 29 16:13:08.367038 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2978/6117] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:08 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:08.544423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:08.545660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:08.572887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:08.574277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:08.574979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:08.576114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:08.578306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:08.580357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:08.897527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:08.925801 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b65c038-37dd-4ebe-81d7-0fed2eb4534a tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1325 microversion: 2.1 time: 0.387646 Aug 29 16:13:08.927185 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3140/6118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:08 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:09.378988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:09.381980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:09.392369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:09.393163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:09.393815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:09.403988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:09.404544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:09.407717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:09.460963 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8282d3a-96d2-40db-b118-7fdfd3ebde6d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085911 Aug 29 16:13:09.462712 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2979/6119] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:09 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:09.950190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:09.951544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:09.968094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:09.969170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:09.969841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:09.973375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:09.974173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:09.974932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.312467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:10.326074 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9a28c690-6baf-47a4-9a60-876526389454 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1521 microversion: 2.1 time: 0.379804 Aug 29 16:13:10.334659 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3141/6120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:09 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:10.353850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:10.354386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:10.361567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.362337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.362950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.363713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.364453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.365093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.415110 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] HTTP exception thrown: Instance is not a member of specified network Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Request method failure captured: Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e/ips/invalid HTTP/1.1 Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOWHW9sTget7F7NpVyUlrRp6E4QdV4Ap6yhxL_teuUUbOGDQZVVLJxComd_DD8K4KhvhgSjOovZyakyQZGkeZy8wkrTYVa2t1BUA963O2T2TY2GfjukC5ixyKEVw-s6XopQlSpT0hFQvkRTZRcTz622u7blwKT6JkOaNStd8xhNlzrU Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ac255c28da36470cbc14243137e75fea Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ac255c28da36470cbc14243137e75fea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ac255c28da36470cbc14243137e75fea", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ac255c28da36470cbc14243137e75fea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ac255c28da36470cbc14243137e75fea"}]}] Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ac255c28da36470cbc14243137e75fea Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerAddressesNegativeTestJSON-396265586-project Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 69af47f499d34232b8c857f5d2fdf91f Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-396265586-project Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance is not a member of specified network Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': '836a4c35-8402-4fa6-81b4-1f85d7d3aa5e', 'id': 'invalid'} Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 29 16:13:10.427958 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.435702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Returning 404 to user: Instance is not a member of specified network {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:10.440321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62640ddf-302b-4a29-9474-e54f37db2364 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.090193 Aug 29 16:13:10.442380 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2980/6121] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 16:13:10 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e/ips/invalid => generated 91 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:13:10.455642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5502aa3d-a7e9-4f2f-9e43-54a816bf169c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:10.456430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5502aa3d-a7e9-4f2f-9e43-54a816bf169c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Failed to fetch instance by id 999 {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 29 16:13:10.457293 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5502aa3d-a7e9-4f2f-9e43-54a816bf169c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] HTTP exception thrown: Instance 999 could not be found. Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5502aa3d-a7e9-4f2f-9e43-54a816bf169c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Request method failure captured: Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOWHW9sTget7F7NpVyUlrRp6E4QdV4Ap6yhxL_teuUUbOGDQZVVLJxComd_DD8K4KhvhgSjOovZyakyQZGkeZy8wkrTYVa2t1BUA963O2T2TY2GfjukC5ixyKEVw-s6XopQlSpT0hFQvkRTZRcTz622u7blwKT6JkOaNStd8xhNlzrU Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: ac255c28da36470cbc14243137e75fea Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ac255c28da36470cbc14243137e75fea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ac255c28da36470cbc14243137e75fea", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ac255c28da36470cbc14243137e75fea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ac255c28da36470cbc14243137e75fea"}]}] Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: ac255c28da36470cbc14243137e75fea Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerAddressesNegativeTestJSON-396265586-project Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 69af47f499d34232b8c857f5d2fdf91f Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-396265586-project Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 999 could not be found. Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '999'} Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 29 16:13:10.459074 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:10.466592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5502aa3d-a7e9-4f2f-9e43-54a816bf169c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Returning 404 to user: Instance 999 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:10.466592 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5502aa3d-a7e9-4f2f-9e43-54a816bf169c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009585 Aug 29 16:13:10.466592 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3142/6122] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 16:13:10 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 16:13:10.477425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:10.478424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:10.483974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:10.500343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:10.504177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.506673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.515512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.516732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.518945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.519678 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.532351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.532916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.535368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.539173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.539780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.549606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.621766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:13:10.661855 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff944331-65a5-4d50-8ad1-014ad44b6e0d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.188583 Aug 29 16:13:10.683316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3143/6123] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:10 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:10.893850 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-863ab13d-daa3-41a2-8674-13f21d57d508 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "DELETE /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 204 len: 0 microversion: 2.1 time: 0.424628 Aug 29 16:13:10.894449 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2981/6124] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:13:10 2022] DELETE /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:13:10.917980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:10.920696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:10.926274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:10.966416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.968293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.969286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.970420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:10.971163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:10.971821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:10.997567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:11.258077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:11.274938 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb782177-6ee0-4625-8683-fabd4748685c tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1527 microversion: 2.1 time: 0.372461 Aug 29 16:13:11.277012 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3144/6125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:10 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:11.779010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:11.779010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:11.779010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:11.779010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:11.779010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:11.779010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:11.783684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:11.791750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:11.877076 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19980187-6668-49ba-8a83-2cc7a7a36c39 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.206552 Aug 29 16:13:11.882288 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2982/6126] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:11 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:12.301052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:12.301763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:12.309767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:12.310299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:12.310810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:12.311554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:12.312029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:12.312564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:12.800267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:12.815877 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8dfafad-8237-4d53-8a4a-498619149162 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1527 microversion: 2.1 time: 0.519886 Aug 29 16:13:12.819873 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3145/6127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:12 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1527 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:12.896435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:12.902087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:12.926871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:12.927383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:12.928200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:12.929031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:12.929450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:12.930254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:13.007106 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3f5d3aca-bac5-4cc4-a108-58bb02eb7b2e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118080 Aug 29 16:13:13.008704 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2983/6128] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:12 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:13.844221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:13.845683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:13.855693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:13.856468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:13.857101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:13.858024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:13.858650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:13.859269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:13.998605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69af47f499d34232b8c857f5d2fdf91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac255c28da36470cbc14243137e75fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:14.018616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4890a4d0-97f3-4062-ae64-2f16eaae2497 tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 200 len: 1485 microversion: 2.1 time: 0.180149 Aug 29 16:13:14.023614 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3146/6129] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:13 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 1485 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:14.027628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:14.038864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:14.051116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:14.055052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:14.056633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.059301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:14.059931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:14.063121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.161046 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8fb2b0b8-25f8-4576-9015-6e30d7d67cb3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.140510 Aug 29 16:13:14.168192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-31e0049d-0eb6-45ec-a8e9-a86fa4c886cb req-c2a24533-13e2-4bcc-a8c1-23f99cd0daf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "836a4c35-8402-4fa6-81b4-1f85d7d3aa5e", "name": "network-vif-deleted", "tag": "18185fdd-1b47-4931-a454-944aca7037d7"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:14.169574 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2984/6130] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:13:14 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:14.183548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31e0049d-0eb6-45ec-a8e9-a86fa4c886cb req-c2a24533-13e2-4bcc-a8c1-23f99cd0daf6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:14.184105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31e0049d-0eb6-45ec-a8e9-a86fa4c886cb req-c2a24533-13e2-4bcc-a8c1-23f99cd0daf6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:14.184546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-31e0049d-0eb6-45ec-a8e9-a86fa4c886cb req-c2a24533-13e2-4bcc-a8c1-23f99cd0daf6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.213150 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-31e0049d-0eb6-45ec-a8e9-a86fa4c886cb req-c2a24533-13e2-4bcc-a8c1-23f99cd0daf6 service nova] Creating event network-vif-deleted:18185fdd-1b47-4931-a454-944aca7037d7 for instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e on n-h1-836830-13 Aug 29 16:13:14.221433 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-31e0049d-0eb6-45ec-a8e9-a86fa4c886cb req-c2a24533-13e2-4bcc-a8c1-23f99cd0daf6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057410 Aug 29 16:13:14.222721 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3147/6131] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:14.279671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:14.280529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:14.300830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:14.302148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:14.304051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.308836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:14.309545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:14.312536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.382064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:13:14.585242 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5a6b50d4-97d4-469c-9332-eea5f9821b27 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 204 len: 0 microversion: 2.20 time: 0.321130 Aug 29 16:13:14.608284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:14.609123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:14.612032 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2985/6132] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 16:13:14 2022] DELETE /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:13:14.619807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:14.622252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:14.623455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.624767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:14.625817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:14.626504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:14.850027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:14.870626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:14.872422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:14.874282 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae5a3f6c-bf0a-4384-819f-72158eb21cca tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 0.274336 Aug 29 16:13:14.875686 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3148/6133] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:14 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:15.040346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:15.041769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] [instance: 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:15.052281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.053024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.053624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.054485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.055114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.055938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.096584 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] HTTP exception thrown: Instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e could not be found. Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Request method failure captured: Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e HTTP/1.1 Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOWHW9sTget7F7NpVyUlrRp6E4QdV4Ap6yhxL_teuUUbOGDQZVVLJxComd_DD8K4KhvhgSjOovZyakyQZGkeZy8wkrTYVa2t1BUA963O2T2TY2GfjukC5ixyKEVw-s6XopQlSpT0hFQvkRTZRcTz622u7blwKT6JkOaNStd8xhNlzrU Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: ac255c28da36470cbc14243137e75fea Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ac255c28da36470cbc14243137e75fea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ac255c28da36470cbc14243137e75fea", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ac255c28da36470cbc14243137e75fea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ac255c28da36470cbc14243137e75fea"}]}] Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: ac255c28da36470cbc14243137e75fea Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-396265586 Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerAddressesNegativeTestJSON-396265586-project Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 69af47f499d34232b8c857f5d2fdf91f Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-396265586-project Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e could not be found. Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '836a4c35-8402-4fa6-81b4-1f85d7d3aa5e'} Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e could not be found. Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e could not be found. Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:15.098364 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e could not be found. Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] Returning 404 to user: Instance 836a4c35-8402-4fa6-81b4-1f85d7d3aa5e could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:15.101711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3829086-2a81-4757-a46b-61b14f39d4ad tempest-ServerAddressesNegativeTestJSON-396265586 tempest-ServerAddressesNegativeTestJSON-396265586-project] 10.222.0.83 "GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e" status: 404 len: 111 microversion: 2.1 time: 0.064212 Aug 29 16:13:15.104608 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2986/6134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:15 2022] GET /compute/v2.1/servers/836a4c35-8402-4fa6-81b4-1f85d7d3aa5e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:13:15.295457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1303361231-access_point-1305974043", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "5ce58506-dfbf-452b-b7d5-cbddfc4097ce"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1486936364", "security_groups": [{"name": "tempest-secgroup_access--1902311216"}, {"name": "tempest-secgroup_general--217101212"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:15.309768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:15.544693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] validate_networks() for [('5ce58506-dfbf-452b-b7d5-cbddfc4097ce', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:13:15.900039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:15.901395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:15.912502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.914128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.917739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.920575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:15.922010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:15.923485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:15.935136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:16.141288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:13:16.141756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:13:16.142166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:13:16.142572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:13:16.142983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:13:16.162077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:16.163302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:16.163755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:16.166531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:16.166660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:16.168036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:16.203912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Getting quotas for project e8971b1ee2b842588adbd7dc5d7552a0. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:13:16.210953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Getting quotas for user 86ff3f40c7224251ae1346fc60f361f9 and project e8971b1ee2b842588adbd7dc5d7552a0. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:13:16.229281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:13:16.231786 n-d-836830-13 devstack@n-api.service[129133]: WARNING nova.utils [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1303361231-access_point-1305974043 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1303361231-ac Aug 29 16:13:16.232829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:13:16.234876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:16.244663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:16.246140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:16.247384 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b8549b2a-7142-4718-9b59-6f370ba50cab tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 0.352318 Aug 29 16:13:16.251723 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2987/6135] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:15 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:13:16.308146 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ddd8fc1-f6a9-4b41-842b-cf6f183bacdf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.016736 Aug 29 16:13:16.309569 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3149/6136] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:13:15 2022] POST /compute/v2.1/servers => generated 457 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:13:16.324491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6113b84f-11dd-4c96-9562-0982659d9ac5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:16.325172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6113b84f-11dd-4c96-9562-0982659d9ac5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:16.406696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6113b84f-11dd-4c96-9562-0982659d9ac5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:16.413780 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6113b84f-11dd-4c96-9562-0982659d9ac5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1295 microversion: 2.1 time: 0.096139 Aug 29 16:13:16.414550 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2988/6137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:16 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:17.281892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:17.283179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:17.292881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:17.293689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:17.294310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.302734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:17.303495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:17.303975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.436188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:17.436796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:17.450836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:17.454779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:17.455504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.458814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:17.459583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:17.460393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:17.560115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:17.572344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:17.574016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:17.575621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52dc26d2-d879-4bd1-aa4a-7e65bfc9b10d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1722 microversion: 2.20 time: 0.298851 Aug 29 16:13:17.578520 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3150/6138] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:17 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:17.662201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:17.671548 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-91ebd37f-9dca-4b88-87f2-d9855b774e65 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1347 microversion: 2.1 time: 0.238973 Aug 29 16:13:17.672641 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2989/6139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:17 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1347 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:18.605629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:18.606306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:18.635902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.636527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.637033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.646817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.647321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.657941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.695210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:18.696501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:18.725002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.725523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.725968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.730355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:18.730866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:18.731358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:18.928649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:18.942153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:18.944038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:18.953193 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7139e136-dcbc-40b6-86c3-d649a6537343 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1655 microversion: 2.20 time: 0.350692 Aug 29 16:13:18.959002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3151/6140] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:18 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1655 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:13:19.025140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:19.038729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3faf6de8-bd02-440e-a67b-23ae0bcebfcf req-db19e7aa-8442-4dd5-bcc0-a50a525bd641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f73b215-d38d-4427-bc4b-181df4e8fa4d", "name": "network-vif-deleted", "tag": "1f75301b-8193-416d-8706-b2b0f43eace2"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:19.048928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3faf6de8-bd02-440e-a67b-23ae0bcebfcf req-db19e7aa-8442-4dd5-bcc0-a50a525bd641 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:19.050099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3faf6de8-bd02-440e-a67b-23ae0bcebfcf req-db19e7aa-8442-4dd5-bcc0-a50a525bd641 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:19.050701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3faf6de8-bd02-440e-a67b-23ae0bcebfcf req-db19e7aa-8442-4dd5-bcc0-a50a525bd641 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:19.063636 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-004d7414-0424-44c5-9993-5c7aaf66c3f7 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1353 microversion: 2.1 time: 0.372549 Aug 29 16:13:19.067482 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3faf6de8-bd02-440e-a67b-23ae0bcebfcf req-db19e7aa-8442-4dd5-bcc0-a50a525bd641 service nova] Creating event network-vif-deleted:1f75301b-8193-416d-8706-b2b0f43eace2 for instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d on n-h2-836830-13 Aug 29 16:13:19.073856 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3faf6de8-bd02-440e-a67b-23ae0bcebfcf req-db19e7aa-8442-4dd5-bcc0-a50a525bd641 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038798 Aug 29 16:13:19.078558 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3152/6141] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:19.088016 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2990/6142] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:18 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1353 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:19.987388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:19.988260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:20.007439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:20.014999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:20.015567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.018682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:20.020095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:20.027573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.091816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:20.093039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:20.111500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:20.113945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:20.114427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.115713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:20.117587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:20.119530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.171588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:20.172300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:20.176090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:20.177137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lazy-loading 'fault' on Instance uuid 3f73b215-d38d-4427-bc4b-181df4e8fa4d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:13:20.322135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:20.362767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:20.365037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:20.366631 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-480fd12f-042c-461f-a122-e4445d25200b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 200 len: 1370 microversion: 2.20 time: 0.385428 Aug 29 16:13:20.368404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3153/6143] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:19 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 1370 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:21.122913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:21.138524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aa4cf503-3b70-45a8-80f9-bc767daa4ad5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1472 microversion: 2.1 time: 1.051069 Aug 29 16:13:21.140739 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2991/6144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:20 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1472 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:21.396587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:21.397519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:21.409443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:21.410549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:21.411549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:21.413031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:21.413915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:21.414599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:21.434121 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] HTTP exception thrown: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Request method failure captured: Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d HTTP/1.1 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOSLV2X-CUcZHBH0wf799EWzVFBLcc14v3WeRPAvvoJRX7XAm0XARWKoR0FC9lu6S3cOdj_syDiCD1jwEj_7Zyst2wxqiuMH25Skb_-SDKD0WoiJsoLr3p_zd9Se_Hoiy6fIO2zu9oikWVGP-NO_OCi4QyD7SmiiBYdlPNa-n59I280 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a32ab2f89fcf4b3ab01be67165388175", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a32ab2f89fcf4b3ab01be67165388175"}]}] Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 884be770746c44d29f50c099613f08ed Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '3f73b215-d38d-4427-bc4b-181df4e8fa4d'} Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:21.436199 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Returning 404 to user: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a11105dd-8ee9-412c-a1bd-a077e9604492 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 404 len: 111 microversion: 2.20 time: 0.047604 Aug 29 16:13:21.439522 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3154/6145] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:21 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:13:21.449205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed1274a4-1c5e-4506-b0b7-12d4b7632a74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '.version_select at 0x7f32ee8eb040>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:21.478596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9f01e8d8-026f-4ad3-92e3-dbc9704ff7bc req-4111d850-1ef0-4c49-b669-d7613a83bfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e9e5be-9e32-418d-89b7-e2e6d985311d", "tag": "643c1014-64a1-438d-9006-982466b4fc54"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:21.500285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9f01e8d8-026f-4ad3-92e3-dbc9704ff7bc req-4111d850-1ef0-4c49-b669-d7613a83bfa4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:21.500914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9f01e8d8-026f-4ad3-92e3-dbc9704ff7bc req-4111d850-1ef0-4c49-b669-d7613a83bfa4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:21.503432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9f01e8d8-026f-4ad3-92e3-dbc9704ff7bc req-4111d850-1ef0-4c49-b669-d7613a83bfa4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:21.518659 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed1274a4-1c5e-4506-b0b7-12d4b7632a74 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93064840" status: 204 len: 0 microversion: 2.20 time: 0.073328 Aug 29 16:13:21.521304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2992/6146] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 16:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93064840 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:13:21.533598 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9f01e8d8-026f-4ad3-92e3-dbc9704ff7bc req-4111d850-1ef0-4c49-b669-d7613a83bfa4 service nova] Creating event network-changed:643c1014-64a1-438d-9006-982466b4fc54 for instance 21e9e5be-9e32-418d-89b7-e2e6d985311d on n-h1-836830-13 Aug 29 16:13:21.550413 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9f01e8d8-026f-4ad3-92e3-dbc9704ff7bc req-4111d850-1ef0-4c49-b669-d7613a83bfa4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075369 Aug 29 16:13:21.551377 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3155/6147] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:22.166731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:22.171375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:22.188960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:22.189465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:22.189905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:22.190626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:22.191165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:22.191769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:22.443274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:22.454314 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-efb6f85a-361c-40fc-944a-a3d573ba95b5 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1472 microversion: 2.1 time: 0.291883 Aug 29 16:13:22.473096 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2993/6148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:22 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:22.890662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b968e9d-26bf-48af-bbd7-e30d813e3273 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'create', calling method: .version_select at 0x7f32ed0bc550>, body: {"keypair": {"name": "tempest-keypair-336689360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAET0bpAPH7V9wCRs7tf/ASqrN4ny8+gWHC9h9sEL0+8dZWJ3GOi5/N9Paf6UQlQhwKDV2HSvoacKIIYeRmwVljstT7MUEBlkyahB1yyPqUZJLRHpp6/YHNWDto/4L+FFA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:22.914474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-7b968e9d-26bf-48af-bbd7-e30d813e3273 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for project a32ab2f89fcf4b3ab01be67165388175. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:13:22.924765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-7b968e9d-26bf-48af-bbd7-e30d813e3273 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for user 884be770746c44d29f50c099613f08ed and project a32ab2f89fcf4b3ab01be67165388175. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:13:22.975931 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b968e9d-26bf-48af-bbd7-e30d813e3273 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.090080 Aug 29 16:13:22.976860 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3156/6149] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 16:13:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 16:13:23.479139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:23.479770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:23.502659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.503592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.504288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.505316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:23.505991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:23.507054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:23.831173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:23.844347 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4972831f-093f-4033-ba4e-5a19db2afea8 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1472 microversion: 2.1 time: 0.367437 Aug 29 16:13:23.850269 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2994/6150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:23 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:24.870365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:24.872884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:24.883062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:24.883062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:24.884165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:24.889656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:24.890490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:24.891790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:25.019238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-300528306", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933040d4-e26a-4652-bb1d-25e9b999aa42"}], "security_groups": [{"name": "tempest-securitygroup--1194175080"}], "key_name": "tempest-keypair-336689360", "user_data": "}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:25.172976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:25.191533 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a47d12f7-a940-4f9d-8ac2-1894250878b3 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1472 microversion: 2.1 time: 0.326425 Aug 29 16:13:25.192779 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3157/6151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:24 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:25.217967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] validate_networks() for [('933040d4-e26a-4652-bb1d-25e9b999aa42', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:13:26.085147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:13:26.085758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:13:26.086227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:13:26.087603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:13:26.088318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:13:26.099763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:26.100334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:26.100862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:26.101775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:26.102892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:26.103456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:26.124038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for project a32ab2f89fcf4b3ab01be67165388175. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:13:26.129940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Getting quotas for user 884be770746c44d29f50c099613f08ed and project a32ab2f89fcf4b3ab01be67165388175. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:13:26.157156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:13:26.160112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:13:26.200459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:26.215536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:26.216756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:26.221426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:26.226769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:26.228516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:26.229200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:26.230281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:26.230927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:26.231647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:26.249257 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3c3c16a-7c04-4b1d-8225-5a0767d28d8e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.235576 Aug 29 16:13:26.250626 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2995/6152] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 16:13:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 16:13:26.264277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd570f48-c4c6-452e-bc08-86438e7ad392 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:26.270116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd570f48-c4c6-452e-bc08-86438e7ad392 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:26.439421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd570f48-c4c6-452e-bc08-86438e7ad392 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:26.449955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd570f48-c4c6-452e-bc08-86438e7ad392 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:26.452870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd570f48-c4c6-452e-bc08-86438e7ad392 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:26.454264 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd570f48-c4c6-452e-bc08-86438e7ad392 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1280 microversion: 2.20 time: 0.194346 Aug 29 16:13:26.455541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2996/6153] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:26 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:26.482612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:26.491259 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c66d9e37-1654-4a91-a02b-ba2ee854be0b tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1472 microversion: 2.1 time: 0.280219 Aug 29 16:13:26.494440 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3158/6154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:26 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:27.313260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-26ed8a79-0e3c-48d3-8cc3-3b7adc0f1d0d req-4cbb57ea-715f-491d-a832-5fd65aad9683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e9e5be-9e32-418d-89b7-e2e6d985311d", "name": "network-vif-plugged", "status": "completed", "tag": "643c1014-64a1-438d-9006-982466b4fc54"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:27.342316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-26ed8a79-0e3c-48d3-8cc3-3b7adc0f1d0d req-4cbb57ea-715f-491d-a832-5fd65aad9683 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:27.342984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-26ed8a79-0e3c-48d3-8cc3-3b7adc0f1d0d req-4cbb57ea-715f-491d-a832-5fd65aad9683 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:27.343691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-26ed8a79-0e3c-48d3-8cc3-3b7adc0f1d0d req-4cbb57ea-715f-491d-a832-5fd65aad9683 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:27.358886 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-26ed8a79-0e3c-48d3-8cc3-3b7adc0f1d0d req-4cbb57ea-715f-491d-a832-5fd65aad9683 service nova] Creating event network-vif-plugged:643c1014-64a1-438d-9006-982466b4fc54 for instance 21e9e5be-9e32-418d-89b7-e2e6d985311d on n-h1-836830-13 Aug 29 16:13:27.365424 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-26ed8a79-0e3c-48d3-8cc3-3b7adc0f1d0d req-4cbb57ea-715f-491d-a832-5fd65aad9683 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056590 Aug 29 16:13:27.366538 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2997/6155] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:27.476651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:27.478079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:27.490458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:27.492105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:27.494424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:27.495418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:27.496703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:27.497678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:27.519581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:27.520305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:27.534617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:27.535163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:27.537292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:27.567786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:27.573899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:27.576094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:27.880742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:27.900067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:27.901955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:27.919493 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-113f2ae0-948d-4405-9817-6f2cb1ab279b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1332 microversion: 2.20 time: 0.430685 Aug 29 16:13:27.920651 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3159/6156] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:27 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1332 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:28.147728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:28.160835 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff62052f-5e13-4c97-9963-f595c1c4cc29 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1472 microversion: 2.1 time: 0.646850 Aug 29 16:13:28.161522 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2998/6157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:27 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1472 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:28.946226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:28.947429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:28.963899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:28.964418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:28.964865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:28.965592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:28.966049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:28.966476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:29.184882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:29.186017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:29.200499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:29.203429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:29.204383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:29.205445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:29.207682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:29.208349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:29.578338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:29.592031 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9c57c88-57ac-496f-ae6d-a9f3304b51d6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1472 microversion: 2.1 time: 0.412208 Aug 29 16:13:29.595297 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 2999/6158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:29 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:29.673607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:29.686515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:29.688322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:29.689758 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7c37d6ff-83e7-421f-9645-60ac22c8dc0a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1406 microversion: 2.20 time: 0.748887 Aug 29 16:13:29.690936 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3160/6159] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:28 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1406 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:13:30.560257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:30.561319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:30.571719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f4f5cc49-ad2b-4fff-8d8a-8c0f11b7fdb8 req-99d1b813-05c6-4780-8d7f-ab685f4a5f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24e2965-1e4e-487a-94ee-fcc5f60caef4", "tag": "3dd4d296-411f-4624-b4df-9c83aaf449cc"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:30.587780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:30.589317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:30.591567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:30.592466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:30.595122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:30.596580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:30.603459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f4f5cc49-ad2b-4fff-8d8a-8c0f11b7fdb8 req-99d1b813-05c6-4780-8d7f-ab685f4a5f17 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:30.603971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f4f5cc49-ad2b-4fff-8d8a-8c0f11b7fdb8 req-99d1b813-05c6-4780-8d7f-ab685f4a5f17 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:30.604416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f4f5cc49-ad2b-4fff-8d8a-8c0f11b7fdb8 req-99d1b813-05c6-4780-8d7f-ab685f4a5f17 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:30.639076 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f4f5cc49-ad2b-4fff-8d8a-8c0f11b7fdb8 req-99d1b813-05c6-4780-8d7f-ab685f4a5f17 service nova] Creating event network-changed:3dd4d296-411f-4624-b4df-9c83aaf449cc for instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 on n-h1-836830-13 Aug 29 16:13:30.654498 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f4f5cc49-ad2b-4fff-8d8a-8c0f11b7fdb8 req-99d1b813-05c6-4780-8d7f-ab685f4a5f17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090730 Aug 29 16:13:30.655210 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3161/6160] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:30.683596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:13:30.684169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:30.684917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:30.712224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:30.717484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:30.721072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:30.722454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:30.723117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:30.723878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:30.928757 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd03a27d-afb0-4666-8b43-38d51402424d tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 204 len: 0 microversion: 2.1 time: 0.371682 Aug 29 16:13:30.931945 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3000/6161] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:13:30 2022] DELETE /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:13:30.949434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:30.951089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:30.972906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:30.973693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:30.975137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:30.976037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:30.983880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:30.984372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:31.308102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:31.322697 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f9e2fd4-258d-4863-8a52-5a52d5d569cd tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1644 microversion: 2.1 time: 0.666302 Aug 29 16:13:31.333998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3162/6162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:30 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1644 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:31.358855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:31.359496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:31.377954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:31.378690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:31.379335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:31.380265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:31.382668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:31.383440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:31.503242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:31.516803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:31.518286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:31.519685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4265464-5d3b-4285-801c-d5b1c1ddbbe9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1406 microversion: 2.20 time: 0.585029 Aug 29 16:13:31.529334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3001/6163] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:30 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1406 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:31.536913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-80f29b7a-030c-4d97-9000-34141cbbff36 req-9d413a33-812d-4ea5-aef0-80ac20994152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:31.560094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-80f29b7a-030c-4d97-9000-34141cbbff36 req-9d413a33-812d-4ea5-aef0-80ac20994152 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:31.560578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-80f29b7a-030c-4d97-9000-34141cbbff36 req-9d413a33-812d-4ea5-aef0-80ac20994152 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:31.561103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-80f29b7a-030c-4d97-9000-34141cbbff36 req-9d413a33-812d-4ea5-aef0-80ac20994152 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:31.592141 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-80f29b7a-030c-4d97-9000-34141cbbff36 req-9d413a33-812d-4ea5-aef0-80ac20994152 service nova] Creating event network-changed:e4bfbf99-90f2-4df5-acc6-3031e3a7f32a for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 on n-h2-836830-13 Aug 29 16:13:31.603297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-80f29b7a-030c-4d97-9000-34141cbbff36 req-9d413a33-812d-4ea5-aef0-80ac20994152 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071908 Aug 29 16:13:31.611962 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3002/6164] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:31.623689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:31.625387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:31.637382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:31.638379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:31.639134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:31.640251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:31.641278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:31.641892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:31.767647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:31.780286 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7250a95f-0290-495f-98bd-292b191bda81 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1581 microversion: 2.1 time: 0.435272 Aug 29 16:13:31.781573 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3163/6165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:31 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1581 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:32.043838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:32.057632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d85e5d3-3907-4839-a7b0-79253908dded tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1644 microversion: 2.1 time: 0.443360 Aug 29 16:13:32.059485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3003/6166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:31 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1644 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:32.085143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:32.086002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:32.106083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:32.106665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:32.107148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:32.107895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:32.108358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:32.108791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:32.554344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:32.556728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:32.586281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:32.587885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:32.592083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:32.592771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:32.593717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:32.599953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:32.723093 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-655b6a36-a3ca-4c71-90f4-e030b6154486 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1797 microversion: 2.1 time: 0.642993 Aug 29 16:13:32.723688 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3164/6167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:32 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1797 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:32.805922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:32.807453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:32.817687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:32.818403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:32.818989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:32.831210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:32.831963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:32.833170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:32.918033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:32.949832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:33.235432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:33.257792 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a949d717-5a93-4e99-b50e-6b095af9b711 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1581 microversion: 2.1 time: 0.456047 Aug 29 16:13:33.261920 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3165/6168] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:32 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1581 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:33.466669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:33.473007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-683575392", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:33.478309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:33.486924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:33.488700 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-37b0834d-29aa-4de9-9118-52469f7dcbfc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1406 microversion: 2.20 time: 0.943523 Aug 29 16:13:33.491920 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3004/6169] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:32 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1406 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:33.550174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] validate_networks() for [('2b42d7d3-25ec-434d-b3eb-8da5a8256128', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:13:34.049430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-456698c0-5e04-4b99-8aa6-b9efbbe5d868 req-0777dfc6-cc2e-436c-9870-ce2346efe9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24e2965-1e4e-487a-94ee-fcc5f60caef4", "name": "network-vif-deleted", "tag": "3dd4d296-411f-4624-b4df-9c83aaf449cc"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:34.069384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-456698c0-5e04-4b99-8aa6-b9efbbe5d868 req-0777dfc6-cc2e-436c-9870-ce2346efe9ac service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:34.070323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-456698c0-5e04-4b99-8aa6-b9efbbe5d868 req-0777dfc6-cc2e-436c-9870-ce2346efe9ac service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:34.071692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-456698c0-5e04-4b99-8aa6-b9efbbe5d868 req-0777dfc6-cc2e-436c-9870-ce2346efe9ac service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:34.099572 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-456698c0-5e04-4b99-8aa6-b9efbbe5d868 req-0777dfc6-cc2e-436c-9870-ce2346efe9ac service nova] Creating event network-vif-deleted:3dd4d296-411f-4624-b4df-9c83aaf449cc for instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 on n-h1-836830-13 Aug 29 16:13:34.109023 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-456698c0-5e04-4b99-8aa6-b9efbbe5d868 req-0777dfc6-cc2e-436c-9870-ce2346efe9ac service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214601 Aug 29 16:13:34.111071 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3005/6170] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:34.287446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:34.288763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:34.306688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:34.310095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:34.314488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:34.315519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:34.316131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:34.316672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:34.374078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:13:34.375162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:13:34.375924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:13:34.376512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:13:34.377139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:13:34.389010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:34.389747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:34.390667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:34.391943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:34.392695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:34.393339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:34.417519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Getting quotas for project 392f9e4adbf748c9a83ff7673fc77cb7. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:13:34.424436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Getting quotas for user 12de3ef79acd458baaec5e85570c8ae2 and project 392f9e4adbf748c9a83ff7673fc77cb7. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:13:34.456142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:13:34.462739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:13:34.574941 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-212e356c-12a6-4926-b35c-732a1e8c23ac tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.309772 Aug 29 16:13:34.575762 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3166/6171] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:13:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:13:34.583778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:34.584504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:34.592829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:34.593394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:34.595538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:34.596374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:34.596910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:34.598136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:34.796742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:34.837624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:34.848136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:34.848531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57fd1543-6af9-44df-8178-4961a0066185 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1229 microversion: 2.1 time: 0.565767 Aug 29 16:13:34.849153 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3006/6172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:34 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1229 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:34.850355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:34.852023 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b5f90a3-df1b-4f2f-91af-6ef9e64deab4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1406 microversion: 2.20 time: 0.274699 Aug 29 16:13:34.853723 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3167/6173] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:34 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:34.892313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0d01100-b31b-4fc4-8f81-41d947ebee4b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:34.892938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0d01100-b31b-4fc4-8f81-41d947ebee4b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:35.029025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a0d01100-b31b-4fc4-8f81-41d947ebee4b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:35.050533 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0d01100-b31b-4fc4-8f81-41d947ebee4b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1222 microversion: 2.1 time: 0.179000 Aug 29 16:13:35.054784 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3007/6174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:34 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1222 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:35.882202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:35.882824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:35.891409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:35.892016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:35.909694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:35.914320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:35.914909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:35.915697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:35.918894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:35.919606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:35.920362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:35.921189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:35.932361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:35.933479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:35.942195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:35.944263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:36.114759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:36.211930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:36.228920 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17384c76-b2d6-49be-bf33-9184de36e165 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1229 microversion: 2.1 time: 0.350567 Aug 29 16:13:36.229525 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3168/6175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:35 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1229 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:36.245643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:36.246596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:36.264781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:36.265300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:36.265811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:36.266801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:36.267336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:36.267767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:36.472941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:36.475741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:36.486945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:36.497215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f0a7dba-7d70-4619-9d0f-d5c137488a2d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1274 microversion: 2.1 time: 0.266434 Aug 29 16:13:36.500731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:36.502339 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3169/6176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:36 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:36.505864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:36.512184 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-785b5744-6638-4121-88ce-d2614d293a3c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1406 microversion: 2.20 time: 0.624643 Aug 29 16:13:36.528766 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3008/6177] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:35 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1406 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:37.265885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:37.276142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:37.301216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:37.302372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:37.303711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:37.305795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:37.311751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:37.312913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:37.476995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:37.488521 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3d45f5f-d817-4f23-b6d0-2ca48864effc tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1229 microversion: 2.1 time: 0.230356 Aug 29 16:13:37.494981 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3170/6178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:37 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1229 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:37.541177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:37.542518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:37.551557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:37.552339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:37.552961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:37.553713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:37.554107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:37.554816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:37.555763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:37.556394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:37.572005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:37.573079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:37.573842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:37.576373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:37.577146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:37.578469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:37.710875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:37.730441 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0690d2a3-7084-4c53-a1e6-7fe50ba4535b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1280 microversion: 2.1 time: 0.184687 Aug 29 16:13:37.731507 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3171/6179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:37 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:38.122486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-02bbe979-e7cc-49ea-b6a6-8bc0b4ce57f8 req-3583d8d5-6499-4389-a61f-d234de65fa91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "name": "network-vif-plugged", "status": "completed", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:38.145272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-02bbe979-e7cc-49ea-b6a6-8bc0b4ce57f8 req-3583d8d5-6499-4389-a61f-d234de65fa91 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:38.146070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-02bbe979-e7cc-49ea-b6a6-8bc0b4ce57f8 req-3583d8d5-6499-4389-a61f-d234de65fa91 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:38.146655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-02bbe979-e7cc-49ea-b6a6-8bc0b4ce57f8 req-3583d8d5-6499-4389-a61f-d234de65fa91 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:38.177741 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-02bbe979-e7cc-49ea-b6a6-8bc0b4ce57f8 req-3583d8d5-6499-4389-a61f-d234de65fa91 service nova] Creating event network-vif-plugged:e4bfbf99-90f2-4df5-acc6-3031e3a7f32a for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 on n-h2-836830-13 Aug 29 16:13:38.202774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-02bbe979-e7cc-49ea-b6a6-8bc0b4ce57f8 req-3583d8d5-6499-4389-a61f-d234de65fa91 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084332 Aug 29 16:13:38.206039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3172/6180] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:38.295409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:38.309406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:38.314379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:38.321235 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d69c62bc-4736-4ca3-89b2-a00d3e1a85dc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1406 microversion: 2.20 time: 0.785926 Aug 29 16:13:38.339162 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3009/6181] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:37 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1406 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:38.526545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:38.528951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:38.537826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:38.575486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:38.576930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:38.578412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:38.582422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:38.588048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:38.589641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:38.640415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-653ef662-6c64-4f94-accf-c376ad926c4f req-e322e477-e025-49a4-9f5d-374294609c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e9e5be-9e32-418d-89b7-e2e6d985311d", "tag": "643c1014-64a1-438d-9006-982466b4fc54"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:38.695330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-653ef662-6c64-4f94-accf-c376ad926c4f req-e322e477-e025-49a4-9f5d-374294609c36 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:38.699492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-653ef662-6c64-4f94-accf-c376ad926c4f req-e322e477-e025-49a4-9f5d-374294609c36 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:38.700867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-653ef662-6c64-4f94-accf-c376ad926c4f req-e322e477-e025-49a4-9f5d-374294609c36 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:38.736041 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-653ef662-6c64-4f94-accf-c376ad926c4f req-e322e477-e025-49a4-9f5d-374294609c36 service nova] Creating event network-changed:643c1014-64a1-438d-9006-982466b4fc54 for instance 21e9e5be-9e32-418d-89b7-e2e6d985311d on n-h1-836830-13 Aug 29 16:13:38.743832 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-653ef662-6c64-4f94-accf-c376ad926c4f req-e322e477-e025-49a4-9f5d-374294609c36 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118321 Aug 29 16:13:38.745399 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3010/6182] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:38.796202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:38.797066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:38.816715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:38.818194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:38.818931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:38.822158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:38.824887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:38.825637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:38.981275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:38.991156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:38.996787 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-50d0df43-3c0e-4984-8ec3-e396823882a0 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1229 microversion: 2.1 time: 0.477582 Aug 29 16:13:39.012536 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3173/6183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:38 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1229 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:39.025250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c55c44b-7e53-4a97-bc8e-30764e3b337b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1280 microversion: 2.1 time: 0.271619 Aug 29 16:13:39.030128 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3011/6184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:38 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1280 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:39.345790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:39.346568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:39.362671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:39.363365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:39.363911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:39.364725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:39.365412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:39.366066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:40.008906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:40.023564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:40.024319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:40.025475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:40.028460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:40.032389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-db0ea778-f19a-49c7-a04b-88fbf8ae328e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1406 microversion: 2.20 time: 0.690516 Aug 29 16:13:40.062344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:40.065373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:40.066160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:40.068044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:40.072324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:40.074602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:40.077271 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3174/6185] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:39 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1406 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:40.106890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:40.108472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:40.119803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:40.123062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:40.127198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:40.128664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:40.129372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:40.130015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:40.441475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:40.459016 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-260cde8e-5968-4359-9bb9-56d308ef6823 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1229 microversion: 2.1 time: 0.438602 Aug 29 16:13:40.461146 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3012/6186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:40 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1229 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:41.056441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:41.066517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:41.068350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:41.080417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:41.082304 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd6c4a2a-3217-434a-9cb3-dccb5d9aa4f3 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1322 microversion: 2.1 time: 0.996253 Aug 29 16:13:41.083132 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3175/6187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:40 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1322 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:41.085518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:41.086021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:41.087056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:41.087868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:41.088313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:41.390846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-75b99a37-2d0e-4d50-8d5b-d03a948975c6 req-951ba701-f6d2-4f72-9129-3161b4f44320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d7450c-c999-4347-b8cd-8076572ac9f4", "tag": "102959ee-77d8-4cfe-86b1-1502706d2ac8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:41.426972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-75b99a37-2d0e-4d50-8d5b-d03a948975c6 req-951ba701-f6d2-4f72-9129-3161b4f44320 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:41.427502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:41.430699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-75b99a37-2d0e-4d50-8d5b-d03a948975c6 req-951ba701-f6d2-4f72-9129-3161b4f44320 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:41.431522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-75b99a37-2d0e-4d50-8d5b-d03a948975c6 req-951ba701-f6d2-4f72-9129-3161b4f44320 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:41.441589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:41.442878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:41.444078 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6180f2d-faa7-4edf-ba8e-9a89357ce549 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1599 microversion: 2.20 time: 0.382475 Aug 29 16:13:41.444654 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3013/6188] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:13:41 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1599 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:13:41.483453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:41.483805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:41.499358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:41.499669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:41.499767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-75b99a37-2d0e-4d50-8d5b-d03a948975c6 req-951ba701-f6d2-4f72-9129-3161b4f44320 service nova] Creating event network-changed:102959ee-77d8-4cfe-86b1-1502706d2ac8 for instance 59d7450c-c999-4347-b8cd-8076572ac9f4 on n-h1-836830-13 Aug 29 16:13:41.500116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:41.500822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:41.501260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:41.501693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:41.511654 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-75b99a37-2d0e-4d50-8d5b-d03a948975c6 req-951ba701-f6d2-4f72-9129-3161b4f44320 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127478 Aug 29 16:13:41.527322 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3176/6189] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:13:41.562247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:41.575623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:41.591921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:41.592414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:41.592847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:41.593550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:41.593990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:41.594576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:41.729787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:41.750884 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77f3b4c8-6778-4c86-b0d5-e5da5a5df4e4 tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1229 microversion: 2.1 time: 0.208482 Aug 29 16:13:41.768603 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3177/6190] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:41 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1229 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:41.828150 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11bffe1a-c1da-4763-8b45-4c7da5541685 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.351352 Aug 29 16:13:41.828888 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3014/6191] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 16:13:41 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:42.103359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:42.104562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:42.110888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:42.111618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:42.112226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:42.113189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:42.113798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:42.114379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:42.297873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:42.308002 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc1e95d7-88c1-4e4c-96a0-9b33ca7b8b1e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1322 microversion: 2.1 time: 0.208998 Aug 29 16:13:42.308595 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3178/6192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:42 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:42.803946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:42.804633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:42.814363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:42.814900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:42.815692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:42.816670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:42.817332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:42.818387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:42.866218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:42.869842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:42.871044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:42.876096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lazy-loading 'fault' on Instance uuid a24e2965-1e4e-487a-94ee-fcc5f60caef4 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:13:43.291989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35cca2c3486c4389a04f6a20b8d567e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b07be353bbc481cbd35a4304501c57e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:43.300905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e165754-28d9-438c-9618-7e47da02e2ae tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 200 len: 1234 microversion: 2.1 time: 0.503336 Aug 29 16:13:43.301593 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3015/6193] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:42 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 1234 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:43.334272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:43.334879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:43.342502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:43.343260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:43.343748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:43.344461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:43.344918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:43.345341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:43.492452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:43.501943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bbdf010-334b-4e82-a6bc-a614d67c6995 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1322 microversion: 2.1 time: 0.171845 Aug 29 16:13:43.515053 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3179/6194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:43 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:43.560266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-09aa362b-42f4-4e57-aea7-8cf3d05cb171 req-2761931c-6574-4b47-9426-4ec3b4f861b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:43.581333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-09aa362b-42f4-4e57-aea7-8cf3d05cb171 req-2761931c-6574-4b47-9426-4ec3b4f861b9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:43.582147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-09aa362b-42f4-4e57-aea7-8cf3d05cb171 req-2761931c-6574-4b47-9426-4ec3b4f861b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:43.582817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-09aa362b-42f4-4e57-aea7-8cf3d05cb171 req-2761931c-6574-4b47-9426-4ec3b4f861b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:43.597190 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-09aa362b-42f4-4e57-aea7-8cf3d05cb171 req-2761931c-6574-4b47-9426-4ec3b4f861b9 service nova] Creating event network-changed:e4bfbf99-90f2-4df5-acc6-3031e3a7f32a for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 on n-h2-836830-13 Aug 29 16:13:43.611941 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-09aa362b-42f4-4e57-aea7-8cf3d05cb171 req-2761931c-6574-4b47-9426-4ec3b4f861b9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056376 Aug 29 16:13:43.614253 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3016/6195] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:43.902412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:43.903037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:43.909245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:43.910522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:43.911278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:43.912176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:43.913352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:43.914460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.072966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:44.081515 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6cd7e008-70c8-4cd9-9838-05258c0d0f4c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1680 microversion: 2.1 time: 0.344742 Aug 29 16:13:44.082992 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3180/6196] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:43 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1680 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:44.200732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:44.203560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:44.213596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.214786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.215699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.216648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.217240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.217808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.319370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e1ab49d-a3ac-47a3-b2fe-a78693cee199 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action" status: 200 len: 32642 microversion: 2.1 time: 0.122772 Aug 29 16:13:44.328986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:44.330619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] [instance: a24e2965-1e4e-487a-94ee-fcc5f60caef4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:44.331302 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3017/6197] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:13:44 2022] POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action => generated 32642 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:13:44.341777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.345503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.346496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.347852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.348609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.349250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.375120 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] HTTP exception thrown: Instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 could not be found. Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Request method failure captured: Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 HTTP/1.1 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDORJUkmF-vFbZiIQ3HmqznVP7yfAhzNj3AN4DlaFeurKz1lj-Gc8DTlYeSJrWwh65pjAxafN_H1j5ZhgL1etHtQ0dsl-fcdhff-gMaWqNELLjDy4r6HriOXU3w0ayugeCfP2ibKQuXXB1irZgY1yuGzaHB2-m5dyNqur5TvmCP2vRSc Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 7b07be353bbc481cbd35a4304501c57e Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBackupRestore-1216255915 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7b07be353bbc481cbd35a4304501c57e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_7b07be353bbc481cbd35a4304501c57e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/7b07be353bbc481cbd35a4304501c57e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/7b07be353bbc481cbd35a4304501c57e"}]}] Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBackupRestore-1216255915 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 7b07be353bbc481cbd35a4304501c57e Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1216255915 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBackupRestore-1216255915-project Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 35cca2c3486c4389a04f6a20b8d567e9 Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBackupRestore-1216255915-project Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 could not be found. Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'a24e2965-1e4e-487a-94ee-fcc5f60caef4'} Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 could not be found. Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 could not be found. Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:13:44.380489 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 could not be found. Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Returning 404 to user: Instance a24e2965-1e4e-487a-94ee-fcc5f60caef4 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:13:44.384624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d324adbe-da4a-4a18-bbe7-5f0a34d7c67a tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4" status: 404 len: 111 microversion: 2.1 time: 0.063027 Aug 29 16:13:44.387389 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3181/6198] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:44 2022] GET /compute/v2.1/servers/a24e2965-1e4e-487a-94ee-fcc5f60caef4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:13:44.472926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:44.473869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:44.485122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.485617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.486049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.486751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.487233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.487893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.525707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:44.526467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:44.528709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:44.529437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:44.561945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.562677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.563170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.564147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.564733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.565199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.785487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:44.816684 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ff14571-ceef-4fb4-96b8-32981e09730b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1322 microversion: 2.1 time: 0.295736 Aug 29 16:13:44.819992 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3182/6199] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:44 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:44.824128 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13d807fe-6257-4384-9afa-4ab79d301cc0 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1833 microversion: 2.1 time: 0.355490 Aug 29 16:13:44.833677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3339faf8-60a0-4cb2-8d5b-40fdbfea3a1c tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] Calling method '.version_select at 0x7f32ed0e05e0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:44.840191 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3018/6200] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:44 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1833 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:44.863053 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3339faf8-60a0-4cb2-8d5b-40fdbfea3a1c tempest-TestVolumeBackupRestore-1216255915 tempest-TestVolumeBackupRestore-1216255915-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-449373120" status: 202 len: 0 microversion: 2.1 time: 0.041617 Aug 29 16:13:44.863988 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3183/6201] 10.222.0.83 () {58 vars in 1266 bytes} [Mon Aug 29 16:13:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-449373120 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:13:44.864193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:44.867546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:44.877108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.877620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.878067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.878775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:44.879268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:44.879700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:44.907690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lazy-loading 'flavor' on Instance uuid bc8e79c5-da97-4231-989f-22816d6612cd {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:13:44.923043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Going to try to live migrate instance to another host {{(pid=129132) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 29 16:13:45.037207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:45.846462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:45.848043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:45.856262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:45.857000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:45.857785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:45.869863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:45.871485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:45.872180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:46.094756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:46.115671 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ce11146-3db8-4b3c-812f-8021462b0a95 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1322 microversion: 2.1 time: 0.276673 Aug 29 16:13:46.128084 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3184/6202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:45 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:47.139656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:47.140254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:47.167482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:47.169525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:47.175782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:47.178038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:47.178929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:47.179476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:47.579787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:47.582432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:47.593795 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-886434b2-a1be-411e-ada7-345c38a88a36 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1322 microversion: 2.1 time: 0.458237 Aug 29 16:13:47.604662 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3185/6203] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:47 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:47.615130 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-945177fc-2699-4fa4-b1ae-c15d4d10e2c5 tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action" status: 202 len: 0 microversion: 2.1 time: 2.755156 Aug 29 16:13:47.615780 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3019/6204] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:13:44 2022] POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action => generated 0 bytes in 2757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:13:47.632311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:47.632818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:47.649331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-30c2654d-e5f5-4d74-8a81-e4d8b2b81b1a req-e4f37264-fb04-4125-959d-a83bf9ab6d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7450c-c999-4347-b8cd-8076572ac9f4", "name": "network-vif-plugged", "status": "completed", "tag": "102959ee-77d8-4cfe-86b1-1502706d2ac8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:47.667446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:47.669093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:47.669596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:47.673138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:47.678493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-30c2654d-e5f5-4d74-8a81-e4d8b2b81b1a req-e4f37264-fb04-4125-959d-a83bf9ab6d9f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:47.681694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:47.682706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-30c2654d-e5f5-4d74-8a81-e4d8b2b81b1a req-e4f37264-fb04-4125-959d-a83bf9ab6d9f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:47.684193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:47.685016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-30c2654d-e5f5-4d74-8a81-e4d8b2b81b1a req-e4f37264-fb04-4125-959d-a83bf9ab6d9f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:47.718975 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-30c2654d-e5f5-4d74-8a81-e4d8b2b81b1a req-e4f37264-fb04-4125-959d-a83bf9ab6d9f service nova] Creating event network-vif-plugged:102959ee-77d8-4cfe-86b1-1502706d2ac8 for instance 59d7450c-c999-4347-b8cd-8076572ac9f4 on n-h1-836830-13 Aug 29 16:13:47.738607 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-30c2654d-e5f5-4d74-8a81-e4d8b2b81b1a req-e4f37264-fb04-4125-959d-a83bf9ab6d9f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093923 Aug 29 16:13:47.766325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3020/6205] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:48.012983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:48.022730 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9446f89-6376-4587-acc5-d1fecdb98d67 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.398744 Aug 29 16:13:48.023360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3186/6206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:47 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:48.616563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:48.617330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:48.638554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:48.639264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:48.639709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:48.640711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:48.641379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:48.651730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:48.939453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:48.972823 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab318d66-923a-4798-bb70-a28eaea79f66 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1322 microversion: 2.1 time: 0.355115 Aug 29 16:13:48.974620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3021/6207] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:48 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:49.050930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:49.051460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:49.062676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:49.066371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:49.069814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:49.071663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:49.072424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:49.073980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:49.560859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:49.573446 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-460c467a-9c41-4b6d-9108-ac0c85986c9b tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.527436 Aug 29 16:13:49.576281 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3187/6208] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:49 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:49.911374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9dc205d5-e02c-4485-896e-efc393ddd0eb req-d9d6f63c-00fa-4d06-ba51-498b5950a531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8e79c5-da97-4231-989f-22816d6612cd", "name": "network-vif-unplugged", "status": "completed", "tag": "98c2fb7e-c6fa-42db-b01d-706843714612"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:49.936818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9dc205d5-e02c-4485-896e-efc393ddd0eb req-d9d6f63c-00fa-4d06-ba51-498b5950a531 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:49.937313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9dc205d5-e02c-4485-896e-efc393ddd0eb req-d9d6f63c-00fa-4d06-ba51-498b5950a531 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:49.937734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9dc205d5-e02c-4485-896e-efc393ddd0eb req-d9d6f63c-00fa-4d06-ba51-498b5950a531 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:49.970071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9dc205d5-e02c-4485-896e-efc393ddd0eb req-d9d6f63c-00fa-4d06-ba51-498b5950a531 service nova] Creating event network-vif-unplugged:98c2fb7e-c6fa-42db-b01d-706843714612 for instance bc8e79c5-da97-4231-989f-22816d6612cd on n-h2-836830-13 Aug 29 16:13:49.977678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9dc205d5-e02c-4485-896e-efc393ddd0eb req-d9d6f63c-00fa-4d06-ba51-498b5950a531 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069879 Aug 29 16:13:49.978842 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3022/6209] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:49.999608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:50.000676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:50.010922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.018818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.019807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:50.022682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.024000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.026463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:50.416121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:50.439896 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0912f288-bb68-4cf8-b760-3b97e027d788 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1517 microversion: 2.1 time: 0.444571 Aug 29 16:13:50.441524 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3188/6210] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:49 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1517 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:50.465672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:50.469444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:50.476396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.477079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.477620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:50.478493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.479092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.479598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:50.544059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lazy-loading 'flavor' on Instance uuid 59d7450c-c999-4347-b8cd-8076572ac9f4 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:13:50.605748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:50.606383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:50.619884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.620384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.620828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:50.621537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.623151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.623151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:50.745349 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ac2ca54-abe5-4e44-8754-cf1437aa0169 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action" status: 200 len: 32 microversion: 2.1 time: 0.280898 Aug 29 16:13:50.749035 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3023/6211] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:13:50 2022] POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:13:50.771880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:50.773039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:50.788637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.790303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.791672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:50.792745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:50.793441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:50.794351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:51.060357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:51.063487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:51.079481 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9ab8812-a17a-449f-9c44-5160d31a2781 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.324466 Aug 29 16:13:51.080443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3024/6212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:50 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:51.143534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:51.154452 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54acebaf-d19c-4a9d-8560-afdc039c9fe2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.555737 Aug 29 16:13:51.155994 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3189/6213] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:50 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:13:52.110465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:52.115940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ec6c1e2e-c443-40d0-a9ec-9d1f183f9f0d req-6605bf2b-6c98-497b-8f69-72a160940798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8e79c5-da97-4231-989f-22816d6612cd", "tag": "98c2fb7e-c6fa-42db-b01d-706843714612"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:13:52.117243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:52.133918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:52.134420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:52.134866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:52.134980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ec6c1e2e-c443-40d0-a9ec-9d1f183f9f0d req-6605bf2b-6c98-497b-8f69-72a160940798 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:52.135588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:52.136048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:52.136475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:52.136696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ec6c1e2e-c443-40d0-a9ec-9d1f183f9f0d req-6605bf2b-6c98-497b-8f69-72a160940798 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:52.137339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ec6c1e2e-c443-40d0-a9ec-9d1f183f9f0d req-6605bf2b-6c98-497b-8f69-72a160940798 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:52.153583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ec6c1e2e-c443-40d0-a9ec-9d1f183f9f0d req-6605bf2b-6c98-497b-8f69-72a160940798 service nova] Creating event network-changed:98c2fb7e-c6fa-42db-b01d-706843714612 for instance bc8e79c5-da97-4231-989f-22816d6612cd on n-h2-836830-13 Aug 29 16:13:52.167348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ec6c1e2e-c443-40d0-a9ec-9d1f183f9f0d req-6605bf2b-6c98-497b-8f69-72a160940798 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062908 Aug 29 16:13:52.168595 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3190/6214] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:13:52.179861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:52.180944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:52.190013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:52.191139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:52.191810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:52.193039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:52.193762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:52.194419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:52.449440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:52.465147 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-90486c5f-3efd-4a5f-81f9-bb0225d0d72c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.367705 Aug 29 16:13:52.465741 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3025/6215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:52 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:52.942607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:52.953058 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1c3cd5f-bfae-4d2b-beff-bcd0864bb499 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.779525 Aug 29 16:13:52.953991 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3191/6216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:52 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:53.487664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:53.488953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:53.498418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:53.499254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:53.499911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:53.500880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:53.501528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:53.502219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:53.709675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:53.718489 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a776a4b7-6427-4e42-8630-3f67a9e616ca tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.234747 Aug 29 16:13:53.719126 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3026/6217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:53 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:53.977713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:53.979926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:53.987425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:53.988107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:53.988705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:53.989963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:53.990563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:53.991204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:54.171055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:54.183599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b6ce4cf7-81f9-45f7-b997-3a37636a5c71 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.210204 Aug 29 16:13:54.184650 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3192/6218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:53 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:54.740985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:54.741603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:54.754334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:54.755064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:54.755637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:54.756592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:54.757179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:54.757756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:54.999090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:55.028415 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f7e821cb-d8ee-40d0-bc3e-b05d96405354 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.292340 Aug 29 16:13:55.037548 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3027/6219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:54 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:55.209368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:55.210555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:55.218719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:55.223885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:55.225075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:55.225825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:55.236686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:55.239758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:55.531950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:55.541091 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b880e0ce-9f08-4cea-8a12-4f7f9647fbdf tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.337702 Aug 29 16:13:55.542468 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3193/6220] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:55 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:56.061479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:56.062854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:56.082320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:56.083036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:56.083637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:56.084948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:56.085538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:56.086259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:56.333312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:56.342937 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c4a31e3-a78d-466f-8e75-7d8803a81a06 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.296014 Aug 29 16:13:56.343576 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3028/6221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:56 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:56.565967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:56.566825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:56.578690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:56.579377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:56.579916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:56.580666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:56.581134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:56.581566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:56.756100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:56.768353 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67255a0e-a589-422d-9d25-6dd73f2ac6f4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.206697 Aug 29 16:13:56.775823 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3194/6222] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:56 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:57.367342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:57.369636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:57.376648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:13:57.378156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:57.378879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:57.379642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:57.380579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:57.381235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:57.382020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:57.690911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:57.701952 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4c3bac4a-4e8b-4278-b8a3-f8c735564df6 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.339150 Aug 29 16:13:57.703244 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3029/6223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:57 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:57.790569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:57.791469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:57.798520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:57.799312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:57.800705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:57.801785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:57.802241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:57.802892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:57.987582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:57.997812 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-239aad1a-2847-4a48-b54f-3dfed8449c81 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.211873 Aug 29 16:13:58.012188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3195/6224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:57 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:58.725531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:58.727716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:58.736476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:58.737185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:58.737768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:58.738766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:58.739398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:58.740008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:59.010674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:59.023558 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a1ae7261-aa70-48f4-8485-33a4f67e9094 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.298855 Aug 29 16:13:59.023862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:13:59.025238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:13:59.034617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:59.035865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:59.036472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:59.037426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:13:59.038045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:13:59.038661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:13:59.042122 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3030/6225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:58 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:13:59.331579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:13:59.354041 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8f72696-cb67-4b2c-8550-d3c7e0db1a6c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1690 microversion: 2.1 time: 0.331842 Aug 29 16:13:59.356703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3196/6226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:13:59 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1690 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:00.045480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:00.046332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:00.057927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.058575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.059256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.059716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.061773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.061773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.378413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:00.385826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:00.387151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:00.389131 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-261dfa61-7555-4a8d-a802-a772e30ab65e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.347679 Aug 29 16:14:00.393954 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3031/6227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:00 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:00.395599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.396336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.396983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.397929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.399116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.399897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.560546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:00.572677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c9355ae-c68b-49d7-9887-b448d2a728e1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1680 microversion: 2.1 time: 0.190489 Aug 29 16:14:00.573101 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3197/6228] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:00 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:00.602487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:00.603417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:00.610555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.611283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.611871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.612737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.613338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.613910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.822138 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a5a813dc-ecd4-4602-80a9-1b8203a6e30d tempest-TestNetworkAdvancedServerOps-1945701096 tempest-TestNetworkAdvancedServerOps-1945701096-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1833 microversion: 2.1 time: 0.228710 Aug 29 16:14:00.822746 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3032/6229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:00 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1833 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:00.845435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:00.846284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:00.857465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.859739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.861454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:00.863706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:00.864751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:00.865354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:01.105950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:01.115590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3107b02c-7212-42f5-9cbe-998286161f3f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1680 microversion: 2.1 time: 0.275321 Aug 29 16:14:01.127763 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3198/6230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:00 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:01.411360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:01.411989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:01.419244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:01.419737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:01.420170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:01.421075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:01.421536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:01.421959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:01.622487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:01.631326 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a917e859-3556-4955-8b9e-cfcad256f991 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.223852 Aug 29 16:14:01.631961 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3033/6231] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:01 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:02.653727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:02.655055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:02.662719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:02.663415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:02.664068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:02.665987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:02.667623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:02.679129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:02.831712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:02.841928 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67f75373-37af-4325-885d-84a2964a6571 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.192077 Aug 29 16:14:02.842515 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3199/6232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:02 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:03.284003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:03.286506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:03.295165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:03.295674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:03.296161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:03.296884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:03.297346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:03.297793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:03.354693 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad997543-93bb-4120-96fc-514341402afb tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action" status: 200 len: 38384 microversion: 2.1 time: 0.074488 Aug 29 16:14:03.355647 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3034/6233] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:03 2022] POST /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd/action => generated 38384 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:14:03.868615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:03.869251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:03.876287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:03.876899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:03.877338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:03.878043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:03.878515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:03.879137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.033126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:04.041730 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d032230f-ee65-4c6c-ac1c-efe6c3e81973 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.182488 Aug 29 16:14:04.051367 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3200/6234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:03 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:04.406642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:04.407321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:04.408798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b8d5d4dc-5d30-4195-a18f-97a06d3d250b req-270ed01f-d77f-40fe-b953-ead00e072e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8e79c5-da97-4231-989f-22816d6612cd", "tag": "98c2fb7e-c6fa-42db-b01d-706843714612"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:04.419139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b8d5d4dc-5d30-4195-a18f-97a06d3d250b req-270ed01f-d77f-40fe-b953-ead00e072e80 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:04.419628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b8d5d4dc-5d30-4195-a18f-97a06d3d250b req-270ed01f-d77f-40fe-b953-ead00e072e80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:04.420090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b8d5d4dc-5d30-4195-a18f-97a06d3d250b req-270ed01f-d77f-40fe-b953-ead00e072e80 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.434657 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b8d5d4dc-5d30-4195-a18f-97a06d3d250b req-270ed01f-d77f-40fe-b953-ead00e072e80 service nova] Creating event network-changed:98c2fb7e-c6fa-42db-b01d-706843714612 for instance bc8e79c5-da97-4231-989f-22816d6612cd on n-h1-836830-13 Aug 29 16:14:04.438360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:04.438852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:04.439372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.439748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b8d5d4dc-5d30-4195-a18f-97a06d3d250b req-270ed01f-d77f-40fe-b953-ead00e072e80 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035417 Aug 29 16:14:04.440065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:04.440516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:04.440878 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3201/6235] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:04.441200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.477513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:14:04.616273 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7138e007-d288-4de7-ae2a-74de4daa312c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 204 len: 0 microversion: 2.1 time: 0.213333 Aug 29 16:14:04.617043 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3035/6236] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:14:04 2022] DELETE /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:14:04.630270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:04.631377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:04.642022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:04.643574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:04.644179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.645662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:04.646434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:04.647667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:04.928495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:04.939841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8a3d362-2a9d-4479-9b93-9ef2885cc344 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1686 microversion: 2.1 time: 0.315358 Aug 29 16:14:04.940437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3202/6237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:04 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1686 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:05.067426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:05.068145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:05.089295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:05.090115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:05.090731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:05.092869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:05.094588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:05.098534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:05.490610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:05.501814 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4896f6f2-e441-4d99-95cb-c2bdfb62888e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.440511 Aug 29 16:14:05.502495 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3036/6238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:05 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:05.965378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:05.966026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:05.973681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:05.974411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:05.975227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:05.976094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:05.977762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:05.978403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:06.021142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:06.021720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:06.022191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:06.022778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lazy-loading 'fault' on Instance uuid bc8e79c5-da97-4231-989f-22816d6612cd {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:14:06.026777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:06.107815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:06.119852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79e076ad-937d-4937-815e-5cdebe171395 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 200 len: 1354 microversion: 2.1 time: 0.159400 Aug 29 16:14:06.120683 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3203/6239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:05 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 1354 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:06.456199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5b710c90-d550-4111-a92b-28bc10bf8d3a req-ecf501ca-5bd2-4215-9e43-dc319e6ef7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8e79c5-da97-4231-989f-22816d6612cd", "name": "network-vif-deleted", "tag": "98c2fb7e-c6fa-42db-b01d-706843714612"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:06.468228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5b710c90-d550-4111-a92b-28bc10bf8d3a req-ecf501ca-5bd2-4215-9e43-dc319e6ef7b9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:06.468717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5b710c90-d550-4111-a92b-28bc10bf8d3a req-ecf501ca-5bd2-4215-9e43-dc319e6ef7b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:06.469146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5b710c90-d550-4111-a92b-28bc10bf8d3a req-ecf501ca-5bd2-4215-9e43-dc319e6ef7b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:06.480322 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-5b710c90-d550-4111-a92b-28bc10bf8d3a req-ecf501ca-5bd2-4215-9e43-dc319e6ef7b9 service nova] Creating event network-vif-deleted:98c2fb7e-c6fa-42db-b01d-706843714612 for instance bc8e79c5-da97-4231-989f-22816d6612cd on n-h1-836830-13 Aug 29 16:14:06.485174 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5b710c90-d550-4111-a92b-28bc10bf8d3a req-ecf501ca-5bd2-4215-9e43-dc319e6ef7b9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032949 Aug 29 16:14:06.485942 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3037/6240] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:06.523244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:06.524125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:06.530651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:06.531227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:06.531696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:06.532442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:06.532933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:06.533365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:06.726537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:06.737016 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c8630008-742f-41c9-839b-a1e0c807cb77 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.217738 Aug 29 16:14:06.738069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3204/6241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:06 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:07.142475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:07.143314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: bc8e79c5-da97-4231-989f-22816d6612cd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:07.152598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:07.153103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:07.153547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:07.154473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:07.154937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:07.155412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:07.170601 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] HTTP exception thrown: Instance bc8e79c5-da97-4231-989f-22816d6612cd could not be found. Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Request method failure captured: Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd HTTP/1.1 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDONG2yb9mOHKeSltTvDyEcQiLtYQbcBPTxy0x3FxNBGEXH1-i_wA8cuOZwd2nh_mlieUYhV6h68joQSnzP2mBZSWo_OXVfZhWFJZt3PmVDpW23gIlfq-AEevegrGoX_S4C-hfVnJi8_8nBLzj4KsqpP-tAe80eHDwGKZwj5vloWUvXM Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_18bd3c1e18644293a3cc974c300efd06", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/18bd3c1e18644293a3cc974c300efd06"}]}] Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e1ce5d3d668743d5b8843936f77c0150 Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance bc8e79c5-da97-4231-989f-22816d6612cd could not be found. Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'bc8e79c5-da97-4231-989f-22816d6612cd'} Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8e79c5-da97-4231-989f-22816d6612cd could not be found. Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8e79c5-da97-4231-989f-22816d6612cd could not be found. Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:07.172351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8e79c5-da97-4231-989f-22816d6612cd could not be found. Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Returning 404 to user: Instance bc8e79c5-da97-4231-989f-22816d6612cd could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:07.176080 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa31b647-617b-45f6-a7d8-cb7139ed13b0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd" status: 404 len: 111 microversion: 2.1 time: 0.036386 Aug 29 16:14:07.178139 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3038/6242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:07 2022] GET /compute/v2.1/servers/bc8e79c5-da97-4231-989f-22816d6612cd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:14:07.759354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:07.760315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:07.767299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:07.767879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:07.768370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:07.769166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:07.769715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:07.770195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:07.934721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:07.955983 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98ba0e8d-2efc-4343-ac20-7bf05e618446 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.201510 Aug 29 16:14:07.957233 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3205/6243] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:07 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:08.979688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:08.980849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:08.988412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:08.988932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:08.989702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:08.990411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:08.991035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:08.991496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:09.440402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:09.449046 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de249efa-b05a-4c79-9129-ff6d03d9fe7c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.475090 Aug 29 16:14:09.449648 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3039/6244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:08 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:10.471286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:10.472496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:10.476496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:10.481818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:10.482518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:10.483133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:10.484017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:10.484621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:10.485195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:10.735553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:10.753491 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c121a86b-6cb1-47b9-b33e-0526ae419106 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.285941 Aug 29 16:14:10.754503 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3206/6245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:10 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:11.778009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:11.778809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:11.795907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:11.797658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:11.799083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:11.802665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:11.804282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:11.813290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:12.233756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:12.248457 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3795a0ca-e098-4c5f-bc23-3a1d9cfde342 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.474830 Aug 29 16:14:12.250737 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3040/6246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:11 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:13.271644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:13.272278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:13.282690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:13.283220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:13.283666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:13.284382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:13.284898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:13.285256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:13.741718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:13.757013 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-482d76d0-a4ab-4942-885e-8c9201032815 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.489543 Aug 29 16:14:13.759494 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3207/6247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:13 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:14.787079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:14.788184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:14.829226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:14.830006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:14.830747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:14.838623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:14.839463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:14.840216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:14.853703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5954b9f8-ab6a-44f7-9688-cec65b840bd5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '.version_select at 0x7f32ee2bf0d0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:14.969285 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5954b9f8-ab6a-44f7-9688-cec65b840bd5 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-15941267" status: 202 len: 0 microversion: 2.1 time: 0.122626 Aug 29 16:14:14.970307 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3208/6248] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-15941267 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:15.000501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef92d034-e921-49e5-8b18-6ee2ad561438 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: .version_select at 0x7f32ed0e0ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1360284420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD81OtrHYhHTSS9UlARZh1phxByeU1pjCajRDx9LZ4OYHsAO5V8TqJ5bKQtT1WVyJKqsjf8DF+oztoA7GxSuRactX9PhkRIcYCYfhS4CzsGelQPtkhUd76cjVUb2A8bKfA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:15.004592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:15.129478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ef92d034-e921-49e5-8b18-6ee2ad561438 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:15.144471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ef92d034-e921-49e5-8b18-6ee2ad561438 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:15.234334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef92d034-e921-49e5-8b18-6ee2ad561438 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.241509 Aug 29 16:14:15.235735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3209/6249] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:14:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:15.360934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:15.370469 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fdece555-8818-4744-aef0-9165479b745d tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.591208 Aug 29 16:14:15.371731 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3041/6250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:14 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:16.397452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:16.399698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:16.417900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:16.419103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:16.419799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:16.421291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:16.422823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:16.424426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:16.750161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:16.761883 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75df4200-6da1-4bb7-89e4-232f8e8cab1c tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.370248 Aug 29 16:14:16.763806 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3210/6251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:16 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:16.979010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1508973600", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "c69c7ea0-a38e-4254-afbc-00bae9ca0ad7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1486936364", "security_groups": []}, "os:scheduler_hints": {"different_host": ["21e9e5be-9e32-418d-89b7-e2e6d985311d"]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:17.045895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] validate_networks() for [('c69c7ea0-a38e-4254-afbc-00bae9ca0ad7', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:14:17.786225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:17.788483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:17.809732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:17.810546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:17.811217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:17.812179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:17.812827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:17.813788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:18.094778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:18.103791 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-190d995a-9a1c-4f28-b4c8-6d99619d5da1 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1523 microversion: 2.1 time: 0.323040 Aug 29 16:14:18.107862 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3211/6252] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:17 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:18.155018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:14:18.156393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:14:18.157078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:14:18.157683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:14:18.158925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:14:18.170393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:18.171138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:18.171730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:18.172643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:18.173255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:18.173984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:18.198498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Getting quotas for project e8971b1ee2b842588adbd7dc5d7552a0. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:18.206500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Getting quotas for user 86ff3f40c7224251ae1346fc60f361f9 and project e8971b1ee2b842588adbd7dc5d7552a0. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:18.225932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:14:18.229243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:14:18.284043 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f6184ef7-f383-421f-876d-097db3f022e0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.311355 Aug 29 16:14:18.285633 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3042/6253] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:16 2022] POST /compute/v2.1/servers => generated 361 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:14:18.296556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dcde69e2-822a-4dc3-b044-bd1dc1b23e7a tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:18.297397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dcde69e2-822a-4dc3-b044-bd1dc1b23e7a tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:18.414118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dcde69e2-822a-4dc3-b044-bd1dc1b23e7a tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:18.428980 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dcde69e2-822a-4dc3-b044-bd1dc1b23e7a tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1242 microversion: 2.1 time: 0.135916 Aug 29 16:14:18.430771 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3212/6254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:18 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:19.141755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:19.143310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:19.160287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:19.161484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:19.162708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:19.163650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:19.164384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:19.164985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:19.455609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:19.457077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:19.469094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:19.470147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:19.470829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:19.472734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:19.473613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:19.474325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:19.621132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:19.637433 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01c5813a-358c-47da-b8a9-42809b61a7ea tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1294 microversion: 2.1 time: 0.187073 Aug 29 16:14:19.638976 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3213/6255] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:19 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:19.691899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:19.710403 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e9a09b64-1f15-4e3d-85a7-bc68c2623320 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1503 microversion: 2.1 time: 0.585428 Aug 29 16:14:19.713176 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3043/6256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:19 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1503 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:19.740693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aaa19959-cde3-48d8-a382-89351a80f7de tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'create', calling method: .version_select at 0x7f32ed94d790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1886984326", "description": "tempest-description-1306376031"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:20.057060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aaa19959-cde3-48d8-a382-89351a80f7de tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.323850 Aug 29 16:14:20.057626 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3214/6257] 10.222.0.83 () {60 vars in 1180 bytes} [Mon Aug 29 16:14:19 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:20.073096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1886984326"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:20.073943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:20.083284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:20.084040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:20.084639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:20.085511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:20.087472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:20.088085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:20.572620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.network.security_group_api [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Adding security group 44099aad-cef3-41c4-b623-1e8e630ddff3 to port 102959ee-77d8-4cfe-86b1-1502706d2ac8 Aug 29 16:14:20.662563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:20.663840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:20.682016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:20.682461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:20.682906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:20.683664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:20.684127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:20.684566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:20.814348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:20.847721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7e773eec-175a-4dce-a25d-49059e61a154 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.190018 Aug 29 16:14:20.850366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3215/6258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:20 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:21.876634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:21.877342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:21.901415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:21.901976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:21.913026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:21.931571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:21.938272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:21.939262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:22.140513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:22.163382 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9aa1075a-c908-4e5d-8d89-4800b8123aff tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.288119 Aug 29 16:14:22.178885 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3216/6259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:21 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:22.498085 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-227075f5-8361-4492-806f-bdd4e93ffc3b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action" status: 202 len: 0 microversion: 2.1 time: 2.431127 Aug 29 16:14:22.498709 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3044/6260] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:20 2022] POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action => generated 0 bytes in 2433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:22.507338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1886984326"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:22.508586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:22.518377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:22.518877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:22.525601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:22.526344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:22.526833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:22.527309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:22.552169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4fbe6d98-d1c8-4da7-8461-ce2289eb9fbc req-c0d169ad-798d-4c20-b36a-0d7d28ab0cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d7450c-c999-4347-b8cd-8076572ac9f4", "tag": "102959ee-77d8-4cfe-86b1-1502706d2ac8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:22.584681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4fbe6d98-d1c8-4da7-8461-ce2289eb9fbc req-c0d169ad-798d-4c20-b36a-0d7d28ab0cea service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:22.585175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4fbe6d98-d1c8-4da7-8461-ce2289eb9fbc req-c0d169ad-798d-4c20-b36a-0d7d28ab0cea service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:22.596548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4fbe6d98-d1c8-4da7-8461-ce2289eb9fbc req-c0d169ad-798d-4c20-b36a-0d7d28ab0cea service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:22.627954 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4fbe6d98-d1c8-4da7-8461-ce2289eb9fbc req-c0d169ad-798d-4c20-b36a-0d7d28ab0cea service nova] Creating event network-changed:102959ee-77d8-4cfe-86b1-1502706d2ac8 for instance 59d7450c-c999-4347-b8cd-8076572ac9f4 on n-h1-836830-13 Aug 29 16:14:22.634917 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4fbe6d98-d1c8-4da7-8461-ce2289eb9fbc req-c0d169ad-798d-4c20-b36a-0d7d28ab0cea service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086807 Aug 29 16:14:22.635956 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3045/6261] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:22.876463 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.network.security_group_api [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Removing security group 44099aad-cef3-41c4-b623-1e8e630ddff3 from port 102959ee-77d8-4cfe-86b1-1502706d2ac8 Aug 29 16:14:23.189140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:23.189846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:23.203098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:23.203870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:23.211814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:23.212847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:23.213472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:23.214061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:23.724507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:23.737163 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7b8e63c3-3f90-4978-acf5-5286d595ac01 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.553869 Aug 29 16:14:23.758964 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3046/6262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:23 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:24.011510 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-210ec015-9fc5-4358-abc1-55b074568e87 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action" status: 202 len: 0 microversion: 2.1 time: 1.508259 Aug 29 16:14:24.013439 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3217/6263] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:22 2022] POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action => generated 0 bytes in 1511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:24.026243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f172a12a-c6c6-49a1-b840-163ba3d4e43a tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'create', calling method: .version_select at 0x7f32ee3c4280>, body: {"pool": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:24.304602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-27faafeb-f4b5-4eb0-a823-e596ffc3f8d2 req-59cab126-7a66-43ef-8ec6-5ff4e9c51da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d7450c-c999-4347-b8cd-8076572ac9f4", "tag": "102959ee-77d8-4cfe-86b1-1502706d2ac8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:24.319490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-27faafeb-f4b5-4eb0-a823-e596ffc3f8d2 req-59cab126-7a66-43ef-8ec6-5ff4e9c51da1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:24.320504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-27faafeb-f4b5-4eb0-a823-e596ffc3f8d2 req-59cab126-7a66-43ef-8ec6-5ff4e9c51da1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:24.321468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-27faafeb-f4b5-4eb0-a823-e596ffc3f8d2 req-59cab126-7a66-43ef-8ec6-5ff4e9c51da1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:24.341687 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-27faafeb-f4b5-4eb0-a823-e596ffc3f8d2 req-59cab126-7a66-43ef-8ec6-5ff4e9c51da1 service nova] Creating event network-changed:102959ee-77d8-4cfe-86b1-1502706d2ac8 for instance 59d7450c-c999-4347-b8cd-8076572ac9f4 on n-h1-836830-13 Aug 29 16:14:24.355006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-27faafeb-f4b5-4eb0-a823-e596ffc3f8d2 req-59cab126-7a66-43ef-8ec6-5ff4e9c51da1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285105 Aug 29 16:14:24.359821 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3218/6264] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:24.765826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:24.766763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:24.785758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:24.786506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:24.788149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:24.797687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:24.801479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:24.803740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:24.996892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:25.005547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31f74de5-7908-429b-9a26-e9ccec37c49e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.243972 Aug 29 16:14:25.008731 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3219/6265] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:24 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:25.894282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1725792325", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "3348a555-c147-4d42-9ef2-7b71b62d2812"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1360284420", "security_groups": [{"name": "tempest-secgroup-smoke-334820799"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:26.051554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] validate_networks() for [('3348a555-c147-4d42-9ef2-7b71b62d2812', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:14:26.888907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:14:26.889396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:14:26.890036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:14:26.890454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:14:26.890948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:14:26.925403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:26.926859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:26.927889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:26.929530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:26.931770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:26.936662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:26.962798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:26.969314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Getting quotas for user e1ce5d3d668743d5b8843936f77c0150 and project 18bd3c1e18644293a3cc974c300efd06. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:26.992328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:14:26.995570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:14:27.060332 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-81c9db59-0e8b-433b-9a09-c9ecb39af9c1 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.169887 Aug 29 16:14:27.061286 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3220/6266] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:14:27.068345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:27.069245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:27.085175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:27.087643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:27.088319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:27.089257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:27.092979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:27.093880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:27.284998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:27.295315 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da51fb2a-de36-4cb7-9877-3299a9c8dae9 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.232170 Aug 29 16:14:27.308414 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3221/6267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:27 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:27.316850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9f0d80cc-1885-4c4a-8057-865abfd76b06 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:27.318332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9f0d80cc-1885-4c4a-8057-865abfd76b06 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:27.401499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9f0d80cc-1885-4c4a-8057-865abfd76b06 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:27.410432 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9f0d80cc-1885-4c4a-8057-865abfd76b06 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1267 microversion: 2.1 time: 0.100770 Aug 29 16:14:27.426209 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3222/6268] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:27 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:28.190708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:28.215167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6cbbc031-0d95-4a54-b34c-8b1b07a06bdf req-f42b028a-8730-42fd-b472-176853e7060d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1fee37-9edc-4509-9e62-c72a6f165182", "tag": "dde1bb78-d8a7-4e84-9076-d04f6c10c923"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:28.217082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:28.235164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cbbc031-0d95-4a54-b34c-8b1b07a06bdf req-f42b028a-8730-42fd-b472-176853e7060d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:28.236382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cbbc031-0d95-4a54-b34c-8b1b07a06bdf req-f42b028a-8730-42fd-b472-176853e7060d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:28.237026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6cbbc031-0d95-4a54-b34c-8b1b07a06bdf req-f42b028a-8730-42fd-b472-176853e7060d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:28.259703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6cbbc031-0d95-4a54-b34c-8b1b07a06bdf req-f42b028a-8730-42fd-b472-176853e7060d service nova] Creating event network-changed:dde1bb78-d8a7-4e84-9076-d04f6c10c923 for instance 5a1fee37-9edc-4509-9e62-c72a6f165182 on n-h2-836830-13 Aug 29 16:14:28.266019 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6cbbc031-0d95-4a54-b34c-8b1b07a06bdf req-f42b028a-8730-42fd-b472-176853e7060d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056093 Aug 29 16:14:28.267799 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3223/6269] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:28.331113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:28.337960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:28.355471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:28.356878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:28.357770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:28.360276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:28.362671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:28.363564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:28.489702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:28.502902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-70239094-8ed0-4632-b27a-e0ea41db9670 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.186608 Aug 29 16:14:28.503932 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3224/6270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:28 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:28.509790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:28.510416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:28.522356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:28.522929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:28.523449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:28.524337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:28.524826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:28.525267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:28.634826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:28.645687 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2d9fbd5c-7fca-4834-b2fa-ad695395755e tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1319 microversion: 2.1 time: 0.140130 Aug 29 16:14:28.648025 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3225/6271] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:28 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:29.527501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:29.528121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:29.559482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:29.561537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:29.562113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:29.563074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:29.564241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:29.564683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:29.718710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:29.730732 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c69183be-5da4-4276-a8df-249759cdcc0d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.207944 Aug 29 16:14:29.732142 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3226/6272] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:29 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:29.739962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:29.741240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:29.749814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:29.751262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:29.751961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:29.752977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:29.754148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:29.754683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:29.772890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:29.845402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:29.856050 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd9e424d-e96d-4739-9825-738dbc285f4f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1325 microversion: 2.1 time: 0.122503 Aug 29 16:14:29.857129 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3227/6273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:29 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1325 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:30.503474 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f172a12a-c6c6-49a1-b840-163ba3d4e43a tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.484091 Aug 29 16:14:30.504087 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3047/6274] 10.222.0.83 () {60 vars in 1170 bytes} [Mon Aug 29 16:14:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:30.518828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.98"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:30.522355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:30.531537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.532879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.533529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.534472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.535152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.537140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.574657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "refresh_cache-59d7450c-c999-4347-b8cd-8076572ac9f4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 16:14:30.576059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquired lock "refresh_cache-59d7450c-c999-4347-b8cd-8076572ac9f4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 16:14:30.752897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:30.754227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:30.757403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:30.763894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.764414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.765212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.765939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.766400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.767046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.911661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:30.919939 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4535e122-008d-45f6-b412-36bbeeb75fc6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.170857 Aug 29 16:14:30.921012 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3048/6275] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:30 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:30.926870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:30.927693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:30.938664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.944522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.945058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:30.946447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:30.946939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:30.947404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:31.218082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:31.226990 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f32d459-483f-4076-ba9f-1ea01d53affe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.304379 Aug 29 16:14:31.228433 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3049/6276] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:30 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:31.905150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-acbfd66f-0180-4457-8734-e82b01031fb1 req-2e8b2dff-a0e9-4acc-9689-f0285c7d28ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0", "tag": "4f53a185-015c-4142-982e-3b79fd4c14df"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:31.920922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-acbfd66f-0180-4457-8734-e82b01031fb1 req-2e8b2dff-a0e9-4acc-9689-f0285c7d28ce service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:31.921654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-acbfd66f-0180-4457-8734-e82b01031fb1 req-2e8b2dff-a0e9-4acc-9689-f0285c7d28ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:31.922284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-acbfd66f-0180-4457-8734-e82b01031fb1 req-2e8b2dff-a0e9-4acc-9689-f0285c7d28ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:31.942769 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-acbfd66f-0180-4457-8734-e82b01031fb1 req-2e8b2dff-a0e9-4acc-9689-f0285c7d28ce service nova] Creating event network-changed:4f53a185-015c-4142-982e-3b79fd4c14df for instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 on n-h1-836830-13 Aug 29 16:14:31.953578 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-acbfd66f-0180-4457-8734-e82b01031fb1 req-2e8b2dff-a0e9-4acc-9689-f0285c7d28ce service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055065 Aug 29 16:14:31.954196 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3050/6277] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:31.959991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:31.961555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:31.968755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:31.969266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:31.969695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:31.970398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:31.970875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:31.971469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:32.081029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:32.089531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac083bbf-5ef8-4dc6-9023-74aaf8703a09 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.133853 Aug 29 16:14:32.090322 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3051/6278] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:31 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:32.251963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:32.252595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:32.262833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:32.262833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:32.262833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:32.262833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:32.268230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:32.268825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:32.426129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:32.434781 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2952d9a7-6a60-4615-81b3-12703b7b0eb8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.186970 Aug 29 16:14:32.439076 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3052/6279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:32 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:32.753918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Building network info cache for instance {{(pid=129133) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 16:14:33.111435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:33.112657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:33.125483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:33.130096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:33.130771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:33.131903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:33.132587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:33.133750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:33.302743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:33.318082 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a01bdc27-6a36-45c9-9544-c6cf78492e00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.210629 Aug 29 16:14:33.337484 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3053/6280] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:33 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:33.457489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:33.458722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:33.471657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:33.472411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:33.473107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:33.474049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:33.476117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:33.477180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:33.700287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:33.710472 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-907cba85-6015-4a25-9538-1dcf0ad6fe8d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.257160 Aug 29 16:14:33.723401 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3054/6281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:33 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:33.987937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-47e10ff4-01db-4a84-af7e-7cc5abec4c53 req-60a7b8be-f985-4cdf-8b50-0a70ae37104b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d7450c-c999-4347-b8cd-8076572ac9f4", "tag": "102959ee-77d8-4cfe-86b1-1502706d2ac8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:34.000796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-47e10ff4-01db-4a84-af7e-7cc5abec4c53 req-60a7b8be-f985-4cdf-8b50-0a70ae37104b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:34.001366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-47e10ff4-01db-4a84-af7e-7cc5abec4c53 req-60a7b8be-f985-4cdf-8b50-0a70ae37104b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:34.003585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-47e10ff4-01db-4a84-af7e-7cc5abec4c53 req-60a7b8be-f985-4cdf-8b50-0a70ae37104b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:34.026299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-47e10ff4-01db-4a84-af7e-7cc5abec4c53 req-60a7b8be-f985-4cdf-8b50-0a70ae37104b service nova] Creating event network-changed:102959ee-77d8-4cfe-86b1-1502706d2ac8 for instance 59d7450c-c999-4347-b8cd-8076572ac9f4 on n-h1-836830-13 Aug 29 16:14:34.032043 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-47e10ff4-01db-4a84-af7e-7cc5abec4c53 req-60a7b8be-f985-4cdf-8b50-0a70ae37104b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050241 Aug 29 16:14:34.033053 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3055/6282] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:34.347184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:34.348179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:34.368719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:34.369233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:34.369670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:34.373767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:34.374434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:34.375410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:34.544951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:34.557972 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-daf9d5c8-4aa4-4c86-ac99-25063d6a21f1 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.217007 Aug 29 16:14:34.560144 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3056/6283] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:34 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:34.734308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:34.734920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:34.752757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:34.754218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:34.755410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:34.756453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:34.757763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:34.759133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:34.957260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Updating instance_info_cache with network_info: [{"id": "102959ee-77d8-4cfe-86b1-1502706d2ac8", "address": "fa:16:3e:4e:9c:21", "network": {"id": "2b42d7d3-25ec-434d-b3eb-8da5a8256128", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2126413501-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "392f9e4adbf748c9a83ff7673fc77cb7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap102959ee-77", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129133) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 16:14:34.994264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Releasing lock "refresh_cache-59d7450c-c999-4347-b8cd-8076572ac9f4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 16:14:34.996253 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a16b11d9-a8ff-43b7-9ab3-ffe4c6f36e56 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action" status: 202 len: 0 microversion: 2.1 time: 4.482805 Aug 29 16:14:34.997354 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3228/6284] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:30 2022] POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action => generated 0 bytes in 4484 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 16:14:35.010980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.98"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:35.025490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:35.039648 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-242b589f-c742-4ed5-8d12-9c9428b29474 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.308758 Aug 29 16:14:35.053974 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3057/6285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:34 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:35.286068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:35.293180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:35.293890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:35.294515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:35.295254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:35.295854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:35.297412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:35.587918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:35.589505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:35.597245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:35.597757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:35.598203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:35.598917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:35.599405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:35.599835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:35.646966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "refresh_cache-59d7450c-c999-4347-b8cd-8076572ac9f4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 16:14:35.647645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquired lock "refresh_cache-59d7450c-c999-4347-b8cd-8076572ac9f4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 16:14:35.718205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:35.728897 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-264aaec8-9a3f-4083-800e-1bd902413ce0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.150201 Aug 29 16:14:35.730049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3058/6286] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:35 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:36.061163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:36.062031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:36.069269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:36.069772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:36.070954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:36.071879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:36.072341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:36.072934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:36.257200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:36.267004 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0abc646-7bf0-41b6-8641-45330525907c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.209657 Aug 29 16:14:36.267963 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3059/6287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:36 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:36.482028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e7c7cef3-d69a-4d07-97d8-93519792a81a req-fd0eacb9-02e5-42c3-9c1f-4e87d0741ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1fee37-9edc-4509-9e62-c72a6f165182", "name": "network-vif-plugged", "status": "completed", "tag": "dde1bb78-d8a7-4e84-9076-d04f6c10c923"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:36.492721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e7c7cef3-d69a-4d07-97d8-93519792a81a req-fd0eacb9-02e5-42c3-9c1f-4e87d0741ae4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:36.493933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e7c7cef3-d69a-4d07-97d8-93519792a81a req-fd0eacb9-02e5-42c3-9c1f-4e87d0741ae4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:36.494119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e7c7cef3-d69a-4d07-97d8-93519792a81a req-fd0eacb9-02e5-42c3-9c1f-4e87d0741ae4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:36.507638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e7c7cef3-d69a-4d07-97d8-93519792a81a req-fd0eacb9-02e5-42c3-9c1f-4e87d0741ae4 service nova] Creating event network-vif-plugged:dde1bb78-d8a7-4e84-9076-d04f6c10c923 for instance 5a1fee37-9edc-4509-9e62-c72a6f165182 on n-h2-836830-13 Aug 29 16:14:36.514285 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e7c7cef3-d69a-4d07-97d8-93519792a81a req-fd0eacb9-02e5-42c3-9c1f-4e87d0741ae4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121050 Aug 29 16:14:36.515556 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3060/6288] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:36.753123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:36.753858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:36.761962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:36.762454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:36.762890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:36.763620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:36.764079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:36.764535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:36.860550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:36.869806 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02217061-fb5a-443c-bcc3-e6f6cfbb4719 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.121261 Aug 29 16:14:36.870536 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3061/6289] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:36 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:36.948242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:37.254325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Building network info cache for instance {{(pid=129133) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 29 16:14:37.267816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f0544f1f-3fc9-4e1a-baa3-8056ba7db853 req-e88d5221-d85d-415a-b613-967890e37006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d7450c-c999-4347-b8cd-8076572ac9f4", "tag": "102959ee-77d8-4cfe-86b1-1502706d2ac8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:37.286675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f0544f1f-3fc9-4e1a-baa3-8056ba7db853 req-e88d5221-d85d-415a-b613-967890e37006 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.287540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f0544f1f-3fc9-4e1a-baa3-8056ba7db853 req-e88d5221-d85d-415a-b613-967890e37006 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.288186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f0544f1f-3fc9-4e1a-baa3-8056ba7db853 req-e88d5221-d85d-415a-b613-967890e37006 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:37.309558 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f0544f1f-3fc9-4e1a-baa3-8056ba7db853 req-e88d5221-d85d-415a-b613-967890e37006 service nova] Creating event network-changed:102959ee-77d8-4cfe-86b1-1502706d2ac8 for instance 59d7450c-c999-4347-b8cd-8076572ac9f4 on n-h1-836830-13 Aug 29 16:14:37.317198 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f0544f1f-3fc9-4e1a-baa3-8056ba7db853 req-e88d5221-d85d-415a-b613-967890e37006 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052779 Aug 29 16:14:37.318475 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3062/6290] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:37.329735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:37.330657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:37.346783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.347623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.348282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:37.349364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.350327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.351226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:37.377133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:37.409089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=14 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:37.631136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:37.647996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17a148fb-fc5c-47e5-8e50-054668cf3852 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.327777 Aug 29 16:14:37.652920 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3063/6291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:37 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:37.892401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:37.893034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:37.906568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.907824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.908447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:37.909351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:37.909955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:37.911236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.074126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:38.084662 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cdf6289f-4592-46cf-966b-e2dcf6068870 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1300 microversion: 2.1 time: 0.196756 Aug 29 16:14:38.101083 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3064/6292] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:37 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:38.174336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Updating instance_info_cache with network_info: [{"id": "102959ee-77d8-4cfe-86b1-1502706d2ac8", "address": "fa:16:3e:4e:9c:21", "network": {"id": "2b42d7d3-25ec-434d-b3eb-8da5a8256128", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2126413501-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "392f9e4adbf748c9a83ff7673fc77cb7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap102959ee-77", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=129133) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 29 16:14:38.188041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Releasing lock "refresh_cache-59d7450c-c999-4347-b8cd-8076572ac9f4" {{(pid=129133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 16:14:38.192002 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3b84022-4e39-4317-a2fc-132dcbb05979 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action" status: 202 len: 0 microversion: 2.1 time: 3.188868 Aug 29 16:14:38.196545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3229/6293] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:14:35 2022] POST /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4/action => generated 0 bytes in 3194 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 29 16:14:38.201930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6caea6b1-d0b7-4e7a-bad8-c3dc9c1c957b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '.version_select at 0x7f32ee3d0a60>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:38.530227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3ea91854-2190-43e0-8137-b22747ce3108 req-e9258527-3068-4258-8198-6e41ff3b8962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0", "name": "network-vif-plugged", "status": "completed", "tag": "4f53a185-015c-4142-982e-3b79fd4c14df"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:38.542045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3ea91854-2190-43e0-8137-b22747ce3108 req-e9258527-3068-4258-8198-6e41ff3b8962 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:38.542768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3ea91854-2190-43e0-8137-b22747ce3108 req-e9258527-3068-4258-8198-6e41ff3b8962 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:38.543229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3ea91854-2190-43e0-8137-b22747ce3108 req-e9258527-3068-4258-8198-6e41ff3b8962 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.557658 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3ea91854-2190-43e0-8137-b22747ce3108 req-e9258527-3068-4258-8198-6e41ff3b8962 service nova] Creating event network-vif-plugged:4f53a185-015c-4142-982e-3b79fd4c14df for instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 on n-h1-836830-13 Aug 29 16:14:38.562995 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3ea91854-2190-43e0-8137-b22747ce3108 req-e9258527-3068-4258-8198-6e41ff3b8962 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036539 Aug 29 16:14:38.564032 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3230/6294] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:38.677428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:38.678134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:38.687628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:38.688377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:38.688970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.689826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:38.691133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:38.691779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:38.944594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:38.956247 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-753ea341-3df3-4e5e-91d4-f34d4b5a6282 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.283782 Aug 29 16:14:38.975419 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3231/6295] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:38 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:39.112298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.113314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.148036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.150031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.154837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.155864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.158996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.161002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.368683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:39.376768 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-16f65433-8c29-4cc8-b610-abd7d0d59711 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1473 microversion: 2.1 time: 0.269786 Aug 29 16:14:39.393718 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3232/6296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1473 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:39.399919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.400856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.410658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.411975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.412576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.413447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.414634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.415247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.501049 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6caea6b1-d0b7-4e7a-bad8-c3dc9c1c957b tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "DELETE /compute/v2.1/os-floating-ips/487d0937-2a11-4e61-8054-5a60d31663ff" status: 202 len: 0 microversion: 2.1 time: 1.303061 Aug 29 16:14:39.501759 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3065/6297] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:14:38 2022] DELETE /compute/v2.1/os-floating-ips/487d0937-2a11-4e61-8054-5a60d31663ff => generated 0 bytes in 1304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:39.511968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce2aaabc-d86c-4b2f-8c1a-04e81297ecf0 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '.version_select at 0x7f32f004a820>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.536521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:39.550845 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9f2bc29a-799c-4791-bc20-0eee473b7e8e tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1473 microversion: 2.1 time: 0.154897 Aug 29 16:14:39.552532 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3233/6298] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1473 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:39.579798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.580410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.592799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.593890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.595013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.595897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.596430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.597087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.712969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3cf1fa60-77af-47af-9c13-8d58a56d5e78 tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1626 microversion: 2.1 time: 0.136853 Aug 29 16:14:39.726145 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3234/6299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1626 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:39.734767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.736127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.744449 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce2aaabc-d86c-4b2f-8c1a-04e81297ecf0 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "DELETE /compute/v2.1/os-security-groups/44099aad-cef3-41c4-b623-1e8e630ddff3" status: 202 len: 0 microversion: 2.1 time: 0.236602 Aug 29 16:14:39.744540 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3066/6300] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 16:14:39 2022] DELETE /compute/v2.1/os-security-groups/44099aad-cef3-41c4-b623-1e8e630ddff3 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:39.752179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.752687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.755408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.756168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.756844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.757844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.758500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.758985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.772050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.772776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.773262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.775009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.775532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.775974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.819211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:14:39.918385 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a7403b1-5fe0-45a4-83f7-1ed2da5365ba tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "DELETE /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 204 len: 0 microversion: 2.1 time: 0.169891 Aug 29 16:14:39.918984 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3067/6301] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:14:39 2022] DELETE /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:14:39.928020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:39.928797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:39.936228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.936741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.937184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:39.937904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:39.938375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:39.938810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.017372 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a969a6c7-0905-47a0-b7cd-02e01b13473a tempest-TestSecurityGroupsBasicOps-579377988 tempest-TestSecurityGroupsBasicOps-579377988-project-admin] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1916 microversion: 2.1 time: 0.286450 Aug 29 16:14:40.018617 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3235/6302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1916 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:40.025258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:40.026180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:40.036920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.037919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.038695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.041304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.042540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.043244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.122060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:40.140297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ceea941-e0a3-48c5-a441-34fb4544d394 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1509 microversion: 2.1 time: 0.216940 Aug 29 16:14:40.145161 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3068/6303] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:39 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:40.157248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:40.160236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:40.174872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.178464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.178935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.179742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.180553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.181044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.222283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:14:40.251113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:40.262470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2cfd0355-dd17-4811-b9c1-f2021f8736af tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1392 microversion: 2.1 time: 0.241901 Aug 29 16:14:40.263662 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3236/6304] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:40 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:40.340274 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80e93c9a-7bf4-4731-8bf9-a046edeb28bf tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 204 len: 0 microversion: 2.1 time: 0.193568 Aug 29 16:14:40.342634 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3069/6305] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:14:40 2022] DELETE /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:14:40.351597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:40.352810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:40.359613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.360060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.360495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.361234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:40.361699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:40.362399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:40.471890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:40.481137 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-872767a9-c911-489b-92b7-e99e6117fdb0 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1479 microversion: 2.1 time: 0.133501 Aug 29 16:14:40.482083 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3237/6306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:40 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1479 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:41.167562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:41.168750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:41.175947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.176693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.177130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.177830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.178290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.179012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.283950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:41.284562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:41.287475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:41.293371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.293876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.294305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.295000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.295854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.296458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.336938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:41.345475 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7914a272-7050-4872-93c3-a05e122d28cf tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1509 microversion: 2.1 time: 0.183237 Aug 29 16:14:41.346317 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3070/6307] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:41 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:41.468831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:41.476802 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3f3995f6-d0e0-4fd6-ac5f-bec9c477323f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1563 microversion: 2.1 time: 0.196645 Aug 29 16:14:41.477633 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3238/6308] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:41 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1563 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:41.499501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:41.500348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:41.507151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.508585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.508863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:41.509244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.509485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:41.510164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.510874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.511427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.515438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.516116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.517987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.517987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:41.517987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:41.518269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:41.617884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:41.626599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d36b66de-d2b4-45c8-bce4-ea455fec6877 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1479 microversion: 2.1 time: 0.122143 Aug 29 16:14:41.627229 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3239/6309] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:41 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1479 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:41.700254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:41.708678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b6807d60-96a3-402a-a8bc-3045300aad89 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1563 microversion: 2.1 time: 0.214605 Aug 29 16:14:41.709279 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3071/6310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:41 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1563 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:42.367818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:42.368111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:42.375858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:42.376438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:42.376989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:42.377793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:42.378323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:42.378820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:42.636353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:42.650564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:42.651420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:42.655389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4753a6a-9dd9-4d3f-a503-734140d740d9 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1509 microversion: 2.1 time: 0.282463 Aug 29 16:14:42.656315 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3240/6311] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:42 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:42.660400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:42.661152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:42.661690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:42.662492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:42.663077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:42.663704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:42.810962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:42.827871 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ef09089-4364-4d1b-ae82-96008f38cf00 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 200 len: 1479 microversion: 2.1 time: 0.181746 Aug 29 16:14:42.828475 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3072/6312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:42 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 1479 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:43.048015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-67342bdc-bbbf-4d23-8d21-86d906521318 req-e757e63a-3cdd-4a49-8320-47aa8518eb96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1fee37-9edc-4509-9e62-c72a6f165182", "name": "network-vif-deleted", "tag": "dde1bb78-d8a7-4e84-9076-d04f6c10c923"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:43.072309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-67342bdc-bbbf-4d23-8d21-86d906521318 req-e757e63a-3cdd-4a49-8320-47aa8518eb96 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.072928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-67342bdc-bbbf-4d23-8d21-86d906521318 req-e757e63a-3cdd-4a49-8320-47aa8518eb96 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.073883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-67342bdc-bbbf-4d23-8d21-86d906521318 req-e757e63a-3cdd-4a49-8320-47aa8518eb96 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.090308 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-67342bdc-bbbf-4d23-8d21-86d906521318 req-e757e63a-3cdd-4a49-8320-47aa8518eb96 service nova] Creating event network-vif-deleted:dde1bb78-d8a7-4e84-9076-d04f6c10c923 for instance 5a1fee37-9edc-4509-9e62-c72a6f165182 on n-h2-836830-13 Aug 29 16:14:43.096326 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-67342bdc-bbbf-4d23-8d21-86d906521318 req-e757e63a-3cdd-4a49-8320-47aa8518eb96 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051912 Aug 29 16:14:43.097676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3241/6313] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:43.589011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:43.589628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:43.592414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9eb66457-9c91-412e-aa7c-668f59810071 req-5da4b1c3-b618-457f-80fd-78322b279cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0", "tag": "4f53a185-015c-4142-982e-3b79fd4c14df"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:43.596119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.596611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.597262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.597956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.598602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.599250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.602652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9eb66457-9c91-412e-aa7c-668f59810071 req-5da4b1c3-b618-457f-80fd-78322b279cb7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.603434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9eb66457-9c91-412e-aa7c-668f59810071 req-5da4b1c3-b618-457f-80fd-78322b279cb7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.603859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9eb66457-9c91-412e-aa7c-668f59810071 req-5da4b1c3-b618-457f-80fd-78322b279cb7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.615800 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9eb66457-9c91-412e-aa7c-668f59810071 req-5da4b1c3-b618-457f-80fd-78322b279cb7 service nova] Creating event network-changed:4f53a185-015c-4142-982e-3b79fd4c14df for instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 on n-h1-836830-13 Aug 29 16:14:43.621760 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9eb66457-9c91-412e-aa7c-668f59810071 req-5da4b1c3-b618-457f-80fd-78322b279cb7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034337 Aug 29 16:14:43.622562 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3242/6314] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:43.679304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:43.681559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:43.692368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.693299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.693902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.694778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.695992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.707533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.753797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.754288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.754956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.755449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lazy-loading 'fault' on Instance uuid 59d7450c-c999-4347-b8cd-8076572ac9f4 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:14:43.803478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12de3ef79acd458baaec5e85570c8ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392f9e4adbf748c9a83ff7673fc77cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:43.814149 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a009d2ea-ec25-4c93-8e75-cc066f109a5e tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 200 len: 1312 microversion: 2.1 time: 0.140012 Aug 29 16:14:43.828405 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3243/6315] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:43 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:43.853679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:43.854740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 5a1fee37-9edc-4509-9e62-c72a6f165182] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:43.865119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.865760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.866270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.867603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:43.868337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:43.868835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:43.875620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=1,nova_cell1:RELEASE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:14:43.896514 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] HTTP exception thrown: Instance 5a1fee37-9edc-4509-9e62-c72a6f165182 could not be found. Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Request method failure captured: Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 HTTP/1.1 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOWPFKJYUux4PQR9O8UBmaQ3UTFiQtkSqcA_wq_Qkv91PWq5bW24Ak8REWx468rOVdDkt5r7pdMDJ5DvT-EIJ12ufDrCI6iFda1ROvT1RbAmj3TIEkEfdaY0jcjCIzzP4oIEMls7AJR80UL90D47wsQPAU8ccM8KMgjL7LYBgdFrUpU Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: e8971b1ee2b842588adbd7dc5d7552a0 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1303361231 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e8971b1ee2b842588adbd7dc5d7552a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e8971b1ee2b842588adbd7dc5d7552a0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e8971b1ee2b842588adbd7dc5d7552a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e8971b1ee2b842588adbd7dc5d7552a0"}]}] Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1303361231 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: e8971b1ee2b842588adbd7dc5d7552a0 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1303361231 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestSecurityGroupsBasicOps-1303361231-project Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 86ff3f40c7224251ae1346fc60f361f9 Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1303361231-project Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5a1fee37-9edc-4509-9e62-c72a6f165182 could not be found. Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5a1fee37-9edc-4509-9e62-c72a6f165182'} Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1fee37-9edc-4509-9e62-c72a6f165182 could not be found. Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1fee37-9edc-4509-9e62-c72a6f165182 could not be found. Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:43.900733 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1fee37-9edc-4509-9e62-c72a6f165182 could not be found. Aug 29 16:14:43.904741 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:43.905288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Returning 404 to user: Instance 5a1fee37-9edc-4509-9e62-c72a6f165182 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:43.906569 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dfa72775-a46b-410c-99d2-2542c9933dcb tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182" status: 404 len: 111 microversion: 2.1 time: 0.059557 Aug 29 16:14:43.907152 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3244/6316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:43 2022] GET /compute/v2.1/servers/5a1fee37-9edc-4509-9e62-c72a6f165182 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:14:43.950344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:43.962747 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3fe227a1-4bb0-4ab2-bc54-537755ca87b3 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1563 microversion: 2.1 time: 0.378328 Aug 29 16:14:43.979390 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3073/6317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:43 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1563 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:44.836800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:44.837576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] [instance: 59d7450c-c999-4347-b8cd-8076572ac9f4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:44.846907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:44.847807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:44.848511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:44.849370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:44.850109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:44.851045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:44.871133 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] HTTP exception thrown: Instance 59d7450c-c999-4347-b8cd-8076572ac9f4 could not be found. Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Request method failure captured: Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 HTTP/1.1 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOWsipN0P8xn54wSfP2VVRWYUXtCzgyLTWuPuboxw7Z1fSv7GmPC84ZvcL_2ZTAyM9vlZRRQCIdRvpk2PVKvmRAL9e-kahBc7DgAXYZ-ToQM6HLWUwwLGaMQ7nzEy5dazRwUfIOwZrTnFDIbWBOUCHL6uaX9H6-gcDpYK4BlcAZ-rKg Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 392f9e4adbf748c9a83ff7673fc77cb7 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2105980406 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/392f9e4adbf748c9a83ff7673fc77cb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_392f9e4adbf748c9a83ff7673fc77cb7", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/392f9e4adbf748c9a83ff7673fc77cb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/392f9e4adbf748c9a83ff7673fc77cb7"}]}] Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2105980406 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 392f9e4adbf748c9a83ff7673fc77cb7 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2105980406 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerRescueTestJSONUnderV235-2105980406-project Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 12de3ef79acd458baaec5e85570c8ae2 Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2105980406-project Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 59d7450c-c999-4347-b8cd-8076572ac9f4 could not be found. Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '59d7450c-c999-4347-b8cd-8076572ac9f4'} Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d7450c-c999-4347-b8cd-8076572ac9f4 could not be found. Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d7450c-c999-4347-b8cd-8076572ac9f4 could not be found. Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:44.873310 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d7450c-c999-4347-b8cd-8076572ac9f4 could not be found. Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:14:44.876722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] Returning 404 to user: Instance 59d7450c-c999-4347-b8cd-8076572ac9f4 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:44.877225 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f562aa6-cc8d-423f-86b7-968883c8ec10 tempest-ServerRescueTestJSONUnderV235-2105980406 tempest-ServerRescueTestJSONUnderV235-2105980406-project] 10.222.0.83 "GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4" status: 404 len: 111 microversion: 2.1 time: 0.044686 Aug 29 16:14:44.877976 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3245/6318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:44 2022] GET /compute/v2.1/servers/59d7450c-c999-4347-b8cd-8076572ac9f4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:14:45.279325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7b38070a-5729-46b9-9831-4fe0e0576662 req-ad24c354-dd20-43e2-b46a-68e4d64a2c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d7450c-c999-4347-b8cd-8076572ac9f4", "name": "network-vif-deleted", "tag": "102959ee-77d8-4cfe-86b1-1502706d2ac8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:45.290893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7b38070a-5729-46b9-9831-4fe0e0576662 req-ad24c354-dd20-43e2-b46a-68e4d64a2c19 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:45.291497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7b38070a-5729-46b9-9831-4fe0e0576662 req-ad24c354-dd20-43e2-b46a-68e4d64a2c19 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:45.292007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7b38070a-5729-46b9-9831-4fe0e0576662 req-ad24c354-dd20-43e2-b46a-68e4d64a2c19 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:45.305137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7b38070a-5729-46b9-9831-4fe0e0576662 req-ad24c354-dd20-43e2-b46a-68e4d64a2c19 service nova] Creating event network-vif-deleted:102959ee-77d8-4cfe-86b1-1502706d2ac8 for instance 59d7450c-c999-4347-b8cd-8076572ac9f4 on n-h1-836830-13 Aug 29 16:14:45.310336 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7b38070a-5729-46b9-9831-4fe0e0576662 req-ad24c354-dd20-43e2-b46a-68e4d64a2c19 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034877 Aug 29 16:14:45.310964 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3074/6319] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:48.834698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:48.836077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:48.841353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-47b6798e-9ef9-4eac-a63f-38a4bde30195 req-7f16bb89-f4d6-4dbb-b899-5c3835ea8b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e9e5be-9e32-418d-89b7-e2e6d985311d", "tag": "643c1014-64a1-438d-9006-982466b4fc54"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:48.856372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-47b6798e-9ef9-4eac-a63f-38a4bde30195 req-7f16bb89-f4d6-4dbb-b899-5c3835ea8b5c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:48.858041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:48.858432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-47b6798e-9ef9-4eac-a63f-38a4bde30195 req-7f16bb89-f4d6-4dbb-b899-5c3835ea8b5c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:48.859080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:48.859544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-47b6798e-9ef9-4eac-a63f-38a4bde30195 req-7f16bb89-f4d6-4dbb-b899-5c3835ea8b5c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:48.860108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:48.863131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:48.863837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:48.865049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:48.880491 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-47b6798e-9ef9-4eac-a63f-38a4bde30195 req-7f16bb89-f4d6-4dbb-b899-5c3835ea8b5c service nova] Creating event network-changed:643c1014-64a1-438d-9006-982466b4fc54 for instance 21e9e5be-9e32-418d-89b7-e2e6d985311d on n-h1-836830-13 Aug 29 16:14:48.886649 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-47b6798e-9ef9-4eac-a63f-38a4bde30195 req-7f16bb89-f4d6-4dbb-b899-5c3835ea8b5c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050827 Aug 29 16:14:48.891211 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3075/6320] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:48.905111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:14:49.034934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-47464d94-a7e5-49eb-a6c0-8073ca8c96a6 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "DELETE /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 204 len: 0 microversion: 2.1 time: 0.204491 Aug 29 16:14:49.035926 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3246/6321] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:14:48 2022] DELETE /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:14:49.046327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:49.047562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:49.057016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:49.058662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:49.059136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:49.060088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:49.060748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:49.061368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:49.266251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:49.274481 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d095f51-cb9e-46c0-9b29-8fdf6aa3b937 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1769 microversion: 2.1 time: 0.233139 Aug 29 16:14:49.275116 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3076/6322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:49 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1769 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:50.297099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:50.297901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:50.307744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:50.308613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:50.309263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:50.310169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:50.310934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:50.311638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:50.711774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:50.719766 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ece0532b-4856-4d2a-a91c-bbd283b4b753 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1769 microversion: 2.1 time: 0.426932 Aug 29 16:14:50.720328 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3247/6323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:50 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1769 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:51.335084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c53fc3a8-f286-4a56-8dfc-0cf69b8226c9 req-3a24dba4-3fff-47fd-9aac-0dd72117f82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e9e5be-9e32-418d-89b7-e2e6d985311d", "name": "network-vif-deleted", "tag": "643c1014-64a1-438d-9006-982466b4fc54"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:51.354398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c53fc3a8-f286-4a56-8dfc-0cf69b8226c9 req-3a24dba4-3fff-47fd-9aac-0dd72117f82c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:51.355200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c53fc3a8-f286-4a56-8dfc-0cf69b8226c9 req-3a24dba4-3fff-47fd-9aac-0dd72117f82c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:51.355777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c53fc3a8-f286-4a56-8dfc-0cf69b8226c9 req-3a24dba4-3fff-47fd-9aac-0dd72117f82c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:51.373235 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c53fc3a8-f286-4a56-8dfc-0cf69b8226c9 req-3a24dba4-3fff-47fd-9aac-0dd72117f82c service nova] Creating event network-vif-deleted:643c1014-64a1-438d-9006-982466b4fc54 for instance 21e9e5be-9e32-418d-89b7-e2e6d985311d on n-h1-836830-13 Aug 29 16:14:51.380477 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c53fc3a8-f286-4a56-8dfc-0cf69b8226c9 req-3a24dba4-3fff-47fd-9aac-0dd72117f82c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049727 Aug 29 16:14:51.382954 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3077/6324] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:14:51.742981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:51.744288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:51.756054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:51.757826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:51.758465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:51.759701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:51.760640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:51.761490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:51.814410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:51.815357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:51.815963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:51.816526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lazy-loading 'fault' on Instance uuid 21e9e5be-9e32-418d-89b7-e2e6d985311d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:14:51.904721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff3f40c7224251ae1346fc60f361f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8971b1ee2b842588adbd7dc5d7552a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:51.914026 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5c00a63b-2629-4c74-bbab-59efb771ba5d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 200 len: 1385 microversion: 2.1 time: 0.176136 Aug 29 16:14:51.915574 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3248/6325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:51 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 1385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:52.937637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:52.938359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] [instance: 21e9e5be-9e32-418d-89b7-e2e6d985311d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:52.948277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:52.948808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:52.949247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:52.949955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:52.950410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:52.950836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:52.966475 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] HTTP exception thrown: Instance 21e9e5be-9e32-418d-89b7-e2e6d985311d could not be found. Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Request method failure captured: Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d HTTP/1.1 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOWPFKJYUux4PQR9O8UBmaQ3UTFiQtkSqcA_wq_Qkv91PWq5bW24Ak8REWx468rOVdDkt5r7pdMDJ5DvT-EIJ12ufDrCI6iFda1ROvT1RbAmj3TIEkEfdaY0jcjCIzzP4oIEMls7AJR80UL90D47wsQPAU8ccM8KMgjL7LYBgdFrUpU Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: e8971b1ee2b842588adbd7dc5d7552a0 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1303361231 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e8971b1ee2b842588adbd7dc5d7552a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e8971b1ee2b842588adbd7dc5d7552a0", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e8971b1ee2b842588adbd7dc5d7552a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e8971b1ee2b842588adbd7dc5d7552a0"}]}] Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1303361231 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: e8971b1ee2b842588adbd7dc5d7552a0 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1303361231 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestSecurityGroupsBasicOps-1303361231-project Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 86ff3f40c7224251ae1346fc60f361f9 Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1303361231-project Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 21e9e5be-9e32-418d-89b7-e2e6d985311d could not be found. Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '21e9e5be-9e32-418d-89b7-e2e6d985311d'} Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e9e5be-9e32-418d-89b7-e2e6d985311d could not be found. Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e9e5be-9e32-418d-89b7-e2e6d985311d could not be found. Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:52.968498 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e9e5be-9e32-418d-89b7-e2e6d985311d could not be found. Aug 29 16:14:52.972041 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:14:52.973790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Returning 404 to user: Instance 21e9e5be-9e32-418d-89b7-e2e6d985311d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:14:52.974852 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e3c86756-c5c3-4d27-9cdf-fc84c8287f8d tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d" status: 404 len: 111 microversion: 2.1 time: 0.042526 Aug 29 16:14:52.975819 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3078/6326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:52 2022] GET /compute/v2.1/servers/21e9e5be-9e32-418d-89b7-e2e6d985311d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:14:55.225395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-774145110", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:55.293715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:14:55.784443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:14:55.784873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:14:55.785349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:14:55.785761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:14:55.786178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:14:55.808094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:55.808598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:55.809039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:55.809771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:55.810236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:55.810667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:55.836930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:14:55.843415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:14:55.860068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:14:55.862680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:14:55.966194 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3d7a326-c8e7-4099-953d-5c02e4422432 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942503 Aug 29 16:14:55.978513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-edb8cee3-4b53-493b-858d-cdb71b75fcad tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:55.979258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-edb8cee3-4b53-493b-858d-cdb71b75fcad tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:55.983518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3249/6327] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:14:56.089775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-edb8cee3-4b53-493b-858d-cdb71b75fcad tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:56.106501 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-edb8cee3-4b53-493b-858d-cdb71b75fcad tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1192 microversion: 2.1 time: 0.132673 Aug 29 16:14:56.107462 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3079/6328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:55 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1192 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:14:57.128653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:57.129544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:57.140320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:57.140817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:57.141557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:57.142459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:57.143094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:57.143741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:57.223428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:57.234139 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a048b651-0e75-4987-a9ad-c1a5be4e9403 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1244 microversion: 2.1 time: 0.109833 Aug 29 16:14:57.243241 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3250/6329] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:57 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:57.393471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b85f01e4-90c3-44cb-b1cb-81310e614723 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] Calling method '.version_select at 0x7f32ee8558b0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:57.415249 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b85f01e4-90c3-44cb-b1cb-81310e614723 tempest-TestSecurityGroupsBasicOps-1303361231 tempest-TestSecurityGroupsBasicOps-1303361231-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1486936364" status: 202 len: 0 microversion: 2.1 time: 0.025765 Aug 29 16:14:57.419842 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3080/6330] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1486936364 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:14:58.258404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:58.259224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:58.268406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:58.268902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:58.269332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:58.276800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:58.277311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:58.277756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:58.494890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:58.505269 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ed14c05-83b7-4b4c-837e-0aa279f20216 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1292 microversion: 2.1 time: 0.252093 Aug 29 16:14:58.518971 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3251/6331] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:58 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1292 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:14:59.310562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-741e6de3-c875-49d5-a2d7-21d504aab409 req-15ebb69d-cbb9-4aa9-921c-1bbbf0c3605f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68134a73-3ff4-4ec6-bb11-279ba1953518", "tag": "d313af38-be70-4160-b9dc-db8c081d055a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:14:59.330525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-741e6de3-c875-49d5-a2d7-21d504aab409 req-15ebb69d-cbb9-4aa9-921c-1bbbf0c3605f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:59.334103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-741e6de3-c875-49d5-a2d7-21d504aab409 req-15ebb69d-cbb9-4aa9-921c-1bbbf0c3605f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:59.336897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-741e6de3-c875-49d5-a2d7-21d504aab409 req-15ebb69d-cbb9-4aa9-921c-1bbbf0c3605f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:59.363499 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-741e6de3-c875-49d5-a2d7-21d504aab409 req-15ebb69d-cbb9-4aa9-921c-1bbbf0c3605f service nova] Creating event network-changed:d313af38-be70-4160-b9dc-db8c081d055a for instance 68134a73-3ff4-4ec6-bb11-279ba1953518 on n-h2-836830-13 Aug 29 16:14:59.380892 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-741e6de3-c875-49d5-a2d7-21d504aab409 req-15ebb69d-cbb9-4aa9-921c-1bbbf0c3605f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074807 Aug 29 16:14:59.382074 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3252/6332] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:14:59.404285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:59.404804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:59.415275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:59.416021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:59.416621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:59.417482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:59.418093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:59.418702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:59.447939 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-308e594b-69a7-4f9c-bdf4-8ee48fd64bbf tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/ips" status: 200 len: 153 microversion: 2.20 time: 0.379360 Aug 29 16:14:59.449060 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3081/6333] 10.222.0.83 () {60 vars in 1289 bytes} [Mon Aug 29 16:14:59 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/ips => generated 153 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:14:59.529173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:14:59.529890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:14:59.542698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:59.545280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:59.546113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:59.551224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:14:59.552334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:14:59.552769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:14:59.784789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:14:59.794806 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-924114fd-5521-4884-9f4f-4c649a889582 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1292 microversion: 2.1 time: 0.271343 Aug 29 16:14:59.799427 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3253/6334] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:14:59 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1292 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:00.824401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:00.825039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:00.829632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:00.838319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:00.838868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:00.839338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:00.840355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:00.840928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:00.841317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.011859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:01.022353 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40daa82a-2744-4931-a0f9-035f9d3fded2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1292 microversion: 2.1 time: 0.205164 Aug 29 16:15:01.023507 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3082/6335] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:00 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:01.480555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:01.481470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:01.488601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.489164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.489670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.490374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.490830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.491279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.517223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lazy-loading 'flavor' on Instance uuid 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:15:01.724694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-091901f2-b144-4a5d-8b74-f38afab6ad97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/action" status: 202 len: 0 microversion: 2.20 time: 0.248876 Aug 29 16:15:01.725384 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3254/6336] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 16:15:01 2022] POST /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:15:01.742577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:01.744144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:01.759915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.761234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.762351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.763978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:01.765116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:01.766434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:01.948966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:01.955010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:01.963041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:01.964611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:01.967779 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ffcccee-68aa-441d-bc5d-5e693d0e4ba3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.236799 Aug 29 16:15:01.968730 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3083/6337] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:01 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:02.043969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:02.044950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:02.053515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:02.055801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:02.056730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:02.058067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:02.059552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:02.060187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:02.601950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:02.622115 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e14e9dc-6f20-4e52-bfa0-919222e0f6e4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1292 microversion: 2.1 time: 0.583620 Aug 29 16:15:02.622787 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3255/6338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:02 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1292 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:02.991507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:02.992831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:03.003356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:03.003848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:03.004279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:03.005207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:03.005809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:03.006228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:03.256139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:03.271422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:03.274591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:03.276138 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-70cc03cd-a022-4368-b804-4a246758dee6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.288489 Aug 29 16:15:03.299308 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3084/6339] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:02 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:03.645988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:03.646636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:03.654019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:03.654505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:03.654944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:03.655774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:03.656226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:03.656651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:03.865042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:03.884636 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a96e78ab-a568-4e0b-b704-3a4ed299225b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1292 microversion: 2.1 time: 0.242453 Aug 29 16:15:03.885244 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3256/6340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:03 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1292 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:04.312986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:04.314418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:04.327656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.331483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.332321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:04.333464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.334177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.334697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:04.373067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4acf7f64-744c-4d24-b872-66d15ddfb3e0 req-952f4494-7cce-4bb0-a54c-d8ba8b82ade1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68134a73-3ff4-4ec6-bb11-279ba1953518", "name": "network-vif-plugged", "status": "completed", "tag": "d313af38-be70-4160-b9dc-db8c081d055a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:04.388436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4acf7f64-744c-4d24-b872-66d15ddfb3e0 req-952f4494-7cce-4bb0-a54c-d8ba8b82ade1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.393643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4acf7f64-744c-4d24-b872-66d15ddfb3e0 req-952f4494-7cce-4bb0-a54c-d8ba8b82ade1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.394281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4acf7f64-744c-4d24-b872-66d15ddfb3e0 req-952f4494-7cce-4bb0-a54c-d8ba8b82ade1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:04.406307 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4acf7f64-744c-4d24-b872-66d15ddfb3e0 req-952f4494-7cce-4bb0-a54c-d8ba8b82ade1 service nova] Creating event network-vif-plugged:d313af38-be70-4160-b9dc-db8c081d055a for instance 68134a73-3ff4-4ec6-bb11-279ba1953518 on n-h2-836830-13 Aug 29 16:15:04.412337 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4acf7f64-744c-4d24-b872-66d15ddfb3e0 req-952f4494-7cce-4bb0-a54c-d8ba8b82ade1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043767 Aug 29 16:15:04.414170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3257/6341] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:15:04.602686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:04.612144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:04.613604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:04.615703 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96b01edb-2b8c-4ced-8932-e26716671e6f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.308100 Aug 29 16:15:04.617971 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3085/6342] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:04 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:04.907827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:04.908637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:04.916396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.917761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.918435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:04.919417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:04.920209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:04.921120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.107319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:05.118383 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d09b0e38-32b2-450b-98fd-c4c65c22d15d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1292 microversion: 2.1 time: 0.216447 Aug 29 16:15:05.119708 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3258/6343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:04 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1292 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:05.320987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:05.323519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:05.339881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:05.340547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:05.341284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.342355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:05.343050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:05.343700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.419689 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14339b0f-08e3-4fe3-969b-9322b7dc1da0 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0/action" status: 200 len: 24566 microversion: 2.1 time: 0.103337 Aug 29 16:15:05.420503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3086/6344] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:15:05 2022] POST /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0/action => generated 24566 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:15:05.641886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:05.643532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:05.649910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:05.650513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:05.650955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.651686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:05.652439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:05.652874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:05.807509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:05.817965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:05.819796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:05.822100 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-514df52a-8aeb-4996-beb0-2975fb0519eb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.184134 Aug 29 16:15:05.823100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3259/6345] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:05 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:06.141305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:06.142221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:06.144769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:06.152134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.152620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.153054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.153754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.154352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.154809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.301408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:06.310275 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28d9e61b-7cba-40bd-b593-f31a6c2b5038 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1292 microversion: 2.1 time: 0.174269 Aug 29 16:15:06.310945 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3087/6346] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:06 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1292 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:06.847688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:06.848304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:06.850372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:06.851063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:06.873379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.873937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.874626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.875512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:06.876320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:06.876898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:06.882764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:07.049494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:07.060497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:07.062256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:07.063823 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-456b101f-6d0f-48c3-a6a3-fa6f16f14773 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.220144 Aug 29 16:15:07.065039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3260/6347] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:06 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:07.331926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:07.332543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:07.340465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:07.340952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:07.341384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:07.342078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:07.342561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:07.342984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:07.624137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:07.634123 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8aba8f4-6020-4860-ae82-c553f8f4fa7b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1472 microversion: 2.1 time: 0.305804 Aug 29 16:15:07.634843 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3088/6348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:07 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:07.795156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1839822584", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:07.862013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:08.089553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:08.090564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:08.096892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:08.097622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:08.098203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:08.099485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:08.100101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:08.100819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:08.378701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:08.381648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:08.386877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:08.387357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:08.387790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:08.404661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:08.405156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:08.407287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:08.408405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:08.411108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:08.411870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:08.427281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:08.433861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:08.439867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:08.440591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:08.441927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:08.444141 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ec67f7c-bec8-4f08-b10f-791096a92846 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.359329 Aug 29 16:15:08.445295 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3089/6349] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:08 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:08.456370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:08.459383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: e9e1e1dc-2d12-44aa-86a5-41eae2cd8827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:08.508943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c9ad7b47-67dd-410c-8fc6-08c0d66727bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718509 Aug 29 16:15:08.510161 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3261/6350] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:15:08.522236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2deb7b3b-ba4a-467e-8e54-4ffd1dd78b8a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:08.522739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2deb7b3b-ba4a-467e-8e54-4ffd1dd78b8a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: e9e1e1dc-2d12-44aa-86a5-41eae2cd8827] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:08.557808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2deb7b3b-ba4a-467e-8e54-4ffd1dd78b8a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: e9e1e1dc-2d12-44aa-86a5-41eae2cd8827] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:15:08.979560 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2deb7b3b-ba4a-467e-8e54-4ffd1dd78b8a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827" status: 204 len: 0 microversion: 2.1 time: 0.462281 Aug 29 16:15:08.981168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3090/6351] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:15:08 2022] DELETE /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:15:08.994309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ce863c2-0680-4260-bbff-111b520af794 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:08.995610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ce863c2-0680-4260-bbff-111b520af794 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: e9e1e1dc-2d12-44aa-86a5-41eae2cd8827] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:09.011683 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0ce863c2-0680-4260-bbff-111b520af794 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ce863c2-0680-4260-bbff-111b520af794 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 HTTP/1.1 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'e9e1e1dc-2d12-44aa-86a5-41eae2cd8827'} Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:09.013669 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:09.018287 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:09.018287 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:15:09.018287 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:15:09.018287 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:15:09.018287 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:15:09.020623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ce863c2-0680-4260-bbff-111b520af794 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:15:09.021921 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ce863c2-0680-4260-bbff-111b520af794 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827" status: 404 len: 111 microversion: 2.1 time: 0.035637 Aug 29 16:15:09.022714 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3262/6352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:08 2022] GET /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:15:09.104394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1244636620", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:09.238498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:09.469226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:09.470076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:09.476791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:09.477827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:09.478447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:09.479442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:09.480220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:09.480786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:09.652487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:09.667546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:09.669690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:09.671138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bae9ba35-3b39-4d85-9efb-6e733dc5a376 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.206001 Aug 29 16:15:09.688141 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3263/6353] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:09 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:10.542043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:10.542653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:10.542909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:10.543355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:10.543773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:10.566260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.566876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.567370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:10.568160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.571399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.573086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:10.625207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:10.642992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:10.670312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:10.676361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:10.698526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:10.699754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:10.722243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.722997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.723653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:10.724520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:10.725125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:10.725703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:10.792132 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ede39c0d-6d77-4fec-8bb0-c59adffde5ff tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.693160 Aug 29 16:15:10.793461 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3091/6354] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:15:10.808424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7a845f2-a678-46ac-ba72-c34e70277583 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:10.811057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a7a845f2-a678-46ac-ba72-c34e70277583 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:11.104901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:11.114532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:11.119391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:11.120635 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54c787b7-a1a1-468a-935c-475e19040e20 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.428126 Aug 29 16:15:11.137382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3264/6355] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:10 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:11.149782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a7a845f2-a678-46ac-ba72-c34e70277583 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:11.170135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7a845f2-a678-46ac-ba72-c34e70277583 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1221 microversion: 2.1 time: 0.359452 Aug 29 16:15:11.170842 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3092/6356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:10 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1221 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:12.146841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:12.147538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:12.152430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:12.159106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.160194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.161163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.162222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.162775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.163439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.191689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:12.192301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:12.202467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.203415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.204035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.205843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:12.206489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:12.207314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:12.338566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:12.352381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:12.354692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:12.356226 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37bcc8b4-bc35-4864-89c4-4a12f8c5d0b3 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.214298 Aug 29 16:15:12.371059 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3265/6357] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:12 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:12.371267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:12.387535 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a4023c4-b6c6-4cfd-923c-edb859cf098c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1273 microversion: 2.1 time: 0.198210 Aug 29 16:15:12.397734 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3093/6358] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:12 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:13.002197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-764d18db-935e-482c-82b5-a54cecc5d5bb tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Action: 'create', calling method: .version_select at 0x7f32eda479d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-86562625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMVLii+4iTCwf00a3jbHeEYod8FSn8y5ywDJE3PrVX/I99BInUhIsDcBDLFwUwEmT22m/fF8c+A+RhpmvfeoOH5I+LCgQjfWwLI7FMUpWMidL3Id1SCCnvJMcMseyH7jw=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:13.020549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-764d18db-935e-482c-82b5-a54cecc5d5bb tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Getting quotas for project c91939ee21734b77890428f8d9a337be. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:13.027521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-764d18db-935e-482c-82b5-a54cecc5d5bb tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Getting quotas for user 5ffcf740d5ac459f8f624437ce64ab74 and project c91939ee21734b77890428f8d9a337be. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:13.065004 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-764d18db-935e-482c-82b5-a54cecc5d5bb tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.285932 Aug 29 16:15:13.067159 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3266/6359] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:15:12 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:13.384042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:13.384824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:13.399042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.409808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.410115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:13.410537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.410947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:13.411102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.411682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.412120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.422972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.424885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.425559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.426928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:13.427849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:13.428770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:13.742072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:13.765083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:13.766980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:13.768491 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cbed1ce3-47d6-474b-ae2a-358537760dbc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.388747 Aug 29 16:15:13.769697 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3094/6360] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:13 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:13.784617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:13.794321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f50f23ed-df4b-4aab-b626-32b20342e74a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1321 microversion: 2.1 time: 0.388814 Aug 29 16:15:13.795183 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3267/6361] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:13 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:14.353968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b25ca77f-8fe5-4eb8-861d-57bf5880d9c7 req-45b22c6c-1bea-4510-8279-6c3b28739b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbee4b52-ff7d-4c07-870d-c25080713f57", "tag": "3867172e-f39d-457d-9ea1-0af2c2b640c8"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:14.366350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b25ca77f-8fe5-4eb8-861d-57bf5880d9c7 req-45b22c6c-1bea-4510-8279-6c3b28739b9c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:14.371551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b25ca77f-8fe5-4eb8-861d-57bf5880d9c7 req-45b22c6c-1bea-4510-8279-6c3b28739b9c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:14.372006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b25ca77f-8fe5-4eb8-861d-57bf5880d9c7 req-45b22c6c-1bea-4510-8279-6c3b28739b9c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:14.396905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b25ca77f-8fe5-4eb8-861d-57bf5880d9c7 req-45b22c6c-1bea-4510-8279-6c3b28739b9c service nova] Creating event network-changed:3867172e-f39d-457d-9ea1-0af2c2b640c8 for instance dbee4b52-ff7d-4c07-870d-c25080713f57 on n-h1-836830-13 Aug 29 16:15:14.403376 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b25ca77f-8fe5-4eb8-861d-57bf5880d9c7 req-45b22c6c-1bea-4510-8279-6c3b28739b9c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059645 Aug 29 16:15:14.404009 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3095/6362] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:14.609366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-410562626", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-86562625", "security_groups": [{"name": "tempest-secgroup-smoke-1614248245"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "212c3082-f4de-42a2-abdb-aa929c8bce12"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:14.779673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] validate_networks() for [('212c3082-f4de-42a2-abdb-aa929c8bce12', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:14.794518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:14.795748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:14.802503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:14.803106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:14.803624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:14.805060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:14.805991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:14.806452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.014976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:15.025288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:15.026750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:15.028476 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b4fdbf2-a681-407b-b5df-787e8b247eff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.238200 Aug 29 16:15:15.029523 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3096/6363] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:14 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:15.035829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:15.036587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:15.048070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:15.048749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:15.049194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.049961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:15.050597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:15.051060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.194732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:15.204279 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a6c6717-037f-4c3c-ab4c-8f9438d1b9d1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1321 microversion: 2.1 time: 0.173539 Aug 29 16:15:15.205514 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3097/6364] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:15 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:15.300656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Getting quotas for project c91939ee21734b77890428f8d9a337be. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:15.307095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Getting quotas for user 5ffcf740d5ac459f8f624437ce64ab74 and project c91939ee21734b77890428f8d9a337be. Resources: dict_keys(['metadata_items']) {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:15.321720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:15.322534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:15.323016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:15.323461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:15.323882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:15.332132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:15.332628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:15.333064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.335284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:15.336516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:15.336960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:15.354901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Getting quotas for project c91939ee21734b77890428f8d9a337be. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:15.360066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Getting quotas for user 5ffcf740d5ac459f8f624437ce64ab74 and project c91939ee21734b77890428f8d9a337be. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:15.372725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:15.374943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:15.426667 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a02b88f-e4ee-4bdc-8119-e5cb9de7935f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.821019 Aug 29 16:15:15.427661 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3268/6365] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:15:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:15:15.439182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ba8aad9-8974-4ec7-b0f5-01a25c9d7cbe tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:15.439732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ba8aad9-8974-4ec7-b0f5-01a25c9d7cbe tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:15.519246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ba8aad9-8974-4ec7-b0f5-01a25c9d7cbe tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:15.529357 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ba8aad9-8974-4ec7-b0f5-01a25c9d7cbe tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1300 microversion: 2.1 time: 0.094187 Aug 29 16:15:15.533589 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3098/6366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:15 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:16.053081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:16.055670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.062743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.063493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.064081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.064945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.065574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.066225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.227984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:16.228617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.236168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.236666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.237095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.238072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.238595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.239119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.313440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:16.325540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:16.327007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:16.328246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24a27b69-ca66-4966-a7ad-d6003396bbc2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.280333 Aug 29 16:15:16.340676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3269/6367] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:16 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:16.385129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:16.393200 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f191f89-2c20-4a4d-afa1-b998543ce865 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1321 microversion: 2.1 time: 0.171299 Aug 29 16:15:16.393785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3099/6368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:16 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:16.499998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "648e7a49-e66c-42cf-859c-64f1df130787"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:16.502840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.509462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.509958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.510399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.511165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.511630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.512061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.549773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:16.550555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.559549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.560131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.560513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.561219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.561675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.562170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.607946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:16.608656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:16.609299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:16.609862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:16.610505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:16.641077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:16.654845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c3e30cb4-24ed-469c-b493-d0f8f8545488 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1352 microversion: 2.1 time: 0.108919 Aug 29 16:15:16.655696 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3100/6369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:16 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:16.687503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.699808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.700663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.701302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.702976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.702976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.703398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.766693 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dbc98674-ce94-47d7-a1a7-c0aabee84444 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0/action" status: 202 len: 1137 microversion: 2.1 time: 0.270694 Aug 29 16:15:16.767866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3270/6370] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:15:16 2022] POST /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0/action => generated 1137 bytes in 272 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 29 16:15:16.790925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:16.791676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:16.798639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.799398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.799834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:16.800738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:16.801197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:16.801621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.003675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:17.012791 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ff8192a-d536-4ddf-a69c-75e1e0f379fe tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.226409 Aug 29 16:15:17.013393 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3101/6371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:16 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:17.353755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:17.354471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:17.361561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.362039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.362472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.363182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.363630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.364048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.413842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:17.414462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:17.420795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.421290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.421731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.422457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.422915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.423373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.545788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:17.559122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:17.561213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:17.562674 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78256e82-e26e-4cdc-b063-575e27196c95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.213544 Aug 29 16:15:17.563578 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3271/6372] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:17 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:17.567498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:17.577209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77bb077d-cbf6-4c0e-a72a-fb5de74b8248 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1321 microversion: 2.1 time: 0.167255 Aug 29 16:15:17.577792 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3102/6373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:17 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:17.680451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:17.681105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:17.693443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.694201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.694894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:17.695977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:17.696605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:17.697340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.034978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:18.035543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:18.042603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.043116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.043554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.044628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.045088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.045742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.163146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.177988 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-235b9c88-ff68-4713-bd06-288174ec3969 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1426 microversion: 2.1 time: 0.503266 Aug 29 16:15:18.191109 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3272/6374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:17 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1426 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:18.218612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.231623 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1bd84058-aa8c-4e4f-8a02-63b18bb22210 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.201383 Aug 29 16:15:18.233144 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3103/6375] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:18 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:18.586423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:18.587347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:18.594661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.595324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.595764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.596468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.597052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.597481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.598689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:18.599852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:18.606909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.607435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.607939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.608841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.609268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.609700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.769838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.778575 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54093874-507f-436f-8400-a4f57fc07a87 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1321 microversion: 2.1 time: 0.184286 Aug 29 16:15:18.791049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3104/6376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:18 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:18.803257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.807427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2298f832-6e7e-4085-a567-4f2487563871 req-0309fc7d-95e0-41f3-8f11-42fb68a611ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4aca38d-1490-461b-b9ad-2e77d0b93134", "tag": "220f020b-71c5-4e10-ac81-a101fa7a3a0b"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:18.814486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.816276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:18.817487 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9082836f-1585-4f52-b1d1-8ee58dc203e5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.235632 Aug 29 16:15:18.817624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2298f832-6e7e-4085-a567-4f2487563871 req-0309fc7d-95e0-41f3-8f11-42fb68a611ce service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:18.818093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2298f832-6e7e-4085-a567-4f2487563871 req-0309fc7d-95e0-41f3-8f11-42fb68a611ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:18.818520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2298f832-6e7e-4085-a567-4f2487563871 req-0309fc7d-95e0-41f3-8f11-42fb68a611ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:18.822154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:18.831758 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3273/6377] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:18 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:18.854690 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2298f832-6e7e-4085-a567-4f2487563871 req-0309fc7d-95e0-41f3-8f11-42fb68a611ce service nova] Creating event network-changed:220f020b-71c5-4e10-ac81-a101fa7a3a0b for instance d4aca38d-1490-461b-b9ad-2e77d0b93134 on n-h1-836830-13 Aug 29 16:15:18.861261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2298f832-6e7e-4085-a567-4f2487563871 req-0309fc7d-95e0-41f3-8f11-42fb68a611ce service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058939 Aug 29 16:15:18.861887 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3105/6378] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:19.202902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:19.203582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:19.209624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.210135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.211097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.211941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.212460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.212890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.255942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:19.258594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:19.265834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.266337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.266781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.267650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.268114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.268543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.360698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:19.376009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-278b443d-3116-4fe9-8fc0-2c28b35ab57f tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1426 microversion: 2.1 time: 0.173956 Aug 29 16:15:19.376615 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3274/6379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:19 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1426 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:19.410592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:19.418983 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3802206-973f-4e1f-a0d5-6c3488209cb2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.168624 Aug 29 16:15:19.419593 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3106/6380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:19 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:19.779142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1167bba4-a9aa-4531-a35f-e3bd2a0eabc2 req-9b0670be-4e35-48cc-bb83-1526c932d0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbee4b52-ff7d-4c07-870d-c25080713f57", "name": "network-vif-plugged", "status": "completed", "tag": "3867172e-f39d-457d-9ea1-0af2c2b640c8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:19.790562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1167bba4-a9aa-4531-a35f-e3bd2a0eabc2 req-9b0670be-4e35-48cc-bb83-1526c932d0cd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.791218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1167bba4-a9aa-4531-a35f-e3bd2a0eabc2 req-9b0670be-4e35-48cc-bb83-1526c932d0cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.791528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1167bba4-a9aa-4531-a35f-e3bd2a0eabc2 req-9b0670be-4e35-48cc-bb83-1526c932d0cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.800402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:19.801020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:19.805416 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1167bba4-a9aa-4531-a35f-e3bd2a0eabc2 req-9b0670be-4e35-48cc-bb83-1526c932d0cd service nova] Creating event network-vif-plugged:3867172e-f39d-457d-9ea1-0af2c2b640c8 for instance dbee4b52-ff7d-4c07-870d-c25080713f57 on n-h1-836830-13 Aug 29 16:15:19.808101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.808586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.809019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.809839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.810291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.810505 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1167bba4-a9aa-4531-a35f-e3bd2a0eabc2 req-9b0670be-4e35-48cc-bb83-1526c932d0cd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Aug 29 16:15:19.810711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.811289 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3275/6381] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:19.843958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:19.844853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:19.854633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.855478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.855949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.856676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:19.857407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:19.858132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:19.964063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:19.971829 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1643167-15d7-44ac-a3c1-3607474004ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1321 microversion: 2.1 time: 0.175464 Aug 29 16:15:19.972518 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3107/6382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:19 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:20.000337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:20.009159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:20.010596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:20.011815 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fbed2c01-89de-4e56-b217-edad80911169 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1745 microversion: 2.20 time: 0.172537 Aug 29 16:15:20.012581 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3276/6383] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:19 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:20.399708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:20.400687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:20.407581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:20.408079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:20.408521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:20.409231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:20.409689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:20.410115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:20.442989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:20.444055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:20.452593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:20.453350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:20.454011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:20.454958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:20.455839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:20.456447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:20.560017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:20.569603 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed56756e-00af-4f64-8ef8-1a8c87126dd1 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1426 microversion: 2.1 time: 0.176200 Aug 29 16:15:20.570288 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3108/6384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:20 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1426 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:20.671849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:20.680163 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a9bf775-5c91-4667-8a98-3a8e6959006d tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.241699 Aug 29 16:15:20.680741 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3277/6385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:20 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:20.993650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:20.994261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:20.996263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:21.002552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.003077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.003519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.004221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.004675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.005100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.036397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:21.037058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:21.045062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.045550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.045989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.046749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.046749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.047655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.159472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.167536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e6aa4d6-15e9-4866-9ebd-5658c22b6065 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1321 microversion: 2.1 time: 0.177992 Aug 29 16:15:21.168129 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3109/6386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:20 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:21.204753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.208370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:21.214021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.215513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.216698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-adb6126b-1cb2-43e3-8589-037af95bdf8c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1745 microversion: 2.20 time: 0.184226 Aug 29 16:15:21.217267 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3278/6387] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:21 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:21.590293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:21.590912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:21.597452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.597938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.598373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.599091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.599545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.599968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.702420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:21.703192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:21.710257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.710856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.711986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.712729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:21.713647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:21.713647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:21.736863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.750380 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3e15405-bf85-4859-9272-1801eb5c8116 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1426 microversion: 2.1 time: 0.164494 Aug 29 16:15:21.751109 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3110/6388] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:21 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1426 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:21.852371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:21.860087 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-719ae16b-3acf-4063-b2bf-ba8b197299d8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.161815 Aug 29 16:15:21.860664 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3279/6389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:21 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:22.189334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.189989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.197658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.198193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.198636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.199378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.199839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.200270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.240246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.241220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.250292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.250885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.251571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.252341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.252956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.253526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.348839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.357744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a1c1fda-2179-44b1-883d-59aeb2d86e5c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1502 microversion: 2.1 time: 0.172318 Aug 29 16:15:22.371458 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3111/6390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:22 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:22.378964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.379618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.392586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.393082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.393712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.394579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.395252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.395682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.405927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.415644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.417105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.418452 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6d14749-4ada-4843-b34c-9cdb81119de9 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1745 microversion: 2.20 time: 0.182826 Aug 29 16:15:22.419290 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3280/6391] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:22 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:22.495856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-11d47eeb-a0c3-4b99-814a-e43be08908b4 req-b8ccd186-2e92-4d3a-93da-ab1d41777e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "name": "network-vif-plugged", "status": "completed", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:22.506225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-11d47eeb-a0c3-4b99-814a-e43be08908b4 req-b8ccd186-2e92-4d3a-93da-ab1d41777e20 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.506714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-11d47eeb-a0c3-4b99-814a-e43be08908b4 req-b8ccd186-2e92-4d3a-93da-ab1d41777e20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.507372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-11d47eeb-a0c3-4b99-814a-e43be08908b4 req-b8ccd186-2e92-4d3a-93da-ab1d41777e20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.520300 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-11d47eeb-a0c3-4b99-814a-e43be08908b4 req-b8ccd186-2e92-4d3a-93da-ab1d41777e20 service nova] Creating event network-vif-plugged:e4bfbf99-90f2-4df5-acc6-3031e3a7f32a for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 on n-h2-836830-13 Aug 29 16:15:22.525553 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-11d47eeb-a0c3-4b99-814a-e43be08908b4 req-b8ccd186-2e92-4d3a-93da-ab1d41777e20 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035023 Aug 29 16:15:22.526454 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3281/6392] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:22.539726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.550062 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4bd6a3ce-639c-481b-89f0-851346f083bc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1502 microversion: 2.1 time: 0.174586 Aug 29 16:15:22.550954 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3112/6393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:22 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:22.572001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.572600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.578945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.579516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.579956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.580665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.581106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.581538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.607546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:15:22.688867 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e032a58f-88a7-4d95-9903-ecaf2bf5b7ea tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 204 len: 0 microversion: 2.1 time: 0.121107 Aug 29 16:15:22.689542 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3282/6394] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:15:22 2022] DELETE /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:15:22.699824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.700498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.707338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.707831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.708267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.708967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.709424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.709854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.772197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.772970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.779056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.779562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.780003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.780698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.781158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.781733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.856606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.864529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b67dec2-a10a-424a-b6df-1e2c2ae0e71d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1508 microversion: 2.1 time: 0.169192 Aug 29 16:15:22.865110 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3113/6395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:22 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:22.881223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:22.881982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:22.888687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.889157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.889600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.890315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:22.890772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:22.891244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:22.921987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:22.939684 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4fab3eb5-6965-4d9a-ad11-7e36b375d368 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1426 microversion: 2.1 time: 0.171712 Aug 29 16:15:22.940872 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3283/6396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:22 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1426 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:23.075188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:23.083673 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9ba3f48d-9d51-4149-8614-e45374b4cd1c tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.206353 Aug 29 16:15:23.084257 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3114/6397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:22 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:23.442221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:23.442834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:23.449948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.450473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.450874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:23.451602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.452055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.452478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:23.602133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:23.610649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:23.612141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:23.613320 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-655290c5-cac7-4fb8-85f5-9cc74305f34d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1745 microversion: 2.20 time: 0.175060 Aug 29 16:15:23.613887 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3284/6398] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:23 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:23.886497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:23.887149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:23.894108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.894599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.895056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:23.895757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.896219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.896651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:23.962738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:23.963315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:23.969388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.969879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.970371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:23.971473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:23.971587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:23.971984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.042757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:24.051099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-370d179d-304c-463e-a81e-97340177effa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1508 microversion: 2.1 time: 0.169111 Aug 29 16:15:24.051681 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3115/6399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:23 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:24.106276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:24.106925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:24.110105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:24.115451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:24.116268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:24.117388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.118424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:24.118974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:24.119492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.185991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:24.194434 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e8469f5-d3d9-40aa-a588-5560addb4925 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1426 microversion: 2.1 time: 0.236602 Aug 29 16:15:24.197087 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3285/6400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:23 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1426 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:24.271518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:24.280240 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8466f976-e0b4-4284-a899-a0e17ea411d4 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.177944 Aug 29 16:15:24.280828 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3116/6401] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:24 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:24.536976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2c5a9473-f77e-4704-be79-80031fbf0a45 req-bef50c7b-3e98-4dc0-bbad-c5e08ecee484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbee4b52-ff7d-4c07-870d-c25080713f57", "name": "network-vif-deleted", "tag": "3867172e-f39d-457d-9ea1-0af2c2b640c8"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:24.556311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c5a9473-f77e-4704-be79-80031fbf0a45 req-bef50c7b-3e98-4dc0-bbad-c5e08ecee484 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:24.559567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c5a9473-f77e-4704-be79-80031fbf0a45 req-bef50c7b-3e98-4dc0-bbad-c5e08ecee484 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:24.560168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c5a9473-f77e-4704-be79-80031fbf0a45 req-bef50c7b-3e98-4dc0-bbad-c5e08ecee484 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.576099 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2c5a9473-f77e-4704-be79-80031fbf0a45 req-bef50c7b-3e98-4dc0-bbad-c5e08ecee484 service nova] Creating event network-vif-deleted:3867172e-f39d-457d-9ea1-0af2c2b640c8 for instance dbee4b52-ff7d-4c07-870d-c25080713f57 on n-h1-836830-13 Aug 29 16:15:24.585788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d9ee784f-7e89-444d-9b43-29228e15dbfc req-5b6ef2e2-b767-42c3-8928-8a07916589e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aca38d-1490-461b-b9ad-2e77d0b93134", "name": "network-vif-plugged", "status": "completed", "tag": "220f020b-71c5-4e10-ac81-a101fa7a3a0b"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:24.592629 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2c5a9473-f77e-4704-be79-80031fbf0a45 req-bef50c7b-3e98-4dc0-bbad-c5e08ecee484 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049690 Aug 29 16:15:24.593637 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3286/6402] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:24.623759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d9ee784f-7e89-444d-9b43-29228e15dbfc req-5b6ef2e2-b767-42c3-8928-8a07916589e7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:24.627143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d9ee784f-7e89-444d-9b43-29228e15dbfc req-5b6ef2e2-b767-42c3-8928-8a07916589e7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:24.628242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d9ee784f-7e89-444d-9b43-29228e15dbfc req-5b6ef2e2-b767-42c3-8928-8a07916589e7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.639133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:24.640566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:24.648995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:24.649757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:24.650357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.651253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:24.651902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d9ee784f-7e89-444d-9b43-29228e15dbfc req-5b6ef2e2-b767-42c3-8928-8a07916589e7 service nova] Creating event network-vif-plugged:220f020b-71c5-4e10-ac81-a101fa7a3a0b for instance d4aca38d-1490-461b-b9ad-2e77d0b93134 on n-h1-836830-13 Aug 29 16:15:24.652182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:24.652750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:24.657922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d9ee784f-7e89-444d-9b43-29228e15dbfc req-5b6ef2e2-b767-42c3-8928-8a07916589e7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083035 Aug 29 16:15:24.658995 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3117/6403] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:24.926350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:24.936026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:24.937591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:24.939743 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bf7c0ed4-7912-49cb-a837-432edb93721d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.305231 Aug 29 16:15:24.940464 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3287/6404] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:24 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:25.076060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:25.076908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:25.083500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.084093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.084542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.085242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.086449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.087010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.124074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.124690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.125210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.125668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lazy-loading 'fault' on Instance uuid dbee4b52-ff7d-4c07-870d-c25080713f57 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:15:25.171737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:25.180170 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bfbe3efe-9162-4534-bf9f-602617b93aaa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 200 len: 1311 microversion: 2.1 time: 0.110036 Aug 29 16:15:25.180756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3118/6405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:25 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:25.217847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:25.218450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:25.224719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.225209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.225644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.227108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.227962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.228749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.303687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:25.304262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:25.315219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.315722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.316185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.317165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.317481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.318038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.347045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:25.366681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=20 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:25.450214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:25.462200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fdd3589e-7408-42d5-a8a3-e1b6bcd833ce tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1426 microversion: 2.1 time: 0.248379 Aug 29 16:15:25.473417 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3288/6406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:25 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1426 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:25.524388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:25.550407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:25.561095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-542514dc-9075-4f1d-9109-bd19fb7fdd5f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.261459 Aug 29 16:15:25.562192 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3119/6407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:25 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:25.965733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:25.966981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:25.977195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.977685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.978131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:25.978840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:25.979324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:25.987819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.177959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:26.188090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:26.189766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:26.190948 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29997fca-60c6-4af6-8cd4-c8e6305bbb92 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.229396 Aug 29 16:15:26.191863 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3289/6408] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:25 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:26.203105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:26.203729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:26.211968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.212509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.212970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.213727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.214175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.214675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.229648 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 HTTP/1.1 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'dbee4b52-ff7d-4c07-870d-c25080713f57'} Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:26.231351 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ee2c37e-4df8-4e6c-ae26-a94d6a931489 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 404 len: 111 microversion: 2.1 time: 0.034538 Aug 29 16:15:26.234871 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3120/6409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:26 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:15:26.249039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fb0dbaac-582f-4276-b00e-b40b3795713b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: .version_select at 0x7f32ecfa6c10>, body: {"keypair": {"name": "tempest-key-1158488205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx7uj6E1oetoXqJ8pRXKdhNGVJBNJGyz/nO5gWIem9Nz0UEMDMpC1JZxndX2D5zdVm5WehXms15YrwaUPtms2qcf9KrS+kIPkGGvJ/v5D+W3VbR5xu5hHZSjKT8dHb8Xw=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:26.266852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fb0dbaac-582f-4276-b00e-b40b3795713b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:26.276832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fb0dbaac-582f-4276-b00e-b40b3795713b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:26.285681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:26.322304 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fb0dbaac-582f-4276-b00e-b40b3795713b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.076967 Aug 29 16:15:26.332503 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3290/6410] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:15:26 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:15:26.339709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9743612-5757-44c7-b4d9-8186422dd258 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '.version_select at 0x7f32ee86ef70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:26.347295 n-d-836830-13 devstack@n-api.service[129132]: WARNING oslo_db.sqlalchemy.utils [None req-e9743612-5757-44c7-b4d9-8186422dd258 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 29 16:15:26.357286 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e9743612-5757-44c7-b4d9-8186422dd258 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.023325 Aug 29 16:15:26.358072 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3121/6411] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 16:15:26 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:15:26.418222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2120544946", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-key-1158488205", "networks": [{"uuid": "eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:26.483912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:26.486931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:26.493660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:26.523479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.524290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.524750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.525514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.525957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.526397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.802250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:26.816484 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f14beb46-df18-45d9-8934-c215fdfdca95 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1605 microversion: 2.1 time: 0.335466 Aug 29 16:15:26.819068 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3122/6412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:26 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1605 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:26.846168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:26.846791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:26.855253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.856150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.856756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:26.858870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:26.859631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:26.860321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.042666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.060032 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d522042-b9dc-4e14-97ec-a4804e850a9f tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.234513 Aug 29 16:15:27.063323 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3123/6413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:26 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:27.079596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:27.080657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:27.098764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.099938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.100329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.101927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.102483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.103138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.135418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:27.156460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:27.157273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:27.157750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:27.158438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:27.159286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:27.174377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.175226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.176418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.177962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.180192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.180838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.214190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:27.220736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:27.256677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:27.259980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:27.299973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.311975 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d8ada0f7-c024-47d7-93d7-6ff54df7ee9e tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1605 microversion: 2.1 time: 0.246935 Aug 29 16:15:27.313573 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3124/6414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:27 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:27.330881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:27.341843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:27.351831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.352599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.353899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.354699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.355168 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f1fc3db6-0c88-4d19-91d8-96d6de08e9c7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940846 Aug 29 16:15:27.356025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.361943 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3291/6415] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:15:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:15:27.362204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.366239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:27.369255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:27.385681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.386290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.387889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.389046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:27.389596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:27.390097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:27.583921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.590604 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba494046-076e-4c35-9580-859a02ae6749 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1605 microversion: 2.1 time: 0.231940 Aug 29 16:15:27.603262 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3292/6416] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:27 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:27.603262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eaf5f74b-185d-401f-a7be-4969fedc5815 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:27.603262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eaf5f74b-185d-401f-a7be-4969fedc5815 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:27.712176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.712881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eaf5f74b-185d-401f-a7be-4969fedc5815 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.724989 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eaf5f74b-185d-401f-a7be-4969fedc5815 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1229 microversion: 2.1 time: 0.131153 Aug 29 16:15:27.729232 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3293/6417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:27 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1229 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:27.735760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.739239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:27.745520 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-df3850e7-eda9-4d44-acb1-aa2cb1904f77 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.429036 Aug 29 16:15:27.759124 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3125/6418] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:27 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:28.084745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:28.085505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:28.096985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.097694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.098355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.099320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.099972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.100688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.360466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:28.375074 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f2da588-6724-4dac-b21e-cb44aa94b7e2 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.294593 Aug 29 16:15:28.390970 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3294/6419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:28 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:28.751938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:28.752595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:28.762722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.763260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.763704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.764433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.764899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.765335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.779792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:28.780802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:28.795116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.795719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.796677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.797533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:28.798071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:28.798695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:28.930955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:28.941220 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-efb03a90-7bcd-4907-a1b4-887506d3169d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1281 microversion: 2.1 time: 0.196209 Aug 29 16:15:28.942162 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3126/6420] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:28 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:29.102605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:29.118983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:29.122474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:29.123788 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59b655cf-146a-432d-9a24-e23b45130f95 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.348577 Aug 29 16:15:29.124893 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3295/6421] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:28 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:29.400359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:29.401335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:29.414564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:29.417271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:29.418896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:29.423828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:29.424314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:29.424990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:29.619982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:29.628569 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-464c2b1d-2ef8-463b-bd35-13bbf3b69048 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.234650 Aug 29 16:15:29.639663 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3127/6422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:29 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:29.963394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:29.964597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:29.974878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:29.975686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:29.977047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:29.978271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:29.978945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:29.979620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.149519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:30.150764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:30.167501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:30.168287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:30.168907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.169781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:30.170392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:30.170991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.453017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:30.468588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:30.475677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:30.477786 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8161ca9-ba34-456b-8ee1-07461d90476f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.333682 Aug 29 16:15:30.493325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3128/6423] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:30 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:30.624096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:30.643838 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-45435aaa-d1af-4e02-878f-4760c9d2c3c9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.685145 Aug 29 16:15:30.662779 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3296/6424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:29 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:30.663174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:30.663174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:30.665481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:30.665989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:30.670302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.671187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:30.671688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:30.672119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.693093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-98a647ef-1deb-4b2b-a13a-96795383c3b3 req-7230a9bb-244d-4448-8967-b5001cc7fe09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4aca38d-1490-461b-b9ad-2e77d0b93134", "tag": "220f020b-71c5-4e10-ac81-a101fa7a3a0b"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:30.705699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-98a647ef-1deb-4b2b-a13a-96795383c3b3 req-7230a9bb-244d-4448-8967-b5001cc7fe09 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:30.706241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-98a647ef-1deb-4b2b-a13a-96795383c3b3 req-7230a9bb-244d-4448-8967-b5001cc7fe09 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:30.706982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-98a647ef-1deb-4b2b-a13a-96795383c3b3 req-7230a9bb-244d-4448-8967-b5001cc7fe09 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:30.722500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-98a647ef-1deb-4b2b-a13a-96795383c3b3 req-7230a9bb-244d-4448-8967-b5001cc7fe09 service nova] Creating event network-changed:220f020b-71c5-4e10-ac81-a101fa7a3a0b for instance d4aca38d-1490-461b-b9ad-2e77d0b93134 on n-h1-836830-13 Aug 29 16:15:30.729424 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-98a647ef-1deb-4b2b-a13a-96795383c3b3 req-7230a9bb-244d-4448-8967-b5001cc7fe09 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040016 Aug 29 16:15:30.731092 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3297/6425] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:15:30.938794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:30.950881 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f9837f0-dc66-4417-a677-119565afeefd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.300950 Aug 29 16:15:30.951750 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3129/6426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:30 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:31.507412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:31.508388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:31.517109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.517600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.518032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.518731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.519215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.531145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.581292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:31.676172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:31.677584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:31.689813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.692546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.696200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.697369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.706927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.707688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.806423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:31.816277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:31.817736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:31.818938 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5fce44f-acf9-4b88-bb8f-1a8e382d8878 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.316518 Aug 29 16:15:31.844015 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3298/6427] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:31 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:31.849424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-165fd585-fd5e-460e-9e50-5d27abe204de req-f5a0138e-a3f2-4a35-8138-609507cb4d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65db1b3c-f7ac-4cdb-a55a-8c85697c74ec", "tag": "1c6018c1-5d15-479f-97b1-5378bea16f40"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:31.864098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-165fd585-fd5e-460e-9e50-5d27abe204de req-f5a0138e-a3f2-4a35-8138-609507cb4d06 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.864601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-165fd585-fd5e-460e-9e50-5d27abe204de req-f5a0138e-a3f2-4a35-8138-609507cb4d06 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.865039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-165fd585-fd5e-460e-9e50-5d27abe204de req-f5a0138e-a3f2-4a35-8138-609507cb4d06 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.881969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-165fd585-fd5e-460e-9e50-5d27abe204de req-f5a0138e-a3f2-4a35-8138-609507cb4d06 service nova] Creating event network-changed:1c6018c1-5d15-479f-97b1-5378bea16f40 for instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec on n-h2-836830-13 Aug 29 16:15:31.889077 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-165fd585-fd5e-460e-9e50-5d27abe204de req-f5a0138e-a3f2-4a35-8138-609507cb4d06 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043676 Aug 29 16:15:31.890147 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3299/6428] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:31.974088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:31.974579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:31.985935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.993582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.994318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:31.995405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:31.995788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:31.996327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:32.019774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:32.031259 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62dd4564-4cce-417a-a5d9-e9568c9dae1f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.359407 Aug 29 16:15:32.058654 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3130/6429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:31 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:32.240213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:32.253135 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e9068c78-3fe1-4b2b-abff-6ba77594dab8 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.283953 Aug 29 16:15:32.267052 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3300/6430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:31 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:32.855625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:32.856331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:32.864385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:32.864995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:32.865538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:32.866355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:32.867145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:32.867855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:33.027367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:33.036924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:33.038487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:33.040346 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-86c84e9d-700e-4aff-b07f-8e6e0438be4c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.189075 Aug 29 16:15:33.040936 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3131/6431] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:32 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:33.065683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:33.066219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:33.074263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:33.074758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:33.075228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:33.076123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:33.076584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:33.077012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:33.218210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:33.226911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-921cac30-c12f-460d-bf97-afc50dafc759 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.164776 Aug 29 16:15:33.240179 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3301/6432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:33 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:33.276257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:33.276880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:33.283904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:33.284630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:33.285071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:33.285934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:33.286549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:33.287164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:33.453893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:33.463097 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-34d2613b-ae26-4395-a96c-a353689155f6 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1691 microversion: 2.1 time: 0.191248 Aug 29 16:15:33.464210 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3132/6433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:33 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:34.064926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:34.065948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:34.074749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.075367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.076003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.076895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.077590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.078208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.226348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:34.236879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:34.238752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:34.240109 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ab00159c-02d5-4069-92a1-55ca130eff02 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.179435 Aug 29 16:15:34.255680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:34.256256 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3302/6434] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:34 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:34.256342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:34.264717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.265235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.265700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.266529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.266991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.267443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.429572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:34.436157 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57a74723-aa12-4074-997b-a95c3ecd847a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.184854 Aug 29 16:15:34.436832 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3133/6435] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:34 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:34.485902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:34.486516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:34.496314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.496813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.497257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.497962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:34.498424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:34.498856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:34.734202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:34.749903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ff9e779-2d8c-4392-a664-f6990d693541 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1697 microversion: 2.1 time: 0.268032 Aug 29 16:15:34.750506 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3303/6436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:34 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1697 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:35.264594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:35.265254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:35.275246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.276083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.276522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.277387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.278034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.278673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.459319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:35.461176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:35.474912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.475794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.477138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.478067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.479145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.479785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.533063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:35.547636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:35.549749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:35.553822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e8d530a-faa4-48c4-822b-8d228d487f64 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.291473 Aug 29 16:15:35.555908 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3134/6437] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:35 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:35.715491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:35.724321 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8588d18f-466f-41f9-acd0-3834dd44b799 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.269296 Aug 29 16:15:35.729134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3304/6438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:35 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:35.774594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:35.775250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:35.791523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.791953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.803535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:35.804581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:35.805079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:35.805529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.095875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:36.106033 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17cf160d-fa37-49e6-a9de-904390d9be61 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1682 microversion: 2.1 time: 0.336171 Aug 29 16:15:36.106981 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3135/6439] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:35 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:36.585116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:36.587011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:36.599886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.600926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.601940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.603377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.604233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.605132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.757225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:36.758642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:36.771940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.774638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.777061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.778007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:36.778656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:36.779777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:36.794049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:36.808486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:36.811074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:36.812570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-163cff23-f736-42a2-938b-1f2e7fc3b347 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.238142 Aug 29 16:15:36.813576 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3305/6440] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:36 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:37.004545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:37.013443 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f45acee8-c108-481d-ae4c-419076c89c06 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.267567 Aug 29 16:15:37.014335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3136/6441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:36 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:37.838180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:37.838956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:37.841036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:37.842681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=12 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:37.848725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:37.849361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:37.849806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:37.850511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:37.851186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:37.851789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:37.893649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ac19e3ee-05b0-4eaf-ad09-8df4be144a3a req-9334db7f-d072-4364-974d-caefef17a451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0", "name": "network-vif-plugged", "status": "completed", "tag": "4f53a185-015c-4142-982e-3b79fd4c14df"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:37.905093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ac19e3ee-05b0-4eaf-ad09-8df4be144a3a req-9334db7f-d072-4364-974d-caefef17a451 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:37.906022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ac19e3ee-05b0-4eaf-ad09-8df4be144a3a req-9334db7f-d072-4364-974d-caefef17a451 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:37.906378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ac19e3ee-05b0-4eaf-ad09-8df4be144a3a req-9334db7f-d072-4364-974d-caefef17a451 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:37.918435 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ac19e3ee-05b0-4eaf-ad09-8df4be144a3a req-9334db7f-d072-4364-974d-caefef17a451 service nova] Creating event network-vif-plugged:4f53a185-015c-4142-982e-3b79fd4c14df for instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 on n-h1-836830-13 Aug 29 16:15:37.923839 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ac19e3ee-05b0-4eaf-ad09-8df4be144a3a req-9334db7f-d072-4364-974d-caefef17a451 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033992 Aug 29 16:15:37.924816 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3137/6442] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:15:38.001856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:38.010795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:38.012275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:38.013466 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a93d1aef-da24-401e-a27c-0d95180fc69e tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1740 microversion: 2.20 time: 0.179462 Aug 29 16:15:38.014033 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3306/6443] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:37 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:38.035126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:38.035889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:38.042556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:38.043079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:38.043520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:38.044235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:38.044693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:38.045119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:38.181431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:38.190668 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-656abb34-9aef-4532-9168-85df53aa3e5d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.160013 Aug 29 16:15:38.191386 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3138/6444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:38 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:39.037629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:39.038171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:39.045235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:39.045721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:39.046154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:39.046841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:39.047351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:39.047774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:39.185492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:39.193629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:39.195731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:39.196909 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2995494d-d3be-489f-aec1-d501acecfef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1722 microversion: 2.20 time: 0.163298 Aug 29 16:15:39.197481 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3307/6445] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:39 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:39.212234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:39.212850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:39.219970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:39.220462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:39.220900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:39.221596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:39.222058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:39.222487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:39.364345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:39.372506 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8b526e53-f0ed-41f3-accf-465cd655309b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.164316 Aug 29 16:15:39.373252 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3139/6446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:39 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:39.941713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9ab467b9-3b90-4440-9065-bb649c170a45 req-03c84674-135b-49c2-8794-c42eaf315d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65db1b3c-f7ac-4cdb-a55a-8c85697c74ec", "name": "network-vif-plugged", "status": "completed", "tag": "1c6018c1-5d15-479f-97b1-5378bea16f40"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:39.951926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9ab467b9-3b90-4440-9065-bb649c170a45 req-03c84674-135b-49c2-8794-c42eaf315d3d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:39.952436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9ab467b9-3b90-4440-9065-bb649c170a45 req-03c84674-135b-49c2-8794-c42eaf315d3d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:39.952871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9ab467b9-3b90-4440-9065-bb649c170a45 req-03c84674-135b-49c2-8794-c42eaf315d3d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:39.963721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9ab467b9-3b90-4440-9065-bb649c170a45 req-03c84674-135b-49c2-8794-c42eaf315d3d service nova] Creating event network-vif-plugged:1c6018c1-5d15-479f-97b1-5378bea16f40 for instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec on n-h2-836830-13 Aug 29 16:15:39.968925 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9ab467b9-3b90-4440-9065-bb649c170a45 req-03c84674-135b-49c2-8794-c42eaf315d3d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030878 Aug 29 16:15:39.969550 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3308/6447] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:40.220869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:40.221387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:40.228268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:40.228755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:40.229194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:40.230589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:40.231189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:40.231649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:40.362321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:40.371241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:40.372818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:40.373987 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21c6b98f-d0e4-470c-8871-7b4f442d65d8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1722 microversion: 2.20 time: 0.157333 Aug 29 16:15:40.374561 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3140/6448] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:40 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:40.394674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:40.395423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:40.401777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:40.402474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:40.403096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:40.403706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:40.404272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:40.404777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:40.538202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:40.546845 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dbdf4fa8-87d8-478f-95a8-fa958388ea7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.157342 Aug 29 16:15:40.547644 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3309/6449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:40 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:41.397653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:41.398275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:41.405389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:41.405884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:41.406336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:41.407052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:41.407507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:41.407932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:41.556478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:41.560886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:41.569492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:41.569716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:41.570259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:41.570948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:41.572127 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18ed425d-07ac-4d58-83bc-6c2019f5ea88 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1725 microversion: 2.20 time: 0.179025 Aug 29 16:15:41.572685 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3141/6450] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:41 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:41.577974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:41.578469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:41.578909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:41.579635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:41.580096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:41.580528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:41.604189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc3514a0-f2de-4d15-9425-ade4b30188d5"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:41.607756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:41.618782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:41.619554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:41.621422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:41.622130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:41.622518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:41.622949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:41.738219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:41.747512 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1fbae183-a314-45f0-9c03-c58fc76c2e96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1329 microversion: 2.1 time: 0.181921 Aug 29 16:15:41.748411 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3310/6451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:41 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1329 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:41.918272 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b5f72ff-075a-4900-8546-587d8ae6296d tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.320474 Aug 29 16:15:41.918906 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3142/6452] 10.222.0.83 () {62 vars in 1364 bytes} [Mon Aug 29 16:15:41 2022] POST /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:15:42.041090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:42.041595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:42.047890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.048374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.048813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.049507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.049988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.050418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.302202 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83906ac7-8d1d-4315-a79e-417871caf0cd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-volume_attachments/cc3514a0-f2de-4d15-9425-ade4b30188d5" status: 202 len: 0 microversion: 2.20 time: 0.265156 Aug 29 16:15:42.303074 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3311/6453] 10.222.0.83 () {60 vars in 1457 bytes} [Mon Aug 29 16:15:42 2022] DELETE /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-volume_attachments/cc3514a0-f2de-4d15-9425-ade4b30188d5 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:15:42.372904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:42.374210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:42.386995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.387793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.388997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.389892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.390364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.390794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.421365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129132) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 16:15:42.491529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3c76b938-f20d-43df-98dd-3a19ba585dd2 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "POST /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/action" status: 202 len: 0 microversion: 2.20 time: 0.130920 Aug 29 16:15:42.492274 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3143/6454] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 16:15:42 2022] POST /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:15:42.500774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:42.501391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:42.507510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.508004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.508446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.509139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.509595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.510027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.683789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:42.692141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:42.693689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:42.694842 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ac0172a-8c79-46ea-a649-cb2cf3b0a178 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1673 microversion: 2.20 time: 0.198093 Aug 29 16:15:42.695429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3312/6455] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:42 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:42.769123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:42.769912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:42.776001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.777187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.777895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.778662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.779339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.779880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.830769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-eec1db01-3ff9-485a-bd33-918030f4971b req-d7de9a98-441d-46e4-981f-53f4410a1bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "name": "network-vif-unplugged", "status": "completed", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:42.844389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eec1db01-3ff9-485a-bd33-918030f4971b req-d7de9a98-441d-46e4-981f-53f4410a1bf6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.845066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eec1db01-3ff9-485a-bd33-918030f4971b req-d7de9a98-441d-46e4-981f-53f4410a1bf6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.845673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-eec1db01-3ff9-485a-bd33-918030f4971b req-d7de9a98-441d-46e4-981f-53f4410a1bf6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.862254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.server_external_events [req-eec1db01-3ff9-485a-bd33-918030f4971b req-d7de9a98-441d-46e4-981f-53f4410a1bf6 service nova] Unable to find a host for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79. Dropping event network-vif-unplugged {{(pid=129133) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 16:15:42.863373 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-eec1db01-3ff9-485a-bd33-918030f4971b req-d7de9a98-441d-46e4-981f-53f4410a1bf6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036652 Aug 29 16:15:42.863978 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3313/6456] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 29 16:15:42.932519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:42.941319 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac9f8654-d212-41ff-a401-35c76e7c0ce8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1509 microversion: 2.1 time: 0.176538 Aug 29 16:15:42.941912 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3144/6457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:42 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:42.962150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:42.962794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:42.969697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.970179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.970610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:42.971330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:42.971780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:42.972203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:43.119983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:43.122498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:43.129575 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-94565a2b-66bc-4f8d-a90b-04b78fdf38d7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1509 microversion: 2.1 time: 0.171243 Aug 29 16:15:43.130312 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3314/6458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:42 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:43.149847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:43.150580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:43.157667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:43.158368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:43.158807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:43.159543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:43.160002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:43.160431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:43.190505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:15:43.272509 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0361409e-816b-443f-a97e-9a33072b6a8e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 204 len: 0 microversion: 2.1 time: 0.126021 Aug 29 16:15:43.273119 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3145/6459] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:15:43 2022] DELETE /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:15:43.283701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:43.284411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:43.291290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:43.291780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:43.292367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:43.293207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:43.293667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:43.294144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:43.430290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:43.439159 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9929f79c-fdf6-436e-afe7-051acef4c876 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1515 microversion: 2.1 time: 0.160219 Aug 29 16:15:43.439937 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3315/6460] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:43 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:43.718530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:43.719305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:43.726190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:43.726703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:43.727176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:43.727857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:43.728308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:43.728731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:43.878768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:43.890672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:43.892372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:43.893765 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad9fefae-dc1a-45f1-b2ac-17642f991cb7 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.179688 Aug 29 16:15:43.894657 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3146/6461] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:43 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:44.461043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:44.461658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:44.469214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:44.469706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:44.470251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:44.470950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:44.471794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:44.472224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:44.637162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f5b977ee-5da4-4b7a-b502-c580cadc57f2 req-89a7f76a-f423-4d00-ae4b-238b4c2423b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:44.647142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f5b977ee-5da4-4b7a-b502-c580cadc57f2 req-89a7f76a-f423-4d00-ae4b-238b4c2423b3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:44.647628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f5b977ee-5da4-4b7a-b502-c580cadc57f2 req-89a7f76a-f423-4d00-ae4b-238b4c2423b3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:44.648064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f5b977ee-5da4-4b7a-b502-c580cadc57f2 req-89a7f76a-f423-4d00-ae4b-238b4c2423b3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:44.663194 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f5b977ee-5da4-4b7a-b502-c580cadc57f2 req-89a7f76a-f423-4d00-ae4b-238b4c2423b3 service nova] Creating event network-changed:e4bfbf99-90f2-4df5-acc6-3031e3a7f32a for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 on n-h1-836830-13 Aug 29 16:15:44.669418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f5b977ee-5da4-4b7a-b502-c580cadc57f2 req-89a7f76a-f423-4d00-ae4b-238b4c2423b3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035822 Aug 29 16:15:44.670368 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3147/6462] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:44.724398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:44.734052 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4339f42-e21c-44c2-bcf6-ffc687a20a94 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1515 microversion: 2.1 time: 0.276800 Aug 29 16:15:44.734579 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3316/6463] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:44 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:44.920687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:44.921384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:44.928294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:44.928774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:44.929203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:44.929886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:44.930335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:44.930754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:45.112977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:45.122074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:45.123708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:45.125645 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-145d9094-a981-4f6a-8ebc-b21c881913af tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.210421 Aug 29 16:15:45.126525 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3148/6464] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:44 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:45.601372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6aebdcbd-947d-4a76-9b5a-0b92bc3972d6 req-f2ff945a-8c3e-4d0c-9827-80936138339b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65db1b3c-f7ac-4cdb-a55a-8c85697c74ec", "name": "network-vif-deleted", "tag": "1c6018c1-5d15-479f-97b1-5378bea16f40"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:45.633977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6aebdcbd-947d-4a76-9b5a-0b92bc3972d6 req-f2ff945a-8c3e-4d0c-9827-80936138339b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:45.634915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6aebdcbd-947d-4a76-9b5a-0b92bc3972d6 req-f2ff945a-8c3e-4d0c-9827-80936138339b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:45.636934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6aebdcbd-947d-4a76-9b5a-0b92bc3972d6 req-f2ff945a-8c3e-4d0c-9827-80936138339b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:45.681002 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6aebdcbd-947d-4a76-9b5a-0b92bc3972d6 req-f2ff945a-8c3e-4d0c-9827-80936138339b service nova] Creating event network-vif-deleted:1c6018c1-5d15-479f-97b1-5378bea16f40 for instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec on n-h2-836830-13 Aug 29 16:15:45.700954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6aebdcbd-947d-4a76-9b5a-0b92bc3972d6 req-f2ff945a-8c3e-4d0c-9827-80936138339b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103786 Aug 29 16:15:45.711397 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3317/6465] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:45.757239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:45.757913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:45.782863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:45.787633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:45.798473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:45.800009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:45.800690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:45.808929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:45.892136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:45.893005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:45.894083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:45.894927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lazy-loading 'fault' on Instance uuid 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:15:45.963603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:45.989644 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3cac9ed0-763f-40cc-be82-b6a7f9af4ea7 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 200 len: 1319 microversion: 2.1 time: 0.236153 Aug 29 16:15:45.994303 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3149/6466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:45 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:46.149537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:46.150157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:46.165884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:46.166945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:46.168391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:46.170600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:46.171497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:46.172219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:46.329968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:46.340110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:46.342631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:46.345546 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ee137937-82b6-4779-a639-e39b6c4904f6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.200346 Aug 29 16:15:46.346509 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3318/6467] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:46 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:47.021416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:47.022065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:47.029059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.029560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.030001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.030719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.031223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.031658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.048020 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec HTTP/1.1 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '65db1b3c-f7ac-4cdb-a55a-8c85697c74ec'} Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:15:47.049723 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-485e2dc5-5227-4d09-8a8e-76114c39cef1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 404 len: 111 microversion: 2.1 time: 0.033796 Aug 29 16:15:47.053485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3150/6468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:47 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:15:47.061019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cbce0969-1739-43d8-bb9c-bad8cedd5640 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '.version_select at 0x7f32ed08f5e0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:47.081842 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cbce0969-1739-43d8-bb9c-bad8cedd5640 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-key-1158488205" status: 202 len: 0 microversion: 2.1 time: 0.025511 Aug 29 16:15:47.082471 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3319/6469] 10.222.0.83 () {58 vars in 1209 bytes} [Mon Aug 29 16:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1158488205 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:15:47.135606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1742020343", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:47.193943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:47.369295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:47.370328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:47.378185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.379070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.379752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.380675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.381343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.381981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.540819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:47.550508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:47.551839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:47.553290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4aab4f0-f1ef-46b4-8998-fb21843f1580 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.188034 Aug 29 16:15:47.553873 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3320/6470] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:47 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:47.659147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:47.659579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:47.660096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:47.660514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:47.660928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:47.670619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.671134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.671568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.672303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:47.672744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:47.673237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:47.692586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:47.698284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:47.711741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:47.714222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:47.778263 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14cdfdca-4d93-4da6-8ebf-e13fca972da4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646581 Aug 29 16:15:47.779344 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3151/6471] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:15:47.789910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ace957e-6857-4c1b-a502-4fcb7c49a834 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:47.790522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ace957e-6857-4c1b-a502-4fcb7c49a834 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:47.846237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ace957e-6857-4c1b-a502-4fcb7c49a834 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:47.855156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ace957e-6857-4c1b-a502-4fcb7c49a834 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1209 microversion: 2.1 time: 0.068458 Aug 29 16:15:47.856194 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3321/6472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:47 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1209 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:48.580005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:48.581304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:48.583504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:48.592010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:48.592756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:48.593209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:48.593920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:48.594381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:48.594811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:48.755701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:48.765494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:48.767172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:48.768536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40bee5ae-2563-43d8-8d9c-741f38ab7a97 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.195641 Aug 29 16:15:48.786842 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3152/6473] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:48 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:48.878023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:48.878642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:48.894784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:48.895896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:48.896548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:48.897655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:48.898332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:48.899150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:48.972268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:48.981969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1eecd51-2617-46b8-9c8c-37e5e7f6c321 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1261 microversion: 2.1 time: 0.107640 Aug 29 16:15:48.983137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3322/6474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:48 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1261 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:49.795338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:49.796149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:49.814641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:49.815532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:49.816117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:49.816982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:49.817582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:49.818150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:50.012767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:50.013385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:50.033260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:50.033769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:50.034209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:50.034953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:50.035443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:50.035873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:50.122362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:50.140387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:50.141850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:50.143219 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99b4f03e-39d1-4d1e-90ba-362293f32421 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.353260 Aug 29 16:15:50.143793 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3153/6475] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:49 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:50.215922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:50.224642 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ecd177f9-53a3-43f3-8569-1471df6f0b10 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1309 microversion: 2.1 time: 0.216353 Aug 29 16:15:50.225550 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3323/6476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:50 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1309 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:50.627107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7616dbdd-b21b-4514-8bca-b9a77dc19434 req-781a8f23-af89-4812-bfd8-5a3bb1513a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d793c2-710d-4174-8dd7-a82591cb152c", "tag": "f42ca1d8-de60-4963-b8ee-714657f3c3dd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:50.639461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7616dbdd-b21b-4514-8bca-b9a77dc19434 req-781a8f23-af89-4812-bfd8-5a3bb1513a20 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:50.640335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7616dbdd-b21b-4514-8bca-b9a77dc19434 req-781a8f23-af89-4812-bfd8-5a3bb1513a20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:50.641003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7616dbdd-b21b-4514-8bca-b9a77dc19434 req-781a8f23-af89-4812-bfd8-5a3bb1513a20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:50.657452 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7616dbdd-b21b-4514-8bca-b9a77dc19434 req-781a8f23-af89-4812-bfd8-5a3bb1513a20 service nova] Creating event network-changed:f42ca1d8-de60-4963-b8ee-714657f3c3dd for instance a2d793c2-710d-4174-8dd7-a82591cb152c on n-h2-836830-13 Aug 29 16:15:50.662872 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7616dbdd-b21b-4514-8bca-b9a77dc19434 req-781a8f23-af89-4812-bfd8-5a3bb1513a20 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042517 Aug 29 16:15:50.663979 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3154/6477] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:51.174069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:51.179856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:51.192454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:51.192948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:51.193388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:51.194089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:51.194539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:51.194962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:51.248729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:51.249444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:51.255935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:51.256875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:51.257659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:51.259098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:51.259997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:51.265033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:51.282911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:51.372210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:51.382464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:51.384241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:51.390009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4700cab-75cb-4f47-af2b-d26ef276a75a tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.219747 Aug 29 16:15:51.390866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3324/6478] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:51 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:51.458504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:51.467279 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d200a46c-acb0-44ca-b577-fc320930cd3c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1309 microversion: 2.1 time: 0.224777 Aug 29 16:15:51.467867 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3155/6479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:51 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:52.413871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:52.414510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:52.422105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:52.422565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:52.422989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:52.423696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:52.424145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:52.424563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:52.489341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:52.490962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:52.499412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:52.499917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:52.500356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:52.503960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:52.504448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:52.504891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:52.569909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:52.584260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:52.586178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:52.587839 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c0f32f5-a721-4ac3-a7d7-0433df4458fb tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.177807 Aug 29 16:15:52.589977 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3325/6480] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:52 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:52.668719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:52.680686 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4be3f990-ed7f-4ad3-8212-82d712016ece tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1309 microversion: 2.1 time: 0.194922 Aug 29 16:15:52.691314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3156/6481] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:52 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:53.616720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:53.618064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:53.625810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:53.626801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:53.627481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:53.628433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:53.628974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:53.629477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:53.707759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:53.707759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:53.730646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:53.731585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:53.733651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:53.734541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:53.735132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:53.735727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:53.796789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:53.806253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:53.813976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:53.815753 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11a8bd05-ec9e-46c0-be9b-07994ba362c1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.203050 Aug 29 16:15:53.818339 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3326/6482] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:53 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:54.250389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:54.258338 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-771683d3-9c06-4e22-bedc-b4b64977bc52 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1309 microversion: 2.1 time: 0.557548 Aug 29 16:15:54.258947 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3157/6483] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:53 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1309 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:54.843370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:54.843992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:54.847181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:54.852637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:54.853158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:54.853609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:54.854439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:54.855667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:54.856109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:54.997203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:55.005504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:55.006955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:55.008163 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a336315-0c8c-4856-b5a1-37eeafd520a8 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.169386 Aug 29 16:15:55.008734 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3327/6484] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:54 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:55.279816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:55.280350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:55.287305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.288252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.288995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.290190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:55.290905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:55.291820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:55.432039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:55.440558 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f3229b64-92df-4539-b44b-d106deab85a9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1309 microversion: 2.1 time: 0.164739 Aug 29 16:15:55.441141 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3158/6485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:55 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:56.032847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:56.033407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:56.040093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:56.040572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:56.041005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.041690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:56.042143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:56.042565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.173360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:56.181786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:56.183250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:56.184520 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-61c15ffe-0651-4299-9ef6-e709d6d1ea1f tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.156226 Aug 29 16:15:56.185095 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3328/6486] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:56 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:56.461357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:56.461975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:56.468883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:56.469371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:56.469908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.470629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:56.471119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:56.471546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.607500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:56.615186 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-adef227f-094e-4c37-b2fc-6211c43064b1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1309 microversion: 2.1 time: 0.157775 Aug 29 16:15:56.615762 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3159/6487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:56 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:56.883586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-62ad9a60-d895-4085-9380-cf95bd623cc0 req-e98c9809-82c3-46c6-a5a5-bf49147c953a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d793c2-710d-4174-8dd7-a82591cb152c", "name": "network-vif-plugged", "status": "completed", "tag": "f42ca1d8-de60-4963-b8ee-714657f3c3dd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:56.893574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-62ad9a60-d895-4085-9380-cf95bd623cc0 req-e98c9809-82c3-46c6-a5a5-bf49147c953a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:56.894056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-62ad9a60-d895-4085-9380-cf95bd623cc0 req-e98c9809-82c3-46c6-a5a5-bf49147c953a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:56.894465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-62ad9a60-d895-4085-9380-cf95bd623cc0 req-e98c9809-82c3-46c6-a5a5-bf49147c953a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:56.914978 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-62ad9a60-d895-4085-9380-cf95bd623cc0 req-e98c9809-82c3-46c6-a5a5-bf49147c953a service nova] Creating event network-vif-plugged:f42ca1d8-de60-4963-b8ee-714657f3c3dd for instance a2d793c2-710d-4174-8dd7-a82591cb152c on n-h2-836830-13 Aug 29 16:15:56.920262 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-62ad9a60-d895-4085-9380-cf95bd623cc0 req-e98c9809-82c3-46c6-a5a5-bf49147c953a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040280 Aug 29 16:15:56.920901 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3329/6488] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:15:57.208707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:57.209332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:57.215508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:57.216199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:57.216644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:57.217339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:57.217802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:57.218235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:57.349173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:57.357333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:57.358796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:57.360025 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3792c834-6cef-41a1-b432-ff2f43baf3a6 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.155290 Aug 29 16:15:57.360594 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3160/6489] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:57 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:57.637857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:57.638586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:57.644793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:57.645277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:57.645707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:57.646387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:57.646840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:57.647285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:57.782777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:57.790930 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7437d6ec-9470-46eb-b996-f8bf9079c808 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1309 microversion: 2.1 time: 0.158331 Aug 29 16:15:57.791572 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3330/6490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:57 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:15:58.383690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:58.384316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:58.386971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:58.388384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:58.394267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:58.394758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:58.395235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:58.395935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:58.396393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:58.396834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:58.537060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:58.545779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:58.547320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:58.548462 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f6d4c07-922d-497a-beb2-163c9bf7219c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.168752 Aug 29 16:15:58.549035 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3161/6491] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:58 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:15:58.818690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:58.819491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:58.821322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:15:58.829392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:58.829889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:58.830334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:58.831074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:58.831537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:58.831968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.003886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:59.011882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1b9345ca-d3ad-4f8f-b8e4-d47ee17090e1 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1490 microversion: 2.1 time: 0.197336 Aug 29 16:15:59.012545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3331/6492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:58 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1490 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:59.073541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1742020343", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:59.128365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:15:59.505406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:15:59.505898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:15:59.506284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:15:59.506756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:15:59.507220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:15:59.516367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:59.516844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:59.517283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.517998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:59.518445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:59.518864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.536630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:15:59.541888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:15:59.556440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:15:59.558991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:15:59.572562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:59.573205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:59.579633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:59.580175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:59.580555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.581302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:59.581858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:59.582258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.607771 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9404d31-05c0-4d34-858d-d138c26b0e80 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538174 Aug 29 16:15:59.608799 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3162/6493] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:15:59.618707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-677afc90-dcda-41db-9f01-732296947044 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:15:59.619359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-677afc90-dcda-41db-9f01-732296947044 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:15:59.676137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-677afc90-dcda-41db-9f01-732296947044 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:59.684133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-677afc90-dcda-41db-9f01-732296947044 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1209 microversion: 2.1 time: 0.069028 Aug 29 16:15:59.685822 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3163/6494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:15:59 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1209 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:15:59.741915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:59.751653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:59.753696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:15:59.755358 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1364e987-dec1-4cc2-9ca2-e40910aaf3bc tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.186977 Aug 29 16:15:59.756004 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3332/6495] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:15:59 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:15:59.943215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-41e21bdd-137b-4fe8-8522-3904aea5ece6 req-fc9ae9c6-e027-420e-be90-d2214a923af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "name": "network-vif-plugged", "status": "completed", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:15:59.953674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-41e21bdd-137b-4fe8-8522-3904aea5ece6 req-fc9ae9c6-e027-420e-be90-d2214a923af1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:15:59.954137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-41e21bdd-137b-4fe8-8522-3904aea5ece6 req-fc9ae9c6-e027-420e-be90-d2214a923af1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:15:59.954567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-41e21bdd-137b-4fe8-8522-3904aea5ece6 req-fc9ae9c6-e027-420e-be90-d2214a923af1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:15:59.967729 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-41e21bdd-137b-4fe8-8522-3904aea5ece6 req-fc9ae9c6-e027-420e-be90-d2214a923af1 service nova] Creating event network-vif-plugged:e4bfbf99-90f2-4df5-acc6-3031e3a7f32a for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 on n-h1-836830-13 Aug 29 16:15:59.973269 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-41e21bdd-137b-4fe8-8522-3904aea5ece6 req-fc9ae9c6-e027-420e-be90-d2214a923af1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033594 Aug 29 16:15:59.974028 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3164/6496] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:00.705330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:00.705944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:00.713022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:00.713437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:00.713873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:00.714573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:00.715061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:00.715528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:00.779684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:00.783484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:00.784370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:00.788647 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0c18997d-2a89-4daa-a7bd-9ca39251f603 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1261 microversion: 2.1 time: 0.087191 Aug 29 16:16:00.789282 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3333/6497] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:00 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:00.803196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:00.803196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:00.813166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:00.814135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:00.814632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:00.815114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:01.045543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:01.053857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:01.055375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:01.056524 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b25aab91-7488-4dd1-bb7b-cef875cfb95b tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.279335 Aug 29 16:16:01.057092 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3165/6498] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:00 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:16:01.810915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:01.812279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:01.823757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:01.827946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:01.828632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:01.829717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:01.832334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:01.833164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:02.021978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:02.026033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:02.041718 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e04667a-bbf3-45e6-955a-6ce8be368ba5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.235825 Aug 29 16:16:02.055210 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3334/6499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:01 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:02.079582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:02.080636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:02.087674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:02.088174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:02.088612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:02.089318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:02.089776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:02.090207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:02.305552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:02.316410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:02.317850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:02.319011 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b65ac695-411b-4e38-8206-94129a4045ac tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1731 microversion: 2.20 time: 0.243788 Aug 29 16:16:02.319610 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3166/6500] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:02 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:16:02.482610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6ba76592-3dcd-49a4-8c6a-355f17dd6e33 req-16f84b64-43a8-4715-9528-64df71f3b901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6", "tag": "248811ca-d778-4ce0-8d32-1627a69a2772"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:02.493999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ba76592-3dcd-49a4-8c6a-355f17dd6e33 req-16f84b64-43a8-4715-9528-64df71f3b901 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:02.494484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ba76592-3dcd-49a4-8c6a-355f17dd6e33 req-16f84b64-43a8-4715-9528-64df71f3b901 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:02.495070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6ba76592-3dcd-49a4-8c6a-355f17dd6e33 req-16f84b64-43a8-4715-9528-64df71f3b901 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:02.506235 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6ba76592-3dcd-49a4-8c6a-355f17dd6e33 req-16f84b64-43a8-4715-9528-64df71f3b901 service nova] Creating event network-changed:248811ca-d778-4ce0-8d32-1627a69a2772 for instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 on n-h2-836830-13 Aug 29 16:16:02.510910 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6ba76592-3dcd-49a4-8c6a-355f17dd6e33 req-16f84b64-43a8-4715-9528-64df71f3b901 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032907 Aug 29 16:16:02.511545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3335/6501] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:16:03.063320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:03.063932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:03.072415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:03.073302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:03.074093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:03.075331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:03.076156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:03.077018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:03.240736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:03.248931 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-830d0c95-66fb-4c8c-84a0-6bf9bd802d18 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.189531 Aug 29 16:16:03.249517 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3167/6502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:03 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:03.344006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:03.344723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:03.351015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:03.351522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:03.351957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:03.352653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:03.353108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:03.353530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:03.495492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:03.504564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:03.506028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:03.507274 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-37c1b922-aa3b-4054-9a95-f7dfd436cb9c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1718 microversion: 2.20 time: 0.169172 Aug 29 16:16:03.507853 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3336/6503] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:03 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1718 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:16:04.269810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:04.270430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:04.277409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:04.277906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:04.278955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:04.280150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:04.280888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:04.281326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:04.329507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:04.331828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:04.337904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:04.338395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:04.338836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:04.339579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:04.340041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:04.340472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:04.392734 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aea59352-2aaf-42b6-a175-37a5313b9449 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "POST /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0/action" status: 200 len: 24556 microversion: 2.1 time: 0.067789 Aug 29 16:16:04.393374 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3337/6504] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:16:04 2022] POST /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0/action => generated 24556 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:16:04.416658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:04.424907 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aaf15e8f-0cd2-4d38-b9b8-cd945d675078 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.159065 Aug 29 16:16:04.425485 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3168/6505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:04 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:05.445868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:05.446584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:05.454708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:05.455238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:05.455687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:05.456413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:05.456852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:05.457283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:05.595416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:05.603520 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f4bd778-1add-4ad3-823d-8de19d42460b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.161844 Aug 29 16:16:05.604113 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3338/6506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:05 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:06.625945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:06.626565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:06.634336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:06.634828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:06.635341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:06.636020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:06.636476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:06.636900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:06.783545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:06.791512 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4047d36e-af40-4e21-9bf2-05e290b2e3b9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.169473 Aug 29 16:16:06.792296 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3169/6507] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:06 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:07.813479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:07.814125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:07.821083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:07.821568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:07.822004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:07.822698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:07.823183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:07.823610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:07.884381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:07.884946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:07.893304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:07.893793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:07.894235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:07.894927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:07.895405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:07.895826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:07.923244 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb44b71c-8bf7-4503-8ca4-cdfbba20b44d tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042817 Aug 29 16:16:07.923948 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3170/6508] 10.222.0.83 () {58 vars in 1293 bytes} [Mon Aug 29 16:16:07 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:16:07.962751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:07.972729 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09d688e1-791b-49da-a9c2-8f2bdd9d251f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.163585 Aug 29 16:16:07.973527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3339/6509] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:07 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:08.923317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1d0e033f-a087-4ad9-a879-c11e933ac67c req-b71b6262-f9d9-45b4-be79-919c90fb5cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6", "name": "network-vif-plugged", "status": "completed", "tag": "248811ca-d778-4ce0-8d32-1627a69a2772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:08.934995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d0e033f-a087-4ad9-a879-c11e933ac67c req-b71b6262-f9d9-45b4-be79-919c90fb5cc8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:08.935617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d0e033f-a087-4ad9-a879-c11e933ac67c req-b71b6262-f9d9-45b4-be79-919c90fb5cc8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:08.936063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d0e033f-a087-4ad9-a879-c11e933ac67c req-b71b6262-f9d9-45b4-be79-919c90fb5cc8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:08.948007 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1d0e033f-a087-4ad9-a879-c11e933ac67c req-b71b6262-f9d9-45b4-be79-919c90fb5cc8 service nova] Creating event network-vif-plugged:248811ca-d778-4ce0-8d32-1627a69a2772 for instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 on n-h2-836830-13 Aug 29 16:16:08.953651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1d0e033f-a087-4ad9-a879-c11e933ac67c req-b71b6262-f9d9-45b4-be79-919c90fb5cc8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034327 Aug 29 16:16:08.954289 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3171/6510] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:16:08.993886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:08.994507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:09.002925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:09.003449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:09.003878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:09.004563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:09.005013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:09.005431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:09.148532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:09.157223 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60eb812e-282b-41e0-9ef5-493735ad5dab tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.167307 Aug 29 16:16:09.157816 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3340/6511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:08 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:10.177107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:10.178353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:10.183679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:10.185054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:10.192345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:10.192835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:10.193281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:10.193977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:10.194431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:10.194856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:10.330761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:10.338597 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6fd59041-a66a-460c-8061-fd713ac9532d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1309 microversion: 2.1 time: 0.162451 Aug 29 16:16:10.339202 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3172/6512] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:10 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:11.362100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:11.363122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:11.371773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.372541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.373036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.373755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.374211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.374636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.578540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:11.590580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:11.591287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:11.597506 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fca76ba5-fd67-4fc1-bc40-840d2c795077 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1489 microversion: 2.1 time: 0.241502 Aug 29 16:16:11.604347 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3341/6513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:11 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1489 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:11.604523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.604523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.604523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.604523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.604523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.604523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.605043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5a5e76bb-b66a-4942-83de-f2e6de63e7ac req-eb8820e4-816e-4523-a149-90abf9973897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0", "tag": "4f53a185-015c-4142-982e-3b79fd4c14df"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:11.612569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5a5e76bb-b66a-4942-83de-f2e6de63e7ac req-eb8820e4-816e-4523-a149-90abf9973897 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.612972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5a5e76bb-b66a-4942-83de-f2e6de63e7ac req-eb8820e4-816e-4523-a149-90abf9973897 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.613682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5a5e76bb-b66a-4942-83de-f2e6de63e7ac req-eb8820e4-816e-4523-a149-90abf9973897 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.627905 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5a5e76bb-b66a-4942-83de-f2e6de63e7ac req-eb8820e4-816e-4523-a149-90abf9973897 service nova] Creating event network-changed:4f53a185-015c-4142-982e-3b79fd4c14df for instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 on n-h1-836830-13 Aug 29 16:16:11.633128 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5a5e76bb-b66a-4942-83de-f2e6de63e7ac req-eb8820e4-816e-4523-a149-90abf9973897 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033900 Aug 29 16:16:11.634398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:16:11.637336 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3342/6514] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:11.647959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:11.649305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:11.660091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.660598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.661040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.661752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.662219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.662649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.710936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:11.755253 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6db0656-e305-4083-81e1-c2eabfb3cb04 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 204 len: 0 microversion: 2.1 time: 0.168114 Aug 29 16:16:11.759685 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3173/6515] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:16:11 2022] DELETE /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:16:11.768284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:11.769355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:11.776626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.777857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.778503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.779598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.780631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.781279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.906058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:11.923954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-50bb4966-0030-4c82-b2c2-7f6090f245d2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1490 microversion: 2.1 time: 0.284301 Aug 29 16:16:11.938545 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3343/6516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:11 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1490 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:11.946307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:11.947293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:11.948993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:11.956643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.957133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.957562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:11.957752 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c3f27006-c388-4acb-b700-3420c2d56557 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1688 microversion: 2.1 time: 0.196467 Aug 29 16:16:11.958511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:11.958651 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3174/6517] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:11 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:11.958730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:11.959215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:12.095954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:12.103907 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ff4728a-b53e-46d2-94c5-6b285009b775 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1489 microversion: 2.1 time: 0.162649 Aug 29 16:16:12.104488 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3344/6518] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:11 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1489 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:12.124659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:12.125113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:12.131230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:12.131724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:12.132164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:12.132929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:12.133390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:12.133814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:12.159792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:16:12.241681 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-214c34f6-d18f-4ed1-a725-5befc06d6b66 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 204 len: 0 microversion: 2.1 time: 0.121009 Aug 29 16:16:12.242317 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3175/6519] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:16:12 2022] DELETE /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:16:12.252383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:12.253008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:12.263111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:12.263814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:12.264581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:12.265336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:12.265792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:12.266216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:12.413910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:12.422479 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d39340c7-ad27-4195-9d7b-cbfd69e4cc3f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1495 microversion: 2.1 time: 0.175596 Aug 29 16:16:12.423100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3345/6520] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:12 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1495 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:12.985291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:12.988189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:13.007773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:13.009290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:13.010474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:13.012040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:13.013837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:13.014871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:13.187281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:13.196077 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-962685d1-aeb8-4bc9-9d8e-5dc90cee2fcd tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1688 microversion: 2.1 time: 0.219570 Aug 29 16:16:13.196894 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3176/6521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:12 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:13.445539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:13.446188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:13.453599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:13.454091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:13.454529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:13.455274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:13.455735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:13.456159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:13.595792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:13.604275 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e1d393a-8475-49d9-9172-c5c615395d37 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1495 microversion: 2.1 time: 0.162651 Aug 29 16:16:13.604907 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3346/6522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:13 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1495 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:14.218303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:14.218939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:14.226936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:14.227465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:14.227903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:14.228615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:14.229103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:14.229690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:14.564881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce5d3d668743d5b8843936f77c0150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bd3c1e18644293a3cc974c300efd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:14.585104 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54b6e748-7643-422b-8865-3a6233865240 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 200 len: 1502 microversion: 2.1 time: 0.370557 Aug 29 16:16:14.599163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3177/6523] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:14 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 1502 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:16:14.625764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:14.626452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:14.633520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:14.634239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:14.634668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:14.635403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:14.635853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:14.636332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:14.665601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3d0c65e7-bd57-451a-8c09-89c265b6a1e1 req-a6ceda02-f564-40ec-b869-14a73bcd75d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0", "name": "network-vif-deleted", "tag": "4f53a185-015c-4142-982e-3b79fd4c14df"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:14.678541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3d0c65e7-bd57-451a-8c09-89c265b6a1e1 req-a6ceda02-f564-40ec-b869-14a73bcd75d2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:14.679158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3d0c65e7-bd57-451a-8c09-89c265b6a1e1 req-a6ceda02-f564-40ec-b869-14a73bcd75d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:14.679691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3d0c65e7-bd57-451a-8c09-89c265b6a1e1 req-a6ceda02-f564-40ec-b869-14a73bcd75d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:14.694194 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3d0c65e7-bd57-451a-8c09-89c265b6a1e1 req-a6ceda02-f564-40ec-b869-14a73bcd75d2 service nova] Creating event network-vif-deleted:4f53a185-015c-4142-982e-3b79fd4c14df for instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 on n-h1-836830-13 Aug 29 16:16:14.701814 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3d0c65e7-bd57-451a-8c09-89c265b6a1e1 req-a6ceda02-f564-40ec-b869-14a73bcd75d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039881 Aug 29 16:16:14.702836 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3178/6524] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:16:14.808914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:14.824327 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9de3d632-c934-4d33-90d8-33fb6e7a527b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1495 microversion: 2.1 time: 0.202941 Aug 29 16:16:14.831069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3347/6525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:14 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1495 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:15.623432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:15.624049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] [instance: 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:15.630607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:15.631117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:15.631554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:15.632318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:15.632795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:15.633223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:15.647330 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] HTTP exception thrown: Instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 could not be found. Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Request method failure captured: Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 HTTP/1.1 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDONG2yb9mOHKeSltTvDyEcQiLtYQbcBPTxy0x3FxNBGEXH1-i_wA8cuOZwd2nh_mlieUYhV6h68joQSnzP2mBZSWo_OXVfZhWFJZt3PmVDpW23gIlfq-AEevegrGoX_S4C-hfVnJi8_8nBLzj4KsqpP-tAe80eHDwGKZwj5vloWUvXM Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_18bd3c1e18644293a3cc974c300efd06", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/18bd3c1e18644293a3cc974c300efd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/18bd3c1e18644293a3cc974c300efd06"}]}] Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 18bd3c1e18644293a3cc974c300efd06 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1041807496 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e1ce5d3d668743d5b8843936f77c0150 Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1041807496-project Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 could not be found. Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0'} Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 could not be found. Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 could not be found. Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:15.648975 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 could not be found. Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Returning 404 to user: Instance 7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a5cc1ec-b3a8-4c16-af89-9414303ef799 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0" status: 404 len: 111 microversion: 2.1 time: 0.032286 Aug 29 16:16:15.654193 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3179/6526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:15 2022] GET /compute/v2.1/servers/7d19df1b-f4b2-4dc8-ba4a-fbb9a94ccce0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:16:15.846252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:15.846982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:15.855597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:15.856168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:15.856612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:15.857420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:15.858277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:15.858277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:15.894302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:15.895052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:15.895485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:15.895949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lazy-loading 'fault' on Instance uuid 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:16:15.941045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:15.948368 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c3b0f9e-6317-4d8c-8de9-443af4aec733 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 200 len: 1299 microversion: 2.1 time: 0.106221 Aug 29 16:16:15.949256 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3348/6527] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:15 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:16.750649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e463499f-17e1-4413-9f3a-f1662f94fbd8 req-6357d9d7-0e4a-4ce7-bf31-e5c9d1d65ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6", "name": "network-vif-deleted", "tag": "248811ca-d778-4ce0-8d32-1627a69a2772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:16.761087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e463499f-17e1-4413-9f3a-f1662f94fbd8 req-6357d9d7-0e4a-4ce7-bf31-e5c9d1d65ddd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:16.761571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e463499f-17e1-4413-9f3a-f1662f94fbd8 req-6357d9d7-0e4a-4ce7-bf31-e5c9d1d65ddd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:16.761998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e463499f-17e1-4413-9f3a-f1662f94fbd8 req-6357d9d7-0e4a-4ce7-bf31-e5c9d1d65ddd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:16.776928 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e463499f-17e1-4413-9f3a-f1662f94fbd8 req-6357d9d7-0e4a-4ce7-bf31-e5c9d1d65ddd service nova] Creating event network-vif-deleted:248811ca-d778-4ce0-8d32-1627a69a2772 for instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 on n-h2-836830-13 Aug 29 16:16:16.782321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e463499f-17e1-4413-9f3a-f1662f94fbd8 req-6357d9d7-0e4a-4ce7-bf31-e5c9d1d65ddd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035354 Aug 29 16:16:16.783184 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3180/6528] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:16.970361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:16.971054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:16.977974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:16.978458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:16.978893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:16.979607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:16.980063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:16.980481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:16.994221 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 HTTP/1.1 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6'} Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:16.995921 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5d653788-7a9b-4071-8aa1-92f8a6df01db tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 404 len: 111 microversion: 2.1 time: 0.031719 Aug 29 16:16:17.000382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3349/6529] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:16 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:16:17.008855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:17.009698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:17.016811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:17.017391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:17.017903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:17.018675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:17.019286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:17.019786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:17.046097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:16:17.146137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c98e35ec-390b-4b6e-912a-621e938b2c95 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 204 len: 0 microversion: 2.1 time: 0.141227 Aug 29 16:16:17.146855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3181/6530] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:16:17 2022] DELETE /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:16:17.156155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:17.157036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:17.163730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:17.164481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:17.164927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:17.165648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:17.166092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:17.166516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:17.712548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:17.720727 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e0c3220d-a0a7-4f7e-9cc0-fa85260fdcb8 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1496 microversion: 2.1 time: 0.569299 Aug 29 16:16:17.721230 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3350/6531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:17 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1496 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:16:18.744279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:18.744995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:18.749497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:18.753289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:18.753815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:18.754251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:18.754943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:18.755798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:18.756382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:19.449045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:19.457536 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f54ec73-b47b-4d02-96f2-72c8a4a30026 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1496 microversion: 2.1 time: 0.718220 Aug 29 16:16:19.458237 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3182/6532] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:18 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1496 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:19.688070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-69c6a594-7dd5-46f7-b5f2-973fa4749288 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] Calling method '.version_select at 0x7f32ecfa65e0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:19.716534 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-69c6a594-7dd5-46f7-b5f2-973fa4749288 tempest-TestNetworkAdvancedServerOps-1041807496 tempest-TestNetworkAdvancedServerOps-1041807496-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1360284420" status: 202 len: 0 microversion: 2.1 time: 0.032472 Aug 29 16:16:19.717288 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3351/6533] 10.222.0.83 () {58 vars in 1284 bytes} [Mon Aug 29 16:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1360284420 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:16:19.862465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-0f9f7312-bdfe-43af-ac62-164085f4084c req-d4dfd148-94b4-437c-a9bb-b49637519b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d793c2-710d-4174-8dd7-a82591cb152c", "name": "network-vif-deleted", "tag": "f42ca1d8-de60-4963-b8ee-714657f3c3dd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:19.878064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0f9f7312-bdfe-43af-ac62-164085f4084c req-d4dfd148-94b4-437c-a9bb-b49637519b49 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:19.878858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0f9f7312-bdfe-43af-ac62-164085f4084c req-d4dfd148-94b4-437c-a9bb-b49637519b49 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:19.879498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0f9f7312-bdfe-43af-ac62-164085f4084c req-d4dfd148-94b4-437c-a9bb-b49637519b49 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:19.896809 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-0f9f7312-bdfe-43af-ac62-164085f4084c req-d4dfd148-94b4-437c-a9bb-b49637519b49 service nova] Creating event network-vif-deleted:f42ca1d8-de60-4963-b8ee-714657f3c3dd for instance a2d793c2-710d-4174-8dd7-a82591cb152c on n-h2-836830-13 Aug 29 16:16:19.903755 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-0f9f7312-bdfe-43af-ac62-164085f4084c req-d4dfd148-94b4-437c-a9bb-b49637519b49 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045029 Aug 29 16:16:19.910115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3183/6534] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:20.479937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:20.480973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:20.492654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:20.493160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:20.493602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:20.494304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:20.494768 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:20.495226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:20.534916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:20.535725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:20.535959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:20.536509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lazy-loading 'fault' on Instance uuid a2d793c2-710d-4174-8dd7-a82591cb152c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:16:20.609637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:20.619621 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-56ba7c32-42cf-4e0d-a4dc-ffefcca4968a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 200 len: 1299 microversion: 2.1 time: 0.143586 Aug 29 16:16:20.620195 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3352/6535] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:20 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 1299 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:21.643313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:21.644015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:21.650258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:21.650770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:21.651233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:21.651952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:21.652434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:21.652863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:21.666883 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c HTTP/1.1 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a2d793c2-710d-4174-8dd7-a82591cb152c'} Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:21.668616 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-751e6181-68fe-49af-bab2-c5fe40bea352 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 404 len: 111 microversion: 2.1 time: 0.032824 Aug 29 16:16:21.673229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3184/6536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:21 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:16:21.789797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-700780477", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:21.849713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:16:22.246191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:16:22.246788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:16:22.247771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:16:22.248233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:16:22.248651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:16:22.258226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:22.258709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:22.259178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:22.260016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:22.260354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:22.260783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:22.280135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:16:22.286256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:16:22.300265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:16:22.302572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:16:22.350684 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-83e843a7-c06a-4288-aeeb-0773fe2a8e47 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564801 Aug 29 16:16:22.351728 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3353/6537] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:16:22.362782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2789ea57-7441-4cc8-8a69-59dd066115aa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:22.363459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2789ea57-7441-4cc8-8a69-59dd066115aa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:22.419482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2789ea57-7441-4cc8-8a69-59dd066115aa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:22.426606 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2789ea57-7441-4cc8-8a69-59dd066115aa tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1208 microversion: 2.1 time: 0.067688 Aug 29 16:16:22.427300 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3185/6538] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:22 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:23.449647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:23.450683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:23.458322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:23.458824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:23.459295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:23.460005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:23.460461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:23.461091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:23.532789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:23.535176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:23.543269 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bd0e37f-47d7-40b4-a2b0-8bbd80faed96 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1260 microversion: 2.1 time: 0.098549 Aug 29 16:16:23.544508 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3354/6539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:23 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1260 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:24.569616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:24.570983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:24.581724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:24.582330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:24.582842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:24.583655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:24.584334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:24.584854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:24.703211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:24.713754 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a021d03-b0c1-4cc6-a5d6-901875702b24 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1266 microversion: 2.1 time: 0.148575 Aug 29 16:16:24.716203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3186/6540] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:24 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:25.589256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-718d23bd-6cb7-4619-a149-28885933ae97 req-e4df8fe9-04b8-40c7-ad41-839c23d4694a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be92994-8cc3-4ab8-a8a6-b5433d334936", "tag": "d3eec564-4d71-4f77-af2f-6ef8b43b6a80"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:25.595437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:25.601432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-718d23bd-6cb7-4619-a149-28885933ae97 req-e4df8fe9-04b8-40c7-ad41-839c23d4694a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:25.602014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-718d23bd-6cb7-4619-a149-28885933ae97 req-e4df8fe9-04b8-40c7-ad41-839c23d4694a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:25.602511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-718d23bd-6cb7-4619-a149-28885933ae97 req-e4df8fe9-04b8-40c7-ad41-839c23d4694a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:25.616616 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-718d23bd-6cb7-4619-a149-28885933ae97 req-e4df8fe9-04b8-40c7-ad41-839c23d4694a service nova] Creating event network-changed:d3eec564-4d71-4f77-af2f-6ef8b43b6a80 for instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 on n-h2-836830-13 Aug 29 16:16:25.621906 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-718d23bd-6cb7-4619-a149-28885933ae97 req-e4df8fe9-04b8-40c7-ad41-839c23d4694a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Aug 29 16:16:25.622858 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3355/6541] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:16:25.737768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:25.738414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:25.745511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:25.745999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:25.746441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:25.747607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:25.748073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:25.748500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:25.915379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:25.923176 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-708d9c25-eab9-4ecf-a59a-a69a29973f93 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1308 microversion: 2.1 time: 0.189283 Aug 29 16:16:25.923761 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3187/6542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:25 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:26.945815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:26.946590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:26.954062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:26.954554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:26.954998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:26.955731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:26.956186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:26.956617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:27.093401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:27.101219 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4161e230-2721-4063-85cb-4353f2341264 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1308 microversion: 2.1 time: 0.160741 Aug 29 16:16:27.101790 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3356/6543] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:26 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:28.122399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:28.122939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:28.130051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:28.130538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:28.130975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:28.131703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:28.132158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:28.132585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:28.271894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:28.279742 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33d0f0a3-5b16-422b-80bc-4d0c376b739b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1308 microversion: 2.1 time: 0.161924 Aug 29 16:16:28.280335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3188/6544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:28 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:29.300406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:29.300952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:29.308325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:29.308805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:29.309897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:29.310751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:29.311235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:29.311664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:29.445281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:29.454072 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-075025d8-4dee-488e-aa59-47e4b39b7a71 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1308 microversion: 2.1 time: 0.157573 Aug 29 16:16:29.454667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3357/6545] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:29 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:16:30.477836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:30.478441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:30.485656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:30.486138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:30.486573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:30.487281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:30.487732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:30.488460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:30.619891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:30.627739 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a59dff9-fa2a-454c-b87d-4e4686846221 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1308 microversion: 2.1 time: 0.153801 Aug 29 16:16:30.628318 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3189/6546] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:30 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:31.027638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8f87015b-46ab-40ff-8256-010f2719ae55 req-a4331235-b57f-46f7-80e5-11979dfa57a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be92994-8cc3-4ab8-a8a6-b5433d334936", "name": "network-vif-plugged", "status": "completed", "tag": "d3eec564-4d71-4f77-af2f-6ef8b43b6a80"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:31.039049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8f87015b-46ab-40ff-8256-010f2719ae55 req-a4331235-b57f-46f7-80e5-11979dfa57a0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:31.039553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8f87015b-46ab-40ff-8256-010f2719ae55 req-a4331235-b57f-46f7-80e5-11979dfa57a0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:31.039993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8f87015b-46ab-40ff-8256-010f2719ae55 req-a4331235-b57f-46f7-80e5-11979dfa57a0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:31.052332 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8f87015b-46ab-40ff-8256-010f2719ae55 req-a4331235-b57f-46f7-80e5-11979dfa57a0 service nova] Creating event network-vif-plugged:d3eec564-4d71-4f77-af2f-6ef8b43b6a80 for instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 on n-h2-836830-13 Aug 29 16:16:31.057481 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8f87015b-46ab-40ff-8256-010f2719ae55 req-a4331235-b57f-46f7-80e5-11979dfa57a0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Aug 29 16:16:31.058101 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3358/6547] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:31.649056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:31.649601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:31.657816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:31.658338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:31.658785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:31.659535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:31.660061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:31.660492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:31.793012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:31.801577 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-61abcb67-1f0f-4cda-9ff5-5d1fee3ce4bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1308 microversion: 2.1 time: 0.156579 Aug 29 16:16:31.802152 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3190/6548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:31 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:32.819807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:32.820573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:32.825609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:32.826407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:32.833555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:32.834029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:32.834454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:32.835173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:32.835620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:32.836036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:32.972291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:32.980158 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fbad756a-8a7a-4800-8b42-80c181d9dd62 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1488 microversion: 2.1 time: 0.162153 Aug 29 16:16:32.980747 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3359/6549] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:32 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1488 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:33.001132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:33.003708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:33.005743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:33.011450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.011942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.013093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.013790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.014256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.014690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.029561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:33.082227 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7f0e4d3-df4c-4b23-8356-2eb34d83d8a2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "PUT /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1083 microversion: 2.1 time: 0.085868 Aug 29 16:16:33.082876 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3191/6550] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 16:16:32 2022] PUT /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1083 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:33.099479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:33.100101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:33.106109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.106604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.107062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.107755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.108212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.108637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.244744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:33.253612 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-015b916a-0989-4e25-8b84-16d860b583a3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1509 microversion: 2.1 time: 0.157885 Aug 29 16:16:33.254194 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3360/6551] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:33 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:33.273947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:33.274488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:33.280941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.281430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.281869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.282558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.283045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.283463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.418106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:33.426206 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c430a6c6-a389-4d82-a19b-4c6b4a8c2138 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1509 microversion: 2.1 time: 0.156269 Aug 29 16:16:33.426789 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3192/6552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:33 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:33.446116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:33.446618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:33.453489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.453974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.454409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.455153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.455615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.456045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.482733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:16:33.560334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11e14997-bdba-470a-ac0d-981c42e44a44 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 204 len: 0 microversion: 2.1 time: 0.116978 Aug 29 16:16:33.560856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3361/6553] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:16:33 2022] DELETE /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:16:33.569728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:33.570369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:33.576578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.577065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.577506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.578189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:33.578643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:33.579093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:33.714241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:33.722620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-68fb244c-d8d6-4751-978b-c6c7f7292015 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1515 microversion: 2.1 time: 0.156725 Aug 29 16:16:33.723220 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3193/6554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:33 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:16:34.744040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:34.744880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:34.752562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:34.753056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:34.753492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:34.754188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:34.754677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:34.755129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:34.889392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:34.897323 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ad72e88-addc-42d2-bfd0-ff4e0110e155 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1515 microversion: 2.1 time: 0.157609 Aug 29 16:16:34.897899 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3362/6555] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:34 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:35.362742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:35.364965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:35.371983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.372464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.372902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.373737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.374198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.374620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.406436 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e611bb83-f06a-4e72-8dca-b788ca5323ba tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047845 Aug 29 16:16:35.407016 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3194/6556] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 16:16:35 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:35.475297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:35.475803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:35.482108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.482480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.482921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.483661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.484126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.484549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.512930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:16:35.594973 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ae07d3e-6fbf-46ee-9907-217f565d9d5c tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 204 len: 0 microversion: 2.20 time: 0.123568 Aug 29 16:16:35.595672 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3363/6557] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 16:16:35 2022] DELETE /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:16:35.604710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:35.605423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:35.612063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.612663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.613124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.613814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.614277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.614708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.918708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:35.919613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:35.926755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.927339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.927726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.928790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:35.929253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:35.929681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:35.999716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:36.007735 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0f1b073-4faf-4d29-843a-f3e4b9f5fe1d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 200 len: 1473 microversion: 2.1 time: 0.093522 Aug 29 16:16:36.008316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3364/6558] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:35 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 1473 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:16:36.035603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d00e3614-5a02-4dad-9d0e-316627d61b9c req-b1b8086d-f6a4-4514-8ce1-9305625298e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be92994-8cc3-4ab8-a8a6-b5433d334936", "name": "network-vif-deleted", "tag": "d3eec564-4d71-4f77-af2f-6ef8b43b6a80"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:36.046948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d00e3614-5a02-4dad-9d0e-316627d61b9c req-b1b8086d-f6a4-4514-8ce1-9305625298e4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:36.047597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d00e3614-5a02-4dad-9d0e-316627d61b9c req-b1b8086d-f6a4-4514-8ce1-9305625298e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:36.048665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d00e3614-5a02-4dad-9d0e-316627d61b9c req-b1b8086d-f6a4-4514-8ce1-9305625298e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:36.061699 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d00e3614-5a02-4dad-9d0e-316627d61b9c req-b1b8086d-f6a4-4514-8ce1-9305625298e4 service nova] Creating event network-vif-deleted:d3eec564-4d71-4f77-af2f-6ef8b43b6a80 for instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 on n-h2-836830-13 Aug 29 16:16:36.066932 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d00e3614-5a02-4dad-9d0e-316627d61b9c req-b1b8086d-f6a4-4514-8ce1-9305625298e4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035740 Aug 29 16:16:36.067691 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3365/6559] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:16:36.099056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:36.107665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:36.109129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:36.110327 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f352ef5e-5287-4c1a-bd2d-e65b36f490ff tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.509707 Aug 29 16:16:36.110903 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3195/6560] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:35 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 16:16:37.032399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:37.033097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:37.039403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:37.039880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:37.040307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:37.041008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:37.041458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:37.041876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:37.058726 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 HTTP/1.1 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '6be92994-8cc3-4ab8-a8a6-b5433d334936'} Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:37.060534 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4895fdaf-c25d-45c6-9265-2b52b1051124 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 404 len: 111 microversion: 2.1 time: 0.035228 Aug 29 16:16:37.075470 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3366/6561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:37 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:16:37.134079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:37.134594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:37.142916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:37.143445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:37.143885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:37.144583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:37.145040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:37.145465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:37.175480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1769828843", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:37.243413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] validate_networks() for [('eef4e6e4-92a3-4ce3-9ba7-e2b7018e6a42', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:16:37.396057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:37.407137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:37.408862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:37.410268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6d1f5769-5663-47b6-a528-a17366257d10 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1724 microversion: 2.20 time: 0.280266 Aug 29 16:16:37.410845 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3196/6562] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:37 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:16:37.655285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:16:37.655806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:16:37.656433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:16:37.656862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:16:37.657314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:16:37.667707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:37.668195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:37.669119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:37.669953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:37.670419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:37.670851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:37.689923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:16:37.695402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Getting quotas for user e667dee610ce46f4acf19997989172f0 and project 0d82685728d34330ba75d35e23065cb1. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:16:37.709240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:16:37.711571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:16:37.759425 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2f4f1ae-d39c-44e0-b599-52e539cfed32 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588148 Aug 29 16:16:37.760336 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3367/6563] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:16:37.771707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-48500731-3270-4f80-8236-0ba6d760f87b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:37.772566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-48500731-3270-4f80-8236-0ba6d760f87b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:37.843618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-48500731-3270-4f80-8236-0ba6d760f87b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:37.854162 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-48500731-3270-4f80-8236-0ba6d760f87b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1209 microversion: 2.1 time: 0.085190 Aug 29 16:16:37.855724 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3197/6564] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:37 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:38.088281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e5d502ac-d5bd-4722-9ebb-cd6320e0c0a0 req-83b056fe-77a9-477e-81b7-a0d2a523da9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d5282e-1dad-4b3a-863c-bda2f1dcdd79", "name": "network-vif-deleted", "tag": "e4bfbf99-90f2-4df5-acc6-3031e3a7f32a"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:38.105214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5d502ac-d5bd-4722-9ebb-cd6320e0c0a0 req-83b056fe-77a9-477e-81b7-a0d2a523da9c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.107892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5d502ac-d5bd-4722-9ebb-cd6320e0c0a0 req-83b056fe-77a9-477e-81b7-a0d2a523da9c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.108554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5d502ac-d5bd-4722-9ebb-cd6320e0c0a0 req-83b056fe-77a9-477e-81b7-a0d2a523da9c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.154982 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e5d502ac-d5bd-4722-9ebb-cd6320e0c0a0 req-83b056fe-77a9-477e-81b7-a0d2a523da9c service nova] Creating event network-vif-deleted:e4bfbf99-90f2-4df5-acc6-3031e3a7f32a for instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 on n-h1-836830-13 Aug 29 16:16:38.160977 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e5d502ac-d5bd-4722-9ebb-cd6320e0c0a0 req-83b056fe-77a9-477e-81b7-a0d2a523da9c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079698 Aug 29 16:16:38.161593 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3368/6565] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:38.432916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:38.433777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:38.443478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.444120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.444764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.445472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.445928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.446351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.487889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.488620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.489224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.491481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lazy-loading 'fault' on Instance uuid 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:16:38.547639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:38.563010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:38.571998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '884be770746c44d29f50c099613f08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a32ab2f89fcf4b3ab01be67165388175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:38.573419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a2ecdb5-0701-4ea0-bba2-e12b42898c53 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 200 len: 1370 microversion: 2.20 time: 0.145122 Aug 29 16:16:38.575564 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3198/6566] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:38 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 16:16:38.877552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:38.878437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:38.886271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.886775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.887518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.888530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:38.889099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:38.889334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:38.961547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:38.970155 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f6c1185-f7cd-4c56-8974-3e816f7c5c43 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1261 microversion: 2.1 time: 0.096699 Aug 29 16:16:38.970833 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3369/6567] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:38 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:39.600552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:39.601374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:39.608609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:39.609121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:39.609565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:39.610273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:39.610734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:39.611200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:39.625444 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] HTTP exception thrown: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Request method failure captured: Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 HTTP/1.1 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOSLV2X-CUcZHBH0wf799EWzVFBLcc14v3WeRPAvvoJRX7XAm0XARWKoR0FC9lu6S3cOdj_syDiCD1jwEj_7Zyst2wxqiuMH25Skb_-SDKD0WoiJsoLr3p_zd9Se_Hoiy6fIO2zu9oikWVGP-NO_OCi4QyD7SmiiBYdlPNa-n59I280 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a32ab2f89fcf4b3ab01be67165388175", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a32ab2f89fcf4b3ab01be67165388175"}]}] Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 884be770746c44d29f50c099613f08ed Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '86d5282e-1dad-4b3a-863c-bda2f1dcdd79'} Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:39.627096 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Returning 404 to user: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-22595114-ec5e-41c1-bcda-09d1d9356621 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 404 len: 111 microversion: 2.20 time: 0.031987 Aug 29 16:16:39.632102 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3199/6568] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:39 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:16:39.638315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1eb5bccb-27f4-4ceb-baab-a50e83e752d5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '.version_select at 0x7f32ecfaa700>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:39.662836 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1eb5bccb-27f4-4ceb-baab-a50e83e752d5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-336689360" status: 204 len: 0 microversion: 2.20 time: 0.028609 Aug 29 16:16:39.663468 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3370/6569] 10.222.0.83 () {60 vars in 1259 bytes} [Mon Aug 29 16:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-336689360 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 16:16:39.991545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:39.992660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:40.007668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:40.009271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:40.009877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:40.011181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:40.012016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:40.013613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:40.310585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:40.318827 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04edc1e4-617f-4306-bfea-3a5a65eb642d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.331204 Aug 29 16:16:40.319524 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3200/6570] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:39 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:40.989811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9d9583e6-6363-47ee-b2dc-70271bcaa6b4 req-e8eaad60-624d-4310-8ae7-1e89a75ff33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3c924d-4b22-4b9a-8e03-cb69a5f80bff", "tag": "17f2d13c-7b1c-40ee-969f-c4aff9081138"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:41.020368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9d9583e6-6363-47ee-b2dc-70271bcaa6b4 req-e8eaad60-624d-4310-8ae7-1e89a75ff33c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:41.021445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9d9583e6-6363-47ee-b2dc-70271bcaa6b4 req-e8eaad60-624d-4310-8ae7-1e89a75ff33c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:41.023421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9d9583e6-6363-47ee-b2dc-70271bcaa6b4 req-e8eaad60-624d-4310-8ae7-1e89a75ff33c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:41.038934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9d9583e6-6363-47ee-b2dc-70271bcaa6b4 req-e8eaad60-624d-4310-8ae7-1e89a75ff33c service nova] Creating event network-changed:17f2d13c-7b1c-40ee-969f-c4aff9081138 for instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff on n-h2-836830-13 Aug 29 16:16:41.046489 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9d9583e6-6363-47ee-b2dc-70271bcaa6b4 req-e8eaad60-624d-4310-8ae7-1e89a75ff33c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061569 Aug 29 16:16:41.050480 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3371/6571] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:41.341808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:41.342430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:41.349827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:41.350325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:41.350762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:41.351718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:41.352177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:41.352804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:41.571396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:41.581923 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ffba11b-2a45-4bce-acad-81da10ed3ee6 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.244781 Aug 29 16:16:41.583070 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3201/6572] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:41 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:42.604597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:42.605393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:42.612289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:42.613046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:42.613542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:42.614252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:42.614709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:42.615164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:42.765882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:42.775685 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aaec1f76-933e-44f7-8d95-bc7c3bf946d5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.176262 Aug 29 16:16:42.776276 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3372/6573] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:42 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:43.018959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:43.019561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:43.028165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.028664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.029101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:43.029809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.030346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.030781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:43.048280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] HTTP exception thrown: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Request method failure captured: Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 HTTP/1.1 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOSLV2X-CUcZHBH0wf799EWzVFBLcc14v3WeRPAvvoJRX7XAm0XARWKoR0FC9lu6S3cOdj_syDiCD1jwEj_7Zyst2wxqiuMH25Skb_-SDKD0WoiJsoLr3p_zd9Se_Hoiy6fIO2zu9oikWVGP-NO_OCi4QyD7SmiiBYdlPNa-n59I280 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a32ab2f89fcf4b3ab01be67165388175", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a32ab2f89fcf4b3ab01be67165388175"}]}] Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 884be770746c44d29f50c099613f08ed Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '86d5282e-1dad-4b3a-863c-bda2f1dcdd79'} Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:43.049956 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Returning 404 to user: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d99a6b9-a155-47d7-b567-b9b09c888bd4 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 404 len: 111 microversion: 2.20 time: 0.036596 Aug 29 16:16:43.058336 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3202/6574] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 16:16:43 2022] DELETE /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:16:43.061641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:43.062278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 86d5282e-1dad-4b3a-863c-bda2f1dcdd79] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:43.068554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.069038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.069473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:43.070166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.070616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.071081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:43.085528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] HTTP exception thrown: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Request method failure captured: Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 HTTP/1.1 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOSLV2X-CUcZHBH0wf799EWzVFBLcc14v3WeRPAvvoJRX7XAm0XARWKoR0FC9lu6S3cOdj_syDiCD1jwEj_7Zyst2wxqiuMH25Skb_-SDKD0WoiJsoLr3p_zd9Se_Hoiy6fIO2zu9oikWVGP-NO_OCi4QyD7SmiiBYdlPNa-n59I280 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a32ab2f89fcf4b3ab01be67165388175", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a32ab2f89fcf4b3ab01be67165388175"}]}] Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 884be770746c44d29f50c099613f08ed Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '86d5282e-1dad-4b3a-863c-bda2f1dcdd79'} Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.087235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Returning 404 to user: Instance 86d5282e-1dad-4b3a-863c-bda2f1dcdd79 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-12525d5d-9348-40f3-8d99-9562b2c16ff1 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79" status: 404 len: 111 microversion: 2.20 time: 0.032156 Aug 29 16:16:43.092237 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3373/6575] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:43 2022] GET /compute/v2.1/servers/86d5282e-1dad-4b3a-863c-bda2f1dcdd79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 16:16:43.798708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:43.799852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:43.807794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.808812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.809646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:43.810732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:43.811573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:43.812264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:44.047314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:44.055751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8835caf7-f95a-438d-82a3-a34ce603f237 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.262460 Aug 29 16:16:44.056553 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3203/6576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:43 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:45.078848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:45.080093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:45.087996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:45.088651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:45.089099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:45.089913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:45.090411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:45.090838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:45.113508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:45.248429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:45.256067 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d5f6ab6-1948-4f1a-b6ba-1ce7f9fc8454 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.183378 Aug 29 16:16:45.256976 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3374/6577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:45 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:46.277300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:46.277956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:46.285650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.286150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.286590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.287329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.287791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.288219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.355017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:46.355525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:46.362715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.363248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.363689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.364392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.364850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.365279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.381560 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] HTTP exception thrown: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Request method failure captured: Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d HTTP/1.1 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOSLV2X-CUcZHBH0wf799EWzVFBLcc14v3WeRPAvvoJRX7XAm0XARWKoR0FC9lu6S3cOdj_syDiCD1jwEj_7Zyst2wxqiuMH25Skb_-SDKD0WoiJsoLr3p_zd9Se_Hoiy6fIO2zu9oikWVGP-NO_OCi4QyD7SmiiBYdlPNa-n59I280 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a32ab2f89fcf4b3ab01be67165388175", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a32ab2f89fcf4b3ab01be67165388175"}]}] Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 884be770746c44d29f50c099613f08ed Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '3f73b215-d38d-4427-bc4b-181df4e8fa4d'} Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:46.383181 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Returning 404 to user: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a2f33a0-ba6b-4023-9eeb-20e550cdf9fd tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 404 len: 111 microversion: 2.20 time: 0.033507 Aug 29 16:16:46.386805 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3375/6578] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 16:16:46 2022] DELETE /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:16:46.396347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:46.397392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] [instance: 3f73b215-d38d-4427-bc4b-181df4e8fa4d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:46.404106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.404683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.405207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.405977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:46.406504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:46.407152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:46.425338 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] HTTP exception thrown: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Request method failure captured: Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d HTTP/1.1 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOSLV2X-CUcZHBH0wf799EWzVFBLcc14v3WeRPAvvoJRX7XAm0XARWKoR0FC9lu6S3cOdj_syDiCD1jwEj_7Zyst2wxqiuMH25Skb_-SDKD0WoiJsoLr3p_zd9Se_Hoiy6fIO2zu9oikWVGP-NO_OCi4QyD7SmiiBYdlPNa-n59I280 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_a32ab2f89fcf4b3ab01be67165388175", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/a32ab2f89fcf4b3ab01be67165388175"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/a32ab2f89fcf4b3ab01be67165388175"}]}] Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: a32ab2f89fcf4b3ab01be67165388175 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1481732784 Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 884be770746c44d29f50c099613f08ed Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1481732784-project Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '3f73b215-d38d-4427-bc4b-181df4e8fa4d'} Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.427056 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. Aug 29 16:16:46.431537 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:16:46.431990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:46.432083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] Returning 404 to user: Instance 3f73b215-d38d-4427-bc4b-181df4e8fa4d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:16:46.432083 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c8828f17-3f0f-47c4-9549-b3d098ae0ef5 tempest-AttachVolumeShelveTestJSON-1481732784 tempest-AttachVolumeShelveTestJSON-1481732784-project] 10.222.0.83 "GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d" status: 404 len: 111 microversion: 2.20 time: 0.037669 Aug 29 16:16:46.432083 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3376/6579] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 16:16:46 2022] GET /compute/v2.1/servers/3f73b215-d38d-4427-bc4b-181df4e8fa4d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:16:46.441476 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82a62039-1d8c-404e-a1eb-b40714a5e61c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.167812 Aug 29 16:16:46.451968 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3204/6580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:46 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:47.095961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-69c3d2c4-6816-4e4b-afd7-4c928bc4bd73 req-e0842e4a-396b-4279-91dc-10ddbb719d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3c924d-4b22-4b9a-8e03-cb69a5f80bff", "name": "network-vif-plugged", "status": "completed", "tag": "17f2d13c-7b1c-40ee-969f-c4aff9081138"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:47.108603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-69c3d2c4-6816-4e4b-afd7-4c928bc4bd73 req-e0842e4a-396b-4279-91dc-10ddbb719d25 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:47.109362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-69c3d2c4-6816-4e4b-afd7-4c928bc4bd73 req-e0842e4a-396b-4279-91dc-10ddbb719d25 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:47.109965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-69c3d2c4-6816-4e4b-afd7-4c928bc4bd73 req-e0842e4a-396b-4279-91dc-10ddbb719d25 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:47.404470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-69c3d2c4-6816-4e4b-afd7-4c928bc4bd73 req-e0842e4a-396b-4279-91dc-10ddbb719d25 service nova] Creating event network-vif-plugged:17f2d13c-7b1c-40ee-969f-c4aff9081138 for instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff on n-h2-836830-13 Aug 29 16:16:47.409245 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-69c3d2c4-6816-4e4b-afd7-4c928bc4bd73 req-e0842e4a-396b-4279-91dc-10ddbb719d25 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316961 Aug 29 16:16:47.410949 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3377/6581] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:16:47.462957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:47.463605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:47.473338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:47.473807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:47.474465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:47.475220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:47.475839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:47.476270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:47.789089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:47.797960 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-83f3e5ed-51b4-4450-a0ea-7b9a9405eabd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.339195 Aug 29 16:16:47.799017 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3205/6582] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:47 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:48.817155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:48.818049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:48.823310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:48.824005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:48.833410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:48.833894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:48.834328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:48.835008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:48.835476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:48.835901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:48.973244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:48.982335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c4c73a11-acb5-4302-bd34-26631cf205b3 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1309 microversion: 2.1 time: 0.165360 Aug 29 16:16:48.983041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3378/6583] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:48 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:50.003777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:50.004417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:50.006249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:50.007901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=54 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:50.014657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.015303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.015756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.016453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.017019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.017457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.153070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:50.161871 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b9b01d63-8e86-4377-b245-483c061ba8a0 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1490 microversion: 2.1 time: 0.161871 Aug 29 16:16:50.162919 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3206/6584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:49 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1490 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:50.188714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2084318152"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:50.191284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:50.198158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.198650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.199322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.200394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.201059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.201703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.268927 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5eece16-ad32-445c-ab2f-a29744fec3b2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "PUT /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1075 microversion: 2.1 time: 0.087609 Aug 29 16:16:50.269554 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3379/6585] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 16:16:50 2022] PUT /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1075 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:50.287441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:50.287998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:50.294685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.295387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.295829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.296522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.296982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.297537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.435714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:50.443466 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d86e8c78-53e0-4bae-9fbb-777508c76319 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1501 microversion: 2.1 time: 0.160419 Aug 29 16:16:50.444046 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3207/6586] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:50 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:50.464735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:50.465594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:50.477741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.477741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.477741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.477741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.477741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.477741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.614432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:50.622419 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3227aec-acdd-4f25-bd09-406d20bf03f2 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1501 microversion: 2.1 time: 0.161623 Aug 29 16:16:50.623000 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3380/6587] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:50 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:50.642798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f14a1f87-1de1-4a30-bc35-857946341c5a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:16:50.648825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14a1f87-1de1-4a30-bc35-857946341c5a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.649312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14a1f87-1de1-4a30-bc35-857946341c5a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.649749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f14a1f87-1de1-4a30-bc35-857946341c5a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.674396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f14a1f87-1de1-4a30-bc35-857946341c5a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Going to try to stop instance {{(pid=129132) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:16:50.698642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:50.724707 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f14a1f87-1de1-4a30-bc35-857946341c5a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "POST /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff/action" status: 202 len: 0 microversion: 2.1 time: 0.085548 Aug 29 16:16:50.728424 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3208/6588] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:16:50 2022] POST /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:16:50.734128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:50.734908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:50.747939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.748531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.750144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.751280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:50.751738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:50.752167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:50.892498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:50.901541 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9b47bf3d-aa88-4b46-9866-21ff69dd9adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.171369 Aug 29 16:16:50.902429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3381/6589] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:50 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:51.924184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:51.924909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:51.932641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:51.933132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:51.933576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:51.934382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:51.934930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:51.935810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:52.074705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:52.083580 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b893cda0-db39-469f-95ce-ed2e21d4ce39 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.164242 Aug 29 16:16:52.094339 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3209/6590] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:51 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:53.105699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:53.107084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:53.114335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:53.114828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:53.115302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:53.116015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:53.116478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:53.116908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:53.258325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:53.266281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e65379aa-6139-4449-b60b-f91d4d4afb5f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.164439 Aug 29 16:16:53.266858 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3382/6591] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:53 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:54.287446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:54.288063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:54.296003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:54.296491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:54.296925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:54.297628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:54.298055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:54.298521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:54.432831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:54.442417 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-52fe9698-3321-4e19-aae1-2fc5492725cf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.158737 Aug 29 16:16:54.443014 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3210/6592] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:54 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:55.465017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:55.466370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:55.473370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:55.473854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:55.474292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:55.478065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:55.478065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:55.478065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:55.617252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:55.625985 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bdc37103-e8b5-480f-b5f6-4ef8cf8fd693 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.164929 Aug 29 16:16:55.633856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3383/6593] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:55 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:56.650774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:56.651471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:56.659563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:56.660059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:56.660499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:56.661190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:56.661645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:56.662077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:56.799384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:56.807728 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f3c87d35-9af9-4b32-aec2-445283d89dee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.160737 Aug 29 16:16:56.808240 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3211/6594] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:56 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:57.830677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:57.831326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:57.834033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:16:57.839566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:57.840061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:57.840506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:57.841806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:57.842244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:57.842676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:57.982668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:57.990650 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e23857b-2071-446d-8df6-ddfcf4046422 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.164032 Aug 29 16:16:57.991265 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3384/6595] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:57 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:16:59.011820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:16:59.012444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:16:59.019540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:59.020032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:59.020471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:59.021165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:16:59.021621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:16:59.022051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:16:59.156744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:16:59.164565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5cf055d9-459e-4e6d-9fcf-852629b4e535 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.156705 Aug 29 16:16:59.165139 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3212/6596] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:16:59 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:00.187241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:00.188150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:00.195445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:00.195939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:00.196397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:00.197060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:00.197519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:00.197979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:00.340326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:00.349140 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-efefafc9-d117-49ca-884d-4b0aadb5f622 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.166464 Aug 29 16:17:00.349709 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3385/6597] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:00 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:01.371127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:01.371752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:01.379469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:01.380003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:01.382750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:01.382750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:01.382750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:01.382750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:01.521110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:01.532038 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ee0a714-dbae-4f73-b2bc-ee45b3a264af tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.164726 Aug 29 16:17:01.532682 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3213/6598] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:01 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:02.554252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:02.555186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:02.565716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:02.566246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:02.566685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:02.567420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:02.567883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:02.568309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:02.715085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:02.722932 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-44593723-d31e-4a7b-9451-3acfebf95062 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.172961 Aug 29 16:17:02.723541 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3386/6599] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:02 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:03.745391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:03.746166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:03.753681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.754175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.754609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.755368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:03.755820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:03.756546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:03.910713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:03.922042 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a112431d-e036-4e29-bb90-222b5a19998b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.181240 Aug 29 16:17:03.922644 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3214/6600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:03 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:04.944250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:04.944878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:04.953321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:04.953941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:04.954379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:04.955101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:04.955570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:04.956113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:05.095924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:05.103756 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a737919e-33ca-4587-a167-bea8bce61365 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.164221 Aug 29 16:17:05.104328 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3387/6601] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:04 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:06.126044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:06.126638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:06.134374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:06.134866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:06.135334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:06.136037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:06.136492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:06.136916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:06.277024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:06.285689 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9130699b-30b6-4ebc-b45b-8a28938173bf tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.164073 Aug 29 16:17:06.286351 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3215/6602] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:06 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:07.308137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:07.308679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:07.315569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:07.316058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:07.316497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:07.317192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:07.317649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:07.318077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:07.463745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:07.472547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-acb10909-b4c8-448d-b8cb-aa50ecb8615b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.168663 Aug 29 16:17:07.473133 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3388/6603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:07 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:08.493495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:08.494101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:08.501175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:08.501668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:08.502111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:08.502806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:08.503286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:08.503707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:08.661928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:08.670739 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-02fedc77-fd0f-4601-9f7a-af1692c49846 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.181212 Aug 29 16:17:08.671295 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3216/6604] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:08 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:09.693575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:09.694896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:09.702914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:09.703437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:09.704047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:09.704742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:09.705197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:09.705620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:09.854198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:09.859498 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c1fc8c80-b503-4019-85aa-abad3e06c7f9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.170641 Aug 29 16:17:09.860069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3389/6605] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:09 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:17:10.880455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:10.881037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:10.888777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:10.889485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:10.890100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:10.890894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:10.891517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:10.891957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:11.037016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:11.044980 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-82e6b7a3-ea25-4b3f-a89b-89697abf8073 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.168463 Aug 29 16:17:11.045688 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3217/6606] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:10 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:12.066401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:12.067677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:12.075388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:12.075926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:12.076384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:12.077150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:12.077604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:12.078031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:12.211069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:12.220374 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-023fce38-0e2e-4d50-bd24-b917ed54bf1c tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.158220 Aug 29 16:17:12.220956 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3390/6607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:12 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:13.242186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:13.242908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:13.251167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:13.251734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:13.252174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:13.252864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:13.253313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:13.253738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:13.439057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:13.446945 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0053f1d9-b0b5-4270-b7df-94e71dbe7a31 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.208966 Aug 29 16:17:13.447558 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3218/6608] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:13 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:14.470298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:14.471144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:14.478467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:14.478964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:14.479458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:14.480196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:14.480654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:14.481080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:14.630561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:14.639615 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e741789-ef2a-4f22-bf4f-f5196a529f48 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.173234 Aug 29 16:17:14.641635 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3391/6609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:14 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:15.663319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:15.663978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:15.671533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:15.672023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:15.672462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:15.673443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:15.673650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:15.674078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:15.863978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:15.872076 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-517218ff-9be5-453b-af0c-47bce31e3277 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1511 microversion: 2.1 time: 0.212803 Aug 29 16:17:15.872586 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3219/6610] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:15 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:16.894655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:16.895300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:16.902087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:16.902574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:16.903011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:16.903727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:16.904991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:16.905481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:16.908155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:17.052014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:17.065086 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d9f5dfd-a738-40b0-a645-40e5bf3059f5 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1488 microversion: 2.1 time: 0.174366 Aug 29 16:17:17.065764 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3392/6611] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:16 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1488 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:17.086171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-252353917"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:17.088738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:17.096410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.096904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.097348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.098049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.098510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.098969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.165742 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-382ce621-0d4c-4383-9b6b-8c874574551e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "PUT /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1060 microversion: 2.1 time: 0.083543 Aug 29 16:17:17.166748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3220/6612] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 16:17:17 2022] PUT /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1060 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:17.185018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:17.186385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:17.192502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.193139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.193704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.194581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.195248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.195792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.332498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:17.340231 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3e9772d-23e4-4259-8b24-5e139620cb7e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1487 microversion: 2.1 time: 0.160186 Aug 29 16:17:17.340980 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3393/6613] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:17 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1487 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:17.361557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:17.362187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:17.368424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.368916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.369388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.370081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.370544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.370975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.639382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:17.647188 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-262eb2c1-df58-4c14-aa6c-da9b3b35970f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1487 microversion: 2.1 time: 0.290541 Aug 29 16:17:17.647899 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3221/6614] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:17 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1487 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:17.667153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:17.667656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:17.674334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.674821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.675288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.675981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.676440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.676864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.705640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:17:17.789468 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68a4b1d0-f766-4e39-b35a-7176ec48fffc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 204 len: 0 microversion: 2.1 time: 0.125567 Aug 29 16:17:17.792942 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3394/6615] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:17 2022] DELETE /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:17:17.801019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:17.801871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:17.808640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.809139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.809583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:17.811049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:17.811529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:17.811959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:18.033766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:18.041753 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-788938f6-1d8d-448e-b249-110fdde89c67 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1493 microversion: 2.1 time: 0.246080 Aug 29 16:17:18.042452 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3222/6616] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:17 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1493 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:19.064391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:19.065092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:19.071977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:19.072462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:19.072896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:19.073710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:19.074515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:19.074943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:19.219554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:19.227848 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1cc9dab4-4023-4b0d-9800-00403be01bf4 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1493 microversion: 2.1 time: 0.168215 Aug 29 16:17:19.228496 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3395/6617] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:19 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1493 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:20.246632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1d4c4a8e-7cb4-4989-a837-fc7389f2f4df req-118e0f30-cba1-4c27-b2a8-d3957b9dad5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3c924d-4b22-4b9a-8e03-cb69a5f80bff", "name": "network-vif-deleted", "tag": "17f2d13c-7b1c-40ee-969f-c4aff9081138"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:20.253790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:20.255263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:20.259370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=34 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:20.272228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d4c4a8e-7cb4-4989-a837-fc7389f2f4df req-118e0f30-cba1-4c27-b2a8-d3957b9dad5d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.276990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d4c4a8e-7cb4-4989-a837-fc7389f2f4df req-118e0f30-cba1-4c27-b2a8-d3957b9dad5d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.277485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1d4c4a8e-7cb4-4989-a837-fc7389f2f4df req-118e0f30-cba1-4c27-b2a8-d3957b9dad5d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.284598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.287778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.289207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.290885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:20.293113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:20.299334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:20.312689 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1d4c4a8e-7cb4-4989-a837-fc7389f2f4df req-118e0f30-cba1-4c27-b2a8-d3957b9dad5d service nova] Creating event network-vif-deleted:17f2d13c-7b1c-40ee-969f-c4aff9081138 for instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff on n-h2-836830-13 Aug 29 16:17:20.318163 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1d4c4a8e-7cb4-4989-a837-fc7389f2f4df req-118e0f30-cba1-4c27-b2a8-d3957b9dad5d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075696 Aug 29 16:17:20.319413 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3223/6618] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:20.374440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:20.383602 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46542200-4164-4782-b115-eb17098bbd4b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 200 len: 1291 microversion: 2.1 time: 0.138634 Aug 29 16:17:20.387066 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3396/6619] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:20 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 1291 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:17:21.406451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.407201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.413785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.414451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.414896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.415702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.416162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.416620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.421729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:21.432692 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff HTTP/1.1 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6e3c924d-4b22-4b9a-8e03-cb69a5f80bff'} Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.434366 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e0a7220a-bba2-41dc-b3ea-9a183bb5001b tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 404 len: 111 microversion: 2.1 time: 0.035679 Aug 29 16:17:21.439130 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3224/6620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.451581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.452186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.458235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.458796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.459274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.459964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.460423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.460851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.474941 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff HTTP/1.1 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '6e3c924d-4b22-4b9a-8e03-cb69a5f80bff'} Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.476840 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.481355 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af2df5f3-eaa2-4619-bb48-d0ce29bd4883 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 404 len: 111 microversion: 2.1 time: 0.031686 Aug 29 16:17:21.482645 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3397/6621] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.488495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.489108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.496178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.496665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.497098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.498489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.499165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.499511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.515212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff HTTP/1.1 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6e3c924d-4b22-4b9a-8e03-cb69a5f80bff'} Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.516782 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 6e3c924d-4b22-4b9a-8e03-cb69a5f80bff could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e74a0d8-7469-4fdd-add5-1fe5cab238ee tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff" status: 404 len: 111 microversion: 2.1 time: 0.033951 Aug 29 16:17:21.524241 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3225/6622] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/6e3c924d-4b22-4b9a-8e03-cb69a5f80bff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.527288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.527794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.534243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.534810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.535341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.536099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.536658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.537142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.551449 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 HTTP/1.1 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '6be92994-8cc3-4ab8-a8a6-b5433d334936'} Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.553008 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ef00c3c-5d4a-41aa-bf2f-4fd9afaa1207 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 404 len: 111 microversion: 2.1 time: 0.031501 Aug 29 16:17:21.558360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3398/6623] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.564579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.565202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 6be92994-8cc3-4ab8-a8a6-b5433d334936] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.571249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.571736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.572174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.572863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.573315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.573738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.588418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 HTTP/1.1 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '6be92994-8cc3-4ab8-a8a6-b5433d334936'} Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.589968 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 6be92994-8cc3-4ab8-a8a6-b5433d334936 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a9eae9d5-b976-48ce-bca9-2613aabb1f85 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936" status: 404 len: 111 microversion: 2.1 time: 0.031517 Aug 29 16:17:21.595172 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3226/6624] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/6be92994-8cc3-4ab8-a8a6-b5433d334936 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.600771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.601267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.607466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.607956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.608386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.609069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.609517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.609939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.623359 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 HTTP/1.1 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6'} Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.624937 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3451cfe7-3ea3-41c8-96d5-3f9beb770231 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 404 len: 111 microversion: 2.1 time: 0.029406 Aug 29 16:17:21.628969 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3399/6625] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.634822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.635468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.642351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.642840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.643300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.643992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.644445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.644868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.659410 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 HTTP/1.1 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6'} Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.660886 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.665417 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.665417 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.665417 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.665417 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.665417 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.665417 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. Aug 29 16:17:21.665417 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.666535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.667404 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de5aba62-f665-4b41-892b-2f203ab09269 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6" status: 404 len: 111 microversion: 2.1 time: 0.036389 Aug 29 16:17:21.667957 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3227/6626] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/09f6e915-d0eb-4b6a-92cd-d2ecb1686fd6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.676612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.677115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.683337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.683823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.684263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.684951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.686114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.686585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.700374 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c HTTP/1.1 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'a2d793c2-710d-4174-8dd7-a82591cb152c'} Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.702249 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4e7bd6fb-f25e-4557-a9da-60224913134f tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 404 len: 111 microversion: 2.1 time: 0.031030 Aug 29 16:17:21.709791 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3400/6627] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.712179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.712989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: a2d793c2-710d-4174-8dd7-a82591cb152c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.719601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.720091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.720527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.721217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.721665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.722087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.736939 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c HTTP/1.1 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'a2d793c2-710d-4174-8dd7-a82591cb152c'} Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.738492 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance a2d793c2-710d-4174-8dd7-a82591cb152c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a797b05c-f337-4b82-816b-c3f47aa132e9 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c" status: 404 len: 111 microversion: 2.1 time: 0.031955 Aug 29 16:17:21.742469 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3228/6628] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/a2d793c2-710d-4174-8dd7-a82591cb152c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.753535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.754126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.760651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.761223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.761740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.762530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.762997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.763591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.778135 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec HTTP/1.1 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '65db1b3c-f7ac-4cdb-a55a-8c85697c74ec'} Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.780382 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d684e70-2250-444d-a70b-5d0b51fca4cd tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 404 len: 111 microversion: 2.1 time: 0.032592 Aug 29 16:17:21.785079 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3401/6629] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.790557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.791212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.798368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.798854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.799412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.799989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.800638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.801233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.815990 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec HTTP/1.1 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '65db1b3c-f7ac-4cdb-a55a-8c85697c74ec'} Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.817610 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 65db1b3c-f7ac-4cdb-a55a-8c85697c74ec could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-01364dcc-f0e6-4f6d-b969-8367558b7adc tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec" status: 404 len: 111 microversion: 2.1 time: 0.032583 Aug 29 16:17:21.822697 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3229/6630] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/65db1b3c-f7ac-4cdb-a55a-8c85697c74ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.829693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.830200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.836447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.836937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.837380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.838078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.838538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.838968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.853197 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 HTTP/1.1 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'dbee4b52-ff7d-4c07-870d-c25080713f57'} Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.854904 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90debbf2-997b-45a7-b9f1-3dc646db0605 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 404 len: 111 microversion: 2.1 time: 0.031595 Aug 29 16:17:21.861235 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3402/6631] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.866912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.867562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: dbee4b52-ff7d-4c07-870d-c25080713f57] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.873636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.874128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.874569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.875286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.875745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.876199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.889823 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 HTTP/1.1 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'dbee4b52-ff7d-4c07-870d-c25080713f57'} Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.891400 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance dbee4b52-ff7d-4c07-870d-c25080713f57 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e2cd943-f9d6-4f4d-90f6-0f3d46d5ed17 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57" status: 404 len: 111 microversion: 2.1 time: 0.029868 Aug 29 16:17:21.895626 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3230/6632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/dbee4b52-ff7d-4c07-870d-c25080713f57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:17:21.901474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-513c64d6-0ce5-4846-a91b-c691f35e304d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.901970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-513c64d6-0ce5-4846-a91b-c691f35e304d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: e9e1e1dc-2d12-44aa-86a5-41eae2cd8827] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.908704 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-513c64d6-0ce5-4846-a91b-c691f35e304d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-513c64d6-0ce5-4846-a91b-c691f35e304d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 HTTP/1.1 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'e9e1e1dc-2d12-44aa-86a5-41eae2cd8827'} Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.910282 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-513c64d6-0ce5-4846-a91b-c691f35e304d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-513c64d6-0ce5-4846-a91b-c691f35e304d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827" status: 404 len: 111 microversion: 2.1 time: 0.014132 Aug 29 16:17:21.915246 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3403/6633] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.921388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12e79a09-c5b6-4670-a8db-49b6705e1531 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.923141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-12e79a09-c5b6-4670-a8db-49b6705e1531 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: e9e1e1dc-2d12-44aa-86a5-41eae2cd8827] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.929862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-12e79a09-c5b6-4670-a8db-49b6705e1531 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12e79a09-c5b6-4670-a8db-49b6705e1531 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 HTTP/1.1 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'e9e1e1dc-2d12-44aa-86a5-41eae2cd8827'} Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:21.931425 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12e79a09-c5b6-4670-a8db-49b6705e1531 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-12e79a09-c5b6-4670-a8db-49b6705e1531 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827" status: 404 len: 111 microversion: 2.1 time: 0.016071 Aug 29 16:17:21.935962 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3231/6634] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:21 2022] GET /compute/v2.1/servers/e9e1e1dc-2d12-44aa-86a5-41eae2cd8827 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:17:21.941884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:21.942395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:21.952209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.952698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.953079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.953988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:21.954603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:21.955366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:21.986909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:17:22.075215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe00266b-5fbe-4708-94b6-13dd754dc78d tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "DELETE /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 204 len: 0 microversion: 2.1 time: 0.136871 Aug 29 16:17:22.077409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3404/6635] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:17:21 2022] DELETE /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:17:22.086567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:22.087239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:22.097069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:22.097571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:22.098204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:22.099136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:22.099877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:22.100567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:22.248088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:22.256300 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eac0efd1-42a5-4a96-ae85-b6bb05a7c9fe tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1478 microversion: 2.1 time: 0.174393 Aug 29 16:17:22.256880 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3232/6636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:22 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1478 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:23.282417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:23.283320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:23.292142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.292933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.293585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.294785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:23.298044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:23.299343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:23.581343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:23.590035 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e363ae2e-bea4-4630-ab74-8e969c88e34e tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1478 microversion: 2.1 time: 0.315352 Aug 29 16:17:23.590901 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3405/6637] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:23 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1478 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:24.210792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ba52f29a-75c6-4aa1-95e6-b0048227188f req-6160ed95-461b-4375-a0c0-ee6af99049aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68134a73-3ff4-4ec6-bb11-279ba1953518", "name": "network-vif-deleted", "tag": "d313af38-be70-4160-b9dc-db8c081d055a"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:17:24.234103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba52f29a-75c6-4aa1-95e6-b0048227188f req-6160ed95-461b-4375-a0c0-ee6af99049aa service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.235449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba52f29a-75c6-4aa1-95e6-b0048227188f req-6160ed95-461b-4375-a0c0-ee6af99049aa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.236142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ba52f29a-75c6-4aa1-95e6-b0048227188f req-6160ed95-461b-4375-a0c0-ee6af99049aa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.258773 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ba52f29a-75c6-4aa1-95e6-b0048227188f req-6160ed95-461b-4375-a0c0-ee6af99049aa service nova] Creating event network-vif-deleted:d313af38-be70-4160-b9dc-db8c081d055a for instance 68134a73-3ff4-4ec6-bb11-279ba1953518 on n-h2-836830-13 Aug 29 16:17:24.264788 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ba52f29a-75c6-4aa1-95e6-b0048227188f req-6160ed95-461b-4375-a0c0-ee6af99049aa service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059446 Aug 29 16:17:24.270473 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3233/6638] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:17:24.613271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:24.613875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:24.621844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.623070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.624306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.625764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.627450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.628017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.705220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:24.706077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:24.706774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:24.707469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lazy-loading 'fault' on Instance uuid 68134a73-3ff4-4ec6-bb11-279ba1953518 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:17:24.777095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e667dee610ce46f4acf19997989172f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d82685728d34330ba75d35e23065cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:17:24.803327 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97553306-8933-4666-a269-9a9e1443251a tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 200 len: 1282 microversion: 2.1 time: 0.194361 Aug 29 16:17:24.804770 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3406/6639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:24 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:17:25.825631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:25.827105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] [instance: 68134a73-3ff4-4ec6-bb11-279ba1953518] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:17:25.833789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.834281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.834717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.835505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:25.835961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:25.836385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:25.850932 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] HTTP exception thrown: Instance 68134a73-3ff4-4ec6-bb11-279ba1953518 could not be found. Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Request method failure captured: Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 HTTP/1.1 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOX-OywnRYzLch4kXs7W9X2Ies6hFGEZv02BhM6J4B1Qmczr1RIhyPBvV_YZUsIrzd35fTrPKjuZyRInwwW5wRqVJbvK9RFTAfQ083WwPOTQAEvOYnVvgjxznUlPkTXno36qz44OjHIvOCsV6Hyw9QYsrrnvAxfMkF9SgL9gR-cydc4 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_0d82685728d34330ba75d35e23065cb1", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/0d82685728d34330ba75d35e23065cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/0d82685728d34330ba75d35e23065cb1"}]}] Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersTestJSON-1101161050 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 0d82685728d34330ba75d35e23065cb1 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersTestJSON-1101161050 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e667dee610ce46f4acf19997989172f0 Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersTestJSON-1101161050-project Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 68134a73-3ff4-4ec6-bb11-279ba1953518 could not be found. Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '68134a73-3ff4-4ec6-bb11-279ba1953518'} Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68134a73-3ff4-4ec6-bb11-279ba1953518 could not be found. Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68134a73-3ff4-4ec6-bb11-279ba1953518 could not be found. Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:17:25.852522 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68134a73-3ff4-4ec6-bb11-279ba1953518 could not be found. Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] Returning 404 to user: Instance 68134a73-3ff4-4ec6-bb11-279ba1953518 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f5a3a968-e9a7-4092-ab1c-4d6bf1f18260 tempest-ServersTestJSON-1101161050 tempest-ServersTestJSON-1101161050-project] 10.222.0.83 "GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518" status: 404 len: 111 microversion: 2.1 time: 0.033520 Aug 29 16:17:25.857051 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3234/6640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:17:25 2022] GET /compute/v2.1/servers/68134a73-3ff4-4ec6-bb11-279ba1953518 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:17:55.988484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:55.989984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:17:56.192854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Calling method '.version_select at 0x7f32ed149280>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:17:56.194702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:56.195258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:56.197629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:56.213419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:56.213950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:56.214388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:56.226987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:17:56.227492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:17:56.227924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:17:56.234332 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-760a5f81-962e-4bdc-b665-4d20ea2e1521 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1177043336-project-admin] 10.222.0.83 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.254046 Aug 29 16:17:56.234921 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3407/6641] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 16:17:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:20:11.711454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:11.711886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:11.714424 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:20:11.718048 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:20:11.718048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=23 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:11.718048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=23 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:11.723247 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:20:11.725811 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 (ip 10.222.0.83) !!! Aug 29 16:20:11.732163 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:20:11.732463 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 (ip 10.222.0.83) !!! Aug 29 16:20:11.734084 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:20:11.734187 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 (ip 10.222.0.83) !!! Aug 29 16:20:11.760096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:11.763945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:11.764315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:11.765003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:11.765462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:11.765884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:11.800654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:20:11.888703 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-59c0dcbb-a5ef-451d-803a-54ac421adb07 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 204 len: 0 microversion: 2.1 time: 0.182293 Aug 29 16:20:11.889431 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3235/6642] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:20:11 2022] DELETE /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:20:11.898977 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:20:11.900657 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:20:11.901250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:11.902221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:11.904357 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:20:11.904502 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 (ip 10.222.0.83) !!! Aug 29 16:20:11.906774 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:20:11.906903 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:20:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 (ip 10.222.0.83) !!! Aug 29 16:20:11.913311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:11.914010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:11.933192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:11.933881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:11.934518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:11.939555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:11.940234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:11.941411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:12.341958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:12.356460 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ca1c1e4-a7c5-4509-a428-1bc093765050 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1730 microversion: 2.1 time: 0.461996 Aug 29 16:20:12.357050 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3408/6643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:11 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1730 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:13.380483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:13.381769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:13.392333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:13.393163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:13.393835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:13.394911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:13.395606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:13.396366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:13.427858 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 37574. Aug 29 16:20:13.431160 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 37572. Aug 29 16:20:14.283617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:14.291657 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b74050f-1097-4048-9175-b2a3174729aa tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1730 microversion: 2.1 time: 0.915507 Aug 29 16:20:14.292236 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3236/6644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:13 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1730 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:14.900625 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 37600. Aug 29 16:20:14.907190 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 37598. Aug 29 16:20:15.034831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-af6b1b01-65b9-4f71-b21d-bf0ddb674ca5 req-8139c2ab-95f4-4de3-94e7-700bcdab5369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aca38d-1490-461b-b9ad-2e77d0b93134", "name": "network-vif-deleted", "tag": "220f020b-71c5-4e10-ac81-a101fa7a3a0b"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:15.049008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-af6b1b01-65b9-4f71-b21d-bf0ddb674ca5 req-8139c2ab-95f4-4de3-94e7-700bcdab5369 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:15.049738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-af6b1b01-65b9-4f71-b21d-bf0ddb674ca5 req-8139c2ab-95f4-4de3-94e7-700bcdab5369 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:15.050346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-af6b1b01-65b9-4f71-b21d-bf0ddb674ca5 req-8139c2ab-95f4-4de3-94e7-700bcdab5369 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:15.076552 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-af6b1b01-65b9-4f71-b21d-bf0ddb674ca5 req-8139c2ab-95f4-4de3-94e7-700bcdab5369 service nova] Creating event network-vif-deleted:220f020b-71c5-4e10-ac81-a101fa7a3a0b for instance d4aca38d-1490-461b-b9ad-2e77d0b93134 on n-h1-836830-13 Aug 29 16:20:15.091311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-af6b1b01-65b9-4f71-b21d-bf0ddb674ca5 req-8139c2ab-95f4-4de3-94e7-700bcdab5369 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232316 Aug 29 16:20:15.092751 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3409/6645] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:20:15.314653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:15.318076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:15.332716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:15.333218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:15.333655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:15.334366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:15.334852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:15.335310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:15.370397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:15.373326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:15.373974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:15.374615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lazy-loading 'fault' on Instance uuid d4aca38d-1490-461b-b9ad-2e77d0b93134 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:20:15.432897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffcf740d5ac459f8f624437ce64ab74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91939ee21734b77890428f8d9a337be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:15.445614 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28b3bfce-492b-44e2-90a3-53233404d31a tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 200 len: 1386 microversion: 2.1 time: 0.134027 Aug 29 16:20:15.447092 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3237/6646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:15 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 1386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:16.469169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:16.470673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:16.477761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:16.478257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:16.478691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:16.479460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:16.480254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:16.481554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:16.497865 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] HTTP exception thrown: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Request method failure captured: Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 HTTP/1.1 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOYK2brh5ypBlNooQVQUZgNQsqn4HmGlK6rMKXrDWJDEpBjiF2WWnQe-Q5NhxIlx7w-mAg1dqc2mBdsv4qVcas2utYKc4VI8yySWHs9KGWvZHagJP8tNWmQj3_n5ptr3lPOW0rU98D8OyrxckGywHMNwHfYw2ROM3ehYGMAPYaXHg5k Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: c91939ee21734b77890428f8d9a337be Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestServerBasicOps-492573243 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c91939ee21734b77890428f8d9a337be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c91939ee21734b77890428f8d9a337be", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c91939ee21734b77890428f8d9a337be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c91939ee21734b77890428f8d9a337be"}]}] Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestServerBasicOps-492573243 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: c91939ee21734b77890428f8d9a337be Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestServerBasicOps-492573243 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestServerBasicOps-492573243-project Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 5ffcf740d5ac459f8f624437ce64ab74 Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestServerBasicOps-492573243-project Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd4aca38d-1490-461b-b9ad-2e77d0b93134'} Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:20:16.499659 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Returning 404 to user: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:20:16.504091 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e1ac2c3-4cfe-43be-a43b-8fc5dbd35453 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 404 len: 111 microversion: 2.1 time: 0.037970 Aug 29 16:20:16.505146 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3410/6647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:16 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:20:17.032965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:17.033474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:17.041030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.041525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.041979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.042656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.043920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.044118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.058342 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] HTTP exception thrown: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Request method failure captured: Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 HTTP/1.1 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOYK2brh5ypBlNooQVQUZgNQsqn4HmGlK6rMKXrDWJDEpBjiF2WWnQe-Q5NhxIlx7w-mAg1dqc2mBdsv4qVcas2utYKc4VI8yySWHs9KGWvZHagJP8tNWmQj3_n5ptr3lPOW0rU98D8OyrxckGywHMNwHfYw2ROM3ehYGMAPYaXHg5k Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: c91939ee21734b77890428f8d9a337be Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestServerBasicOps-492573243 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c91939ee21734b77890428f8d9a337be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c91939ee21734b77890428f8d9a337be", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c91939ee21734b77890428f8d9a337be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c91939ee21734b77890428f8d9a337be"}]}] Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestServerBasicOps-492573243 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: c91939ee21734b77890428f8d9a337be Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestServerBasicOps-492573243 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestServerBasicOps-492573243-project Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 5ffcf740d5ac459f8f624437ce64ab74 Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestServerBasicOps-492573243-project Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd4aca38d-1490-461b-b9ad-2e77d0b93134'} Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:20:17.060780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Returning 404 to user: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa02c362-7fee-4ac7-902d-a07e95dedf32 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 404 len: 111 microversion: 2.1 time: 0.034645 Aug 29 16:20:17.064432 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3238/6648] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:20:17 2022] DELETE /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:20:17.071046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:17.071686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] [instance: d4aca38d-1490-461b-b9ad-2e77d0b93134] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:17.080417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.080417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.081191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.081528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:17.081986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:17.082410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:17.097568 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] HTTP exception thrown: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Request method failure captured: Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 HTTP/1.1 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOYK2brh5ypBlNooQVQUZgNQsqn4HmGlK6rMKXrDWJDEpBjiF2WWnQe-Q5NhxIlx7w-mAg1dqc2mBdsv4qVcas2utYKc4VI8yySWHs9KGWvZHagJP8tNWmQj3_n5ptr3lPOW0rU98D8OyrxckGywHMNwHfYw2ROM3ehYGMAPYaXHg5k Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: c91939ee21734b77890428f8d9a337be Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestServerBasicOps-492573243 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c91939ee21734b77890428f8d9a337be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c91939ee21734b77890428f8d9a337be", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c91939ee21734b77890428f8d9a337be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c91939ee21734b77890428f8d9a337be"}]}] Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestServerBasicOps-492573243 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: c91939ee21734b77890428f8d9a337be Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestServerBasicOps-492573243 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestServerBasicOps-492573243-project Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 5ffcf740d5ac459f8f624437ce64ab74 Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestServerBasicOps-492573243-project Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd4aca38d-1490-461b-b9ad-2e77d0b93134'} Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:20:17.099317 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Returning 404 to user: Instance d4aca38d-1490-461b-b9ad-2e77d0b93134 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea7a02ef-1337-4ddf-a8a5-e15db161bef5 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134" status: 404 len: 111 microversion: 2.1 time: 0.033574 Aug 29 16:20:17.103131 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3411/6649] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:17 2022] GET /compute/v2.1/servers/d4aca38d-1490-461b-b9ad-2e77d0b93134 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:20:17.298435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aced12f4-ad9a-484a-9f96-9e63c0aec9a8 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] Calling method '.version_select at 0x7f32ed4c53a0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:17.342682 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aced12f4-ad9a-484a-9f96-9e63c0aec9a8 tempest-TestServerBasicOps-492573243 tempest-TestServerBasicOps-492573243-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-86562625" status: 202 len: 0 microversion: 2.1 time: 0.049838 Aug 29 16:20:17.354046 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3239/6650] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 16:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-86562625 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:20:44.816966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-674524473", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "03bcb0b9-a852-4460-b1fb-21566641f22c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:44.832184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.833127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=12 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:44.904139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:20:45.505930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:20:45.506353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:20:45.507305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:20:45.507717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:20:45.508125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:20:45.517584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:45.518060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:45.518492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:45.519248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:45.519700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:45.520117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:45.537500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:20:45.545723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:20:45.620094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:20:45.622869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03bcb0b9-a852-4460-b1fb-21566641f22c',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:20:45.798564 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b3d38553-ad83-4582-8aaa-e4ee18e4b072 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985438 Aug 29 16:20:45.799678 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3412/6651] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:20:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:20:45.808028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:45.810493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:45.815448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-230b574c-2405-4900-ae08-c8d10bb6b929 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:45.816651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-230b574c-2405-4900-ae08-c8d10bb6b929 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:45.889416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-230b574c-2405-4900-ae08-c8d10bb6b929 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:45.896575 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-230b574c-2405-4900-ae08-c8d10bb6b929 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1056 microversion: 2.1 time: 0.090359 Aug 29 16:20:45.912902 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3240/6652] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:45 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1056 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:46.922452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:46.923859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:46.943114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:46.943558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:46.945260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:46.948205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:46.949923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:46.950593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:47.076298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:47.087423 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4253e24a-4423-46a0-a0c5-ae17e85cd562 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1098 microversion: 2.1 time: 0.170676 Aug 29 16:20:47.088287 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3413/6653] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:46 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1098 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:48.108667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:48.109925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:48.127198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:48.127707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:48.128152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:48.128866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:48.129325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:48.129754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:48.241181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:48.255603 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b12d7953-620a-4683-9ee2-bdf8668ac58b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1172 microversion: 2.1 time: 0.150897 Aug 29 16:20:48.273353 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3241/6654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:48 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1172 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:49.281935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:49.282887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:49.295758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:49.296248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:49.296694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:49.297409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:49.297880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:49.298310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:49.574613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:49.589956 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fda978ef-2f48-4037-9ba8-b04a49c2647f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1214 microversion: 2.1 time: 0.311329 Aug 29 16:20:49.593739 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3414/6655] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:49 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:50.507755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6b3c838a-f1fa-4d4c-bae6-1d9e7f07676e req-c7645f98-b491-49b1-b8eb-3d711b5f7688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a14ebc9e-2442-40b7-9124-fb784a68b20e", "tag": "7f610bcf-6f2a-47a1-ae4c-41314c17cf23"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:20:50.528923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6b3c838a-f1fa-4d4c-bae6-1d9e7f07676e req-c7645f98-b491-49b1-b8eb-3d711b5f7688 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:50.531187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6b3c838a-f1fa-4d4c-bae6-1d9e7f07676e req-c7645f98-b491-49b1-b8eb-3d711b5f7688 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:50.532565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6b3c838a-f1fa-4d4c-bae6-1d9e7f07676e req-c7645f98-b491-49b1-b8eb-3d711b5f7688 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:50.574425 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6b3c838a-f1fa-4d4c-bae6-1d9e7f07676e req-c7645f98-b491-49b1-b8eb-3d711b5f7688 service nova] Creating event network-changed:7f610bcf-6f2a-47a1-ae4c-41314c17cf23 for instance a14ebc9e-2442-40b7-9124-fb784a68b20e on n-h2-836830-13 Aug 29 16:20:50.595905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6b3c838a-f1fa-4d4c-bae6-1d9e7f07676e req-c7645f98-b491-49b1-b8eb-3d711b5f7688 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092018 Aug 29 16:20:50.598941 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3242/6656] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:20:50.616499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:50.617915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:50.650725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:50.651432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:50.653517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:50.655598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:50.658308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:50.659936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:51.021134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:51.040956 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f8eae744-e73c-40ab-ac95-7170e64156ca tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1214 microversion: 2.1 time: 0.429007 Aug 29 16:20:51.042137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3415/6657] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:50 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1214 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:52.068518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:52.069292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:52.085950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:52.089570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:52.090227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:52.091066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:52.092640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:52.093085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:52.423828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:52.434751 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c29e5b0e-57de-4430-b295-bd3e2796ea21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1214 microversion: 2.1 time: 0.371600 Aug 29 16:20:52.451115 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3243/6658] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:52 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1214 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:53.462094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:53.463458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:53.472527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:53.473542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:53.474084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:53.474904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:53.475831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:53.476374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:53.696968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:53.708359 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef90b82d-9942-4143-9cf0-5f1b5959bfbf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1214 microversion: 2.1 time: 0.250704 Aug 29 16:20:53.709062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3416/6659] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:53 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:54.732585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:54.738562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:54.772647 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:54.779008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:54.780143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:54.781869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:54.782567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:54.783216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:54.981915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:54.991310 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-943357ed-db23-41c7-8b34-909afc0a49ec tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1214 microversion: 2.1 time: 0.266848 Aug 29 16:20:54.995184 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3244/6660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:54 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:56.015234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:56.016399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:56.020291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:56.021380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:56.025124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:56.025648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:56.026172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:56.027844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:56.028694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:56.029205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:56.186219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:56.193963 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7040978c-9bb0-489f-945d-babc246c5be6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.183890 Aug 29 16:20:56.194536 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3417/6661] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:56 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:57.216842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:57.217536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:57.220624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:20:57.225843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:57.226473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:57.227435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:57.227952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:57.228486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:57.229009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:57.392842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:57.401373 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be8562b5-7da6-476d-82a3-5d95e856f348 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.189171 Aug 29 16:20:57.402908 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3245/6662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:57 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:58.424103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:58.424840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:58.434371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:58.435216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:58.435867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:58.436865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:58.437665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:58.438627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:58.603943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:58.612291 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-329dcc70-2434-44a8-92ec-55e8b18d0a2e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.192136 Aug 29 16:20:58.613028 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3418/6663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:58 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:20:59.635652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:20:59.636898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:20:59.645277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:59.646065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:59.646673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:59.648360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:20:59.648974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:20:59.649554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:20:59.801807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:20:59.812592 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f679c8c7-70ed-4538-97b0-9510eef9afe8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.182095 Aug 29 16:20:59.813280 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3246/6664] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:20:59 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:00.838623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:00.840668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:00.851740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:00.852375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:00.852917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:00.853728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:00.854312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:00.854833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:01.012688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:01.021577 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0477886c-78e5-447c-9dee-3bb473f3cd6f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.189445 Aug 29 16:21:01.022783 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3419/6665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:00 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:02.044136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:02.045181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:02.052188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:02.052917 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:02.053547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:02.054428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:02.054937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:02.055719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:02.210079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:02.221803 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-436d4741-9298-4260-95f8-de1d4b936462 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.181864 Aug 29 16:21:02.222873 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3247/6666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:02 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:03.248478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:03.249226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:03.257559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:03.258123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:03.258640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:03.259642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:03.260424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:03.261103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:03.439403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:03.450206 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2827cd6b-21ca-4732-98d6-c58fb2e3b7cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.210236 Aug 29 16:21:03.451745 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3420/6667] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:03 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:04.472254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:04.472254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:04.492255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.492775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.493221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:04.493935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:04.494395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:04.495283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:04.666775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:04.677251 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1b0be62-7c4a-43bc-bf03-c6decf39a224 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.209318 Aug 29 16:21:04.678203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3248/6668] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:04 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:05.701302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:05.703484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:05.710901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:05.711582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:05.712054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:05.712985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:05.713522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:05.714007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:05.894179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:05.905182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7f83dc77-f954-4928-9141-79ed16667a7a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.208360 Aug 29 16:21:05.905778 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3421/6669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:05 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:06.361911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-de8ec257-47ad-4017-837b-9239055958d7 req-3fcbce42-aea6-4933-8584-c603b5a6fdcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14ebc9e-2442-40b7-9124-fb784a68b20e", "name": "network-vif-plugged", "status": "completed", "tag": "7f610bcf-6f2a-47a1-ae4c-41314c17cf23"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:06.380997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-de8ec257-47ad-4017-837b-9239055958d7 req-3fcbce42-aea6-4933-8584-c603b5a6fdcd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.381477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-de8ec257-47ad-4017-837b-9239055958d7 req-3fcbce42-aea6-4933-8584-c603b5a6fdcd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.382071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-de8ec257-47ad-4017-837b-9239055958d7 req-3fcbce42-aea6-4933-8584-c603b5a6fdcd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:06.395098 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-de8ec257-47ad-4017-837b-9239055958d7 req-3fcbce42-aea6-4933-8584-c603b5a6fdcd service nova] Creating event network-vif-plugged:7f610bcf-6f2a-47a1-ae4c-41314c17cf23 for instance a14ebc9e-2442-40b7-9124-fb784a68b20e on n-h2-836830-13 Aug 29 16:21:06.400316 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-de8ec257-47ad-4017-837b-9239055958d7 req-3fcbce42-aea6-4933-8584-c603b5a6fdcd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281956 Aug 29 16:21:06.401503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3249/6670] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:06.925799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:06.926423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:06.934775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.935367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.935895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:06.936685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:06.937136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:06.937596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.085538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:07.096283 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a34f8e1-7330-4288-b00a-74b9c1681e95 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.174382 Aug 29 16:21:07.096863 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3422/6671] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:06 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:07.102994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1538548485", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:07.159615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] validate_networks() for None {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:21:07.456654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:21:07.457304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:21:07.458188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:21:07.458607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:21:07.459047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:21:07.468804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.469221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.469653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.470374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:07.470830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:07.471300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:07.488158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Getting quotas for project ca4ac1309d784d33b4122f0976435304. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:07.493442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Getting quotas for user ee4a3df1fa254fcab2514d25c1d2bc77 and project ca4ac1309d784d33b4122f0976435304. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:07.506563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:21:07.508994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:21:07.560057 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0f8927a-9c46-4833-996a-efdafbd1f750 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.460713 Aug 29 16:21:07.566464 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3250/6672] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:21:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:21:07.572509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-27d3687f-bc44-427a-b50f-100897be0d03 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:07.574416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-27d3687f-bc44-427a-b50f-100897be0d03 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:07.640985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-27d3687f-bc44-427a-b50f-100897be0d03 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:07.651850 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-27d3687f-bc44-427a-b50f-100897be0d03 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1214 microversion: 2.1 time: 0.083297 Aug 29 16:21:07.652994 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3423/6673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:07 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:08.123416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:08.124316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:08.133217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.133901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.134349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.135337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.135803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.136739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.298188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:08.306325 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-365ff86b-4083-44bd-bc8a-b36ac0176125 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1202 microversion: 2.1 time: 0.189481 Aug 29 16:21:08.307076 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3251/6674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:08 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:08.673337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:08.675800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:08.685567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.686083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.686501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.687263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:08.687724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:08.688162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:08.758363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:08.770553 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef66149d-e52f-40b2-b692-c166ba4b4215 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1266 microversion: 2.1 time: 0.101177 Aug 29 16:21:08.771556 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3424/6675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:08 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:09.329482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:09.330113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:09.337260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.338860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.340032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.340911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.341376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.341810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.557845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:09.566703 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32bf7d17-9c04-4780-ae9e-52bb1028a507 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1388 microversion: 2.1 time: 0.241847 Aug 29 16:21:09.567444 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3252/6676] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:09 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1388 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:09.589141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:09.592001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:09.598557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.599067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.599506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.600197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.600649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.601095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.781582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:09.790867 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-996f90f6-49de-40b1-abdf-4fccfcf713c0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1388 microversion: 2.1 time: 0.207523 Aug 29 16:21:09.792360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3425/6677] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:09 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1388 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:09.812245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:09.812886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:09.820699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:09.821770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:09.823844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.824540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.825897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.826843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.827843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.828475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.835880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.836382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.836824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:09.837547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:09.848697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:09.849090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.000646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:10.009131 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a2abe26-0b8a-4fc2-be76-a5556b75c09e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1388 microversion: 2.1 time: 0.198896 Aug 29 16:21:10.009707 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3426/6678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:09 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1388 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:10.029705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:10.031246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:10.038911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.039452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.039895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.040788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.041250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.041855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.072693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:21:10.166755 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67fff44d-cb7e-4158-91c6-4a674eaef9df tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 204 len: 0 microversion: 2.1 time: 0.140823 Aug 29 16:21:10.168465 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3427/6679] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:21:10 2022] DELETE /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:21:10.177309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:10.177829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:10.178721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:10.191968 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-049e133d-b227-4f7e-8235-1ce840fe9d51 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1314 microversion: 2.1 time: 0.388267 Aug 29 16:21:10.193190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.193864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.194463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.195816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.196219 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3253/6680] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:09 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:10.196868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.197459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.230735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:10.444750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:10.465537 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-126f80ea-b7cf-4841-8c9c-bae092a5282f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1394 microversion: 2.1 time: 0.291085 Aug 29 16:21:10.466440 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3428/6681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:10 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1394 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:10.549365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-72037465-390a-45e1-8ea2-de536b06b7c6 req-83ea79e2-7579-4a9e-bf30-e68e968c75c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8dd089-1bc9-4a03-8a74-e0f16f7748c4", "tag": "5fa022e7-cd3d-4143-8237-5ebd88a76978"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:10.561484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-72037465-390a-45e1-8ea2-de536b06b7c6 req-83ea79e2-7579-4a9e-bf30-e68e968c75c0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:10.562157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-72037465-390a-45e1-8ea2-de536b06b7c6 req-83ea79e2-7579-4a9e-bf30-e68e968c75c0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:10.562698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-72037465-390a-45e1-8ea2-de536b06b7c6 req-83ea79e2-7579-4a9e-bf30-e68e968c75c0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:10.579090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-72037465-390a-45e1-8ea2-de536b06b7c6 req-83ea79e2-7579-4a9e-bf30-e68e968c75c0 service nova] Creating event network-changed:5fa022e7-cd3d-4143-8237-5ebd88a76978 for instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 on n-h1-836830-13 Aug 29 16:21:10.585666 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-72037465-390a-45e1-8ea2-de536b06b7c6 req-83ea79e2-7579-4a9e-bf30-e68e968c75c0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041448 Aug 29 16:21:10.586836 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3254/6682] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:11.219540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:11.220250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:11.227326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.227857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.228365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.229062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.229523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.230338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.367283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:11.376516 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-50501546-c29a-42ce-8508-2c2040fe049b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1314 microversion: 2.1 time: 0.161945 Aug 29 16:21:11.377180 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3429/6683] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:11 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:11.487658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:11.488476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:11.494742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.495343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.496953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.498051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:11.498759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:11.499353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:11.660574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:11.669213 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30ff7e1c-7edf-457a-86a9-2c11d98c1fe6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1394 microversion: 2.1 time: 0.186402 Aug 29 16:21:11.669825 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3255/6684] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:11 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1394 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:12.397910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:12.398845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:12.406712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.407249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.408296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:12.409000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.409467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.409895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:12.570030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:12.582577 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f46a0089-3030-4235-b5d6-6e0d2389e668 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1314 microversion: 2.1 time: 0.188814 Aug 29 16:21:12.584673 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3430/6685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:12 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:12.701019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:12.702602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:12.710952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.711935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.712718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:12.713939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:12.715195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:12.715852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.014699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:13.017593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8aaae8d4-1d34-4b27-b0a5-7d1c9538fb19 req-712c4468-136a-46af-9c6b-c0a4e6435377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14ebc9e-2442-40b7-9124-fb784a68b20e", "name": "network-vif-deleted", "tag": "7f610bcf-6f2a-47a1-ae4c-41314c17cf23"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:13.023448 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2cbe3ebb-b53e-4350-a922-351044f820de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1394 microversion: 2.1 time: 0.330162 Aug 29 16:21:13.024668 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3256/6686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:12 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1394 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:13.041470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8aaae8d4-1d34-4b27-b0a5-7d1c9538fb19 req-712c4468-136a-46af-9c6b-c0a4e6435377 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.042392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8aaae8d4-1d34-4b27-b0a5-7d1c9538fb19 req-712c4468-136a-46af-9c6b-c0a4e6435377 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.042936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8aaae8d4-1d34-4b27-b0a5-7d1c9538fb19 req-712c4468-136a-46af-9c6b-c0a4e6435377 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.067628 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8aaae8d4-1d34-4b27-b0a5-7d1c9538fb19 req-712c4468-136a-46af-9c6b-c0a4e6435377 service nova] Creating event network-vif-deleted:7f610bcf-6f2a-47a1-ae4c-41314c17cf23 for instance a14ebc9e-2442-40b7-9124-fb784a68b20e on n-h2-836830-13 Aug 29 16:21:13.074496 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8aaae8d4-1d34-4b27-b0a5-7d1c9538fb19 req-712c4468-136a-46af-9c6b-c0a4e6435377 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067353 Aug 29 16:21:13.076426 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3431/6687] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:13.607057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:13.607612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:13.613738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.614214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.614648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.615361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:13.619533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:13.619978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:13.769651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:13.778789 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8c93995-fd6a-43a5-9162-bc0d21042e3b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1314 microversion: 2.1 time: 0.176841 Aug 29 16:21:13.791441 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3257/6688] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:13 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:14.048583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.049879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.056570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.057068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.057521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.058547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.059493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.059922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.133597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:14.142926 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49aa890a-12b5-4d5d-bf50-f4adcfb7ff91 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1187 microversion: 2.1 time: 0.099688 Aug 29 16:21:14.143569 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3432/6689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:14 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:14.801154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:14.802439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:14.810970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.811582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.812094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:14.812884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:14.813414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:14.814058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:15.164960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:15.166290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:15.169650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:15.177664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:15.178533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:15.179249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:15.180192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:15.180888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:15.181538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:15.251481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:15.262344 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76b57c92-34ad-4d9c-b899-ed1a37761cf3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1187 microversion: 2.1 time: 0.099633 Aug 29 16:21:15.263549 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3433/6690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:15 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:15.340882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:15.349261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e40172b-6d92-40c2-8e76-2941410a7015 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1314 microversion: 2.1 time: 0.552176 Aug 29 16:21:15.364163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3258/6691] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:14 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:15.613807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-22a3fec3-0a7c-4d86-a9d3-065907484466 req-83408716-da2b-47b1-9d5b-88ae7b415e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8dd089-1bc9-4a03-8a74-e0f16f7748c4", "name": "network-vif-plugged", "status": "completed", "tag": "5fa022e7-cd3d-4143-8237-5ebd88a76978"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:15.623742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-22a3fec3-0a7c-4d86-a9d3-065907484466 req-83408716-da2b-47b1-9d5b-88ae7b415e57 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:15.624228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-22a3fec3-0a7c-4d86-a9d3-065907484466 req-83408716-da2b-47b1-9d5b-88ae7b415e57 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:15.624848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-22a3fec3-0a7c-4d86-a9d3-065907484466 req-83408716-da2b-47b1-9d5b-88ae7b415e57 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:15.640065 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-22a3fec3-0a7c-4d86-a9d3-065907484466 req-83408716-da2b-47b1-9d5b-88ae7b415e57 service nova] Creating event network-vif-plugged:5fa022e7-cd3d-4143-8237-5ebd88a76978 for instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 on n-h1-836830-13 Aug 29 16:21:15.645619 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-22a3fec3-0a7c-4d86-a9d3-065907484466 req-83408716-da2b-47b1-9d5b-88ae7b415e57 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035449 Aug 29 16:21:15.646517 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3434/6692] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:16.287144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:16.288427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:16.299580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:16.303583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.304294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.304829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.306286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.307077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.307794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.314717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=93 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:16.373347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:16.373978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:16.388663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:16.388865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.389340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.389782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.390493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:16.395792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:16.396301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:16.398792 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e0bdadfe-ae2f-4768-81e6-5d2a4192949b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1187 microversion: 2.1 time: 0.119210 Aug 29 16:21:16.414178 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3259/6693] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:16 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1187 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:16.568014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:16.578747 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c6d63a0-4339-41e7-8d5b-fbff0db82072 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1314 microversion: 2.1 time: 0.211199 Aug 29 16:21:16.580798 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3435/6694] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:16 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:17.421538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:17.422728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:17.429774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:17.430273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:17.430774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:17.431515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:17.431976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:17.432408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:17.478659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:17.499559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:17.501829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:17.509104 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8fbbf6eb-4f55-4324-b7e4-5f7c414ec4a7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 200 len: 1187 microversion: 2.1 time: 0.092268 Aug 29 16:21:17.509713 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3260/6695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:17 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:17.606007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:17.607832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:17.615387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:17.616087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:17.616810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:17.617665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:17.618393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:17.618975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:17.647639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:17.770354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:17.780804 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-02d78784-6366-4b58-82fe-2f481a77c86a tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1464 microversion: 2.1 time: 0.180474 Aug 29 16:21:17.781392 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3436/6696] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:17 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1464 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:17.802807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae30ea92-d8ef-48c8-826c-f0e200652e40", "device": "/dev/sdb"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:17.806248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:17.813265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:17.815098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:17.815738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:17.816506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:17.817013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:17.817616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:18.110770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ba1a29c0-6161-4bb4-a587-bbd8d1d3e73b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "POST /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311821 Aug 29 16:21:18.113690 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3261/6697] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:21:17 2022] POST /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:18.533716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:18.534448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: a14ebc9e-2442-40b7-9124-fb784a68b20e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:18.540838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:18.541680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:18.542269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:18.543212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:18.543764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:18.544276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:18.565233 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance a14ebc9e-2442-40b7-9124-fb784a68b20e could not be found. Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e HTTP/1.1 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance a14ebc9e-2442-40b7-9124-fb784a68b20e could not be found. Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'a14ebc9e-2442-40b7-9124-fb784a68b20e'} Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14ebc9e-2442-40b7-9124-fb784a68b20e could not be found. Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14ebc9e-2442-40b7-9124-fb784a68b20e could not be found. Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:18.567158 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14ebc9e-2442-40b7-9124-fb784a68b20e could not be found. Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance a14ebc9e-2442-40b7-9124-fb784a68b20e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46b6fa07-9c08-4fcd-9823-339282983a16 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e" status: 404 len: 111 microversion: 2.1 time: 0.041214 Aug 29 16:21:18.572408 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3437/6698] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:18 2022] GET /compute/v2.1/servers/a14ebc9e-2442-40b7-9124-fb784a68b20e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:21:24.250502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1119031101", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a72b4c8c-a856-4929-ba14-491f33867a97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:24.319467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:21:24.821247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:21:24.821247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:21:24.821247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:21:24.821247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:21:24.821247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:21:24.832108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:24.832709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:24.833157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:24.833886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:24.834400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:24.834755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:24.873335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:24.879692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:24.945518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:21:24.947816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a72b4c8c-a856-4929-ba14-491f33867a97',volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:21:25.113203 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18fc12e4-97f6-43ec-af3f-7e416c056bea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867337 Aug 29 16:21:25.113873 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3262/6699] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:21:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:21:25.125602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fa595f04-fd20-4cff-96f8-d92ce1ff9515 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:25.126856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fa595f04-fd20-4cff-96f8-d92ce1ff9515 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:25.461169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fa595f04-fd20-4cff-96f8-d92ce1ff9515 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:25.469548 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fa595f04-fd20-4cff-96f8-d92ce1ff9515 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1057 microversion: 2.1 time: 0.348788 Aug 29 16:21:25.470366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3438/6700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:25 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1057 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:26.500044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:26.501870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:26.522081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:26.522863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:26.523532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:26.524459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:26.525140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:26.526651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:26.660626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:26.673160 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e8eb479-8a4d-4066-9a16-747f6b328716 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1173 microversion: 2.1 time: 0.186225 Aug 29 16:21:26.674491 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3263/6701] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:26 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1173 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:27.705035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:27.705655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:27.719933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:27.722063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:27.723798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:27.726010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:27.726659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:27.728565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:28.006921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:28.018820 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-08d560a2-198b-4cfe-b93d-2cade7d10216 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1215 microversion: 2.1 time: 0.323826 Aug 29 16:21:28.020320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3439/6702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:27 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:29.054805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:29.055619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:29.072357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:29.073233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:29.074589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:29.075608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:29.076321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:29.076974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:29.157535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5c9f84aa-4de7-4a97-8f67-09daa329ba4e req-a4711b71-2148-415f-b13d-0584337d51fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e39f4c1-6d47-4397-bc5f-194457945611", "tag": "c04812e0-cb60-44fc-a463-277fe6d9a067"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:29.175566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5c9f84aa-4de7-4a97-8f67-09daa329ba4e req-a4711b71-2148-415f-b13d-0584337d51fe service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:29.176384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5c9f84aa-4de7-4a97-8f67-09daa329ba4e req-a4711b71-2148-415f-b13d-0584337d51fe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:29.177082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5c9f84aa-4de7-4a97-8f67-09daa329ba4e req-a4711b71-2148-415f-b13d-0584337d51fe service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:29.194579 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5c9f84aa-4de7-4a97-8f67-09daa329ba4e req-a4711b71-2148-415f-b13d-0584337d51fe service nova] Creating event network-changed:c04812e0-cb60-44fc-a463-277fe6d9a067 for instance 1e39f4c1-6d47-4397-bc5f-194457945611 on n-h2-836830-13 Aug 29 16:21:29.231398 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5c9f84aa-4de7-4a97-8f67-09daa329ba4e req-a4711b71-2148-415f-b13d-0584337d51fe service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076871 Aug 29 16:21:29.233378 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3440/6703] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:21:29.645041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:29.653395 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7a8f06f-0c25-4c36-9516-ee009c8ba5a3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1215 microversion: 2.1 time: 0.609498 Aug 29 16:21:29.655058 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3264/6704] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:29 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1215 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:30.677979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:30.678690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:30.691740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:30.692237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:30.692677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:30.693383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:30.701202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:30.701997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:30.921199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:30.936597 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba898509-ceaa-4ac5-a7a9-0979d7bd0814 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1215 microversion: 2.1 time: 0.262586 Aug 29 16:21:30.938406 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3441/6705] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:30 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:31.959434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:31.960696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:31.981458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:31.982248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:31.982870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:31.985614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:31.989387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:31.990053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:32.330302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:32.348020 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19ae2de0-22c4-43af-b602-1adfc33fc7d2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1215 microversion: 2.1 time: 0.392835 Aug 29 16:21:32.361580 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3265/6706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:31 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1215 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:33.210100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-78204840-68e0-4905-87c8-95541e1303ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'create', calling method: .version_select at 0x7f32ed9d23a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1579128428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhlLymsQP1uVprPbHGSCZ+Tmde6R3MBwan07xGBnfrKifzYoWh0sAwlaeAzXLeRlRFfwiymNvgJ6EBR6UXa+CPRoZ5mADtQN5B4EoJNDByZNZNQgbbFcWPXXSnbGHbYdQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:33.239947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-78204840-68e0-4905-87c8-95541e1303ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for project c3d414b7ad0443c18d025560cafaab30. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:33.249280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-78204840-68e0-4905-87c8-95541e1303ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for user fdb719a577de458895b29d1017c094f6 and project c3d414b7ad0443c18d025560cafaab30. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:33.289644 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-78204840-68e0-4905-87c8-95541e1303ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.087189 Aug 29 16:21:33.290271 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3442/6707] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:21:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:33.372898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:33.374789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:33.384151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:33.384989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:33.385520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:33.387129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:33.388479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:33.388974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:33.579513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:33.589842 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fb2c0764-2a30-49e8-b753-923da8ba3f62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.223513 Aug 29 16:21:33.591352 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3266/6708] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:33 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:34.614660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:34.616580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:34.627493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:34.628342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:34.629027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:34.629951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:34.630580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:34.631300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:34.632559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1910448791", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "896efefe-f978-4628-8490-3da78ca3195e"}], "key_name": "tempest-TestNetworkBasicOps-1579128428", "security_groups": [{"name": "tempest-secgroup-smoke-584123889"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:34.845058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] validate_networks() for [('896efefe-f978-4628-8490-3da78ca3195e', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:21:34.856990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:34.862150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:34.875734 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3899e553-3e09-4391-b84e-9db1957acb3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.266157 Aug 29 16:21:34.886788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:34.894421 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3443/6709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:34 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:35.289760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:21:35.290310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:21:35.290876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:21:35.291655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:21:35.292515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:21:35.305379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:35.306187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:35.306627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:35.307547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:35.308036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:35.308471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:35.336979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for project c3d414b7ad0443c18d025560cafaab30. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:21:35.346648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for user fdb719a577de458895b29d1017c094f6 and project c3d414b7ad0443c18d025560cafaab30. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:21:35.367375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:21:35.372269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:21:35.434468 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-98ad8acd-b54b-49c9-8f78-c108f8a3e45c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805158 Aug 29 16:21:35.439187 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3267/6710] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:21:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:21:35.447862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-61bd09b9-a6cb-4c90-b15f-815d69700db8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:35.450025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-61bd09b9-a6cb-4c90-b15f-815d69700db8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:35.516773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-61bd09b9-a6cb-4c90-b15f-815d69700db8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:35.527295 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-61bd09b9-a6cb-4c90-b15f-815d69700db8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1249 microversion: 2.1 time: 0.083173 Aug 29 16:21:35.529856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3444/6711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:35 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:35.899635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:35.900265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:35.906982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:35.907496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:35.907950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:35.908646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:35.909112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:35.909554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:36.080657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:36.094232 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d94fba6f-9004-4471-97f1-337c78e24f0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.199093 Aug 29 16:21:36.096347 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3268/6712] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:35 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:36.561084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:36.561701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:36.575532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:36.576028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:36.576474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:36.577181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:36.578854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:36.579314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:36.670454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:36.682570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8d131b7-fd8c-4a98-86f4-64eb11d3da65 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1309 microversion: 2.1 time: 0.125952 Aug 29 16:21:36.683994 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3445/6713] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:36 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:37.121274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:37.122749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:37.138202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.138837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.139925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.140803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.141271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.141694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.396913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:37.407624 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e89730af-0c62-4c30-bf62-73330410158a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.292327 Aug 29 16:21:37.416650 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3269/6714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:37 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:37.723256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:37.724637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:37.735154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.736370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.737360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.738648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:37.739642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:37.740467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:37.936271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:37.944014 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e38898c-eed1-4e3c-b4f0-da8f893ca10a tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1374 microversion: 2.1 time: 0.227016 Aug 29 16:21:37.944631 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3446/6715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:37 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1374 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:38.275898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-55667544-17ac-4ca0-b082-975bcfdd09b2 req-2d1d1c2e-11c5-4700-b5bf-1de6297cb380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d21b5d-0777-4589-9494-3c4aa9ad921e", "tag": "7a20747d-2b6a-4f96-a05b-ac8d90be6e60"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:38.295186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-55667544-17ac-4ca0-b082-975bcfdd09b2 req-2d1d1c2e-11c5-4700-b5bf-1de6297cb380 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:38.295998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-55667544-17ac-4ca0-b082-975bcfdd09b2 req-2d1d1c2e-11c5-4700-b5bf-1de6297cb380 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:38.298227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-55667544-17ac-4ca0-b082-975bcfdd09b2 req-2d1d1c2e-11c5-4700-b5bf-1de6297cb380 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:38.311337 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-55667544-17ac-4ca0-b082-975bcfdd09b2 req-2d1d1c2e-11c5-4700-b5bf-1de6297cb380 service nova] Creating event network-changed:7a20747d-2b6a-4f96-a05b-ac8d90be6e60 for instance 02d21b5d-0777-4589-9494-3c4aa9ad921e on n-h1-836830-13 Aug 29 16:21:38.316228 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-55667544-17ac-4ca0-b082-975bcfdd09b2 req-2d1d1c2e-11c5-4700-b5bf-1de6297cb380 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044170 Aug 29 16:21:38.317185 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3270/6716] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:38.430538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:38.431715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:38.439765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:38.440257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:38.440693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:38.441392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:38.441843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:38.442263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:38.601206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:38.610414 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c91fbb85-908a-422f-b5b8-0c958eb73527 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.185168 Aug 29 16:21:38.611005 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3447/6717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:38 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:38.969537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:38.970270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:38.977013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:38.977700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:38.978126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:38.979089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:38.980423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:38.981256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:39.122340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:39.130427 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad88e4aa-5d69-4e0a-b0a6-6c9887b7ad93 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1374 microversion: 2.1 time: 0.166082 Aug 29 16:21:39.131257 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3271/6718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:38 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:39.632056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:39.633365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:39.663182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:39.663687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:39.664330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:39.665228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:39.665684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:39.666105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:39.828236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:39.838375 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09a1df8e-98bd-41eb-8e24-e8f67127ef99 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.210328 Aug 29 16:21:39.838825 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3448/6719] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:39 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:40.156587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:40.158882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:40.166272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:40.167825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:40.168263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:40.169254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:40.169947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:40.171016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:40.334670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:40.343208 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2562790b-12b5-4b69-bf61-b64e00172902 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1374 microversion: 2.1 time: 0.195285 Aug 29 16:21:40.343788 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3272/6720] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:40 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:40.860753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:40.861488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:40.869270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:40.870015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:40.870931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:40.871728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:40.872375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:40.872817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:40.875696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=89 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:41.335968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:41.343938 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a813b27-c19a-4a58-a746-6841604c0ecc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.487129 Aug 29 16:21:41.344530 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3449/6721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:40 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:41.365558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:41.366207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:41.374401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:41.374903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:41.375383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:41.376090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:41.376547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:41.376977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:41.518921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:41.527620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c7552ca7-dbbf-48c1-8207-b6f38a7200b5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1374 microversion: 2.1 time: 0.165844 Aug 29 16:21:41.528525 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3273/6722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:41 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:42.364365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:42.364979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:42.376018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:42.376739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:42.377378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:42.378100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:42.378570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:42.379004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:42.520441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:42.529669 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73ac829a-8b34-4b11-ad57-653feda66b0f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.169163 Aug 29 16:21:42.530273 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3450/6723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:42 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:42.550389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:42.551323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:42.558836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:42.559488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:42.560449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:42.561266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:42.561792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:42.562290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:42.706889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:42.715556 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b80491c1-7250-4110-b403-579c72c01563 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1374 microversion: 2.1 time: 0.169511 Aug 29 16:21:42.716337 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3274/6724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:42 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:43.552951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:43.553567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:43.562382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:43.562878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:43.563524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:43.564418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:43.564879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:43.565572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:43.586597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4ca07136-6466-48a2-9200-ce166e684b05 req-bdbc0c51-f71a-4398-8ef4-bf3c4b63d18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d21b5d-0777-4589-9494-3c4aa9ad921e", "name": "network-vif-plugged", "status": "completed", "tag": "7a20747d-2b6a-4f96-a05b-ac8d90be6e60"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:43.603365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4ca07136-6466-48a2-9200-ce166e684b05 req-bdbc0c51-f71a-4398-8ef4-bf3c4b63d18b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:43.604178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4ca07136-6466-48a2-9200-ce166e684b05 req-bdbc0c51-f71a-4398-8ef4-bf3c4b63d18b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:43.605442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4ca07136-6466-48a2-9200-ce166e684b05 req-bdbc0c51-f71a-4398-8ef4-bf3c4b63d18b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:43.621580 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4ca07136-6466-48a2-9200-ce166e684b05 req-bdbc0c51-f71a-4398-8ef4-bf3c4b63d18b service nova] Creating event network-vif-plugged:7a20747d-2b6a-4f96-a05b-ac8d90be6e60 for instance 02d21b5d-0777-4589-9494-3c4aa9ad921e on n-h1-836830-13 Aug 29 16:21:43.630645 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4ca07136-6466-48a2-9200-ce166e684b05 req-bdbc0c51-f71a-4398-8ef4-bf3c4b63d18b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048787 Aug 29 16:21:43.631977 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3275/6725] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:21:43.739174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:43.740549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:43.742326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:43.750680 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-201fc2a3-9dcf-449f-a91c-06dbe546dd13 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.202034 Aug 29 16:21:43.752664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:43.753433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:43.754080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:43.755004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:43.756432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:43.757407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:43.763658 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3451/6726] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:43 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:43.922998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:43.931431 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a106ccad-33b4-4859-a92b-f311d5cef712 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1374 microversion: 2.1 time: 0.197771 Aug 29 16:21:43.932199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3276/6727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:43 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:44.772590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:44.773137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:44.780802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:44.781285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:44.781721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:44.782413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:44.782862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:44.783315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:44.925454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:44.934601 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d18eb5b3-a72c-4e9c-9c7f-bb705870f68d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.165560 Aug 29 16:21:44.940326 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3452/6728] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:44 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:44.954366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:44.954993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:44.962354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:44.962848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:44.963322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:44.964602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:44.965066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:44.965497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:44.968554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:45.117167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:45.125867 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30d0235c-2e08-4d07-ad41-b2d470da01df tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1374 microversion: 2.1 time: 0.175609 Aug 29 16:21:45.126456 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3277/6729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:44 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:45.653020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-612be296-779b-4b6f-9391-c00186fd4f48 req-19944039-99a3-4299-af6d-17fba29bc1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e39f4c1-6d47-4397-bc5f-194457945611", "name": "network-vif-plugged", "status": "completed", "tag": "c04812e0-cb60-44fc-a463-277fe6d9a067"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:45.657890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:45.658526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:45.664884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-612be296-779b-4b6f-9391-c00186fd4f48 req-19944039-99a3-4299-af6d-17fba29bc1f9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:45.665367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-612be296-779b-4b6f-9391-c00186fd4f48 req-19944039-99a3-4299-af6d-17fba29bc1f9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:45.665799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-612be296-779b-4b6f-9391-c00186fd4f48 req-19944039-99a3-4299-af6d-17fba29bc1f9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:45.679331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-612be296-779b-4b6f-9391-c00186fd4f48 req-19944039-99a3-4299-af6d-17fba29bc1f9 service nova] Creating event network-vif-plugged:c04812e0-cb60-44fc-a463-277fe6d9a067 for instance 1e39f4c1-6d47-4397-bc5f-194457945611 on n-h2-836830-13 Aug 29 16:21:45.685942 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-612be296-779b-4b6f-9391-c00186fd4f48 req-19944039-99a3-4299-af6d-17fba29bc1f9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036731 Aug 29 16:21:45.686567 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3453/6730] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:45.956609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:45.957378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:45.959646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:45.960411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:45.969077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:45.969580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:45.970037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:45.970750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:45.971230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:45.971661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:46.110881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:46.118796 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c45eb0d5-047b-4c62-95d6-222fa8849caa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.166674 Aug 29 16:21:46.119403 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3278/6731] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:45 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:46.147200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:46.147990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:46.155722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:46.156185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:46.156656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:46.157384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:46.157845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:46.158271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:46.310137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:46.319161 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f28951f3-ef18-46e6-984d-0122fc623951 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1545 microversion: 2.1 time: 0.177062 Aug 29 16:21:46.319745 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3454/6732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:46 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1545 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:46.341443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:46.342071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:46.343988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:21:46.349979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:46.350482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:46.350988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:46.351718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:46.352177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:46.352608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:46.492366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:46.503254 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79e7466b-a16d-4cba-96ad-846bac92e2bd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1545 microversion: 2.1 time: 0.166346 Aug 29 16:21:46.503854 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3279/6733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:46 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1545 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:47.140180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:47.140719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:47.147552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:47.148717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:47.149170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:47.149867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:47.150326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:47.150756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:47.391517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:47.404474 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8f6a89f-fb79-4fe6-bf30-2e5dd509dc21 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1203 microversion: 2.1 time: 0.269148 Aug 29 16:21:47.407180 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3455/6734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:47 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1203 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:48.419862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1339467f-b7aa-4212-9c72-97b25025044e req-afa84867-4ded-4d3d-999c-e8999e3b4fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d21b5d-0777-4589-9494-3c4aa9ad921e", "tag": "7a20747d-2b6a-4f96-a05b-ac8d90be6e60"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:48.427092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:48.428341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:48.430362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1339467f-b7aa-4212-9c72-97b25025044e req-afa84867-4ded-4d3d-999c-e8999e3b4fd3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:48.430876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1339467f-b7aa-4212-9c72-97b25025044e req-afa84867-4ded-4d3d-999c-e8999e3b4fd3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:48.431527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1339467f-b7aa-4212-9c72-97b25025044e req-afa84867-4ded-4d3d-999c-e8999e3b4fd3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:48.436324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:48.436826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:48.437264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:48.437973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:48.438428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:48.438856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:48.444023 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1339467f-b7aa-4212-9c72-97b25025044e req-afa84867-4ded-4d3d-999c-e8999e3b4fd3 service nova] Creating event network-changed:7a20747d-2b6a-4f96-a05b-ac8d90be6e60 for instance 02d21b5d-0777-4589-9494-3c4aa9ad921e on n-h1-836830-13 Aug 29 16:21:48.450246 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1339467f-b7aa-4212-9c72-97b25025044e req-afa84867-4ded-4d3d-999c-e8999e3b4fd3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177689 Aug 29 16:21:48.451191 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3280/6735] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:21:48.593025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:48.603224 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fa5fbad3-e0d7-46c7-bbc5-412d48aae0ef tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1389 microversion: 2.1 time: 0.180067 Aug 29 16:21:48.604333 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3456/6736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:48 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1389 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:21:48.625761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:48.626787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:48.634346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:48.635101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:48.637305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:48.638442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:48.639131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:48.639753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:49.284881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:49.293823 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de700335-9106-4340-a733-394e361f4358 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1389 microversion: 2.1 time: 0.673389 Aug 29 16:21:49.294438 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3281/6737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:48 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1389 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:49.314427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:49.315075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:49.321722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:49.322214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:49.322653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:49.323998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:49.324533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:49.324987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:49.504260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:49.527524 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-160796e4-a457-4b25-bc93-b67ce335c398 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1389 microversion: 2.1 time: 0.205004 Aug 29 16:21:49.527524 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3457/6738] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:49 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1389 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:49.546167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:49.546720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:49.554839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:49.555403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:49.555854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:49.557100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:49.557789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:49.558471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:49.592037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:21:49.711191 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e00af3d-71b1-4dee-adc4-b0d3fc00694a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 204 len: 0 microversion: 2.1 time: 0.170633 Aug 29 16:21:49.711948 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3282/6739] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:21:49 2022] DELETE /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:21:49.721060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:49.721673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:49.727798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:49.728285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:49.728724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:49.729409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:49.730555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:49.731204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:49.867623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:49.876686 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be6a0b65-37da-4754-9d07-7077d1088732 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1395 microversion: 2.1 time: 0.159640 Aug 29 16:21:49.877243 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3458/6740] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:49 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:50.898568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:50.899221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:50.906172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:50.906681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:50.907146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:50.907836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:50.908290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:50.908713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:51.048285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:51.056138 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1888585-9f3a-48f4-b980-445f45a60265 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1395 microversion: 2.1 time: 0.161987 Aug 29 16:21:51.056709 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3283/6741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:50 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:52.079962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:52.080786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:52.090991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:52.091539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:52.092114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:52.092949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:52.093623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:52.094257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:52.127458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6bf7cbb0-a6e2-48bb-acbd-1a58d734932a req-272cc894-cc4d-4a82-9879-2d6514de9872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e39f4c1-6d47-4397-bc5f-194457945611", "name": "network-vif-deleted", "tag": "c04812e0-cb60-44fc-a463-277fe6d9a067"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:21:52.151703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6bf7cbb0-a6e2-48bb-acbd-1a58d734932a req-272cc894-cc4d-4a82-9879-2d6514de9872 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:52.153015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6bf7cbb0-a6e2-48bb-acbd-1a58d734932a req-272cc894-cc4d-4a82-9879-2d6514de9872 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:52.153405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6bf7cbb0-a6e2-48bb-acbd-1a58d734932a req-272cc894-cc4d-4a82-9879-2d6514de9872 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:52.165763 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6bf7cbb0-a6e2-48bb-acbd-1a58d734932a req-272cc894-cc4d-4a82-9879-2d6514de9872 service nova] Creating event network-vif-deleted:c04812e0-cb60-44fc-a463-277fe6d9a067 for instance 1e39f4c1-6d47-4397-bc5f-194457945611 on n-h2-836830-13 Aug 29 16:21:52.175599 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6bf7cbb0-a6e2-48bb-acbd-1a58d734932a req-272cc894-cc4d-4a82-9879-2d6514de9872 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052023 Aug 29 16:21:52.179170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3284/6742] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:21:52.189497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:52.197637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7e348945-89db-4116-8352-efab28266a54 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1353 microversion: 2.1 time: 0.124479 Aug 29 16:21:52.199189 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3459/6743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:52 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:53.221825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:53.222697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:53.229474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:53.230095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:53.230607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:53.231432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:53.232040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:53.232576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:53.304391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:53.314732 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28c125c4-b133-414d-accd-4d65e4502a20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1188 microversion: 2.1 time: 0.098305 Aug 29 16:21:53.315458 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3285/6744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:53 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:54.336648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:54.337267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:54.345571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:54.346066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:54.346501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:54.347235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:54.347694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:54.348116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:54.421485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:54.429441 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-938944d5-bbe1-48e3-b4aa-67163a4f5eb4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1188 microversion: 2.1 time: 0.096805 Aug 29 16:21:54.430223 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3460/6745] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:54 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:55.457451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:55.458173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:55.466923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:55.467522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:55.467980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:55.468737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:55.469438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:55.469877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:55.540807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:55.555346 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e6a038d-5124-4d36-b10b-eb5beb793c1b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1188 microversion: 2.1 time: 0.102465 Aug 29 16:21:55.556594 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3286/6746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:55 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:56.580167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:56.580931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:56.587735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:56.588221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:56.588654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:56.590454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:56.590653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:56.591103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:56.625568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:56.626075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:56.631603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:56.632118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lazy-loading 'fault' on Instance uuid 1e39f4c1-6d47-4397-bc5f-194457945611 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:21:56.680671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:21:56.689619 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-67926c49-8a88-4843-9f5c-753d1686d45f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 200 len: 1193 microversion: 2.1 time: 0.114916 Aug 29 16:21:56.690344 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3461/6747] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:56 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 1193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:21:57.711602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:21:57.712223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 1e39f4c1-6d47-4397-bc5f-194457945611] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:21:57.720246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:57.720733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:57.721175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:57.721863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:21:57.722318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:21:57.722751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:21:57.737336 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 1e39f4c1-6d47-4397-bc5f-194457945611 could not be found. Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 HTTP/1.1 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 1e39f4c1-6d47-4397-bc5f-194457945611 could not be found. Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '1e39f4c1-6d47-4397-bc5f-194457945611'} Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e39f4c1-6d47-4397-bc5f-194457945611 could not be found. Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e39f4c1-6d47-4397-bc5f-194457945611 could not be found. Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:21:57.739428 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e39f4c1-6d47-4397-bc5f-194457945611 could not be found. Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 1e39f4c1-6d47-4397-bc5f-194457945611 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:21:57.744710 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f397095a-2f2f-41a8-989d-dbf26d45598b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611" status: 404 len: 111 microversion: 2.1 time: 0.033912 Aug 29 16:21:57.746504 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3287/6748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:21:57 2022] GET /compute/v2.1/servers/1e39f4c1-6d47-4397-bc5f-194457945611 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:22:10.624637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:10.627182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:10.631516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=19 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:10.632109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=75 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:10.638287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:10.638783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:10.639245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:10.639958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:10.640415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:10.640870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:10.695933 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b28111d-f41f-482c-8001-39a734eba024 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e/action" status: 200 len: 24571 microversion: 2.1 time: 0.076048 Aug 29 16:22:10.696608 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3462/6749] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:22:10 2022] POST /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:22:19.951277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2072369921", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "09038b47-070b-4d44-87b4-1f5088b313fb", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:19.961809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:19.962965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:20.048164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:22:20.468102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:22:20.468531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:22:20.469009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:22:20.469424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:22:20.469841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:22:20.480787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:20.481286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:20.481729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:20.482562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:20.483078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:20.483515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:20.507160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:22:20.514844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:22:20.530443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:22:20.532555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='09038b47-070b-4d44-87b4-1f5088b313fb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:22:20.610462 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4377224-e685-4885-89e7-5c9ca2185e52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663359 Aug 29 16:22:20.611334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3288/6750] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:22:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:22:20.623571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a933c9e5-0cc5-4fa0-aa51-ee00fba9624e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:20.624542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a933c9e5-0cc5-4fa0-aa51-ee00fba9624e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:20.659754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:20.690911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a933c9e5-0cc5-4fa0-aa51-ee00fba9624e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:20.700604 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a933c9e5-0cc5-4fa0-aa51-ee00fba9624e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1057 microversion: 2.1 time: 0.082165 Aug 29 16:22:20.701635 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3463/6751] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:20 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1057 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:21.723756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:21.725119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:21.732843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:21.733351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:21.733975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:21.734683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:21.735325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:21.735923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:21.840737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:21.849525 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-67fbfe6d-eae1-46f9-9220-626877c82e4a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1117 microversion: 2.1 time: 0.131068 Aug 29 16:22:21.850368 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3289/6752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:21 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1117 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:22.871639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:22.872208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:22.893119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:22.893692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:22.894145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:22.894860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:22.897292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:22.897956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:23.214650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:23.226582 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-601e1923-88fe-4548-bac4-4debf2f48c77 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.357227 Aug 29 16:22:23.227499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3464/6753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:22 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:23.391252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e654343-2b8d-42bd-980d-96cece377dea tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'create', calling method: .version_select at 0x7f32ed408790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1270990353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVS5Oq3MYEvf5fFJD7lf3NRb6qgB8qSHVooQ1uqNH3glPRmxarQr3sJHSSQjwKQApNt5K+qBVhWzz7/hVOXCD7IO3B4njMApbfQoA7pAZDBwaNW4p15SN8hWhORevFYug=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:23.416022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3e654343-2b8d-42bd-980d-96cece377dea tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for project c3d414b7ad0443c18d025560cafaab30. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:22:23.425903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-3e654343-2b8d-42bd-980d-96cece377dea tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for user fdb719a577de458895b29d1017c094f6 and project c3d414b7ad0443c18d025560cafaab30. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:22:23.462908 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e654343-2b8d-42bd-980d-96cece377dea tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.075973 Aug 29 16:22:23.467697 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3290/6754] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:22:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:23.733257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-29ff8706-f0c7-47ca-b810-b299283705e5 req-786cf149-21ec-428e-a8d6-e5fa5eb103b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5ea54f9-2957-4953-818e-86eb87d8346d", "tag": "eb438fdd-8567-4c92-9d46-24352f34da04"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:23.756992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-29ff8706-f0c7-47ca-b810-b299283705e5 req-786cf149-21ec-428e-a8d6-e5fa5eb103b9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:23.759270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-29ff8706-f0c7-47ca-b810-b299283705e5 req-786cf149-21ec-428e-a8d6-e5fa5eb103b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:23.762008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-29ff8706-f0c7-47ca-b810-b299283705e5 req-786cf149-21ec-428e-a8d6-e5fa5eb103b9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:23.801611 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-29ff8706-f0c7-47ca-b810-b299283705e5 req-786cf149-21ec-428e-a8d6-e5fa5eb103b9 service nova] Creating event network-changed:eb438fdd-8567-4c92-9d46-24352f34da04 for instance d5ea54f9-2957-4953-818e-86eb87d8346d on n-h2-836830-13 Aug 29 16:22:23.814681 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-29ff8706-f0c7-47ca-b810-b299283705e5 req-786cf149-21ec-428e-a8d6-e5fa5eb103b9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086434 Aug 29 16:22:23.816017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3465/6755] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:24.250321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:24.250946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:24.265708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:24.266502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:24.267127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:24.268021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:24.268653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:24.269237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:24.584991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:24.596381 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd979797-f1da-4bed-bbea-d9d39ee057fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.352135 Aug 29 16:22:24.598359 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3291/6756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:24 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:25.412921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-500136969", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "87fd15e9-36db-49b3-ba74-8c692a810055"}], "key_name": "tempest-TestNetworkBasicOps-1270990353", "security_groups": [{"name": "tempest-secgroup-smoke-1490866297"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:25.570962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] validate_networks() for [('87fd15e9-36db-49b3-ba74-8c692a810055', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:22:25.625776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:25.628829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:25.638055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:25.639191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:25.639817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:25.640708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:25.641329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:25.641934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:26.379344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:22:26.379901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:22:26.380977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:22:26.381680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:22:26.382209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:22:26.388753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:26.413770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a4aaac1a-0ef5-4c33-8b44-3313f5a02bee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.797522 Aug 29 16:22:26.417391 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3292/6757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:25 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:26.426790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:26.429739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:26.431560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:26.434874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:26.436571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:26.438027 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:26.498434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for project c3d414b7ad0443c18d025560cafaab30. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:22:26.511632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for user fdb719a577de458895b29d1017c094f6 and project c3d414b7ad0443c18d025560cafaab30. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:22:26.583753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:22:26.599081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:22:26.763137 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-73df1d5b-7678-4342-b9cc-c0f8770e28fd tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.354501 Aug 29 16:22:26.764129 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3466/6758] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:22:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:22:26.778993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49fc3a12-2de8-4479-9265-729247a59df8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:26.779664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49fc3a12-2de8-4479-9265-729247a59df8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:26.895995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49fc3a12-2de8-4479-9265-729247a59df8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:26.910206 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49fc3a12-2de8-4479-9265-729247a59df8 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1248 microversion: 2.1 time: 0.138414 Aug 29 16:22:26.911939 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3293/6759] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:26 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1248 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:27.446033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:27.448758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:27.463689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:27.464843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:27.467017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:27.468144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:27.469159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:27.471423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:27.846678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:27.856598 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-042cda87-7557-4512-9fe4-b30fd0b4479c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.418534 Aug 29 16:22:27.872450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3467/6760] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:27 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:27.938471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:27.939705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:27.953078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:27.953817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:27.954418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:27.955324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:27.956038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:27.956695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:28.100767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:28.127209 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c516e16b-e770-4aa5-a125-8aee713b20d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1252 microversion: 2.1 time: 0.194373 Aug 29 16:22:28.128128 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3294/6761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:27 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1252 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:28.881695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:28.882377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:28.900931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:28.901521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:28.901972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:28.902717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:28.903217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:28.903642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:29.158429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:29.159182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:29.172788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:29.174958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:29.175543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:29.176459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:29.179693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:29.180852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:29.223396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:29.235961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54a99963-6a6c-40aa-8ef3-0d1e945ecddb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.358813 Aug 29 16:22:29.255373 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3468/6762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:28 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:29.365185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:29.380622 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d2ee748f-0e03-4573-90d3-d63203db2862 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1318 microversion: 2.1 time: 0.225866 Aug 29 16:22:29.383696 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3295/6763] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:29 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:30.266799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:30.268301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:30.279146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:30.279655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:30.280106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:30.285391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:30.286136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:30.286579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:30.409857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:30.412784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:30.436522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:30.436989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:30.437438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:30.438180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:30.438638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:30.439185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:30.518966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:30.533492 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8f9ffbfb-2dfe-4f2b-9c02-a43ef8e8c06b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.279130 Aug 29 16:22:30.546382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:30.559795 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3469/6764] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:30 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:30.956480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:30.972617 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-362b9efc-cabf-4b99-8cb4-e96fb0f9b3d1 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1374 microversion: 2.1 time: 0.567275 Aug 29 16:22:30.973178 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3296/6765] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:30 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1374 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:22:31.468671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c3a5e35f-0391-40fe-af12-2061ff71cc95 req-53d07043-e9b1-46e0-ad8a-5799c34f1d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbb8d79-11ae-4f7d-be78-25a3a222b7cb", "tag": "e2c57902-1438-44c4-aff9-3f3a291b4f94"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:31.489739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c3a5e35f-0391-40fe-af12-2061ff71cc95 req-53d07043-e9b1-46e0-ad8a-5799c34f1d5f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:31.490686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c3a5e35f-0391-40fe-af12-2061ff71cc95 req-53d07043-e9b1-46e0-ad8a-5799c34f1d5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:31.491265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c3a5e35f-0391-40fe-af12-2061ff71cc95 req-53d07043-e9b1-46e0-ad8a-5799c34f1d5f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:31.505391 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c3a5e35f-0391-40fe-af12-2061ff71cc95 req-53d07043-e9b1-46e0-ad8a-5799c34f1d5f service nova] Creating event network-changed:e2c57902-1438-44c4-aff9-3f3a291b4f94 for instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb on n-h1-836830-13 Aug 29 16:22:31.513716 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c3a5e35f-0391-40fe-af12-2061ff71cc95 req-53d07043-e9b1-46e0-ad8a-5799c34f1d5f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048862 Aug 29 16:22:31.513928 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3470/6766] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:31.570350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:31.571676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:31.581887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:31.582390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:31.582833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:31.583595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:31.584048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:31.585470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:31.842331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:31.851956 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11bd8044-e441-4021-97d1-3cb4171aadbd tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.286066 Aug 29 16:22:31.865118 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3297/6767] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:31 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:32.002335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:32.003821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:32.016968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.017471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.017943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:32.018995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.019666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.020248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:32.192761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:32.218331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1facbb72-1c97-43d4-82c4-6644d6eae37c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1374 microversion: 2.1 time: 0.221356 Aug 29 16:22:32.220145 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3471/6768] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:31 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:32.266194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:32.266194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:32.273177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.273665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.274111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:32.274793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.275269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.275693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:32.367490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lazy-loading 'services' on Instance uuid bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:22:32.446780 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9dab9b88-67ba-4aec-a2e0-9a536b286127 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4/os-volume_attachments/ae30ea92-d8ef-48c8-826c-f0e200652e40" status: 202 len: 0 microversion: 2.1 time: 0.185871 Aug 29 16:22:32.447513 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3298/6769] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:22:32 2022] DELETE /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4/os-volume_attachments/ae30ea92-d8ef-48c8-826c-f0e200652e40 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:22:32.910149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:32.911454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:32.919725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.920426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.920854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:32.921679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:32.922260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:32.922691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:33.122725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:33.131452 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-563be4b1-61eb-4c80-bf2f-31f4d0279a38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.225463 Aug 29 16:22:33.132244 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3472/6770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:32 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:33.245218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:33.246005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:33.252771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:33.253434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:33.254053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:33.254737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:33.255408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:33.255851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:33.432003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:33.441061 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d6577cba-5cae-42dc-be29-07da0a435857 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1374 microversion: 2.1 time: 0.200945 Aug 29 16:22:33.455441 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3299/6771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:33 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:34.153386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:34.154311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:34.161885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:34.162687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:34.163240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:34.164055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:34.164586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:34.165087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:34.314173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:34.324065 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aed4cea2-3ef1-4f8d-b9ea-d2fbabebe226 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.174354 Aug 29 16:22:34.325271 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3473/6772] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:34 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:34.463191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:34.463843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:34.471556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:34.472050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:34.472491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:34.473247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:34.473723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:34.474151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:34.613646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:34.622643 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b74987a1-e0fd-4a77-9479-a534c6f8e627 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1374 microversion: 2.1 time: 0.163313 Aug 29 16:22:34.623556 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3300/6773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:34 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:35.345988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:35.347206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:35.354230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:35.354889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:35.355540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:35.356301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:35.357064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:35.357594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:35.499340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:35.507803 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5dfaf453-8c96-4d7f-ac57-3c526aab3541 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.165706 Aug 29 16:22:35.508301 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3474/6774] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:35 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:35.647337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:35.653618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:35.672169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:35.673181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:35.677328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:35.678879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:35.680717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:35.681435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:35.849302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:35.861657 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a69d2898-822d-488b-bf0a-f479d2588b45 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1374 microversion: 2.1 time: 0.219996 Aug 29 16:22:35.862821 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3301/6775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:35 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1374 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:36.014692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ba91d66d-5692-459e-9f3d-2fb35a99c668 req-cf426a85-0843-4795-929b-cb7e0c6b3a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbb8d79-11ae-4f7d-be78-25a3a222b7cb", "name": "network-vif-plugged", "status": "completed", "tag": "e2c57902-1438-44c4-aff9-3f3a291b4f94"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:36.027445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ba91d66d-5692-459e-9f3d-2fb35a99c668 req-cf426a85-0843-4795-929b-cb7e0c6b3a6b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.028831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ba91d66d-5692-459e-9f3d-2fb35a99c668 req-cf426a85-0843-4795-929b-cb7e0c6b3a6b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.029305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ba91d66d-5692-459e-9f3d-2fb35a99c668 req-cf426a85-0843-4795-929b-cb7e0c6b3a6b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:36.041857 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ba91d66d-5692-459e-9f3d-2fb35a99c668 req-cf426a85-0843-4795-929b-cb7e0c6b3a6b service nova] Creating event network-vif-plugged:e2c57902-1438-44c4-aff9-3f3a291b4f94 for instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb on n-h1-836830-13 Aug 29 16:22:36.047689 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ba91d66d-5692-459e-9f3d-2fb35a99c668 req-cf426a85-0843-4795-929b-cb7e0c6b3a6b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037304 Aug 29 16:22:36.048320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3475/6776] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:22:36.530801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:36.531507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:36.537651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.538137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.538571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:36.539287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.539740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.540163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:36.674374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:36.683142 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-58f7fc33-d56a-4316-8868-6aa8c6f87d76 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.156208 Aug 29 16:22:36.683735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3302/6777] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:36 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:36.884668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:36.885333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:36.889416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:36.890089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:36.894894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.895428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.895869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:36.896577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:36.897060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:36.897488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.035951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:37.044220 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4150b491-200d-4140-980e-ba6b65849872 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1374 microversion: 2.1 time: 0.163887 Aug 29 16:22:37.044828 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3476/6778] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:36 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:37.707640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:37.708063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:37.711539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:37.718565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.719134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.719866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.720911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.721459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.721958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.787800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:37.788412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:37.795880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.796683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.797345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.798296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.799253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.800590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.833564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:22:37.896182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:37.907681 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4de69cfd-8bf3-458d-8dac-1d36d589bd4d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.205272 Aug 29 16:22:37.909207 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3303/6779] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:37 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:37.926840 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c984ef3-d886-4d08-9ded-df538b809cb7 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 204 len: 0 microversion: 2.1 time: 0.142464 Aug 29 16:22:37.928684 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3477/6780] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:22:37 2022] DELETE /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:22:37.938250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:37.938786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:37.944990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.945484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.945914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:37.946611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:37.947097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:37.947527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.066847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:38.068053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:38.075363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.076097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.076532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.077248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.077733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.078155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.091273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:38.100082 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47a62f2d-f797-418d-9f2a-51f317258fba tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1470 microversion: 2.1 time: 0.166589 Aug 29 16:22:38.101578 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3304/6781] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:37 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:38.217130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:38.225013 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2dca9fef-996b-480c-9d23-7d05e2a2536e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1547 microversion: 2.1 time: 0.162813 Aug 29 16:22:38.225586 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3478/6782] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:38 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:22:38.246112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:38.246950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:38.254010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.254577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.255106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.255893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.256410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.256916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.395847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:38.404377 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79f01f4e-155f-497d-850d-d0e82b1fcd34 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1547 microversion: 2.1 time: 0.162634 Aug 29 16:22:38.405601 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3305/6783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:38 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:38.930017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:38.930685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:38.938452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.938934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.939576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:38.940084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:38.940534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:38.940954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:39.077697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:39.086164 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5938e4de-2148-4c12-b759-5b1fbc83ec6d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.160146 Aug 29 16:22:39.086740 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3479/6784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:38 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:39.122583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:39.123365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:39.130574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:39.131090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:39.131533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:39.132233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:39.132692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:39.133120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:39.152920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:39.283095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:39.292290 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6cda6a6-a7d7-429d-b31a-cab63573fc0b tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1470 microversion: 2.1 time: 0.173625 Aug 29 16:22:39.293955 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3306/6785] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:39 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:39.899379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d05317f9-d3bb-4b5b-96f7-735ed521ab6a req-fa8b3bd4-6da5-411c-9c4e-339e2a62d289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8dd089-1bc9-4a03-8a74-e0f16f7748c4", "name": "network-vif-deleted", "tag": "5fa022e7-cd3d-4143-8237-5ebd88a76978"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:39.916608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d05317f9-d3bb-4b5b-96f7-735ed521ab6a req-fa8b3bd4-6da5-411c-9c4e-339e2a62d289 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:39.917853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d05317f9-d3bb-4b5b-96f7-735ed521ab6a req-fa8b3bd4-6da5-411c-9c4e-339e2a62d289 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:39.918665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d05317f9-d3bb-4b5b-96f7-735ed521ab6a req-fa8b3bd4-6da5-411c-9c4e-339e2a62d289 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:39.930200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d05317f9-d3bb-4b5b-96f7-735ed521ab6a req-fa8b3bd4-6da5-411c-9c4e-339e2a62d289 service nova] Creating event network-vif-deleted:5fa022e7-cd3d-4143-8237-5ebd88a76978 for instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 on n-h1-836830-13 Aug 29 16:22:39.935273 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d05317f9-d3bb-4b5b-96f7-735ed521ab6a req-fa8b3bd4-6da5-411c-9c4e-339e2a62d289 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040673 Aug 29 16:22:39.935883 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3480/6786] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:40.109078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:40.111428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:40.119270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:40.120248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:40.121801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:40.122944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:40.124303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:40.125099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:40.311350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:40.315735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:40.316475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:40.325462 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32b737b7-4ae2-43ab-a7a0-6c83000c26d7 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.221451 Aug 29 16:22:40.331071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:40.331835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:40.332438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:40.333308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:40.333927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:40.334519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:40.340287 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3307/6787] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:40 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:40.384636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:40.385130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:40.385604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:40.386058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lazy-loading 'fault' on Instance uuid bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:22:40.804657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee4a3df1fa254fcab2514d25c1d2bc77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca4ac1309d784d33b4122f0976435304', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:40.809129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:40.814755 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e4d4722-55dd-40da-bd5e-4688a988f58d tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 200 len: 1304 microversion: 2.1 time: 0.503994 Aug 29 16:22:40.815501 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3481/6788] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:40 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 1304 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:41.346435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:41.347064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:41.355144 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:41.355622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:41.356061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:41.356731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:41.357180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:41.357601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:41.536365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:41.544511 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f5c376f-5beb-4759-9741-a25c62de64b0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1169 microversion: 2.1 time: 0.201787 Aug 29 16:22:41.545662 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3308/6789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:41 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1169 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:41.837502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:41.838145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] [instance: bc8dd089-1bc9-4a03-8a74-e0f16f7748c4] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:41.842118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:41.849260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:41.849909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:41.850507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:41.851400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:41.851860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:41.852277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:41.873646 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] HTTP exception thrown: Instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 could not be found. Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Request method failure captured: Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 HTTP/1.1 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdxnrHmx-uvz-i_dy4DEaeRAbvWJUvigqWsZDZle5M_RPI5uTF_LyfDoaNGGSRwDc7JLv2IF8i41qUGWezTTKGWU1YLvpZV0w5ui-cLjI3SnKhZvKYfn8YXWST18ELHFPZPqRG5BSTvY-jwbRkTKE39zbOxkJnBaq_d7My5qHVIPOg Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: ca4ac1309d784d33b4122f0976435304 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-VolumesBackupsTest-507327820 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ca4ac1309d784d33b4122f0976435304"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_ca4ac1309d784d33b4122f0976435304", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/ca4ac1309d784d33b4122f0976435304"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/ca4ac1309d784d33b4122f0976435304"}]}] Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-VolumesBackupsTest-507327820 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: ca4ac1309d784d33b4122f0976435304 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-VolumesBackupsTest-507327820 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-VolumesBackupsTest-507327820-project Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ee4a3df1fa254fcab2514d25c1d2bc77 Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-VolumesBackupsTest-507327820-project Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 could not be found. Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'bc8dd089-1bc9-4a03-8a74-e0f16f7748c4'} Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 could not be found. Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 could not be found. Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:22:41.875558 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:22:41.881204 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:22:41.881204 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:22:41.881204 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:22:41.881204 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:22:41.881204 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:22:41.881204 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 could not be found. Aug 29 16:22:41.881204 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:22:41.882710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] Returning 404 to user: Instance bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:22:41.883653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e69c817c-e3e2-491e-97d6-f44f33e22d65 tempest-VolumesBackupsTest-507327820 tempest-VolumesBackupsTest-507327820-project] 10.222.0.83 "GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4" status: 404 len: 111 microversion: 2.1 time: 0.050358 Aug 29 16:22:41.884254 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3482/6790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:41 2022] GET /compute/v2.1/servers/bc8dd089-1bc9-4a03-8a74-e0f16f7748c4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:22:42.566357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:42.567162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:42.575335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:42.576169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:42.576854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:42.577643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:42.578198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:42.578739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:42.723010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:42.732157 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8e2dfd68-c68f-45b4-a2df-97a0b6653b0c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.169433 Aug 29 16:22:42.732944 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3309/6791] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:42 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:43.754752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:43.755778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:43.764001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:43.764645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:43.765619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:43.766439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:43.767014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:43.767568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:43.961509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:43.969904 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0e88770e-808a-4839-a777-3bcc95703b5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.219876 Aug 29 16:22:43.970488 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3483/6792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:43 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:44.991937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:44.992596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:44.999600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:45.000087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:45.000522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:45.001213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:45.001668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:45.002096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:45.138365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:45.146979 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d4b994ce-993c-4001-bb19-d46d07712a31 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.159105 Aug 29 16:22:45.147587 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3310/6793] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:44 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:46.169228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:46.169992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:46.177530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:46.178025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:46.178464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:46.179448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:46.180105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:46.180739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:46.332133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:46.342096 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ddaaf6e2-7a60-4c99-8946-dcf42ecbada5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.177516 Aug 29 16:22:46.342762 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3484/6794] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:46 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:47.363658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:47.364285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:47.372434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:47.373286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:47.373738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:47.374442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:47.374901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:47.375350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:47.517838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:47.525659 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee3d7bb3-3dcc-4b46-bed6-0aa29f03456b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.166037 Aug 29 16:22:47.527031 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3311/6795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:47 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:48.548009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:48.548727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:48.556002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.556560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.556994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.558302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:48.558754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:48.559207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:48.696627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:48.705208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-80782668-5553-4b39-bf09-2eb796bcbfdc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.161202 Aug 29 16:22:48.705793 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3485/6796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:48 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:49.725840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:49.726490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:49.734754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:49.735290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:49.735737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:49.736442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:49.736901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:49.737328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:49.884301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:49.893530 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-79a7eeaa-d87d-4c27-969a-662194eb9222 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.171160 Aug 29 16:22:49.894130 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3312/6797] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:49 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:50.914141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:50.914981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:50.922737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:50.923355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:50.924108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:50.925207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:50.925742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:50.926182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:51.069941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:51.079009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ac48ff1-6f50-4b0d-af38-84204003906f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.168534 Aug 29 16:22:51.085799 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3486/6798] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:50 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:52.100030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:52.100646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:52.103487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:22:52.108898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:52.109384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:52.109813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:52.110502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:52.110952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:52.111395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:52.253424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:52.262313 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8861245c-965f-48bc-95cc-2abe6245f2d0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.166079 Aug 29 16:22:52.262912 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3313/6799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:52 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:52.639226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-68763ea5-7fcf-483d-a10b-59f94a132ae3 req-928a1221-8011-4cbb-871b-c4a7d049cdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ea54f9-2957-4953-818e-86eb87d8346d", "name": "network-vif-plugged", "status": "completed", "tag": "eb438fdd-8567-4c92-9d46-24352f34da04"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:52.650319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-68763ea5-7fcf-483d-a10b-59f94a132ae3 req-928a1221-8011-4cbb-871b-c4a7d049cdf3 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:52.650800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-68763ea5-7fcf-483d-a10b-59f94a132ae3 req-928a1221-8011-4cbb-871b-c4a7d049cdf3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:52.652069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-68763ea5-7fcf-483d-a10b-59f94a132ae3 req-928a1221-8011-4cbb-871b-c4a7d049cdf3 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:52.665745 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-68763ea5-7fcf-483d-a10b-59f94a132ae3 req-928a1221-8011-4cbb-871b-c4a7d049cdf3 service nova] Creating event network-vif-plugged:eb438fdd-8567-4c92-9d46-24352f34da04 for instance d5ea54f9-2957-4953-818e-86eb87d8346d on n-h2-836830-13 Aug 29 16:22:52.671115 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-68763ea5-7fcf-483d-a10b-59f94a132ae3 req-928a1221-8011-4cbb-871b-c4a7d049cdf3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036611 Aug 29 16:22:52.671997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3487/6800] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:53.284720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:53.285891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:53.297141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:53.297845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:53.298419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:53.299568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:53.300303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:53.300997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:53.440192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:53.447872 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7ea6fe8b-6b6b-40ad-8600-e1404052a5cf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1203 microversion: 2.1 time: 0.168324 Aug 29 16:22:53.451201 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3314/6801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:53 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:54.473125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:54.473853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.480927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.481457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.481904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.482637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.483304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.483737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.680308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.694401 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2ef4419b-ae6a-47b5-a8bf-7ae2884608e9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1390 microversion: 2.1 time: 0.226253 Aug 29 16:22:54.695372 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3488/6802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:54 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1390 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:54.732502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:54.733110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.739847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.740334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.740765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.741462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.741907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.742328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.878786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:54.887970 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-914ed1fe-38aa-43bf-a22c-2bc236cde81c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1390 microversion: 2.1 time: 0.159418 Aug 29 16:22:54.888558 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3315/6803] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:54 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:54.908258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:54.908873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:54.915163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.915656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.916095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:54.916783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:54.917806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:54.918231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.050333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:55.058978 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d0e7dc68-2c5f-41cd-87ed-5fe2336c8728 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1390 microversion: 2.1 time: 0.154581 Aug 29 16:22:55.059575 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3489/6804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:54 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:55.145218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:55.145715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:55.153004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.153495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.153930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.154618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.155090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.155519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.184282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:22:55.280338 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-38bcf7ef-bc4b-4161-afef-0865bed17293 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 204 len: 0 microversion: 2.1 time: 0.138478 Aug 29 16:22:55.283105 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3316/6805] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:22:55 2022] DELETE /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:22:55.289624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:55.290269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:55.297452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.297962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.298403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.299147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:55.299605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:55.300031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:55.442819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:55.451089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-159cb54e-fef9-4399-acf0-e803584a16ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1396 microversion: 2.1 time: 0.165935 Aug 29 16:22:55.451669 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3490/6806] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:55 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1396 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:56.471671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:56.472364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:56.479161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:56.479937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:56.480338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:56.481003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:56.481433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:56.481857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:56.631237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:56.641133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-690deb13-d542-4fec-bb45-7baa641fc414 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1396 microversion: 2.1 time: 0.173576 Aug 29 16:22:56.641733 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3317/6807] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:56 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1396 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:57.662878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:57.672644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:57.685295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2006fddf-aa06-47a3-ade2-f6016f79dfaa req-f35ec2fb-24e7-4140-99f2-741a44a29d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5ea54f9-2957-4953-818e-86eb87d8346d", "name": "network-vif-deleted", "tag": "eb438fdd-8567-4c92-9d46-24352f34da04"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:22:57.697233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:57.698362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:57.699106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:57.700332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:57.703105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:57.703818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:57.709231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2006fddf-aa06-47a3-ade2-f6016f79dfaa req-f35ec2fb-24e7-4140-99f2-741a44a29d01 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:57.710487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2006fddf-aa06-47a3-ade2-f6016f79dfaa req-f35ec2fb-24e7-4140-99f2-741a44a29d01 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:57.711524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2006fddf-aa06-47a3-ade2-f6016f79dfaa req-f35ec2fb-24e7-4140-99f2-741a44a29d01 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:57.740237 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2006fddf-aa06-47a3-ade2-f6016f79dfaa req-f35ec2fb-24e7-4140-99f2-741a44a29d01 service nova] Creating event network-vif-deleted:eb438fdd-8567-4c92-9d46-24352f34da04 for instance d5ea54f9-2957-4953-818e-86eb87d8346d on n-h2-836830-13 Aug 29 16:22:57.748430 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2006fddf-aa06-47a3-ade2-f6016f79dfaa req-f35ec2fb-24e7-4140-99f2-741a44a29d01 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066690 Aug 29 16:22:57.750063 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3318/6808] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:22:57.823066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:57.833722 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-34b5dc92-7ad3-441a-a384-471592fe4204 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1354 microversion: 2.1 time: 0.175790 Aug 29 16:22:57.847054 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3491/6809] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:57 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1354 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:58.857530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:58.858376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:58.864972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:58.865538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:58.866055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:58.866815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:58.867376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:58.867893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:58.932509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:22:58.941435 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f0beaec-1722-4d5a-9e4c-704e84abcd7c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1188 microversion: 2.1 time: 0.089917 Aug 29 16:22:58.942022 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3319/6810] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:58 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:22:59.962478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:22:59.963553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:22:59.970934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:59.971601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:59.972146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:22:59.972955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:22:59.973694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:22:59.974220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:00.043598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:00.051830 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e5e20c9f-28c6-4b7c-89ff-2a9203c0cc81 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1188 microversion: 2.1 time: 0.093371 Aug 29 16:23:00.052496 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3492/6811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:22:59 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:01.074656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:01.075934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:01.083356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:01.083865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:01.084304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:01.085021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:01.085480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:01.085911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:01.152802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:01.160884 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84a43ab6-4245-49f8-a01d-44b501a9e780 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1188 microversion: 2.1 time: 0.091178 Aug 29 16:23:01.161464 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3320/6812] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:01 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:02.184529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:02.187482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:02.195195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:02.196350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:02.196991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:02.197720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:02.198775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:02.199435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:02.236283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:02.237022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:02.237472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:02.237934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lazy-loading 'fault' on Instance uuid d5ea54f9-2957-4953-818e-86eb87d8346d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:23:02.285055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:02.294466 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c0251c9-2403-4905-b946-235a23b3dff8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 200 len: 1193 microversion: 2.1 time: 0.116421 Aug 29 16:23:02.297258 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3493/6813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:02 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 1193 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:03.317194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:03.318526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:03.325543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:03.326357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:03.327039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:03.327971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:03.328643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:03.329280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:03.344063 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d HTTP/1.1 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd5ea54f9-2957-4953-818e-86eb87d8346d'} Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:03.346109 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:03.350586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:03.350586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:03.350586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:03.350586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:03.350586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:03.350586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:03.350586 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:03.352384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:03.353459 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0a5443a-24ee-48d9-b56c-790bbf5432b1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 404 len: 111 microversion: 2.1 time: 0.040093 Aug 29 16:23:03.368222 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3321/6814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:03 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:04.786807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:04.787748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:04.797847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.798980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.799691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:04.800746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.801831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.802688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:04.842066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:23:04.950738 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9bf069d9-3b93-4375-b05b-68cfd581b9e5 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 204 len: 0 microversion: 2.1 time: 0.171116 Aug 29 16:23:04.954704 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3494/6815] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:04 2022] DELETE /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:23:04.960234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:04.960897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:04.968397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.969183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.969789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:04.970683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:04.971335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:04.971933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.147857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:05.159713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:05.163611 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94b0377c-64ec-4f66-9865-9e2dde4f9308 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1553 microversion: 2.1 time: 0.207487 Aug 29 16:23:05.164553 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3322/6816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:04 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:05.528848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:05.529447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:05.536067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:05.536570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:05.537013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.537720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:05.538171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:05.538599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.565369 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d HTTP/1.1 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd5ea54f9-2957-4953-818e-86eb87d8346d'} Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:05.567586 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.572823 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.575951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:05.576882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-243d0c29-a6a8-41ec-9701-1970b59ff397 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 404 len: 111 microversion: 2.1 time: 0.052634 Aug 29 16:23:05.577657 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3495/6817] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:05 2022] DELETE /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:05.586795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:05.588096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d5ea54f9-2957-4953-818e-86eb87d8346d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:05.595342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:05.595841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:05.596445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.597225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:05.597728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:05.598224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:05.619278 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d HTTP/1.1 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd5ea54f9-2957-4953-818e-86eb87d8346d'} Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:05.621329 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance d5ea54f9-2957-4953-818e-86eb87d8346d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:05.626082 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b950e6c-d85d-492d-ac9a-3541cf1a3b72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d" status: 404 len: 111 microversion: 2.1 time: 0.040866 Aug 29 16:23:05.627714 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3323/6818] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:05 2022] GET /compute/v2.1/servers/d5ea54f9-2957-4953-818e-86eb87d8346d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:06.188222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:06.189590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:06.204822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:06.205333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:06.205782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:06.206500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:06.206963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:06.207420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:06.454007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:06.466955 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3986748b-0f85-4c34-b358-76cf8da98f04 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1553 microversion: 2.1 time: 0.283936 Aug 29 16:23:06.469463 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3496/6819] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:06 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:06.927527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2c4f5bce-c758-4b4f-a3ac-bff7387726f1 req-73649b37-1792-421d-afd4-a47bacdc1ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbb8d79-11ae-4f7d-be78-25a3a222b7cb", "name": "network-vif-deleted", "tag": "e2c57902-1438-44c4-aff9-3f3a291b4f94"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:06.942186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c4f5bce-c758-4b4f-a3ac-bff7387726f1 req-73649b37-1792-421d-afd4-a47bacdc1ee6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:06.942945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c4f5bce-c758-4b4f-a3ac-bff7387726f1 req-73649b37-1792-421d-afd4-a47bacdc1ee6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:06.943590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c4f5bce-c758-4b4f-a3ac-bff7387726f1 req-73649b37-1792-421d-afd4-a47bacdc1ee6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:06.957768 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2c4f5bce-c758-4b4f-a3ac-bff7387726f1 req-73649b37-1792-421d-afd4-a47bacdc1ee6 service nova] Creating event network-vif-deleted:e2c57902-1438-44c4-aff9-3f3a291b4f94 for instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb on n-h1-836830-13 Aug 29 16:23:06.965319 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2c4f5bce-c758-4b4f-a3ac-bff7387726f1 req-73649b37-1792-421d-afd4-a47bacdc1ee6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042871 Aug 29 16:23:06.966492 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3324/6820] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:07.490138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:07.491560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:07.500983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.501683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.502363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.503391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.503934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.504661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.546139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:07.546635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:07.547115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:07.547576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lazy-loading 'fault' on Instance uuid ecbb8d79-11ae-4f7d-be78-25a3a222b7cb {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:23:07.591414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:07.601655 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a83a78d6-a515-4a3d-b8e3-db6a56f44c74 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 200 len: 1338 microversion: 2.1 time: 0.115504 Aug 29 16:23:07.602253 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3497/6821] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:07 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 1338 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:08.625998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:08.626706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: ecbb8d79-11ae-4f7d-be78-25a3a222b7cb] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:08.633868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:08.634360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:08.634800 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:08.635540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:08.636588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:08.637149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:08.651489 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] HTTP exception thrown: Instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb could not be found. Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Request method failure captured: Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb HTTP/1.1 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOeDxwL7LpAMawhWp-jgDtB1VNlV6SmWG5pBJnJ5b5CxQlDUjngCSfYDEnXcq7fWntrfeqyzybXEjPdzuflBmRXn3R-JlqsYU-it_woJYD-M6UaNCkV8BNXSv-PDOJa6lEEPw5N690Z9IV_lj4OhE2RfJQU214VlwV73tt1DOIwnZow Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: c3d414b7ad0443c18d025560cafaab30 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c3d414b7ad0443c18d025560cafaab30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c3d414b7ad0443c18d025560cafaab30", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c3d414b7ad0443c18d025560cafaab30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c3d414b7ad0443c18d025560cafaab30"}]}] Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: c3d414b7ad0443c18d025560cafaab30 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestNetworkBasicOps-1101454336-project Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: fdb719a577de458895b29d1017c094f6 Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestNetworkBasicOps-1101454336-project Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb could not be found. Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'ecbb8d79-11ae-4f7d-be78-25a3a222b7cb'} Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb could not be found. Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb could not be found. Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:08.653184 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb could not be found. Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Returning 404 to user: Instance ecbb8d79-11ae-4f7d-be78-25a3a222b7cb could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3bcd3602-7779-4a67-914f-ee3d3e36dcaf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb" status: 404 len: 111 microversion: 2.1 time: 0.033099 Aug 29 16:23:08.658478 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3325/6822] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:08 2022] GET /compute/v2.1/servers/ecbb8d79-11ae-4f7d-be78-25a3a222b7cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:23:08.851648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7992e739-ac07-47f8-9315-d45011fe675b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '.version_select at 0x7f32ed94daf0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:08.889894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7992e739-ac07-47f8-9315-d45011fe675b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1270990353" status: 202 len: 0 microversion: 2.1 time: 0.041901 Aug 29 16:23:08.894597 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3498/6823] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 16:23:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1270990353 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:23:11.117135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9137dca9-675b-4ebb-b832-f9035d9cc933 req-25a96bcc-4347-4ef1-8a35-9b1af43167ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02d21b5d-0777-4589-9494-3c4aa9ad921e", "tag": "7a20747d-2b6a-4f96-a05b-ac8d90be6e60"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:11.118584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:11.121978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:11.136829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.142414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.143424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.146237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.147009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.148560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.156388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9137dca9-675b-4ebb-b832-f9035d9cc933 req-25a96bcc-4347-4ef1-8a35-9b1af43167ce service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.156874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9137dca9-675b-4ebb-b832-f9035d9cc933 req-25a96bcc-4347-4ef1-8a35-9b1af43167ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.157309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9137dca9-675b-4ebb-b832-f9035d9cc933 req-25a96bcc-4347-4ef1-8a35-9b1af43167ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.176825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:11.188325 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9137dca9-675b-4ebb-b832-f9035d9cc933 req-25a96bcc-4347-4ef1-8a35-9b1af43167ce service nova] Creating event network-changed:7a20747d-2b6a-4f96-a05b-ac8d90be6e60 for instance 02d21b5d-0777-4589-9494-3c4aa9ad921e on n-h1-836830-13 Aug 29 16:23:11.195595 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9137dca9-675b-4ebb-b832-f9035d9cc933 req-25a96bcc-4347-4ef1-8a35-9b1af43167ce service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087294 Aug 29 16:23:11.196435 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3499/6824] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:11.208079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:23:11.353245 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5b9f986-5246-41ad-8394-79abfa0f3c07 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "DELETE /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 204 len: 0 microversion: 2.1 time: 0.249783 Aug 29 16:23:11.354855 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3326/6825] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:23:11 2022] DELETE /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:23:11.364524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:11.365804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:11.375844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.376916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.377756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.378994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:11.379927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:11.380598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:11.624703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:11.634129 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f62f518c-e9cf-447d-b2f9-5c02f424f6d9 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1668 microversion: 2.1 time: 0.274668 Aug 29 16:23:11.635489 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3500/6826] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:11 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1668 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:23:12.657991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:12.658716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:12.674880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:12.675417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:12.675861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:12.676580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:12.677041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:12.677468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:13.284182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:13.295903 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f67fca3-9e50-49f7-bbe7-693b229fab25 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 200 len: 1668 microversion: 2.1 time: 0.642174 Aug 29 16:23:13.310600 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3327/6827] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:12 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 1668 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:13.712148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9eb74d08-c8c5-4dfa-985a-17eb71ac4fc1 req-fa497c48-ca03-45e2-99e0-accd3f656d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02d21b5d-0777-4589-9494-3c4aa9ad921e", "name": "network-vif-deleted", "tag": "7a20747d-2b6a-4f96-a05b-ac8d90be6e60"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:13.727588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9eb74d08-c8c5-4dfa-985a-17eb71ac4fc1 req-fa497c48-ca03-45e2-99e0-accd3f656d17 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:13.728163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9eb74d08-c8c5-4dfa-985a-17eb71ac4fc1 req-fa497c48-ca03-45e2-99e0-accd3f656d17 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:13.728595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9eb74d08-c8c5-4dfa-985a-17eb71ac4fc1 req-fa497c48-ca03-45e2-99e0-accd3f656d17 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:13.748954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9eb74d08-c8c5-4dfa-985a-17eb71ac4fc1 req-fa497c48-ca03-45e2-99e0-accd3f656d17 service nova] Creating event network-vif-deleted:7a20747d-2b6a-4f96-a05b-ac8d90be6e60 for instance 02d21b5d-0777-4589-9494-3c4aa9ad921e on n-h1-836830-13 Aug 29 16:23:13.755873 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9eb74d08-c8c5-4dfa-985a-17eb71ac4fc1 req-fa497c48-ca03-45e2-99e0-accd3f656d17 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047889 Aug 29 16:23:13.756969 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3501/6828] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:23:14.333088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:14.333990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 02d21b5d-0777-4589-9494-3c4aa9ad921e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:14.341230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:14.341720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:14.342367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:14.343109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:14.343600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:14.344025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:14.359723 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] HTTP exception thrown: Instance 02d21b5d-0777-4589-9494-3c4aa9ad921e could not be found. Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Request method failure captured: Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e HTTP/1.1 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOeDxwL7LpAMawhWp-jgDtB1VNlV6SmWG5pBJnJ5b5CxQlDUjngCSfYDEnXcq7fWntrfeqyzybXEjPdzuflBmRXn3R-JlqsYU-it_woJYD-M6UaNCkV8BNXSv-PDOJa6lEEPw5N690Z9IV_lj4OhE2RfJQU214VlwV73tt1DOIwnZow Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: c3d414b7ad0443c18d025560cafaab30 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c3d414b7ad0443c18d025560cafaab30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c3d414b7ad0443c18d025560cafaab30", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c3d414b7ad0443c18d025560cafaab30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c3d414b7ad0443c18d025560cafaab30"}]}] Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: c3d414b7ad0443c18d025560cafaab30 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestNetworkBasicOps-1101454336-project Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: fdb719a577de458895b29d1017c094f6 Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestNetworkBasicOps-1101454336-project Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 02d21b5d-0777-4589-9494-3c4aa9ad921e could not be found. Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '02d21b5d-0777-4589-9494-3c4aa9ad921e'} Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02d21b5d-0777-4589-9494-3c4aa9ad921e could not be found. Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02d21b5d-0777-4589-9494-3c4aa9ad921e could not be found. Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:23:14.361677 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02d21b5d-0777-4589-9494-3c4aa9ad921e could not be found. Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Returning 404 to user: Instance 02d21b5d-0777-4589-9494-3c4aa9ad921e could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-830a3962-9fe1-4c77-8557-1f43cb9c05bf tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e" status: 404 len: 111 microversion: 2.1 time: 0.048466 Aug 29 16:23:14.366727 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3328/6829] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:14 2022] GET /compute/v2.1/servers/02d21b5d-0777-4589-9494-3c4aa9ad921e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:23:14.556374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2228067e-5736-462c-b3dd-1b15f51dc687 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '.version_select at 0x7f32ee4eeaf0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:14.564441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:14.586303 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2228067e-5736-462c-b3dd-1b15f51dc687 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1579128428" status: 202 len: 0 microversion: 2.1 time: 0.034009 Aug 29 16:23:14.592150 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3502/6830] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 16:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1579128428 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:23:25.672017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f16e3e12-969d-49a8-a466-f08f6eef2265 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'create', calling method: .version_select at 0x7f32ed41ac10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-633463989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIIQcNrlpvcGlrq8suahNMcDXi6b0xFAXg2SjRDsVzXN/Um5UAJAPQJTKV8rmVBeW8nHcEvF8A80u1BJQUWMz0rl0LaXtfCRKeO5xdrt0Mqaogkx/FIybYRKwbc4L0h5w=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:25.689522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:25.692280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:25.726693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f16e3e12-969d-49a8-a466-f08f6eef2265 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for project c3d414b7ad0443c18d025560cafaab30. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:23:25.741825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-f16e3e12-969d-49a8-a466-f08f6eef2265 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for user fdb719a577de458895b29d1017c094f6 and project c3d414b7ad0443c18d025560cafaab30. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:23:25.797825 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f16e3e12-969d-49a8-a466-f08f6eef2265 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.131022 Aug 29 16:23:25.798731 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3329/6831] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:23:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:27.449742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-403295109", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9faa6454-0655-49cc-9316-4ffaa978ed7a"}], "key_name": "tempest-TestNetworkBasicOps-633463989", "security_groups": [{"name": "tempest-secgroup-smoke-1391482003"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:27.468305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:27.755437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] validate_networks() for [('9faa6454-0655-49cc-9316-4ffaa978ed7a', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:23:28.306594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:23:28.307062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:23:28.308319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:23:28.308968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:23:28.309460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:23:28.329430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:28.330262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:28.331760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:28.333538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:28.335292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:28.335937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:28.383414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for project c3d414b7ad0443c18d025560cafaab30. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:23:28.390949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Getting quotas for user fdb719a577de458895b29d1017c094f6 and project c3d414b7ad0443c18d025560cafaab30. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:23:28.410201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:23:28.413129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:23:28.481943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3a2efc0d-902a-4ad1-ba91-91e9e4f64007 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.036923 Aug 29 16:23:28.484095 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3503/6832] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:23:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:23:28.495702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-938875e0-654b-4425-a28d-3e9f9375d5bb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:28.496445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-938875e0-654b-4425-a28d-3e9f9375d5bb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:28.590929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-938875e0-654b-4425-a28d-3e9f9375d5bb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:28.602654 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-938875e0-654b-4425-a28d-3e9f9375d5bb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1247 microversion: 2.1 time: 0.111181 Aug 29 16:23:28.607098 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3330/6833] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:28 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1247 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:29.631219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:29.631846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:29.641050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:29.641827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:29.642456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:29.643431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:29.644061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:29.644885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:29.725686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:29.737503 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-315d7c64-1c06-44f9-8299-805c3493e607 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1299 microversion: 2.1 time: 0.111207 Aug 29 16:23:29.738086 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3504/6834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:29 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:30.762570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:30.764592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:30.777035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:30.777881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:30.778499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:30.779538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:30.780232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:30.780840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:31.113842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:31.125116 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81c0ce4e-1695-47ed-9580-3bed0e4c6d3c tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1373 microversion: 2.1 time: 0.369068 Aug 29 16:23:31.125998 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3331/6835] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:30 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1373 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:32.089640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-461492a3-fe27-4845-a615-81b2eb7597eb req-1237699d-56f8-4d52-b915-57a025a85ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfcd68-e3e3-4e68-b119-fedbe10003fd", "tag": "1e10247c-7796-4ae6-bef2-f52a81cbe795"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:32.132021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-461492a3-fe27-4845-a615-81b2eb7597eb req-1237699d-56f8-4d52-b915-57a025a85ffb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:32.134958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-461492a3-fe27-4845-a615-81b2eb7597eb req-1237699d-56f8-4d52-b915-57a025a85ffb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:32.136546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-461492a3-fe27-4845-a615-81b2eb7597eb req-1237699d-56f8-4d52-b915-57a025a85ffb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:32.150905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:32.153310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:32.174598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:32.184131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:32.184600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:32.185359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:32.195432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:32.196092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:32.201704 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-461492a3-fe27-4845-a615-81b2eb7597eb req-1237699d-56f8-4d52-b915-57a025a85ffb service nova] Creating event network-changed:1e10247c-7796-4ae6-bef2-f52a81cbe795 for instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd on n-h1-836830-13 Aug 29 16:23:32.224491 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-461492a3-fe27-4845-a615-81b2eb7597eb req-1237699d-56f8-4d52-b915-57a025a85ffb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141258 Aug 29 16:23:32.225503 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3505/6836] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:32.497000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:32.505590 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33f4f90d-efef-4e9b-ace8-72ae35d0ab7b tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1373 microversion: 2.1 time: 0.361289 Aug 29 16:23:32.506961 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3332/6837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:32 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1373 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:23:33.502309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1451353980", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fe3565de-1c09-4fed-b9e0-90e6216251f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:33.528417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:33.529163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:33.536023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:33.536807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:33.537453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:33.538343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:33.539153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:33.539776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:33.590707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:23:33.777320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:33.786870 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-033dc3e8-0e5e-45e6-9330-1105bd68ce62 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1373 microversion: 2.1 time: 0.262861 Aug 29 16:23:33.787508 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3333/6838] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:33 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1373 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:23:34.010920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:23:34.011443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:23:34.011816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:23:34.012228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:23:34.012641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:23:34.021936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.022426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.022864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:34.023613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.024070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.024497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:34.042924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:23:34.048480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:23:34.112829 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:23:34.115094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe3565de-1c09-4fed-b9e0-90e6216251f6',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:23:34.257982 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ebc60046-f2f6-4514-8f2d-d135a9f88526 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759881 Aug 29 16:23:34.258970 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3506/6839] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:23:34.270756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0f0a04b8-99d2-46cd-86dd-03a40f1e0acf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:34.271520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0f0a04b8-99d2-46cd-86dd-03a40f1e0acf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:34.337514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0f0a04b8-99d2-46cd-86dd-03a40f1e0acf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:34.347565 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0f0a04b8-99d2-46cd-86dd-03a40f1e0acf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1071 microversion: 2.1 time: 0.080684 Aug 29 16:23:34.348735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3334/6840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:34 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1071 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:34.809030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:34.809652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:34.817430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.817923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.818367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:34.819090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:34.819548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:34.819975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:35.002645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:35.011159 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cedc2e90-75fe-472d-bf41-9c9e9041e71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1373 microversion: 2.1 time: 0.206443 Aug 29 16:23:35.012278 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3507/6841] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:34 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:35.368944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:35.370065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:35.378582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:35.379184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:35.380174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:35.380878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:35.381383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:35.381811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:35.483413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:35.492897 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed133bad-e498-4cb6-8de3-14ed238b4878 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1177 microversion: 2.1 time: 0.128000 Aug 29 16:23:35.493769 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3335/6842] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:35 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1177 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:36.034217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:36.034856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:36.048816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.049606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.050242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.051886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.052604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.053701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.254002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:36.268047 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a3a55a3-b313-4257-9d8a-a5fa70c4e2cb tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1373 microversion: 2.1 time: 0.237974 Aug 29 16:23:36.277686 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3508/6843] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:36 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1373 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:36.517052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:36.518352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:36.527341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.528364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.529088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.530380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:36.531245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:36.531882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:36.780086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:36.790711 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-889fecab-ecac-494c-aa49-ae399be5846b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1229 microversion: 2.1 time: 0.278904 Aug 29 16:23:36.803689 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3336/6844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:36 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1229 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:37.158123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c65a34fc-71e0-48fd-8c63-3d05cc1c16fa req-5a527044-2d58-4c6c-a8b9-b9360c605c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94d72ce-548e-4d0a-ac1b-e96da159af7c", "tag": "24fd7463-4014-4f0d-ae40-bf9a316709d7"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:37.183860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c65a34fc-71e0-48fd-8c63-3d05cc1c16fa req-5a527044-2d58-4c6c-a8b9-b9360c605c0a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.184755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c65a34fc-71e0-48fd-8c63-3d05cc1c16fa req-5a527044-2d58-4c6c-a8b9-b9360c605c0a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.185514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c65a34fc-71e0-48fd-8c63-3d05cc1c16fa req-5a527044-2d58-4c6c-a8b9-b9360c605c0a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.214649 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c65a34fc-71e0-48fd-8c63-3d05cc1c16fa req-5a527044-2d58-4c6c-a8b9-b9360c605c0a service nova] Creating event network-changed:24fd7463-4014-4f0d-ae40-bf9a316709d7 for instance d94d72ce-548e-4d0a-ac1b-e96da159af7c on n-h2-836830-13 Aug 29 16:23:37.220098 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c65a34fc-71e0-48fd-8c63-3d05cc1c16fa req-5a527044-2d58-4c6c-a8b9-b9360c605c0a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076832 Aug 29 16:23:37.220923 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3509/6845] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:37.295905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:37.296968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:37.304034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.304966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.305839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.306991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.307904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.308670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.578842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:37.593526 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15e0929d-9030-4477-bb23-b8e92c572c58 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1373 microversion: 2.1 time: 0.302256 Aug 29 16:23:37.594200 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3337/6846] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:37 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1373 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:37.817164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:37.818502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:37.826671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.827542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.828430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.830787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:37.831861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:37.832810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:37.992363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:38.002392 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2df89354-9ec2-469c-afd4-6501fb572bcf tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1229 microversion: 2.1 time: 0.191639 Aug 29 16:23:38.003222 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3510/6847] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:37 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1229 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:38.098377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2454d12a-2f20-4ef4-8a97-dcef3098d4ca req-8174752d-28f0-46d0-a40f-b930260fe60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfcd68-e3e3-4e68-b119-fedbe10003fd", "name": "network-vif-plugged", "status": "completed", "tag": "1e10247c-7796-4ae6-bef2-f52a81cbe795"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:38.121061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2454d12a-2f20-4ef4-8a97-dcef3098d4ca req-8174752d-28f0-46d0-a40f-b930260fe60a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:38.122307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2454d12a-2f20-4ef4-8a97-dcef3098d4ca req-8174752d-28f0-46d0-a40f-b930260fe60a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:38.125834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2454d12a-2f20-4ef4-8a97-dcef3098d4ca req-8174752d-28f0-46d0-a40f-b930260fe60a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:38.160678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2454d12a-2f20-4ef4-8a97-dcef3098d4ca req-8174752d-28f0-46d0-a40f-b930260fe60a service nova] Creating event network-vif-plugged:1e10247c-7796-4ae6-bef2-f52a81cbe795 for instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd on n-h1-836830-13 Aug 29 16:23:38.173503 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2454d12a-2f20-4ef4-8a97-dcef3098d4ca req-8174752d-28f0-46d0-a40f-b930260fe60a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087891 Aug 29 16:23:38.174506 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3338/6848] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:38.614358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:38.614975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:38.623518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:38.623518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:38.623763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:38.624418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:38.624868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:38.625292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:38.797516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:38.806500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87458980-c35c-4612-a2de-e25bea9ad812 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1373 microversion: 2.1 time: 0.196407 Aug 29 16:23:38.807100 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3511/6849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:38 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:39.029776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:39.030494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:39.038341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:39.038837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:39.039303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:39.040045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:39.040481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:39.040919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:39.201976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:39.211041 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3094489c-530e-4b3c-a791-06601b93d38e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1229 microversion: 2.1 time: 0.185842 Aug 29 16:23:39.211975 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3339/6850] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:39 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1229 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:39.829246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:39.829949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:39.837554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:39.838042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:39.839550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:39.840291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:39.840758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:39.841272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:39.989333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:39.998265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e399f31-8bb4-4f3c-baba-3c138c1760b2 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1544 microversion: 2.1 time: 0.173371 Aug 29 16:23:39.998915 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3512/6851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:39 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1544 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:40.019691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:40.020509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:40.027677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.028165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.028610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.029314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.029774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.030353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.185691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:40.197502 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe3e12ea-5830-4b29-b140-2671f00898be tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1544 microversion: 2.1 time: 0.181602 Aug 29 16:23:40.198752 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3340/6852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:40 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:40.234518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:40.236049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:40.243703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.244250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.244809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.245884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:40.246531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:40.247160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:40.515960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:40.529882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5dd3dd22-331c-487b-991b-ae17d8f436a0 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1229 microversion: 2.1 time: 0.300525 Aug 29 16:23:40.531244 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3513/6853] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:40 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1229 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:41.558450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:41.561497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:41.570280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:41.570893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:41.571431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:41.572211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:41.573361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:41.574188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:41.722681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:41.733469 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-61a32843-f8ed-4672-bafa-3d783ccb6f52 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.186404 Aug 29 16:23:41.734275 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3341/6854] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:41 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:42.005576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-78e7ad91-58af-4ea6-9754-67d8c7d4d9d9 req-38f391c1-d8a9-418d-b7bf-f02f34e6576e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfcd68-e3e3-4e68-b119-fedbe10003fd", "tag": "1e10247c-7796-4ae6-bef2-f52a81cbe795"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:42.018765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78e7ad91-58af-4ea6-9754-67d8c7d4d9d9 req-38f391c1-d8a9-418d-b7bf-f02f34e6576e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:42.019771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78e7ad91-58af-4ea6-9754-67d8c7d4d9d9 req-38f391c1-d8a9-418d-b7bf-f02f34e6576e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:42.020465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-78e7ad91-58af-4ea6-9754-67d8c7d4d9d9 req-38f391c1-d8a9-418d-b7bf-f02f34e6576e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:42.035334 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-78e7ad91-58af-4ea6-9754-67d8c7d4d9d9 req-38f391c1-d8a9-418d-b7bf-f02f34e6576e service nova] Creating event network-changed:1e10247c-7796-4ae6-bef2-f52a81cbe795 for instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd on n-h1-836830-13 Aug 29 16:23:42.043185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-78e7ad91-58af-4ea6-9754-67d8c7d4d9d9 req-38f391c1-d8a9-418d-b7bf-f02f34e6576e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040792 Aug 29 16:23:42.044635 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3514/6855] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:42.755176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:42.755726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:42.772417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:42.773246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:42.773937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:42.775351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:42.776090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:42.776713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:42.978344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:42.987522 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-718c8955-dcb9-445c-8010-7c8af1b2a492 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.236231 Aug 29 16:23:43.002096 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3342/6856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:42 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:44.010002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:44.011364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:44.018568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:44.019077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:44.019523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:44.020215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:44.020678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:44.021111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:44.036831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:44.056892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=12 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:44.164867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:44.173246 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c16c6b8-8ad1-4286-a36b-6cad3e34cbad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.167556 Aug 29 16:23:44.173846 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3515/6857] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:44 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:45.195409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:45.196022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:45.198600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:45.204716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:45.205333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:45.205928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:45.206726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:45.207233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:45.207737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:45.344348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:45.352067 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c114b85f-c4b5-4fb3-9f5a-f527058b9992 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.160627 Aug 29 16:23:45.352644 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3343/6858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:45 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:46.374099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:46.374710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:46.380860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:46.381343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:46.381770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:46.382445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:46.382923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:46.383372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:46.515447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:46.523384 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e490ec49-09b6-42ac-a612-10e58d0f0dad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.154117 Aug 29 16:23:46.523952 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3516/6859] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:46 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:47.544651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:47.545303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:47.552340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:47.552833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:47.553279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:47.553970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:47.554430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:47.554862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:47.704100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:47.712544 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6cd3ed3e-e40f-4b53-88e1-f85599167b5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.171741 Aug 29 16:23:47.713128 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3344/6860] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:47 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:48.734005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:48.734632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:48.741654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:48.742152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:48.742594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:48.743427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:48.743902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:48.744325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:48.874743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:48.882835 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c5a72924-d2f7-4ad3-acb4-698843061a3d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.153554 Aug 29 16:23:48.883483 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3517/6861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:48 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:49.903659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:49.904327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:49.911475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.911977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.912421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:49.913143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:49.913605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:49.914036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:50.044256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:50.051927 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-08de9921-f1fa-4ec7-bcf0-25af6c1c59d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.152997 Aug 29 16:23:50.052497 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3345/6862] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:49 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:51.074039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:51.075261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:51.082816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:51.083333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:51.083779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:51.084484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:51.084947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:51.085384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:51.226022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:51.234987 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8cdc075b-79c2-41e3-80f6-84cd37399dfe tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.165550 Aug 29 16:23:51.235608 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3518/6863] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:51 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:52.256656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:52.257403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:52.265812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.266307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.266754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.268311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.268311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.268777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.406088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:52.414528 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3278b16-9db8-4dbc-9476-719ed9e120a4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.161745 Aug 29 16:23:52.415130 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3346/6864] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:52 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:52.853220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-17dc7641-2884-4b8b-bee3-592822437063 req-f519fbd6-e373-491e-b1e1-439ac8082aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94d72ce-548e-4d0a-ac1b-e96da159af7c", "name": "network-vif-plugged", "status": "completed", "tag": "24fd7463-4014-4f0d-ae40-bf9a316709d7"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:52.865370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-17dc7641-2884-4b8b-bee3-592822437063 req-f519fbd6-e373-491e-b1e1-439ac8082aa5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:52.865849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-17dc7641-2884-4b8b-bee3-592822437063 req-f519fbd6-e373-491e-b1e1-439ac8082aa5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:52.866283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-17dc7641-2884-4b8b-bee3-592822437063 req-f519fbd6-e373-491e-b1e1-439ac8082aa5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:52.879690 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-17dc7641-2884-4b8b-bee3-592822437063 req-f519fbd6-e373-491e-b1e1-439ac8082aa5 service nova] Creating event network-vif-plugged:24fd7463-4014-4f0d-ae40-bf9a316709d7 for instance d94d72ce-548e-4d0a-ac1b-e96da159af7c on n-h2-836830-13 Aug 29 16:23:52.884661 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-17dc7641-2884-4b8b-bee3-592822437063 req-f519fbd6-e373-491e-b1e1-439ac8082aa5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035437 Aug 29 16:23:52.885289 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3519/6865] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:23:53.434434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:53.435080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:53.442286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.442779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.443253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.443946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:53.444439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:53.444870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:53.831511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:53.840026 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99e6406b-5f83-491c-b63a-52bf5b8404aa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1217 microversion: 2.1 time: 0.409577 Aug 29 16:23:53.840610 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3347/6866] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:53 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1217 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:54.861979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:54.862591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:54.869359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:54.870637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:54.871235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:54.872488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:54.873158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:54.873757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.011661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:55.019684 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e639cc6e-3239-4bf6-a7d9-b3fd93ce62da tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1404 microversion: 2.1 time: 0.163047 Aug 29 16:23:55.020260 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3520/6867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:54 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:55.039613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:55.040240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:55.047370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:55.047868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:55.048309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.049009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:55.049503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:55.049931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.191124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:55.200721 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9c8f1f51-f4fb-4c7d-948c-512c83ff0d57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1404 microversion: 2.1 time: 0.164911 Aug 29 16:23:55.201467 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3348/6868] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:55 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:55.221839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1073595625"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:55.224178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:55.230227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:55.230712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:55.231182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.231909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:55.232363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:55.232790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:55.327438 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.compute.api [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Attempting to quiesce instance before volume snapshot. Aug 29 16:23:55.381518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.compute.api [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 29 16:23:55.455085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Creating snapshot from volume fe3565de-1c09-4fed-b9e0-90e6216251f6. {{(pid=129133) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 29 16:23:55.624821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:56.330071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0bb32cc9-c444-42f0-9e90-8c7a32f82494 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c/action" status: 202 len: 0 microversion: 2.1 time: 1.112070 Aug 29 16:23:56.332987 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3521/6869] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:23:55 2022] POST /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 16:23:57.499148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-874694872", "imageRef": "ac53154e-7d2d-4efc-a18f-88f4b981a7a9", "flavorRef": "452", "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:23:57.508960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:57.560368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:23:57.952389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:23:57.952894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:23:57.953389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:23:57.953809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:23:57.954467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:23:57.964104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:57.964849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:57.965361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:57.966097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:57.966561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:57.966994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:57.974246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=99 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:57.988149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:23:57.995001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:23:58.008842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:23:58.012288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='52d28db3-2a91-410e-bac5-cb326da4a58e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:23:58.091814 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b7734dd1-3cc3-4154-b879-02937b8049a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597537 Aug 29 16:23:58.092649 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3349/6870] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:23:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:23:58.103553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d69e8a55-b74f-40a3-9be6-2b31e64e16d1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:58.104589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d69e8a55-b74f-40a3-9be6-2b31e64e16d1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:58.107718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:23:58.184671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d69e8a55-b74f-40a3-9be6-2b31e64e16d1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:58.191745 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d69e8a55-b74f-40a3-9be6-2b31e64e16d1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1229 microversion: 2.1 time: 0.092324 Aug 29 16:23:58.192540 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3522/6871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:58 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:23:59.214828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:23:59.216759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:23:59.229405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:59.230932 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:59.231756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:59.234704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:23:59.236742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:23:59.238429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:23:59.348556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:23:59.360733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e609c29e-3e77-4fdb-96a6-b0309f04a5d5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1289 microversion: 2.1 time: 0.151722 Aug 29 16:23:59.361733 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3350/6872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:23:59 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:24:00.382882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:00.384216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:00.399994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:00.401582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:00.402884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:00.404445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:00.405580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:00.407198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:00.555651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:00.571629 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-172f2746-eb7e-483f-8773-110285adaf38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.192449 Aug 29 16:24:00.572447 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3523/6873] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:00 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:00.858004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f53263eb-08bc-4f82-bb9c-bcc9437be7c2 req-64024db7-b62f-44f7-8239-f0a7e73056a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9194df0e-dd9c-497a-93fa-255bc172e946", "tag": "bd77300a-b9c6-4747-9b36-e127263cdfd4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:00.888837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f53263eb-08bc-4f82-bb9c-bcc9437be7c2 req-64024db7-b62f-44f7-8239-f0a7e73056a8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:00.889725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f53263eb-08bc-4f82-bb9c-bcc9437be7c2 req-64024db7-b62f-44f7-8239-f0a7e73056a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:00.890599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f53263eb-08bc-4f82-bb9c-bcc9437be7c2 req-64024db7-b62f-44f7-8239-f0a7e73056a8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:00.920929 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f53263eb-08bc-4f82-bb9c-bcc9437be7c2 req-64024db7-b62f-44f7-8239-f0a7e73056a8 service nova] Creating event network-changed:bd77300a-b9c6-4747-9b36-e127263cdfd4 for instance 9194df0e-dd9c-497a-93fa-255bc172e946 on n-h1-836830-13 Aug 29 16:24:00.929967 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f53263eb-08bc-4f82-bb9c-bcc9437be7c2 req-64024db7-b62f-44f7-8239-f0a7e73056a8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085313 Aug 29 16:24:00.931207 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3351/6874] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:01.598914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:01.599592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:01.608090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:01.608866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:01.609585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:01.610892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:01.611666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:01.612284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:01.757005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:01.766653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68b71ed9-d5e0-4746-97f7-e97371f48dab tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.172335 Aug 29 16:24:01.775085 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3524/6875] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:01 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:02.789519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:02.790269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:02.797323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:02.797754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:02.798195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:02.798893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:02.799380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:02.799809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:02.970344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:02.980350 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d7a589f8-afc4-43ff-b75d-12aa53443689 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.195804 Aug 29 16:24:02.983073 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3352/6876] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:02 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:04.004990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:04.009870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:04.020566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:04.021849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:04.023472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:04.024289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:04.025046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:04.026853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:04.238918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:04.251714 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c8d2b464-0c2e-4c63-8d30-3fe29dd2f6a5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.252931 Aug 29 16:24:04.255308 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3525/6877] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:03 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:04.334625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:04.337400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:04.346892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:04.348250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:04.348959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:04.349966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:04.350593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:04.351430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:04.436071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96dd4f75-01f0-428b-bc1a-271531eee6d6 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd/action" status: 200 len: 24569 microversion: 2.1 time: 0.105609 Aug 29 16:24:04.448327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3353/6878] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:24:04 2022] POST /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd/action => generated 24569 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:24:05.286067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:05.287594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:05.298142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:05.298697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:05.299209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:05.300009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:05.300557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:05.301218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:05.512806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:05.531219 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-abdd3c1f-044b-4368-8d77-772dd83ef1d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.249507 Aug 29 16:24:05.542826 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3526/6879] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:05 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:06.567722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:06.569227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:06.579458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:06.580301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:06.580942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:06.581821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:06.582605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:06.583063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:06.781063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:06.793457 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9641269a-c14c-4709-8222-7c8c1377fbc1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.230077 Aug 29 16:24:06.794038 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3354/6880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:06 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:07.826212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:07.827601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:07.835860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:07.836647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:07.837273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:07.838994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:07.839738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:07.840414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:08.031868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:08.041417 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff41da39-da37-4551-a2d9-73b366dc998a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.219299 Aug 29 16:24:08.055468 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3527/6881] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:07 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:09.062629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:09.063526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:09.066575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:09.067302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:09.074836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:09.075502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:09.075801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:09.076508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:09.076966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:09.077392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:09.227186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:09.237817 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-22d6a790-16c0-44bb-8d94-0752d545daea tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.179079 Aug 29 16:24:09.238431 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3355/6882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:09 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:24:10.258924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:10.260739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:10.262604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:10.269583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:10.270204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:10.270660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:10.271390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:10.271857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:10.272288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:10.428368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:10.436964 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c33482b4-84ce-4f89-859a-f0ddef35749f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.182070 Aug 29 16:24:10.437554 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3528/6883] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:10 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:10.890191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:10.893561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:10.901975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:10.902854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:10.903620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:10.904591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:10.905166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:10.905708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:10.972457 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a49f99f7-ff1b-498b-8c6d-feaf401c65c7 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "POST /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd/action" status: 200 len: 32641 microversion: 2.1 time: 0.085773 Aug 29 16:24:10.973626 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3356/6884] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:24:10 2022] POST /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd/action => generated 32641 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:24:11.458767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:11.460035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:11.469093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:11.469863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:11.470503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:11.471367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:11.471809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:11.472203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:11.633209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:11.642998 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-96d4c18b-8357-45ef-b067-0493719b3c0d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.187910 Aug 29 16:24:11.656203 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3529/6885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:11 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:12.403252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-57d384e6-1e05-49b5-8327-ef6c03d38021 req-c622699e-39c2-4d55-a675-36f91d431953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfcd68-e3e3-4e68-b119-fedbe10003fd", "tag": "1e10247c-7796-4ae6-bef2-f52a81cbe795"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:12.405705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:12.406970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:12.421848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-57d384e6-1e05-49b5-8327-ef6c03d38021 req-c622699e-39c2-4d55-a675-36f91d431953 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:12.422618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-57d384e6-1e05-49b5-8327-ef6c03d38021 req-c622699e-39c2-4d55-a675-36f91d431953 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:12.423420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-57d384e6-1e05-49b5-8327-ef6c03d38021 req-c622699e-39c2-4d55-a675-36f91d431953 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:12.438890 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-57d384e6-1e05-49b5-8327-ef6c03d38021 req-c622699e-39c2-4d55-a675-36f91d431953 service nova] Creating event network-changed:1e10247c-7796-4ae6-bef2-f52a81cbe795 for instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd on n-h1-836830-13 Aug 29 16:24:12.445199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:12.446017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:12.446666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:12.447872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:12.448730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:12.449551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:12.450047 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-57d384e6-1e05-49b5-8327-ef6c03d38021 req-c622699e-39c2-4d55-a675-36f91d431953 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049406 Aug 29 16:24:12.453165 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3530/6886] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:12.499208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:24:12.669382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:12.671327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:12.687863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:12.689664 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11d57293-de46-4a66-b5d5-fb4cd77493ec tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 204 len: 0 microversion: 2.1 time: 0.291714 Aug 29 16:24:12.691048 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3357/6887] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:24:12 2022] DELETE /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:24:12.694641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:12.694641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:12.695543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:12.696422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:12.699528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:12.712802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:12.715268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:12.747295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:12.747993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:12.749272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:12.751238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:12.754512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:12.755161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:12.927767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:12.939305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aee5e18e-cfce-4615-a314-8edf95dadd0b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.276858 Aug 29 16:24:12.955137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3531/6888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:12 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:12.967596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:12.979963 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f6144455-0583-417c-897a-50c1d2984c05 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1669 microversion: 2.1 time: 0.280746 Aug 29 16:24:12.980547 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3358/6889] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:12 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:13.965328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:13.967651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:13.977458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:13.978189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:13.979465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:13.980598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:13.981256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:13.981875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:14.006790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:14.008150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:14.021463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:14.023346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:14.028295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:14.029073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:14.029557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:14.030001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:14.198193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:14.208011 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed6702aa-3a4d-41be-909f-858412933d86 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1341 microversion: 2.1 time: 0.250343 Aug 29 16:24:14.209120 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3532/6890] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:13 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1341 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:14.403567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:14.412124 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d21a0ef2-2a45-4c3a-b559-e1baa039b501 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1669 microversion: 2.1 time: 0.410080 Aug 29 16:24:14.412856 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3359/6891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:14 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1669 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:14.777283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9121ab7f-c7e7-4855-ac7a-0aab7ad24f1c req-ed73016d-3c0c-4474-8ebd-03653c6e9c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfcd68-e3e3-4e68-b119-fedbe10003fd", "name": "network-vif-deleted", "tag": "1e10247c-7796-4ae6-bef2-f52a81cbe795"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:14.787929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9121ab7f-c7e7-4855-ac7a-0aab7ad24f1c req-ed73016d-3c0c-4474-8ebd-03653c6e9c38 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:14.788427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9121ab7f-c7e7-4855-ac7a-0aab7ad24f1c req-ed73016d-3c0c-4474-8ebd-03653c6e9c38 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:14.788879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9121ab7f-c7e7-4855-ac7a-0aab7ad24f1c req-ed73016d-3c0c-4474-8ebd-03653c6e9c38 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:14.810113 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9121ab7f-c7e7-4855-ac7a-0aab7ad24f1c req-ed73016d-3c0c-4474-8ebd-03653c6e9c38 service nova] Creating event network-vif-deleted:1e10247c-7796-4ae6-bef2-f52a81cbe795 for instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd on n-h1-836830-13 Aug 29 16:24:14.829629 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9121ab7f-c7e7-4855-ac7a-0aab7ad24f1c req-ed73016d-3c0c-4474-8ebd-03653c6e9c38 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057028 Aug 29 16:24:14.830275 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3533/6892] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:15.230863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:15.231774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:15.238735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:15.239256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:15.239705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:15.240410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:15.240872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:15.241306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:15.410939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:15.421591 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de809134-308b-47f7-971a-2cf99abe0bd2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.195935 Aug 29 16:24:15.422186 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3360/6893] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:15 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:24:15.440367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:15.441194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:15.449372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:15.450028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:15.450303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:15.451172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:15.451725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:15.453032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:15.488874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:15.489371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:15.489842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:15.490276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lazy-loading 'fault' on Instance uuid 5ecfcd68-e3e3-4e68-b119-fedbe10003fd {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:24:15.539214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdb719a577de458895b29d1017c094f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d414b7ad0443c18d025560cafaab30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:15.547785 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c15f1324-3fc9-409f-95d1-b0955e89f79e tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 200 len: 1337 microversion: 2.1 time: 0.113649 Aug 29 16:24:15.548365 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3534/6894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:15 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 1337 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:16.445386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:16.446001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:16.453406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:16.453909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:16.454350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:16.455077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:16.455598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:16.456031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:16.569956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:16.571253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] [instance: 5ecfcd68-e3e3-4e68-b119-fedbe10003fd] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:16.578569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:16.578993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:16.579739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:16.580457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:16.580925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:16.581366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:16.602442 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] HTTP exception thrown: Instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd could not be found. Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Request method failure captured: Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd HTTP/1.1 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOeDxwL7LpAMawhWp-jgDtB1VNlV6SmWG5pBJnJ5b5CxQlDUjngCSfYDEnXcq7fWntrfeqyzybXEjPdzuflBmRXn3R-JlqsYU-it_woJYD-M6UaNCkV8BNXSv-PDOJa6lEEPw5N690Z9IV_lj4OhE2RfJQU214VlwV73tt1DOIwnZow Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: c3d414b7ad0443c18d025560cafaab30 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c3d414b7ad0443c18d025560cafaab30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_c3d414b7ad0443c18d025560cafaab30", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/c3d414b7ad0443c18d025560cafaab30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/c3d414b7ad0443c18d025560cafaab30"}]}] Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: c3d414b7ad0443c18d025560cafaab30 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestNetworkBasicOps-1101454336 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestNetworkBasicOps-1101454336-project Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: fdb719a577de458895b29d1017c094f6 Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestNetworkBasicOps-1101454336-project Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd could not be found. Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5ecfcd68-e3e3-4e68-b119-fedbe10003fd'} Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd could not be found. Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd could not be found. Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:16.604964 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:16.610637 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:16.610637 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:16.610637 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:16.610637 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:16.610637 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:16.610637 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd could not be found. Aug 29 16:24:16.610637 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:16.614457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Returning 404 to user: Instance 5ecfcd68-e3e3-4e68-b119-fedbe10003fd could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:16.614457 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-40b01c3b-a0b4-4633-aacb-340fe4730a56 tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd" status: 404 len: 111 microversion: 2.1 time: 0.047376 Aug 29 16:24:16.614457 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3535/6895] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:16 2022] GET /compute/v2.1/servers/5ecfcd68-e3e3-4e68-b119-fedbe10003fd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:24:16.616304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:16.626515 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5c1e6806-96b6-4f42-8209-b2f14367db93 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.183637 Aug 29 16:24:16.627880 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3361/6896] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:16 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:24:16.781373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-610bfda8-d6cc-426f-9b7a-ca15608ad71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] Calling method '.version_select at 0x7f32eef531f0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:16.811705 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-610bfda8-d6cc-426f-9b7a-ca15608ad71d tempest-TestNetworkBasicOps-1101454336 tempest-TestNetworkBasicOps-1101454336-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-633463989" status: 202 len: 0 microversion: 2.1 time: 0.033761 Aug 29 16:24:16.812333 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3536/6897] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 16:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-633463989 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:24:17.647974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:17.648728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:17.657138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:17.657654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:17.658201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:17.658992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:17.659555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:17.660247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:17.814464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:17.823983 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14ddf053-8aa5-460b-8aab-88a1d7b8f235 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.180446 Aug 29 16:24:17.824720 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3362/6898] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:17 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:18.845545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:18.846849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:18.856534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:18.857249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:18.857913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:18.858646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:18.859334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:18.859974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:19.038545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:19.051526 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bece3ce0-e7a3-4827-93ff-33c32ff62910 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.209588 Aug 29 16:24:19.052217 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3537/6899] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:18 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:20.078652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:20.079373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:20.113380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:20.113927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:20.114371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:20.115140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:20.115824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:20.116486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:20.311127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:20.320276 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f229188-acfa-43a7-81cd-c291dbe46030 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.248033 Aug 29 16:24:20.325262 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3363/6900] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:20 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:21.347168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:21.347806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:21.355972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:21.356677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:21.357173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:21.357898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:21.358425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:21.359010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:21.498639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:21.506976 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0e95ef5-a0ac-4b83-bc49-1ce400c4e812 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.163797 Aug 29 16:24:21.507590 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3538/6901] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:21 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:22.529516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:22.530325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:22.537348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:22.537842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:22.538279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:22.538985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:22.539541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:22.539967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:22.693930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:22.703309 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-af9d69c0-e800-4a17-b875-fc78f5cb8e12 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.178410 Aug 29 16:24:22.704090 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3364/6902] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:22 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:23.725962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:23.726814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:23.737449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:23.738001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:23.738787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:23.739765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:23.740265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:23.740764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:23.889463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:23.898283 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b97b3c0-4ddd-489b-a86f-12f0547b754a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.177702 Aug 29 16:24:23.898862 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3539/6903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:23 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:24.922264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:24.923215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:24.931834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:24.932742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:24.933390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:24.934108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:24.934738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:24.935329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:25.081313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:25.091250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d5c8787-c5fa-4c9c-a33e-4c34f25593cb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.174542 Aug 29 16:24:25.091831 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3365/6904] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:24 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:24:26.122323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:26.123334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:26.132249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:26.133182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:26.134128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:26.135057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:26.136735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:26.137529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:26.143258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.217670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5706e495-2669-4ff4-896f-66db9c14d5ae req-b2ed8bc3-1f35-4cf9-a9c1-c1699af95322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9194df0e-dd9c-497a-93fa-255bc172e946", "name": "network-vif-plugged", "status": "completed", "tag": "bd77300a-b9c6-4747-9b36-e127263cdfd4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:26.234007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5706e495-2669-4ff4-896f-66db9c14d5ae req-b2ed8bc3-1f35-4cf9-a9c1-c1699af95322 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:26.235105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5706e495-2669-4ff4-896f-66db9c14d5ae req-b2ed8bc3-1f35-4cf9-a9c1-c1699af95322 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:26.235795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5706e495-2669-4ff4-896f-66db9c14d5ae req-b2ed8bc3-1f35-4cf9-a9c1-c1699af95322 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:26.241138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:26.251932 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-5706e495-2669-4ff4-896f-66db9c14d5ae req-b2ed8bc3-1f35-4cf9-a9c1-c1699af95322 service nova] Creating event network-vif-plugged:bd77300a-b9c6-4747-9b36-e127263cdfd4 for instance 9194df0e-dd9c-497a-93fa-255bc172e946 on n-h1-836830-13 Aug 29 16:24:26.258808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5706e495-2669-4ff4-896f-66db9c14d5ae req-b2ed8bc3-1f35-4cf9-a9c1-c1699af95322 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051170 Aug 29 16:24:26.260303 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3366/6905] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:26.350162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:26.362819 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec34f2b0-b079-410e-8434-c6ca6b72001f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.252099 Aug 29 16:24:26.364001 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3540/6906] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:26 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:27.386663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:27.388183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:27.397747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:27.398532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:27.399248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:27.400095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:27.400668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:27.402293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:27.564875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:27.573605 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-843c6d95-783e-4ed5-af8d-e59490efe2ed tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1375 microversion: 2.1 time: 0.192575 Aug 29 16:24:27.574121 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3367/6907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:27 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:28.594166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:28.594804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:28.598007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:28.604259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:28.605050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:28.605516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:28.606248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:28.606762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:28.607240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:28.764120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:28.772349 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-932bc54b-2014-48e1-bf7f-661e8bc41c2d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1562 microversion: 2.1 time: 0.182209 Aug 29 16:24:28.772930 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3541/6908] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:28 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:28.793122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:28.793743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:28.797385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:24:28.802703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:28.803290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:28.803819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:28.804511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:28.805020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:28.805452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:29.117238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:29.117238 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dafeed3b-8802-4912-8ae6-e99e867207ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1562 microversion: 2.1 time: 0.218015 Aug 29 16:24:29.117238 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3368/6909] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:28 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1562 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:29.120945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:29.120945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:29.125500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:29.126045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:29.126497 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:29.127325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:29.127811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:29.128591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:29.159636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:24:29.266832 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c653aca-cecb-4fb9-9c34-03556690887e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 204 len: 0 microversion: 2.1 time: 0.154948 Aug 29 16:24:29.267645 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3542/6910] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:24:29 2022] DELETE /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:24:29.277452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:29.278512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:29.295229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:29.299641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:29.300297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:29.301022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:29.301561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:29.302213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:29.514939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:29.523228 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff1939a1-4185-446c-b24f-a7e210c51e06 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1568 microversion: 2.1 time: 0.251308 Aug 29 16:24:29.523929 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3369/6911] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:29 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:24:30.546543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:30.547387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:30.554614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:30.555595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:30.555770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:30.556622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:30.557900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:30.558737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:30.704876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:30.713528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6feee8ad-05d3-49be-9ef4-a584029cca0e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1568 microversion: 2.1 time: 0.172005 Aug 29 16:24:30.714885 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3543/6912] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:30 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:31.237092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8e435590-a419-47e9-be02-3edabd799790 req-662ab2b1-e1a7-4df2-b807-6beb7dc48005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9194df0e-dd9c-497a-93fa-255bc172e946", "name": "network-vif-deleted", "tag": "bd77300a-b9c6-4747-9b36-e127263cdfd4"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:31.283968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8e435590-a419-47e9-be02-3edabd799790 req-662ab2b1-e1a7-4df2-b807-6beb7dc48005 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:31.284461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8e435590-a419-47e9-be02-3edabd799790 req-662ab2b1-e1a7-4df2-b807-6beb7dc48005 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:31.284905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8e435590-a419-47e9-be02-3edabd799790 req-662ab2b1-e1a7-4df2-b807-6beb7dc48005 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:31.303620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8e435590-a419-47e9-be02-3edabd799790 req-662ab2b1-e1a7-4df2-b807-6beb7dc48005 service nova] Creating event network-vif-deleted:bd77300a-b9c6-4747-9b36-e127263cdfd4 for instance 9194df0e-dd9c-497a-93fa-255bc172e946 on n-h1-836830-13 Aug 29 16:24:31.312407 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8e435590-a419-47e9-be02-3edabd799790 req-662ab2b1-e1a7-4df2-b807-6beb7dc48005 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087113 Aug 29 16:24:31.313042 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3370/6913] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:31.737269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:31.737966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:31.753370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:31.753891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:31.754348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:31.755094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:31.755574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:31.756189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:31.846371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:31.855451 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-df1059db-bad6-4c40-964f-0cf8e601b0b9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1360 microversion: 2.1 time: 0.123870 Aug 29 16:24:31.856121 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3544/6914] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:31 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1360 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:24:32.878704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:32.879714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:32.886710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:32.887481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:32.888206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:32.889136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:32.889796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:32.890418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:32.980169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:32.989649 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6159fe24-0b15-44b0-87b4-9c871201ca3b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1360 microversion: 2.1 time: 0.115921 Aug 29 16:24:32.990265 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3371/6915] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:32 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1360 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:34.012244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:34.013586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:34.021087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:34.021596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:34.022179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:34.022763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:34.023469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:34.023992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:34.091773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:34.101440 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f6fead2-29d0-4426-a21e-95f9efe13236 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1360 microversion: 2.1 time: 0.093698 Aug 29 16:24:34.115048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3545/6916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:34 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1360 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:35.123404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:35.124121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:35.132706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:35.133213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:35.133905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:35.134818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:35.136341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:35.136801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:35.205751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:35.215323 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-04eaf5d5-902d-40e0-8f86-9f7bac35b941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1360 microversion: 2.1 time: 0.095471 Aug 29 16:24:35.226901 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3372/6917] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:35 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:36.237552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:36.238154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:36.247714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:36.248467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:36.248998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:36.249839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:36.250345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:36.250836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:36.315764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:36.316291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:36.316746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:36.317947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lazy-loading 'fault' on Instance uuid 9194df0e-dd9c-497a-93fa-255bc172e946 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:24:36.389080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:36.399473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87d4a3b6-4946-4176-96ad-c21a0eb7de82 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 200 len: 1365 microversion: 2.1 time: 0.165776 Aug 29 16:24:36.411660 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3546/6918] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:36 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:37.423292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:37.424271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:37.432329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:37.433061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:37.433516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:37.434892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:37.435387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:37.436037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:37.469716 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 HTTP/1.1 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9194df0e-dd9c-497a-93fa-255bc172e946'} Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:37.471496 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9bab9bb3-6f3d-40a6-973c-c0f0bf4e547c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 404 len: 111 microversion: 2.1 time: 0.054197 Aug 29 16:24:37.480487 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3373/6919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:37 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:24:41.818969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:41.820217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:41.832663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:41.833183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:41.833648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:41.834378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:41.834862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:41.835351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:41.862360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:24:41.948180 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eed1a93d-13f7-4506-9d8b-670d30bb45c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 204 len: 0 microversion: 2.1 time: 0.132144 Aug 29 16:24:41.949118 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3547/6920] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:24:41 2022] DELETE /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:24:41.959120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:41.959747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:41.967773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:41.968269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:41.968702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:41.969394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:41.969845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:41.970268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:42.115399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:42.124974 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c2179e21-e3f3-467f-b82d-93fee51fe18d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1410 microversion: 2.1 time: 0.171696 Aug 29 16:24:42.125932 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3374/6921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:41 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1410 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:43.148989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:43.149722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:43.157516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:43.158108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:43.158640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:43.159477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:43.159956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:43.160398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:43.296103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:43.305318 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c407f74b-237f-4c83-ad93-6d43eaa4bb01 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1410 microversion: 2.1 time: 0.160936 Aug 29 16:24:43.306300 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3548/6922] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:43 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1410 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:44.330080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:44.331295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:44.340794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:44.342634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:44.343103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:44.343815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:44.344463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:44.344893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:44.353593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-24e2afda-d6c8-42cb-844b-0f18cf11c48b req-2868aadd-07f5-4a0c-9d97-ee76827b60d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94d72ce-548e-4d0a-ac1b-e96da159af7c", "name": "network-vif-deleted", "tag": "24fd7463-4014-4f0d-ae40-bf9a316709d7"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:44.366333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-24e2afda-d6c8-42cb-844b-0f18cf11c48b req-2868aadd-07f5-4a0c-9d97-ee76827b60d0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:44.366839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-24e2afda-d6c8-42cb-844b-0f18cf11c48b req-2868aadd-07f5-4a0c-9d97-ee76827b60d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:44.367327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-24e2afda-d6c8-42cb-844b-0f18cf11c48b req-2868aadd-07f5-4a0c-9d97-ee76827b60d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:44.381251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-24e2afda-d6c8-42cb-844b-0f18cf11c48b req-2868aadd-07f5-4a0c-9d97-ee76827b60d0 service nova] Creating event network-vif-deleted:24fd7463-4014-4f0d-ae40-bf9a316709d7 for instance d94d72ce-548e-4d0a-ac1b-e96da159af7c on n-h2-836830-13 Aug 29 16:24:44.388234 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-24e2afda-d6c8-42cb-844b-0f18cf11c48b req-2868aadd-07f5-4a0c-9d97-ee76827b60d0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038076 Aug 29 16:24:44.389417 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3549/6923] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:24:44.423293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:44.431512 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-976775c6-d9c6-4956-b5b7-b40a1ca03e5c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1368 microversion: 2.1 time: 0.107278 Aug 29 16:24:44.432354 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3375/6924] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:44 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:45.454677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:45.455437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:45.462117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:45.462619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:45.463121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:45.464421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:45.465078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:45.465521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:45.535785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:45.543913 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-404db03b-9169-4dd2-9922-aaa8403c6e5b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1202 microversion: 2.1 time: 0.094439 Aug 29 16:24:45.544492 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3550/6925] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:45 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:46.565028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:46.565866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:46.572837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:46.574280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:46.574741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:46.575503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:46.575999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:46.576438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:46.641072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:46.649267 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bb131f17-09fb-43cc-8432-d4ec57058055 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1202 microversion: 2.1 time: 0.088580 Aug 29 16:24:46.649965 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3376/6926] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:46 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:47.670679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:47.671347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:47.678573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:47.679107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:47.679559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:47.680268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:47.680739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:47.681177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:47.747048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:47.755040 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3ef43593-a2e8-4bb6-9ed0-73fe0073b519 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1202 microversion: 2.1 time: 0.089030 Aug 29 16:24:47.755613 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3551/6927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:47 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:48.776890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:48.777514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:48.784886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:48.785461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:48.785906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:48.786610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:48.787275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:48.787720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:48.882216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:24:48.891503 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e852be5-dc6a-418d-85e4-e8e36fd5a49f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 200 len: 1202 microversion: 2.1 time: 0.119575 Aug 29 16:24:48.892387 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3377/6928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:48 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 1202 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:24:49.912659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:49.913866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:49.921643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:49.922152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:49.922606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:49.923357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:49.923837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:49.924281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:49.938069 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c HTTP/1.1 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd94d72ce-548e-4d0a-ac1b-e96da159af7c'} Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:49.940066 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5116187f-5ac4-41e0-9109-79f96b69d257 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 404 len: 111 microversion: 2.1 time: 0.032840 Aug 29 16:24:49.945289 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3552/6929] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:49 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:24:54.215805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:54.216386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:54.223891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.224457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.224936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.225658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.226119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.226552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.244816 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 HTTP/1.1 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '9194df0e-dd9c-497a-93fa-255bc172e946'} Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:24:54.246506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c92efc5b-40f5-4267-acaf-a769c1e9b97d tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 404 len: 111 microversion: 2.1 time: 0.038029 Aug 29 16:24:54.251562 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3378/6930] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:24:54 2022] DELETE /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:24:54.256945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:54.257579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 9194df0e-dd9c-497a-93fa-255bc172e946] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:54.264776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.265279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.265765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.266473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.266942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.267416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.282906 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 HTTP/1.1 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '9194df0e-dd9c-497a-93fa-255bc172e946'} Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.284767 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.290190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 9194df0e-dd9c-497a-93fa-255bc172e946 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:54.291174 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a968c149-94c6-4713-9f51-01cb518a9e90 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946" status: 404 len: 111 microversion: 2.1 time: 0.036803 Aug 29 16:24:54.292679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3553/6931] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:54 2022] GET /compute/v2.1/servers/9194df0e-dd9c-497a-93fa-255bc172e946 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:24:54.847711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:54.848462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:54.856845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.857675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.858335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.859071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.859728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.860323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.877148 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c HTTP/1.1 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd94d72ce-548e-4d0a-ac1b-e96da159af7c'} Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:24:54.879132 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4fb034ab-0e8d-4e4a-af59-c5e701be7db2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 404 len: 111 microversion: 2.1 time: 0.037939 Aug 29 16:24:54.883976 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3379/6932] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:24:54 2022] DELETE /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:24:54.890756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:24:54.891448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: d94d72ce-548e-4d0a-ac1b-e96da159af7c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:24:54.897663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.898407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.898862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.899607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:24:54.900081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:24:54.900515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:24:54.915145 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c HTTP/1.1 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd94d72ce-548e-4d0a-ac1b-e96da159af7c'} Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:24:54.916870 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance d94d72ce-548e-4d0a-ac1b-e96da159af7c could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b6436d5-e014-4bd2-8925-3419573306be tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c" status: 404 len: 111 microversion: 2.1 time: 0.031591 Aug 29 16:24:54.923610 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3554/6933] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:24:54 2022] GET /compute/v2.1/servers/d94d72ce-548e-4d0a-ac1b-e96da159af7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:24:55.001762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-34b4d549-d9ee-40d1-8383-0c004b91c304 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: .version_select at 0x7f32ee47d310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1677650564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO90qko3pQ9gazLKYVthqCUMtPRCFYfKKG5oGK0+xIsqrIKjfBo0b8hudrmczM4K+D8mSCqS8NovCoMOYpbGCEwmrbhDquuV9bzrAVFojum4EFM6v31rj8nFevvgzaynhQ=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:24:55.019326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-34b4d549-d9ee-40d1-8383-0c004b91c304 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:24:55.025790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-34b4d549-d9ee-40d1-8383-0c004b91c304 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:24:55.053585 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-34b4d549-d9ee-40d1-8383-0c004b91c304 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055790 Aug 29 16:24:55.054285 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3380/6934] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:24:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:12.776723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1946151004", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1677650564", "security_groups": [{"name": "tempest-secgroup-smoke-1322574258"}], "block_device_mapping_v2": [{"uuid": "364adfe8-9cfa-421f-b929-8190d106e81c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:12.792588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:12.793293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:13.094894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:25:13.483817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:25:13.484255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:25:13.484745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:25:13.485319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:25:13.485754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:25:13.494650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.495217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.495667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:13.496402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:13.496874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:13.497312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:13.523900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:25:13.529927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:25:13.592374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:25:13.594727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='364adfe8-9cfa-421f-b929-8190d106e81c',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:25:13.749207 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d7a6dfa-8c75-4ef2-948e-903d1d525d85 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.970544 Aug 29 16:25:13.749207 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3555/6935] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:25:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 16:25:13.754418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54f3b3a4-993e-4777-bcc1-68f849fb1ab5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:13.755067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54f3b3a4-993e-4777-bcc1-68f849fb1ab5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:13.758183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=63 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:13.758861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:13.759706 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:13.897714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54f3b3a4-993e-4777-bcc1-68f849fb1ab5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:13.907069 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54f3b3a4-993e-4777-bcc1-68f849fb1ab5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1095 microversion: 2.1 time: 0.156325 Aug 29 16:25:13.908248 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3381/6936] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:13 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1095 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:14.929754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:14.930407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:14.938486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:14.939811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:14.940279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:14.941059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:14.941471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:14.941919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:15.028360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:15.036699 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a72b3fe-81c1-4293-bd94-72cc185b251a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1211 microversion: 2.1 time: 0.112236 Aug 29 16:25:15.037306 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3556/6937] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:14 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:16.058837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:16.060150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:16.074181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:16.074764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:16.076119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:16.077255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:16.078005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:16.080036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:16.383282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:16.400322 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-be7e0c84-678d-4126-bf05-1afc68613941 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1279 microversion: 2.1 time: 0.346443 Aug 29 16:25:16.401770 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3382/6938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:16 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1279 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:16.880800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6a63197a-b563-44ec-9511-b8a7db89d65c req-fcd85480-cc94-4c67-bca6-755a071060cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d33e4a1-2923-4a8c-bcd4-16b02682a5e9", "tag": "b8ca42c3-d69c-440b-bfd4-77fb240e1bbb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:16.890810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6a63197a-b563-44ec-9511-b8a7db89d65c req-fcd85480-cc94-4c67-bca6-755a071060cd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:16.891614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6a63197a-b563-44ec-9511-b8a7db89d65c req-fcd85480-cc94-4c67-bca6-755a071060cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:16.892252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6a63197a-b563-44ec-9511-b8a7db89d65c req-fcd85480-cc94-4c67-bca6-755a071060cd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:16.905161 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6a63197a-b563-44ec-9511-b8a7db89d65c req-fcd85480-cc94-4c67-bca6-755a071060cd service nova] Creating event network-changed:b8ca42c3-d69c-440b-bfd4-77fb240e1bbb for instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 on n-h1-836830-13 Aug 29 16:25:16.910468 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6a63197a-b563-44ec-9511-b8a7db89d65c req-fcd85480-cc94-4c67-bca6-755a071060cd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158847 Aug 29 16:25:16.911333 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3557/6939] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:25:17.421752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:17.423776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:17.432331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:17.433638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:17.434311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:17.435716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:17.436667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:17.437351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:17.725385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:17.735037 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13f5dad5-95a4-4351-9209-c98c17b61776 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1279 microversion: 2.1 time: 0.317143 Aug 29 16:25:17.736465 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3383/6940] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:17 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1279 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:18.759249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:18.760323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:18.767569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:18.768326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:18.768783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:18.769494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:18.769961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:18.770671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:18.927989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:18.936238 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f843a61f-0b58-4ba8-b2c8-9d0d08878d6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1279 microversion: 2.1 time: 0.182614 Aug 29 16:25:18.936818 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3558/6941] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:18 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:19.957788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:19.958682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:19.966961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:19.967539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:19.968041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:19.968940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:19.969463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:19.970237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:20.118004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:20.126966 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-78514ce0-a786-46dd-966d-773f1b76ed3a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1279 microversion: 2.1 time: 0.173159 Aug 29 16:25:20.127682 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3384/6942] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:19 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:21.148386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:21.149116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:21.156798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:21.157401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:21.157916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:21.158686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:21.159247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:21.159752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:21.313705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:21.323423 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-487234d0-aaec-4df1-a598-80de005fbeba tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.179089 Aug 29 16:25:21.324002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3559/6943] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:21 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:22.344955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:22.345577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:22.352539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:22.353031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:22.353474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:22.354239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:22.355164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:22.355299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:22.498592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:22.506479 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c043f6f8-2349-48a5-82d6-b7c00c1aa7e1 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.165657 Aug 29 16:25:22.507067 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3385/6944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:22 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:23.528692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:23.529328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:23.532301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:23.536164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:23.540895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:23.541896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:23.542339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:23.543250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:23.543752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:23.544192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:23.688551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:23.697119 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be0847c9-9b4c-4be6-abe5-7812f886ad2f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.172754 Aug 29 16:25:23.698188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3560/6945] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:23 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:24.724260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:24.725005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:24.727887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:25:24.734422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:24.734920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:24.735388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:24.736095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:24.736559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:24.736991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:24.883344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:24.892117 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c43571bc-14fe-44b7-896c-640c4fcf6160 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.171795 Aug 29 16:25:24.892831 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3386/6946] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:24 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:25.917122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:25.917755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:25.924937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:25.925449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:25.925912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:25.926628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:25.927131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:25.927582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:26.070606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:26.080064 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76a4f710-cbeb-4e9d-8ebc-c1a7207d341a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.166901 Aug 29 16:25:26.080651 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3561/6947] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:25 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:27.101685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:27.102926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:27.111410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:27.111914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:27.112359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:27.113062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:27.113527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:27.113952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:27.255712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:27.264982 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-abe2ac93-eee2-4647-8c90-1a2655c74b84 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.167301 Aug 29 16:25:27.265667 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3387/6948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:27 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:28.287202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:28.287841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:28.295833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:28.296344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:28.296806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:28.297522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:28.297999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:28.298447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:28.447151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:28.455610 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4330d421-5798-45ab-a9b9-d88a8b070960 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.172388 Aug 29 16:25:28.456522 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3562/6949] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:28 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:29.477501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:29.478106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:29.485224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:29.485714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:29.486150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:29.486840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:29.487320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:29.487756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:29.627371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:29.636060 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17304d48-998b-47d7-a189-7e193cb154a8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.162386 Aug 29 16:25:29.636558 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3388/6950] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:29 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:30.517031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5d9a2024-5daa-4ccd-86aa-18dadbb00c4f req-c2514121-3074-4f8c-9231-653abb8340d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d33e4a1-2923-4a8c-bcd4-16b02682a5e9", "name": "network-vif-plugged", "status": "completed", "tag": "b8ca42c3-d69c-440b-bfd4-77fb240e1bbb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:30.529663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5d9a2024-5daa-4ccd-86aa-18dadbb00c4f req-c2514121-3074-4f8c-9231-653abb8340d0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:30.530269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5d9a2024-5daa-4ccd-86aa-18dadbb00c4f req-c2514121-3074-4f8c-9231-653abb8340d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:30.531888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5d9a2024-5daa-4ccd-86aa-18dadbb00c4f req-c2514121-3074-4f8c-9231-653abb8340d0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:30.547583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5d9a2024-5daa-4ccd-86aa-18dadbb00c4f req-c2514121-3074-4f8c-9231-653abb8340d0 service nova] Creating event network-vif-plugged:b8ca42c3-d69c-440b-bfd4-77fb240e1bbb for instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 on n-h1-836830-13 Aug 29 16:25:30.553238 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5d9a2024-5daa-4ccd-86aa-18dadbb00c4f req-c2514121-3074-4f8c-9231-653abb8340d0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040655 Aug 29 16:25:30.554139 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3563/6951] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:25:30.657304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:30.658477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:30.666826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:30.667742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:30.668428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:30.669258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:30.669791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:30.670431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:30.836151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:30.845135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bc772143-36ae-4ce1-bb20-03c3152ab553 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1267 microversion: 2.1 time: 0.192000 Aug 29 16:25:30.845807 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3389/6952] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:30 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:25:31.866744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:31.867520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:31.876389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:31.876908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:31.877360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:31.878080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:31.878552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:31.879071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:32.026548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:32.034630 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88e3b8c7-970e-41ad-b0e8-226626e0152c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1453 microversion: 2.1 time: 0.172148 Aug 29 16:25:32.035233 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3564/6953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:31 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:32.055369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:25:32.055993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:25:32.063429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:32.064018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:32.064351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:32.065302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:32.065764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:32.066193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:32.211343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:25:32.220399 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7dd00bc7-c2ce-418a-b681-af53c6da7d38 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1453 microversion: 2.1 time: 0.168942 Aug 29 16:25:32.221257 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3390/6954] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:25:32 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:25:33.884369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-aa37423d-bdee-4e39-a94d-ab407ed3eb5d req-39594650-3422-426a-bae9-c4d51e647ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d33e4a1-2923-4a8c-bcd4-16b02682a5e9", "tag": "b8ca42c3-d69c-440b-bfd4-77fb240e1bbb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:25:33.894915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aa37423d-bdee-4e39-a94d-ab407ed3eb5d req-39594650-3422-426a-bae9-c4d51e647ea2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:25:33.895456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aa37423d-bdee-4e39-a94d-ab407ed3eb5d req-39594650-3422-426a-bae9-c4d51e647ea2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:25:33.895918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-aa37423d-bdee-4e39-a94d-ab407ed3eb5d req-39594650-3422-426a-bae9-c4d51e647ea2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:25:33.907695 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-aa37423d-bdee-4e39-a94d-ab407ed3eb5d req-39594650-3422-426a-bae9-c4d51e647ea2 service nova] Creating event network-changed:b8ca42c3-d69c-440b-bfd4-77fb240e1bbb for instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 on n-h1-836830-13 Aug 29 16:25:33.912941 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-aa37423d-bdee-4e39-a94d-ab407ed3eb5d req-39594650-3422-426a-bae9-c4d51e647ea2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032315 Aug 29 16:25:33.913863 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3565/6955] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:31.576046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=22 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:31.577163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=54 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:31.577790 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:27:31.577941 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:27:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 (ip 10.222.0.83) !!! Aug 29 16:27:31.580404 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:27:31.580842 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:27:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 (ip 10.222.0.83) !!! Aug 29 16:27:31.582454 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:27:31.582562 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:27:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 (ip 10.222.0.83) !!! Aug 29 16:27:31.839589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:31.840574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:31.847466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:31.847955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:31.848387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:31.849081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:31.849537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:31.849961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:31.876353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:27:31.960958 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-53bdadd1-5934-4546-abcb-d2629b34aafc tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 204 len: 0 microversion: 2.1 time: 0.390665 Aug 29 16:27:31.961883 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3391/6956] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:27:31 2022] DELETE /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:27:31.968500 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:27:31.969630 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:27:31.970235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:31.970989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=50 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:31.975206 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:27:31.975206 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:27:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 (ip 10.222.0.83) !!! Aug 29 16:27:31.982602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:31.983702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:31.991999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:31.992734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:31.993350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:31.994305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:31.995234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:31.995819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:32.233196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:32.242312 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-40e952ef-ad76-471c-a89e-9a2583dc70b3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1578 microversion: 2.1 time: 0.275760 Aug 29 16:27:32.257552 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3566/6957] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:31 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1578 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:32.689904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1983189457", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "2ad67e78-02fb-4a3f-854f-c69655da3603"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:32.748874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] validate_networks() for [('2ad67e78-02fb-4a3f-854f-c69655da3603', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:27:33.193582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:27:33.194012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:27:33.194496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:27:33.194914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:27:33.195378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:27:33.204388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:33.204878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:33.205323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:33.206050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:33.206513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:33.206944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:33.224145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Getting quotas for project 3a00d97a45164577a2e90b6083515f3a. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:27:33.229611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Getting quotas for user 75ce0c0a463b435690258f9b9958b3de and project 3a00d97a45164577a2e90b6083515f3a. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:27:33.242991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:27:33.245425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:27:33.265348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:33.265993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:33.275345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:33.276006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:33.276613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:33.277602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:33.278705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:33.279174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:33.286555 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 44794. Aug 29 16:27:33.293537 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-101507a7-83c8-4fe1-a4ce-3ba76ea0fb38 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658367 Aug 29 16:27:33.295245 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3392/6958] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:27:33.298075 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 44792. Aug 29 16:27:33.305666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c23d00d6-3095-471a-9485-39c4c3acb0c6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:33.306280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c23d00d6-3095-471a-9485-39c4c3acb0c6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:33.363198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c23d00d6-3095-471a-9485-39c4c3acb0c6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:33.370928 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c23d00d6-3095-471a-9485-39c4c3acb0c6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1215 microversion: 2.1 time: 0.068966 Aug 29 16:27:33.371679 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3393/6959] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:33 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:33.427625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:33.435835 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-da9bce92-ebcf-4ce8-9745-2499fa0dcd62 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1578 microversion: 2.1 time: 0.174768 Aug 29 16:27:33.436463 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3567/6960] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:33 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:34.393805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:34.394555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:34.404338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:34.405003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:34.405551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:34.406428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:34.407002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:34.408148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:34.428398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-468fe21a-ea09-4020-8c2e-c26e5f073a1f req-dbb6c887-e786-4019-a336-7f7524e17f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d33e4a1-2923-4a8c-bcd4-16b02682a5e9", "name": "network-vif-deleted", "tag": "b8ca42c3-d69c-440b-bfd4-77fb240e1bbb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:34.440954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-468fe21a-ea09-4020-8c2e-c26e5f073a1f req-dbb6c887-e786-4019-a336-7f7524e17f3a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:34.441789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-468fe21a-ea09-4020-8c2e-c26e5f073a1f req-dbb6c887-e786-4019-a336-7f7524e17f3a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:34.442632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-468fe21a-ea09-4020-8c2e-c26e5f073a1f req-dbb6c887-e786-4019-a336-7f7524e17f3a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:34.457133 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-468fe21a-ea09-4020-8c2e-c26e5f073a1f req-dbb6c887-e786-4019-a336-7f7524e17f3a service nova] Creating event network-vif-deleted:b8ca42c3-d69c-440b-bfd4-77fb240e1bbb for instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 on n-h1-836830-13 Aug 29 16:27:34.463472 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-468fe21a-ea09-4020-8c2e-c26e5f073a1f req-dbb6c887-e786-4019-a336-7f7524e17f3a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040062 Aug 29 16:27:34.464456 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3568/6961] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:34.470812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:34.471576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:34.478496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:34.479100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:34.479488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:34.480455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:34.480902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:34.481420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:34.509848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:34.519419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-90fec100-6a2d-4799-b78c-78a0a9105bb7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1267 microversion: 2.1 time: 0.130016 Aug 29 16:27:34.534780 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3394/6962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:34 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:34.570629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:34.581071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-210ef425-bf49-4367-bc28-758309faa475 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1226 microversion: 2.1 time: 0.115344 Aug 29 16:27:34.581681 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3569/6963] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:34 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:35.541862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:35.542484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:35.550819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:35.551720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:35.552319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:35.553229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:35.553824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:35.554389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:35.604315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:35.605648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:35.613893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:35.614746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:35.615450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:35.616750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:35.617454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:35.618146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:35.640413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:35.651670 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f21d20d1-e740-4ffc-92ef-6b6689a334cf tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1273 microversion: 2.1 time: 0.113821 Aug 29 16:27:35.666497 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3395/6964] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:35 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:35.735259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:35.746243 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a1cb0c6c-911d-4ea6-8dc2-404256fe01ee tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1226 microversion: 2.1 time: 0.146051 Aug 29 16:27:35.747055 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3570/6965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:35 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:36.623509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b4062b97-0407-409e-8884-58e1353ffdc2 req-98486be2-4566-4e35-80fb-23ec7f4b0959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "995009a3-d00e-4819-8396-b83465a22a7f", "tag": "127c2cfb-84aa-4f9c-a570-116a2c85d057"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:36.635649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b4062b97-0407-409e-8884-58e1353ffdc2 req-98486be2-4566-4e35-80fb-23ec7f4b0959 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.636601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b4062b97-0407-409e-8884-58e1353ffdc2 req-98486be2-4566-4e35-80fb-23ec7f4b0959 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.637220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b4062b97-0407-409e-8884-58e1353ffdc2 req-98486be2-4566-4e35-80fb-23ec7f4b0959 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:36.650409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b4062b97-0407-409e-8884-58e1353ffdc2 req-98486be2-4566-4e35-80fb-23ec7f4b0959 service nova] Creating event network-changed:127c2cfb-84aa-4f9c-a570-116a2c85d057 for instance 995009a3-d00e-4819-8396-b83465a22a7f on n-h2-836830-13 Aug 29 16:27:36.656621 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b4062b97-0407-409e-8884-58e1353ffdc2 req-98486be2-4566-4e35-80fb-23ec7f4b0959 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 Aug 29 16:27:36.657460 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3396/6966] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:36.674577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:36.676616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:36.685054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.686095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.686736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:36.687561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.688358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.689011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:36.770450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:36.771226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:36.780572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.781097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.781563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:36.782282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:36.782741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:36.783188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:36.835587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:36.845191 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f34257cc-6410-44e4-b703-3096bd55c971 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1315 microversion: 2.1 time: 0.175053 Aug 29 16:27:36.846110 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3571/6967] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:36 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:36.870476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:36.879011 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96f8c0ca-00a6-4ac4-a566-52c46a0a7fb2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1226 microversion: 2.1 time: 0.114001 Aug 29 16:27:36.879988 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3397/6968] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:36 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:37.866673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:37.867353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:37.875335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:37.875848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:37.876312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:37.877036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:37.877509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:37.877953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:37.899709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:37.900453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:37.908225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:37.908952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:37.909546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:37.910395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:37.910995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:37.911614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:37.999688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:38.011095 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e1e57890-64ff-427c-98e7-9bb02e6ae76c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1226 microversion: 2.1 time: 0.114991 Aug 29 16:27:38.020375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:38.027119 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3398/6969] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:37 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:38.028983 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-21d5ac4a-0c04-4a9c-97ae-50623d380095 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1315 microversion: 2.1 time: 0.166060 Aug 29 16:27:38.029553 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3572/6970] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:37 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:39.031983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:39.033182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:39.040146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:39.040634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:39.041069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:39.041762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:39.042219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:39.042633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:39.049877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:39.050760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:39.057839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:39.058555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:39.059216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:39.060159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:39.062240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:39.062871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:39.082192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:39.082682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:39.083150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:39.083603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lazy-loading 'fault' on Instance uuid 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:27:39.131362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:39.141872 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f15cfa0-fcf0-4f5d-ad0d-01f9ed3f4669 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 200 len: 1231 microversion: 2.1 time: 0.114564 Aug 29 16:27:39.143063 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3399/6971] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:39 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:39.215406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:39.224465 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f474d9e4-b3cc-4436-8238-a5fe65e3f442 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1315 microversion: 2.1 time: 0.178442 Aug 29 16:27:39.225301 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3573/6972] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:39 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:40.163794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:40.164412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:40.172036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:40.172526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:40.172963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:40.173649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:40.174104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:40.174528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:40.188911 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 HTTP/1.1 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '8d33e4a1-2923-4a8c-bcd4-16b02682a5e9'} Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:40.190603 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4396edad-faa9-41f5-a2e0-74b13dda722e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 404 len: 111 microversion: 2.1 time: 0.032180 Aug 29 16:27:40.194791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3400/6973] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:40 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:27:40.242904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2044079298", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1677650564", "security_groups": [{"name": "tempest-secgroup-smoke-1322574258"}], "block_device_mapping_v2": [{"uuid": "364adfe8-9cfa-421f-b929-8190d106e81c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:40.245555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:40.246184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:40.253267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:40.253766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:40.254214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:40.254926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:40.255420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:40.255856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:40.365177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:27:40.405341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:40.413251 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2bfc280e-789b-4cfc-94be-6902d7b86715 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1315 microversion: 2.1 time: 0.171511 Aug 29 16:27:40.413825 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3401/6974] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:40 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:40.808532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:27:40.809009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:27:40.809503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:27:40.810072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:27:40.811281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:27:40.820566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:40.821072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:40.821527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:40.822272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:40.822748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:40.823233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:40.841508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:27:40.846949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:27:40.906487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:27:40.908677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='364adfe8-9cfa-421f-b929-8190d106e81c',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:27:41.044514 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fff9f643-9ac1-4761-9b82-8ccb723633fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805517 Aug 29 16:27:41.045854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3574/6975] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:27:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:27:41.056519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1dcce21-f6ee-45a6-b52a-8ff72bb71952 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:41.057142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1dcce21-f6ee-45a6-b52a-8ff72bb71952 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:41.112141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1dcce21-f6ee-45a6-b52a-8ff72bb71952 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:41.119318 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1dcce21-f6ee-45a6-b52a-8ff72bb71952 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1095 microversion: 2.1 time: 0.066838 Aug 29 16:27:41.119900 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3402/6976] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:41 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:41.436465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:41.437243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:41.445245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:41.445750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:41.446198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:41.446909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:41.447415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:41.448032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:41.591087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:41.603817 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-818086b8-dc05-4231-b552-5c86e7816da7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1315 microversion: 2.1 time: 0.173581 Aug 29 16:27:41.604724 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3575/6977] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:41 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:42.118652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d0605126-26e1-4a9c-9710-d40d9b49d9ee req-45061229-896c-4220-821b-37c2daf52412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995009a3-d00e-4819-8396-b83465a22a7f", "name": "network-vif-plugged", "status": "completed", "tag": "127c2cfb-84aa-4f9c-a570-116a2c85d057"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:42.130003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d0605126-26e1-4a9c-9710-d40d9b49d9ee req-45061229-896c-4220-821b-37c2daf52412 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:42.130491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d0605126-26e1-4a9c-9710-d40d9b49d9ee req-45061229-896c-4220-821b-37c2daf52412 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:42.130924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d0605126-26e1-4a9c-9710-d40d9b49d9ee req-45061229-896c-4220-821b-37c2daf52412 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:42.142684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d0605126-26e1-4a9c-9710-d40d9b49d9ee req-45061229-896c-4220-821b-37c2daf52412 service nova] Creating event network-vif-plugged:127c2cfb-84aa-4f9c-a570-116a2c85d057 for instance 995009a3-d00e-4819-8396-b83465a22a7f on n-h2-836830-13 Aug 29 16:27:42.143488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:42.144289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:42.148941 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d0605126-26e1-4a9c-9710-d40d9b49d9ee req-45061229-896c-4220-821b-37c2daf52412 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115688 Aug 29 16:27:42.149865 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3403/6978] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:42.157616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:42.158325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:42.158684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:42.159445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:42.159968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:42.160552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:42.237529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:42.246670 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b71a1713-21e3-4f7c-89e6-2fa516bf04b4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1201 microversion: 2.1 time: 0.110122 Aug 29 16:27:42.247694 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3576/6979] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:42 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1201 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:42.627136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:42.627877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:42.634712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:42.635285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:42.636006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:42.636897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:42.637526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:42.638022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:42.855326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:42.863541 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-431e3412-b834-43a6-8ae1-eccdf5f1b1fa tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1315 microversion: 2.1 time: 0.241319 Aug 29 16:27:42.864337 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3404/6980] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:42 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:43.269285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:43.271793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:43.284974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:43.285731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:43.286360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:43.287270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:43.287884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:43.288551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:43.439898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:43.448942 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-adbb9b7b-bbd6-4063-988f-4f0183ab904a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1279 microversion: 2.1 time: 0.183399 Aug 29 16:27:43.451730 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3577/6981] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:43 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:43.725610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-644f0b86-e87d-4124-a496-ed9dfea46c2a req-6a2f58b1-c98b-44df-9079-b89bc943595b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9acf413-9499-4ade-b5be-682c8c4f5e43", "tag": "e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:43.759264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:43.770863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-644f0b86-e87d-4124-a496-ed9dfea46c2a req-6a2f58b1-c98b-44df-9079-b89bc943595b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:43.780695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-644f0b86-e87d-4124-a496-ed9dfea46c2a req-6a2f58b1-c98b-44df-9079-b89bc943595b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:43.781455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-644f0b86-e87d-4124-a496-ed9dfea46c2a req-6a2f58b1-c98b-44df-9079-b89bc943595b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:43.804092 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-644f0b86-e87d-4124-a496-ed9dfea46c2a req-6a2f58b1-c98b-44df-9079-b89bc943595b service nova] Creating event network-changed:e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45 for instance c9acf413-9499-4ade-b5be-682c8c4f5e43 on n-h1-836830-13 Aug 29 16:27:43.814032 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-644f0b86-e87d-4124-a496-ed9dfea46c2a req-6a2f58b1-c98b-44df-9079-b89bc943595b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103097 Aug 29 16:27:43.815620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3405/6982] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:43.885974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:43.886907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:43.916853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:43.919547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:43.921841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:43.924466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:43.926001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:43.927072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.124981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:44.133553 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a669425-ddf8-438d-bd38-b21587173c87 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1502 microversion: 2.1 time: 0.251644 Aug 29 16:27:44.134331 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3578/6983] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:43 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:44.156808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:44.157811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:44.165418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.166204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.166903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.167904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.168570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.169205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.391483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:44.400344 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2dd5a495-f18e-49e8-a673-501c207343a5 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1502 microversion: 2.1 time: 0.248803 Aug 29 16:27:44.401022 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3406/6984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:44 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1502 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:44.422004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:44.422559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:44.429661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.430161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.430613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.431599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.432028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.432343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.459646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lazy-loading 'flavor' on Instance uuid 995009a3-d00e-4819-8396-b83465a22a7f {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:27:44.470345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:44.471364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:44.477711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.479086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.479732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.480660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.481337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.481958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.537472 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-50c1c618-7f4a-455a-b2f1-f0d9cfc12fed tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.119951 Aug 29 16:27:44.538684 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3579/6985] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:27:44 2022] POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:27:44.547844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:44.548972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:44.556077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.556873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.557416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.558329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:44.559270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:44.559756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:44.710794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:44.723307 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d24cacf-75d3-4852-912d-e31d24eda2e4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1279 microversion: 2.1 time: 0.255596 Aug 29 16:27:44.723307 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3407/6986] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:44 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1279 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:44.749957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:44.758693 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6d2cb54-2a0f-45c2-afce-6d2f0465ad5d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1510 microversion: 2.1 time: 0.216256 Aug 29 16:27:44.767118 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3580/6987] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:44 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:45.743496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:45.744222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:45.752352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:45.752851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:45.753300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:45.754010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:45.754523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:45.754959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:45.780859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:45.781771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:45.789216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:45.789808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:45.790330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:45.791139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:45.791827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:45.792338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:45.931815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:45.938933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:45.940735 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3fe3c138-a439-4bb5-b768-30de3804320f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1279 microversion: 2.1 time: 0.201264 Aug 29 16:27:45.941502 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3408/6988] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:45 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:45.949026 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c8967fc0-fb3d-4947-8e12-9abf53e8dc9a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1493 microversion: 2.1 time: 0.171429 Aug 29 16:27:45.949026 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3581/6989] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:45 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1493 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:45.968565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:45.969132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:45.975279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:45.975774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:45.976217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:45.976916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:45.977380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:45.977812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:45.981627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:46.057932 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29463297-b501-4c9d-aaab-1eeccd3f2e3a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.093238 Aug 29 16:27:46.058894 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3582/6990] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:27:45 2022] POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:27:46.068023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:46.068646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:46.077824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:46.078548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:46.079073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:46.080790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:46.081373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:46.082163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:46.277855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:46.287688 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dad0a21d-cb85-4adf-b0d3-b7182d45fa5f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1499 microversion: 2.1 time: 0.223724 Aug 29 16:27:46.288533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3409/6991] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:46 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1499 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:46.963623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:46.964350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:46.971602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:46.972110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:46.972572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:46.973283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:46.973754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:46.974199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:47.118254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:47.128048 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91cd23c1-62c4-4940-ae71-ec5fe39e1239 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1279 microversion: 2.1 time: 0.169742 Aug 29 16:27:47.129314 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3583/6992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:46 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:47.308567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:47.309182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:47.316307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:47.316791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:47.317223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:47.318172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:47.318618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:47.319050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:47.459984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:47.463579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:47.469709 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1f277ece-5312-4fe0-a603-5f9824bfd679 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1499 microversion: 2.1 time: 0.165019 Aug 29 16:27:47.470294 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3410/6993] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:47 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:48.149948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:48.150485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:48.157700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.158192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.158635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.159360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.159824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.160257 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.292937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:48.302136 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98cc4ced-49fc-4e17-84c9-152afca2ab18 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.156466 Aug 29 16:27:48.302718 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3584/6994] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:48 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:48.493869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:48.494482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:48.502623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.503133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.503566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.504252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.504701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.505123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.640895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:48.648658 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fde2a1c1-1bfb-4798-bbfe-b0921f9c931b tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1502 microversion: 2.1 time: 0.161109 Aug 29 16:27:48.649240 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3411/6995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:48 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:48.669110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:48.669667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:48.676253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.676753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.677211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.677913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.678386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.678828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.702540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lazy-loading 'flavor' on Instance uuid 995009a3-d00e-4819-8396-b83465a22a7f {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:27:48.774719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f5b76d5e-9bf7-45cf-a492-c1576dabbeef tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.109265 Aug 29 16:27:48.775338 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3585/6996] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:27:48 2022] POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:27:48.784091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:48.784712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:48.790973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.791508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.792021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.792744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:48.793200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:48.793670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:48.924506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:48.932370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0226f923-3b93-455d-9f2c-1e592b235139 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1510 microversion: 2.1 time: 0.152842 Aug 29 16:27:48.932942 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3412/6997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:48 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:49.324188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:49.324935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:49.332591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:49.333083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:49.333527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:49.334219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:49.334684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:49.335154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:49.469187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:49.477039 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-07b7a332-e80f-460e-b656-68b7a178f019 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.157182 Aug 29 16:27:49.477616 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3586/6998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:49 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:49.954780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:49.955458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:49.962565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:49.963065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:49.963504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:49.964185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:49.964638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:49.965061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:50.099785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:50.108233 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6688dd98-c9d6-4fe3-ac4a-bf544fe8f1b6 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1493 microversion: 2.1 time: 0.156794 Aug 29 16:27:50.109047 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3413/6999] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:49 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1493 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:50.129004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:50.129566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:50.135643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:50.136144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:50.136622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:50.137344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:50.137796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:50.138239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:50.205862 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20f68ba6-2844-4d81-bf22-610419f5d555 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action" status: 202 len: 0 microversion: 2.1 time: 0.080492 Aug 29 16:27:50.206467 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3587/7000] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:27:50 2022] POST /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:27:50.214651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:50.215365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:50.221674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:50.222219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:50.222700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:50.223551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:50.224033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:50.224468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:50.390921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:50.399254 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11635495-69aa-41d1-8e4a-bcecb0cabfe7 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1499 microversion: 2.1 time: 0.188489 Aug 29 16:27:50.399851 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3414/7001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:50 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1499 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:50.498220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:50.499548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:50.506858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:50.507395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:50.507844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:50.508552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:50.509746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:50.509746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:50.654930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:50.663634 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87d5ba7a-bc6c-4972-954b-ccfa00b5b2f3 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.169633 Aug 29 16:27:50.664214 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3588/7002] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:50 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:51.421091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:51.421787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:51.424508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=10 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:51.430207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:51.430694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:51.431235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:51.431933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:51.432398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:51.432821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:51.568437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:51.576332 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b76696ed-d48b-4358-bc5d-e741db7c5c05 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1499 microversion: 2.1 time: 0.159326 Aug 29 16:27:51.576912 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3415/7003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:51 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1499 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:51.686488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:51.687262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:51.689254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:51.689938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:51.696931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:51.697431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:51.697884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:51.698593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:51.699086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:51.699524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:51.836151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:51.844147 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7824ab9-77be-4a27-b3a8-52f6ae045864 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.162762 Aug 29 16:27:51.844716 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3589/7004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:51 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:52.597864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:52.598484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:52.605427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.605909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.606346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:52.607052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.607522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.607946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:52.746146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:52.754304 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bfc9e665-f939-42bb-b67a-e296930d7d72 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1502 microversion: 2.1 time: 0.161012 Aug 29 16:27:52.754881 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3416/7005] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:52 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:52.774499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:52.775072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:52.783171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.783681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.784134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:52.784848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.785323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.785769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:52.811577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:27:52.865475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:52.866180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:52.872380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.872884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.873455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:52.874151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.875273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.876221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:52.888983 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-96a63112-2df2-4e2e-8c90-6e4c5e555ea4 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "DELETE /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 204 len: 0 microversion: 2.1 time: 0.118261 Aug 29 16:27:52.893426 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3590/7006] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:27:52 2022] DELETE /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:27:52.900596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:52.901471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:52.908086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.908682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.909205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:52.909916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:52.910393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:52.910880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:53.018890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:53.026885 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a5d8d48-db4e-48df-9569-0b870ba57b6c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.165592 Aug 29 16:27:53.027496 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3417/7007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:52 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:53.051287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:53.059137 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dddd903e-a796-4aa7-ab5c-210f9e81be21 tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1508 microversion: 2.1 time: 0.164239 Aug 29 16:27:53.059700 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3591/7008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:52 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:54.048324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:54.048844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:54.055942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:54.056427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:54.056863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:54.057584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:54.058040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:54.058468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:54.080979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:54.081609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:54.088679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:54.089182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:54.089630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:54.090338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:54.090804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:54.091267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:54.194021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:54.201811 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ff26c55-31fe-492b-84d6-505fc0e71967 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.157728 Aug 29 16:27:54.202646 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3418/7009] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:54 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:54.226377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:54.234200 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-66f30ccc-b99c-46cf-810a-a006f7f61e8a tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1508 microversion: 2.1 time: 0.157782 Aug 29 16:27:54.235222 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3592/7010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:54 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:55.224874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:55.225675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:55.232649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:55.233124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:55.234641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:55.235428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:55.235884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:55.236303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:55.256603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:55.257810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:55.267066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:55.267840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:55.268522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:55.269495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:55.270186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:55.270743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:55.291939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:27:55.424579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ce0c0a463b435690258f9b9958b3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a00d97a45164577a2e90b6083515f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:55.434420 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8becdc8-5e88-4831-b4c5-d9d910e6c72d tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 200 len: 1508 microversion: 2.1 time: 0.181545 Aug 29 16:27:55.436041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3593/7011] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:55 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:55.447496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:55.458562 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9d9aea26-17c7-421b-86b5-2a3b2053e029 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.237755 Aug 29 16:27:55.459434 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3419/7012] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:55 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:55.582673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-82162438-5061-4399-b7ad-d2d0ce041b72 req-1769dc21-3a73-4264-841a-958860c84fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "995009a3-d00e-4819-8396-b83465a22a7f", "name": "network-vif-deleted", "tag": "127c2cfb-84aa-4f9c-a570-116a2c85d057"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:55.595594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-82162438-5061-4399-b7ad-d2d0ce041b72 req-1769dc21-3a73-4264-841a-958860c84fe8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:55.596093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-82162438-5061-4399-b7ad-d2d0ce041b72 req-1769dc21-3a73-4264-841a-958860c84fe8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:55.596546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-82162438-5061-4399-b7ad-d2d0ce041b72 req-1769dc21-3a73-4264-841a-958860c84fe8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:55.615986 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-82162438-5061-4399-b7ad-d2d0ce041b72 req-1769dc21-3a73-4264-841a-958860c84fe8 service nova] Creating event network-vif-deleted:127c2cfb-84aa-4f9c-a570-116a2c85d057 for instance 995009a3-d00e-4819-8396-b83465a22a7f on n-h2-836830-13 Aug 29 16:27:55.621145 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-82162438-5061-4399-b7ad-d2d0ce041b72 req-1769dc21-3a73-4264-841a-958860c84fe8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042237 Aug 29 16:27:55.621754 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3594/7013] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:56.457699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:56.458346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] [instance: 995009a3-d00e-4819-8396-b83465a22a7f] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:56.466362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:56.466872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:56.467347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:56.468098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:56.468558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:56.468988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:56.480480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:56.481203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:56.484883 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] HTTP exception thrown: Instance 995009a3-d00e-4819-8396-b83465a22a7f could not be found. Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Request method failure captured: Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f HTTP/1.1 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOjzyTjbhpanRtCqHhe2Pc0vQXQ2UT7n0QrwbkWgxTvyG_O525AeV_Fd0X_TevhfY1GM8wDXvriRlwLhL6_Tg30OrJhAMsLyIF9FY-CjkGUgCgunZggzDvaFCv-gs_5zY1gJlOYUFUzqwYrIjO397VTMQRRa69G7yxfz-uEk1tTxe44 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3a00d97a45164577a2e90b6083515f3a Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestServerAdvancedOps-1493117695 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3a00d97a45164577a2e90b6083515f3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3a00d97a45164577a2e90b6083515f3a", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3a00d97a45164577a2e90b6083515f3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3a00d97a45164577a2e90b6083515f3a"}]}] Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestServerAdvancedOps-1493117695 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3a00d97a45164577a2e90b6083515f3a Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestServerAdvancedOps-1493117695 Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestServerAdvancedOps-1493117695-project Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 75ce0c0a463b435690258f9b9958b3de Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestServerAdvancedOps-1493117695-project Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 995009a3-d00e-4819-8396-b83465a22a7f could not be found. Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '995009a3-d00e-4819-8396-b83465a22a7f'} Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 995009a3-d00e-4819-8396-b83465a22a7f could not be found. Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 995009a3-d00e-4819-8396-b83465a22a7f could not be found. Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:27:56.486680 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 995009a3-d00e-4819-8396-b83465a22a7f could not be found. Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] Returning 404 to user: Instance 995009a3-d00e-4819-8396-b83465a22a7f could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1d5bb072-3e98-47c2-979a-c2344f17651f tempest-TestServerAdvancedOps-1493117695 tempest-TestServerAdvancedOps-1493117695-project] 10.222.0.83 "GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f" status: 404 len: 111 microversion: 2.1 time: 0.035850 Aug 29 16:27:56.490195 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3420/7014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:56 2022] GET /compute/v2.1/servers/995009a3-d00e-4819-8396-b83465a22a7f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:27:56.490766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:56.490766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:56.490766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:56.492152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:56.492152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:56.492152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:56.709237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:56.717547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0126db28-509d-4a95-8b66-6c07bd138094 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.241311 Aug 29 16:27:56.718163 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3595/7015] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:56 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:27:57.179456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e3c2f234-7fd6-4c53-98c1-8798c932239f req-582ff707-577b-4088-8dc8-c09c432a6226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9acf413-9499-4ade-b5be-682c8c4f5e43", "name": "network-vif-plugged", "status": "completed", "tag": "e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:27:57.190028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e3c2f234-7fd6-4c53-98c1-8798c932239f req-582ff707-577b-4088-8dc8-c09c432a6226 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:57.190722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e3c2f234-7fd6-4c53-98c1-8798c932239f req-582ff707-577b-4088-8dc8-c09c432a6226 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:57.191189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e3c2f234-7fd6-4c53-98c1-8798c932239f req-582ff707-577b-4088-8dc8-c09c432a6226 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:57.203491 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e3c2f234-7fd6-4c53-98c1-8798c932239f req-582ff707-577b-4088-8dc8-c09c432a6226 service nova] Creating event network-vif-plugged:e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45 for instance c9acf413-9499-4ade-b5be-682c8c4f5e43 on n-h1-836830-13 Aug 29 16:27:57.209057 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e3c2f234-7fd6-4c53-98c1-8798c932239f req-582ff707-577b-4088-8dc8-c09c432a6226 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033627 Aug 29 16:27:57.210010 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3421/7016] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:27:57.737975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:57.738606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:57.745553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:57.746057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:57.746508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:57.747240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:57.747713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:57.748149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:57.885278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:57.894371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c96f57dd-33b8-4bc7-9876-6ea1dd891e57 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1267 microversion: 2.1 time: 0.160558 Aug 29 16:27:57.894957 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3596/7017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:57 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:58.918383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:58.919029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:58.927227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:58.927732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:58.928175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:58.928890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:58.929345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:58.929771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:59.081010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:59.089735 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-97e54b62-8473-435a-ac12-26bd89a80c51 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1453 microversion: 2.1 time: 0.177128 Aug 29 16:27:59.090546 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3422/7018] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:58 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:27:59.113888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:27:59.114542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:27:59.122711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:59.123328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:59.123704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:59.125087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:27:59.126191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:27:59.126503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:27:59.287708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:27:59.298477 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf87bf14-c96b-4cf3-a452-3e0bd11d0a6b tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1453 microversion: 2.1 time: 0.190322 Aug 29 16:27:59.299108 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3597/7019] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:27:59 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:28:01.263031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8770bdb4-78ae-481e-99cd-25a8fbdb2a16 req-f41f1a76-39ee-41a7-b566-b85c7cad5f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9acf413-9499-4ade-b5be-682c8c4f5e43", "tag": "e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:28:01.273093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8770bdb4-78ae-481e-99cd-25a8fbdb2a16 req-f41f1a76-39ee-41a7-b566-b85c7cad5f66 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:28:01.273551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8770bdb4-78ae-481e-99cd-25a8fbdb2a16 req-f41f1a76-39ee-41a7-b566-b85c7cad5f66 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:28:01.273982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8770bdb4-78ae-481e-99cd-25a8fbdb2a16 req-f41f1a76-39ee-41a7-b566-b85c7cad5f66 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:28:01.287848 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8770bdb4-78ae-481e-99cd-25a8fbdb2a16 req-f41f1a76-39ee-41a7-b566-b85c7cad5f66 service nova] Creating event network-changed:e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45 for instance c9acf413-9499-4ade-b5be-682c8c4f5e43 on n-h1-836830-13 Aug 29 16:28:01.293085 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8770bdb4-78ae-481e-99cd-25a8fbdb2a16 req-f41f1a76-39ee-41a7-b566-b85c7cad5f66 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200273 Aug 29 16:28:01.293704 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3423/7020] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:29:51.450373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:51.451253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=22 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:51.456205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1417927953", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1677650564", "security_groups": [{"name": "tempest-secgroup-smoke-1322574258"}], "block_device_mapping_v2": [{"uuid": "bf4c13fc-7fff-4848-bd89-6a166cf61caf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24bb1403-720f-4099-893f-c0478b20118f"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:51.572395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] validate_networks() for [('24bb1403-720f-4099-893f-c0478b20118f', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:29:51.946482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:29:51.946915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:29:51.947468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:29:51.947932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:29:51.948335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:29:51.957163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:51.957655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:51.958096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:51.958819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:51.959310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:51.959744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:51.976471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:29:51.982538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Getting quotas for user 616303b5564840e3bb07d4c9c22c2049 and project 3e4f468e4b694771b47f56110a9ed798. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:29:52.040825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:29:52.042952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf4c13fc-7fff-4848-bd89-6a166cf61caf',volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:29:52.171650 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fdd7b680-2e9b-44a9-9acb-0088f49f860f tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723450 Aug 29 16:29:52.172528 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3598/7021] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:29:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:29:52.182592 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 16:29:52.184054 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:29:52.184637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:52.185393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=66 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:29:52.191380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d2aa096-3f26-4bdd-8b9a-21946a421658 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:52.192077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d2aa096-3f26-4bdd-8b9a-21946a421658 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:52.249445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d2aa096-3f26-4bdd-8b9a-21946a421658 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:52.256727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d2aa096-3f26-4bdd-8b9a-21946a421658 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1095 microversion: 2.1 time: 0.077384 Aug 29 16:29:52.257560 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3424/7022] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:52 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:53.279327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:53.281144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:53.288782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:53.289597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:53.290969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:53.291987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:53.292597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:53.293053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:53.360869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:53.368936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6eae5ad-fbcf-4b48-91fa-e9408a19951e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1211 microversion: 2.1 time: 0.094942 Aug 29 16:29:53.370277 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3599/7023] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:53 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:29:54.391136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:54.392327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:54.408216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:54.408968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:54.409825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:54.411302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:54.411904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:54.412480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:54.419959 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 45128. Aug 29 16:29:54.421565 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 45126. Aug 29 16:29:54.676315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:54.686053 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-474bffe3-b9ca-45aa-adf8-ba52b19474d9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1279 microversion: 2.1 time: 0.299434 Aug 29 16:29:54.700366 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3425/7024] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:54 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1279 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:55.001876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f3023025-944f-4e93-a005-fde3411ba308 req-5ca990e9-5fba-40e4-b339-035a8a831647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d473f5-9af9-416d-817a-9c2da495a279", "tag": "24ccc5c3-f984-4cd6-822e-a50daaa8dd00"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:29:55.015431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3023025-944f-4e93-a005-fde3411ba308 req-5ca990e9-5fba-40e4-b339-035a8a831647 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.016380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3023025-944f-4e93-a005-fde3411ba308 req-5ca990e9-5fba-40e4-b339-035a8a831647 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.017181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f3023025-944f-4e93-a005-fde3411ba308 req-5ca990e9-5fba-40e4-b339-035a8a831647 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.033110 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f3023025-944f-4e93-a005-fde3411ba308 req-5ca990e9-5fba-40e4-b339-035a8a831647 service nova] Creating event network-changed:24ccc5c3-f984-4cd6-822e-a50daaa8dd00 for instance 39d473f5-9af9-416d-817a-9c2da495a279 on n-h2-836830-13 Aug 29 16:29:55.039060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f3023025-944f-4e93-a005-fde3411ba308 req-5ca990e9-5fba-40e4-b339-035a8a831647 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042097 Aug 29 16:29:55.040174 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3600/7025] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:29:55.709995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:55.710637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:55.718098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.718610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.719075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.719798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:55.720259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:55.720694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:55.956500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:55.967668 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b5192316-100e-4097-a98f-dc1a639b87bb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1279 microversion: 2.1 time: 0.263748 Aug 29 16:29:55.983096 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3426/7026] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:55 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1279 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:56.991457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:56.992181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:56.998836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:56.999385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:56.999832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:57.000548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:57.001024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:57.001464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:57.144734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:57.153630 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bb00868-5caf-4974-a7b8-33af01109d20 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1279 microversion: 2.1 time: 0.167341 Aug 29 16:29:57.154222 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3601/7027] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:56 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:58.175186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:58.176096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:58.183347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:58.183840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:58.184286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:58.184979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:58.185427 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:58.185904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:58.331403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:58.339931 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e5a666c-ee3d-41dd-848a-d87d53e358fb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1279 microversion: 2.1 time: 0.169417 Aug 29 16:29:58.340511 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3427/7028] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:58 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:29:59.361347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:29:59.361981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:29:59.369620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:59.370119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:59.370567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:59.371306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:29:59.371776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:29:59.372221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:29:59.506795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:29:59.514762 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15be617a-2cb6-4090-8846-46eca6eaee66 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.157423 Aug 29 16:29:59.515370 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3602/7029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:29:59 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:00.535373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:00.536019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:00.543761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:00.544246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:00.544680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:00.545366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:00.545819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:00.546242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:00.677109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:00.685053 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a1c4dc57-c05f-4ec1-9aff-d837f461ffb9 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.153754 Aug 29 16:30:00.685633 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3428/7030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:00 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:01.705976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:01.706616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:01.713919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:01.714610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:01.715103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:01.715824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:01.716299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:01.716745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:01.850224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:01.858698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-18588b2d-0194-43ce-874d-6c6e07776827 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.156762 Aug 29 16:30:01.859300 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3603/7031] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:01 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:02.881476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:02.882398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:02.886095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:02.892498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:02.892989 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:02.893485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:02.894311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:02.894770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:02.895233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:03.036571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:03.045918 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a35f65d4-f9b9-483a-b3a4-d0624254b07e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.169521 Aug 29 16:30:03.046703 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3429/7032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:02 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:04.067984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:04.068566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:04.070824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:04.071604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:30:04.077778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:04.078283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:04.078738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:04.079487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:04.079948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:04.080418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:04.553181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:04.562097 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-781c9a9c-78e3-4f8b-b028-c04d4dbaa3b5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.498500 Aug 29 16:30:04.562679 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3604/7033] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:04 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:05.583130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:05.583658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:05.591667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:05.592162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:05.592605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:05.593302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:05.593795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:05.594225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:05.732993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:05.740735 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dfcf420b-68e2-48b4-8322-1b49824bc96a tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.161722 Aug 29 16:30:05.741309 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3430/7034] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:05 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:06.761639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:06.762273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:06.769614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:06.770129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:06.770573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:06.771358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:06.771875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:06.772295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:06.907652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:06.915698 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e9f17b4-e0f2-454c-91c2-36ca5e4d57de tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.158176 Aug 29 16:30:06.916382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3605/7035] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:06 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:07.937075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:07.937688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:07.944649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:07.945138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:07.945568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:07.946609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:07.946955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:07.947426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.079388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:08.087137 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a364850-7ead-44f1-b2d9-c63c55298ae8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.154705 Aug 29 16:30:08.087707 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3431/7036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:07 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:08.705154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4cf2dafe-e62f-4a20-aac5-41c1f9858fd6 req-febef76a-b460-4080-8f95-003e048f2da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d473f5-9af9-416d-817a-9c2da495a279", "name": "network-vif-plugged", "status": "completed", "tag": "24ccc5c3-f984-4cd6-822e-a50daaa8dd00"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:08.716080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4cf2dafe-e62f-4a20-aac5-41c1f9858fd6 req-febef76a-b460-4080-8f95-003e048f2da4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:08.716588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4cf2dafe-e62f-4a20-aac5-41c1f9858fd6 req-febef76a-b460-4080-8f95-003e048f2da4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:08.717039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4cf2dafe-e62f-4a20-aac5-41c1f9858fd6 req-febef76a-b460-4080-8f95-003e048f2da4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:08.730669 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4cf2dafe-e62f-4a20-aac5-41c1f9858fd6 req-febef76a-b460-4080-8f95-003e048f2da4 service nova] Creating event network-vif-plugged:24ccc5c3-f984-4cd6-822e-a50daaa8dd00 for instance 39d473f5-9af9-416d-817a-9c2da495a279 on n-h2-836830-13 Aug 29 16:30:08.735767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4cf2dafe-e62f-4a20-aac5-41c1f9858fd6 req-febef76a-b460-4080-8f95-003e048f2da4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 Aug 29 16:30:08.736371 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3606/7037] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:30:09.109010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:09.109634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:09.117035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:09.117530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:09.118049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:09.118745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:09.119242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:09.119759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:09.256718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:09.265198 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a271c509-57d7-43ae-8737-f584048806f5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.160792 Aug 29 16:30:09.265780 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3432/7038] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:09 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:10.287622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:10.288337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:10.295666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:10.296171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:10.296623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:10.297366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:10.297839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:10.298278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:10.439459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:10.447470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-118cfb22-4837-4433-af3d-54804f4df234 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1267 microversion: 2.1 time: 0.164999 Aug 29 16:30:10.448371 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3607/7039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:10 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:11.470689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:11.471335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:11.478160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:11.478649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:11.479380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:11.480083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:11.480565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:11.481005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:11.616198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:11.625506 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1ef5204-2c87-4fa8-97e3-32f8027d565c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1453 microversion: 2.1 time: 0.158637 Aug 29 16:30:11.626304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3433/7040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:11 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:11.647923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:30:11.648556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:30:11.656227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:11.656731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:11.657180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:11.657880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:11.658352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:11.658791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:11.795677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:30:11.803488 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b4da229b-9883-470a-a640-684e9c63c839 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1453 microversion: 2.1 time: 0.159503 Aug 29 16:30:11.804069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3608/7041] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:30:11 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:30:13.402198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-493fd145-da96-4833-9523-2395e3a5985d req-5eda09d7-d716-43b1-b831-7576b327cc2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d473f5-9af9-416d-817a-9c2da495a279", "tag": "24ccc5c3-f984-4cd6-822e-a50daaa8dd00"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:30:13.413259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-493fd145-da96-4833-9523-2395e3a5985d req-5eda09d7-d716-43b1-b831-7576b327cc2a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:30:13.413747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-493fd145-da96-4833-9523-2395e3a5985d req-5eda09d7-d716-43b1-b831-7576b327cc2a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:30:13.414183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-493fd145-da96-4833-9523-2395e3a5985d req-5eda09d7-d716-43b1-b831-7576b327cc2a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:30:13.426133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-493fd145-da96-4833-9523-2395e3a5985d req-5eda09d7-d716-43b1-b831-7576b327cc2a service nova] Creating event network-changed:24ccc5c3-f984-4cd6-822e-a50daaa8dd00 for instance 39d473f5-9af9-416d-817a-9c2da495a279 on n-h2-836830-13 Aug 29 16:30:13.431661 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-493fd145-da96-4833-9523-2395e3a5985d req-5eda09d7-d716-43b1-b831-7576b327cc2a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034205 Aug 29 16:30:13.432783 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3434/7042] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:42.497441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:42.498816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=54 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:42.500583 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:31:42.500837 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 (ip 10.222.0.83) !!! Aug 29 16:31:42.501750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=24 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:42.502508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=56 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:31:42.503820 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:31:42.504289 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 16:31:42.505763 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:31:42.505882 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 16:31:42.507875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:42.508639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:42.512928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7fe19494-16a8-4e0a-a384-1d6c7b566a5b req-61d8ce32-2451-4fbd-bdad-96b438fbc9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d473f5-9af9-416d-817a-9c2da495a279", "tag": "24ccc5c3-f984-4cd6-822e-a50daaa8dd00"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:42.519537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:42.520179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:42.520734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:42.521555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:42.522145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:42.522799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:42.527664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7fe19494-16a8-4e0a-a384-1d6c7b566a5b req-61d8ce32-2451-4fbd-bdad-96b438fbc9f5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:42.529751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7fe19494-16a8-4e0a-a384-1d6c7b566a5b req-61d8ce32-2451-4fbd-bdad-96b438fbc9f5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:42.530367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7fe19494-16a8-4e0a-a384-1d6c7b566a5b req-61d8ce32-2451-4fbd-bdad-96b438fbc9f5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:42.543346 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7fe19494-16a8-4e0a-a384-1d6c7b566a5b req-61d8ce32-2451-4fbd-bdad-96b438fbc9f5 service nova] Creating event network-changed:24ccc5c3-f984-4cd6-822e-a50daaa8dd00 for instance 39d473f5-9af9-416d-817a-9c2da495a279 on n-h2-836830-13 Aug 29 16:31:42.548673 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7fe19494-16a8-4e0a-a384-1d6c7b566a5b req-61d8ce32-2451-4fbd-bdad-96b438fbc9f5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050050 Aug 29 16:31:42.549281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3435/7043] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:42.552121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:31:42.634095 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8acc4a23-5ba7-493d-b0e5-059358475f89 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 204 len: 0 microversion: 2.1 time: 0.138791 Aug 29 16:31:42.634890 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3609/7044] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:31:42 2022] DELETE /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:31:42.644149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:42.644979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:42.653286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:42.653858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:42.654366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:42.655172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:42.655715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:42.657117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:42.864696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:42.874109 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e0d0764-0b28-4a13-bad3-53a70c33fb26 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1578 microversion: 2.1 time: 0.234111 Aug 29 16:31:42.874812 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3436/7045] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:42 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:43.896555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:43.897662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:43.905172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:43.905684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:43.906140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:43.906857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:43.907358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:43.907804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:44.105400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:44.113284 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-82c7061d-9d4b-41b1-8488-b81e4c30fbeb tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1578 microversion: 2.1 time: 0.221088 Aug 29 16:31:44.113856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3610/7046] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:43 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1578 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:44.984803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bb5a8cdc-2438-444d-9d2b-49f9564cc931 req-f223eeea-c570-48f5-9731-ecff390db27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d473f5-9af9-416d-817a-9c2da495a279", "name": "network-vif-deleted", "tag": "24ccc5c3-f984-4cd6-822e-a50daaa8dd00"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:44.995499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bb5a8cdc-2438-444d-9d2b-49f9564cc931 req-f223eeea-c570-48f5-9731-ecff390db27c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:44.995973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bb5a8cdc-2438-444d-9d2b-49f9564cc931 req-f223eeea-c570-48f5-9731-ecff390db27c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:44.996399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bb5a8cdc-2438-444d-9d2b-49f9564cc931 req-f223eeea-c570-48f5-9731-ecff390db27c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:45.007674 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bb5a8cdc-2438-444d-9d2b-49f9564cc931 req-f223eeea-c570-48f5-9731-ecff390db27c service nova] Creating event network-vif-deleted:24ccc5c3-f984-4cd6-822e-a50daaa8dd00 for instance 39d473f5-9af9-416d-817a-9c2da495a279 on n-h2-836830-13 Aug 29 16:31:45.013404 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bb5a8cdc-2438-444d-9d2b-49f9564cc931 req-f223eeea-c570-48f5-9731-ecff390db27c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032299 Aug 29 16:31:45.014011 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3437/7047] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:45.133859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:45.134493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:45.141673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:45.142191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:45.142672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:45.143418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:45.143892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:45.144363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:45.209376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:45.218198 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dcf77259-7285-44a9-852b-932f50089c8c tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1226 microversion: 2.1 time: 0.088279 Aug 29 16:31:45.218711 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3611/7048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:45 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:46.240962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:46.241679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:46.248990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:46.249486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:46.249930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:46.250627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:46.251112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:46.251543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:46.318194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:46.326650 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-83ba5676-2fef-4e1a-84fb-6ba707b557c4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1226 microversion: 2.1 time: 0.090857 Aug 29 16:31:46.327280 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3438/7049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:46 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:47.348041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:47.348596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:47.355699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:47.356208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:47.356659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:47.357368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:47.357837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:47.358275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:47.426763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:47.436122 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fd35fe9f-831e-4bff-a93c-5799584a81fa tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1226 microversion: 2.1 time: 0.091973 Aug 29 16:31:47.436781 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3612/7050] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:47 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:48.457550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:48.458201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:48.466306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:48.466884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:48.467361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:48.468058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:48.468513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:48.468941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:48.537092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:48.545170 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b109f5fe-fb26-477e-902e-8494e02d0f3e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1226 microversion: 2.1 time: 0.091571 Aug 29 16:31:48.545778 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3439/7051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:48 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:49.565857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:49.566489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:49.573897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:49.574409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:49.574870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:49.575608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:49.576086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:49.576532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:49.610224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:49.610728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:49.611214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:49.611681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lazy-loading 'fault' on Instance uuid 39d473f5-9af9-416d-817a-9c2da495a279 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:31:49.656160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:49.664288 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fa93b675-4b34-49fb-a6e7-b0c72dc8ed72 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 200 len: 1231 microversion: 2.1 time: 0.102393 Aug 29 16:31:49.664931 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3613/7052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:49 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:50.687871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:50.688497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 39d473f5-9af9-416d-817a-9c2da495a279] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:50.695894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:50.696506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:50.697000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:50.697664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:50.698385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:50.698815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:50.712738 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 39d473f5-9af9-416d-817a-9c2da495a279 could not be found. Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 HTTP/1.1 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 39d473f5-9af9-416d-817a-9c2da495a279 could not be found. Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '39d473f5-9af9-416d-817a-9c2da495a279'} Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d473f5-9af9-416d-817a-9c2da495a279 could not be found. Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d473f5-9af9-416d-817a-9c2da495a279 could not be found. Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:31:50.714489 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d473f5-9af9-416d-817a-9c2da495a279 could not be found. Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 39d473f5-9af9-416d-817a-9c2da495a279 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-97de99fe-409e-4efa-a18e-2c9b12d562b8 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279" status: 404 len: 111 microversion: 2.1 time: 0.032043 Aug 29 16:31:50.718791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3440/7053] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:50 2022] GET /compute/v2.1/servers/39d473f5-9af9-416d-817a-9c2da495a279 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:31:56.970819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:56.971935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:56.973509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6121b273-46fb-4025-89c1-9cdd54f79b65 req-77e356a5-19e3-4fb1-b601-59d1d9ed2c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9acf413-9499-4ade-b5be-682c8c4f5e43", "tag": "e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:56.982234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:56.983215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:56.984335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:56.985522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:56.986850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:56.987594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:56.988077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6121b273-46fb-4025-89c1-9cdd54f79b65 req-77e356a5-19e3-4fb1-b601-59d1d9ed2c83 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:56.988797 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6121b273-46fb-4025-89c1-9cdd54f79b65 req-77e356a5-19e3-4fb1-b601-59d1d9ed2c83 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:56.989318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6121b273-46fb-4025-89c1-9cdd54f79b65 req-77e356a5-19e3-4fb1-b601-59d1d9ed2c83 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:57.008042 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6121b273-46fb-4025-89c1-9cdd54f79b65 req-77e356a5-19e3-4fb1-b601-59d1d9ed2c83 service nova] Creating event network-changed:e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45 for instance c9acf413-9499-4ade-b5be-682c8c4f5e43 on n-h1-836830-13 Aug 29 16:31:57.014167 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6121b273-46fb-4025-89c1-9cdd54f79b65 req-77e356a5-19e3-4fb1-b601-59d1d9ed2c83 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044805 Aug 29 16:31:57.015236 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3441/7054] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:57.019055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:31:57.117078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fef9fabc-1ca1-418a-addb-9ece2aac55ad tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 204 len: 0 microversion: 2.1 time: 0.149690 Aug 29 16:31:57.118535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3614/7055] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:31:56 2022] DELETE /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:31:57.128445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:57.129491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:57.138202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:57.139047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:57.139731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:57.140830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:57.141521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:57.142634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:57.296335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:57.304560 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a7a188e-2b51-4996-8f72-35593b12d273 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1578 microversion: 2.1 time: 0.181203 Aug 29 16:31:57.305155 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3442/7056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:57 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:31:58.327064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:58.327755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:58.334826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:58.335357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:58.335812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:58.336532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:58.337558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:58.338007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:58.479352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:58.487401 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c510b8e5-94a6-4730-927b-f91adc09dcd6 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1578 microversion: 2.1 time: 0.165152 Aug 29 16:31:58.487982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3615/7057] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:58 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:31:59.225079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-673399db-1be6-4b89-9bc9-dbd8fa3cfd3c req-d63038cb-7140-4ae6-bf6d-9370b73a026d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9acf413-9499-4ade-b5be-682c8c4f5e43", "name": "network-vif-deleted", "tag": "e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:31:59.235326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-673399db-1be6-4b89-9bc9-dbd8fa3cfd3c req-d63038cb-7140-4ae6-bf6d-9370b73a026d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:59.235819 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-673399db-1be6-4b89-9bc9-dbd8fa3cfd3c req-d63038cb-7140-4ae6-bf6d-9370b73a026d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:59.236258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-673399db-1be6-4b89-9bc9-dbd8fa3cfd3c req-d63038cb-7140-4ae6-bf6d-9370b73a026d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:59.249893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-673399db-1be6-4b89-9bc9-dbd8fa3cfd3c req-d63038cb-7140-4ae6-bf6d-9370b73a026d service nova] Creating event network-vif-deleted:e2e88e88-cba2-4e8a-b6f7-1719b3a2ed45 for instance c9acf413-9499-4ade-b5be-682c8c4f5e43 on n-h1-836830-13 Aug 29 16:31:59.255070 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-673399db-1be6-4b89-9bc9-dbd8fa3cfd3c req-d63038cb-7140-4ae6-bf6d-9370b73a026d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107257 Aug 29 16:31:59.256051 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3443/7058] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:31:59.509915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:31:59.510713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:31:59.518221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:59.518986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:59.519464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:59.520179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:31:59.520668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:31:59.521139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:31:59.591772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:31:59.600897 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31b29ab5-04ca-433b-b843-686e42c12fc2 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1226 microversion: 2.1 time: 0.094997 Aug 29 16:31:59.601677 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3616/7059] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:31:59 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:00.624215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:00.624919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:00.631409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:00.632106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:00.632241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:00.633132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:00.633714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:00.634776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:00.699862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:00.708403 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0d8c7577-9dc5-4053-8c19-05dc80ec90ae tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1226 microversion: 2.1 time: 0.090232 Aug 29 16:32:00.708987 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3444/7060] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:00 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:01.729784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:01.730528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:01.737659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:01.738272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:01.738729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:01.739474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:01.739951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:01.740395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:01.808956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:01.816862 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-873aa5dc-79f7-481b-8be2-27dbe2d591e5 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1226 microversion: 2.1 time: 0.091516 Aug 29 16:32:01.817439 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3617/7061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:01 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:02.838544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:02.839213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:02.846215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:02.846692 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:02.847145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:02.847831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:02.848275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:02.848698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:02.916514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '616303b5564840e3bb07d4c9c22c2049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4f468e4b694771b47f56110a9ed798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:02.924140 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06d576ee-626b-41ee-8687-2807eeebd351 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 200 len: 1226 microversion: 2.1 time: 0.090178 Aug 29 16:32:02.924720 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3445/7062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:02 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:03.946081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:03.947403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: c9acf413-9499-4ade-b5be-682c8c4f5e43] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:03.953916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:03.954413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:03.954864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:03.955593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:03.956062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:03.956500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:03.970934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance c9acf413-9499-4ade-b5be-682c8c4f5e43 could not be found. Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 HTTP/1.1 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance c9acf413-9499-4ade-b5be-682c8c4f5e43 could not be found. Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'c9acf413-9499-4ade-b5be-682c8c4f5e43'} Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9acf413-9499-4ade-b5be-682c8c4f5e43 could not be found. Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9acf413-9499-4ade-b5be-682c8c4f5e43 could not be found. Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:03.972620 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9acf413-9499-4ade-b5be-682c8c4f5e43 could not be found. Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance c9acf413-9499-4ade-b5be-682c8c4f5e43 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be54f951-0c78-4f7b-a235-7cd45846b20e tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43" status: 404 len: 111 microversion: 2.1 time: 0.032186 Aug 29 16:32:03.976875 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3618/7063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:03 2022] GET /compute/v2.1/servers/c9acf413-9499-4ade-b5be-682c8c4f5e43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:04.426178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:04.426677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:04.434504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:04.434998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:04.435469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:04.436179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:04.436646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:04.437075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:04.451863 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 HTTP/1.1 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '8d33e4a1-2923-4a8c-bcd4-16b02682a5e9'} Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:32:04.453567 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-53fe45c2-d31e-473d-8a9e-4ce682b0c6d4 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 404 len: 111 microversion: 2.1 time: 0.033222 Aug 29 16:32:04.457331 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3446/7064] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:32:04 2022] DELETE /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:04.463805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:04.464436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] [instance: 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:04.470467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:04.470964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:04.471448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:04.472146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:04.472614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:04.473054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:04.486641 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] HTTP exception thrown: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Request method failure captured: Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 HTTP/1.1 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOdS-d4fdzm_WS1zR4bAExznORbucHkDM9oCP2m0dSueuIhKqeKP-kyeQcnJUkftVBDzJcqw5ql3dSN2jGo2vw5NtXiTEu6m858aFDuFNYlF5l2KpCtAp-usxhfDvaga8goJn8y2eVi1CrTg1dvl1DIXTyG1ks8YVTGvnVfnnDa7zTU Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_3e4f468e4b694771b47f56110a9ed798", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/3e4f468e4b694771b47f56110a9ed798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/3e4f468e4b694771b47f56110a9ed798"}]}] Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 3e4f468e4b694771b47f56110a9ed798 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestVolumeBootPattern-360313676 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 616303b5564840e3bb07d4c9c22c2049 Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestVolumeBootPattern-360313676-project Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '8d33e4a1-2923-4a8c-bcd4-16b02682a5e9'} Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:04.488299 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Returning 404 to user: Instance 8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ce1cfaa-b9a4-4803-ae1a-ba8645bd6101 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9" status: 404 len: 111 microversion: 2.1 time: 0.029956 Aug 29 16:32:04.492368 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3619/7065] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:04 2022] GET /compute/v2.1/servers/8d33e4a1-2923-4a8c-bcd4-16b02682a5e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:07.896136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-498e0ef1-28cc-4bec-b82e-4977d2bcad74 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] Calling method '.version_select at 0x7f32edaf1ee0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:07.936084 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-498e0ef1-28cc-4bec-b82e-4977d2bcad74 tempest-TestVolumeBootPattern-360313676 tempest-TestVolumeBootPattern-360313676-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1677650564" status: 202 len: 0 microversion: 2.1 time: 0.043617 Aug 29 16:32:07.936687 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3447/7066] 10.222.0.83 () {58 vars in 1263 bytes} [Mon Aug 29 16:32:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1677650564 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:32:26.152142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:26.152934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:26.270099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1981674430", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:26.328658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] validate_networks() for None {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:32:26.635319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:32:26.635760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:32:26.636282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:32:26.636837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:32:26.637275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:32:26.647100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:26.647607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:26.648064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:26.648808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:26.649343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:26.649860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:26.669737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Getting quotas for project 30da8aecfbd64d1b9b6516c51d133d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:26.675120 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Getting quotas for user 7ec5f550e4dc42ed9b7de24a22259cfd and project 30da8aecfbd64d1b9b6516c51d133d9f. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:26.689243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:32:26.693114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:32:26.773096 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [e385b3e2-43e8-4aac-8448-f0ab2ce197f4] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 16:32:27.780974 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [e385b3e2-43e8-4aac-8448-f0ab2ce197f4] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 45408. Aug 29 16:32:27.784876 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-22c9634d-e5be-4881-88a5-ef2165850c77 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639035 Aug 29 16:32:27.785535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3620/7067] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:32:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:32:27.798426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1d91787-0509-468c-80ce-c1007bb28bc0 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:27.799066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1d91787-0509-468c-80ce-c1007bb28bc0 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:27.801131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=48 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:27.802028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:27.858328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1d91787-0509-468c-80ce-c1007bb28bc0 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:27.865518 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1d91787-0509-468c-80ce-c1007bb28bc0 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1222 microversion: 2.1 time: 0.071472 Aug 29 16:32:27.866082 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3448/7068] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:27 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:28.893264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:28.893900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:28.902501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:28.903281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:28.903999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:28.904782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:28.905323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:28.905934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:28.973675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:28.982046 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a7081cbe-e5ac-46fe-baa2-0c980bd766db tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1280 microversion: 2.1 time: 0.099890 Aug 29 16:32:28.982628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3621/7069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:28 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:30.003198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:30.003939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:30.011409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:30.011828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:30.012297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:30.013004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:30.013462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:30.013888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:30.212838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:30.220906 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bfc12a1-bc3d-4105-947b-d6b66ac9dec4 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1322 microversion: 2.1 time: 0.221636 Aug 29 16:32:30.221487 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3449/7070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:29 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:32:30.287704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3c322be0-f0d9-4a6d-93ff-c14b30bc5122 req-2916ff1d-fed2-4cbd-adb0-53c6b0d2b850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6b8163-5628-4dca-8b65-509d5efbd359", "tag": "c589310c-b6ed-460d-a90b-f6203698c205"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:30.303453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3c322be0-f0d9-4a6d-93ff-c14b30bc5122 req-2916ff1d-fed2-4cbd-adb0-53c6b0d2b850 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:30.303967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3c322be0-f0d9-4a6d-93ff-c14b30bc5122 req-2916ff1d-fed2-4cbd-adb0-53c6b0d2b850 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:30.304416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3c322be0-f0d9-4a6d-93ff-c14b30bc5122 req-2916ff1d-fed2-4cbd-adb0-53c6b0d2b850 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:30.317066 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3c322be0-f0d9-4a6d-93ff-c14b30bc5122 req-2916ff1d-fed2-4cbd-adb0-53c6b0d2b850 service nova] Creating event network-changed:c589310c-b6ed-460d-a90b-f6203698c205 for instance 8e6b8163-5628-4dca-8b65-509d5efbd359 on n-h1-836830-13 Aug 29 16:32:30.322694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3c322be0-f0d9-4a6d-93ff-c14b30bc5122 req-2916ff1d-fed2-4cbd-adb0-53c6b0d2b850 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Aug 29 16:32:30.323265 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3622/7071] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:32:31.241780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:31.242406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:31.250089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:31.250581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:31.251043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:31.251790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:31.252285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:31.252742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:31.385157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:31.393434 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e513638e-8aa9-43e2-b443-a894ebf3bd74 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1322 microversion: 2.1 time: 0.155627 Aug 29 16:32:31.394006 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3450/7072] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:31 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:32.416600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:32.417463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:32.423863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:32.424370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:32.424828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:32.425544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:32.426019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:32.426460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:32.561982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:32.570006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2fdb5527-096e-4684-9e3c-3ddbbd305899 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1322 microversion: 2.1 time: 0.159738 Aug 29 16:32:32.570641 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3623/7073] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:32 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:33.593174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:33.593768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:33.601006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:33.601502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:33.602366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:33.603363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:33.603923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:33.604362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:33.748776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:33.756601 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15a3b118-13ae-4846-95c6-bc3ee73759ee tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1322 microversion: 2.1 time: 0.168170 Aug 29 16:32:33.757178 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3451/7074] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:33 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:32:34.498190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-5dfdef3d-607f-488c-96b0-7cbde294dbe7 req-1ea18621-0572-4530-a3e5-b95c8c1c5b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6b8163-5628-4dca-8b65-509d5efbd359", "name": "network-vif-plugged", "status": "completed", "tag": "c589310c-b6ed-460d-a90b-f6203698c205"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:34.508177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5dfdef3d-607f-488c-96b0-7cbde294dbe7 req-1ea18621-0572-4530-a3e5-b95c8c1c5b7e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:34.508681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5dfdef3d-607f-488c-96b0-7cbde294dbe7 req-1ea18621-0572-4530-a3e5-b95c8c1c5b7e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:34.509725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-5dfdef3d-607f-488c-96b0-7cbde294dbe7 req-1ea18621-0572-4530-a3e5-b95c8c1c5b7e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:34.521125 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-5dfdef3d-607f-488c-96b0-7cbde294dbe7 req-1ea18621-0572-4530-a3e5-b95c8c1c5b7e service nova] Creating event network-vif-plugged:c589310c-b6ed-460d-a90b-f6203698c205 for instance 8e6b8163-5628-4dca-8b65-509d5efbd359 on n-h1-836830-13 Aug 29 16:32:34.526161 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-5dfdef3d-607f-488c-96b0-7cbde294dbe7 req-1ea18621-0572-4530-a3e5-b95c8c1c5b7e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032419 Aug 29 16:32:34.526776 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3624/7075] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:34.777966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:34.778601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:34.785581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:34.786394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:34.786851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:34.787555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:34.788009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:34.788456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:34.921962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:34.929695 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d467bb2-2755-439e-acc2-03e660096247 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1322 microversion: 2.1 time: 0.155859 Aug 29 16:32:34.930267 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3452/7076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:34 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:35.951947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:35.952691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:35.959214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:35.959650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:35.960095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:35.960792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:35.961386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:35.961697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.099355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:36.108610 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79bb89ea-987f-489d-b75f-4fa252663020 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1471 microversion: 2.1 time: 0.162041 Aug 29 16:32:36.109191 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3625/7077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:35 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:36.187991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0fd3a1b9-2a9f-4d07-88b7-81c30dc19341 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Calling method '.version_select at 0x7f32ee542f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.256219 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0fd3a1b9-2a9f-4d07-88b7-81c30dc19341 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/6d98629c1b6e4c47a74fa2d6da83f47e" status: 200 len: 371 microversion: 2.1 time: 0.129290 Aug 29 16:32:36.256833 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3453/7078] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 16:32:36 2022] GET /compute/v2.1/os-quota-sets/6d98629c1b6e4c47a74fa2d6da83f47e => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:36.269214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf787e11-10f8-4be0-9e74-d759b30aa513 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1486686272", "id": 774674231, "os-flavor-access:is_public": "True"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:36.287749 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf787e11-10f8-4be0-9e74-d759b30aa513 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022280 Aug 29 16:32:36.288349 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3626/7079] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:32:36 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:36.300108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "774674231"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:36.302434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:36.308663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.309152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.309590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.310285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.310745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.311209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.501044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '873ca821b87f41eda08246e7a98432b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d98629c1b6e4c47a74fa2d6da83f47e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:36.507635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1486686272 {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:32:36.514092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.514573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.515004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.515737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.516187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.516608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.537087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Getting quotas for project 30da8aecfbd64d1b9b6516c51d133d9f. Resources: {'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:36.542566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Getting quotas for user 7ec5f550e4dc42ed9b7de24a22259cfd and project 30da8aecfbd64d1b9b6516c51d133d9f. Resources: {'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:36.554173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.compute.api [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] ram quota exceeded for 6d98629c1b6e4c47a74fa2d6da83f47e, tried to resize instance. Aug 29 16:32:36.554728 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Request method failure captured: Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359/action HTTP/1.1 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 38 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOoZqTM_lk44G2X4AovJHeT51NPZQTHgFUWvzjrIPIauwjw9k1atz8rBq09SvAOYht2eiTZU2vE_Ax_LzhQJa6MXOeUZA1dYYR9O6HmqPSYN74YNntVVh6lMHgBPu5ufyo6qiahkrM8V6o-sthxAJPk0imxUyzO-0Er0C8neJ_Axnjo Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6d98629c1b6e4c47a74fa2d6da83f47e Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-4475805 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member,admin Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member,admin Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d98629c1b6e4c47a74fa2d6da83f47e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d98629c1b6e4c47a74fa2d6da83f47e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d98629c1b6e4c47a74fa2d6da83f47e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d98629c1b6e4c47a74fa2d6da83f47e"}]}] Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersAdminNegativeTestJSON-4475805 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6d98629c1b6e4c47a74fa2d6da83f47e Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-4475805 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersAdminNegativeTestJSON-4475805-project-admin Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 873ca821b87f41eda08246e7a98432b6 Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersAdminNegativeTestJSON-4475805-project-admin Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: {"resize": {"flavorRef": "774674231"}} Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '8e6b8163-5628-4dca-8b65-509d5efbd359', 'body': {'resize': {'flavorRef': '774674231'}}} Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:32:36.570780 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a178277a-815c-4ed3-b5b5-70ccdde593db tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359/action" status: 403 len: 118 microversion: 2.1 time: 0.276834 Aug 29 16:32:36.575885 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3454/7080] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:32:36 2022] POST /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359/action => generated 118 bytes in 278 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:36.582171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e6a3d3e-41b6-4ff1-9389-c53a98e94603 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.599311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e6a3d3e-41b6-4ff1-9389-c53a98e94603 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/774674231" status: 202 len: 0 microversion: 2.1 time: 0.020772 Aug 29 16:32:36.599881 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3627/7081] 10.222.0.83 () {58 vars in 1158 bytes} [Mon Aug 29 16:32:36 2022] DELETE /compute/v2.1/flavors/774674231 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:32:36.608129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7531199-a095-48f7-a79a-29022baf7644 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.629149 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7531199-a095-48f7-a79a-29022baf7644 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024629 Aug 29 16:32:36.629717 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3455/7082] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 16:32:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:36.651611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9395e9a3-d05b-466e-a1b0-d70ba7981a0e tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Calling method '.version_select at 0x7f32edcfe040>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.660107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:36.682634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:36.724297 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9395e9a3-d05b-466e-a1b0-d70ba7981a0e tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "GET /compute/v2.1/os-quota-sets/6d98629c1b6e4c47a74fa2d6da83f47e" status: 200 len: 371 microversion: 2.1 time: 0.078297 Aug 29 16:32:36.724871 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3628/7083] 10.222.0.83 () {58 vars in 1242 bytes} [Mon Aug 29 16:32:36 2022] GET /compute/v2.1/os-quota-sets/6d98629c1b6e4c47a74fa2d6da83f47e => generated 371 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:36.738881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b87e906-ada8-4826-85ba-9507cf026279 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1091832241", "id": 1678594133, "os-flavor-access:is_public": "True"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:36.760036 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b87e906-ada8-4826-85ba-9507cf026279 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.026438 Aug 29 16:32:36.760656 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3456/7084] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:32:36 2022] POST /compute/v2.1/flavors => generated 437 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:36.774115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1678594133"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:36.777030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:36.784417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.784925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.785407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.786147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.786623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.787091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.876758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '873ca821b87f41eda08246e7a98432b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d98629c1b6e4c47a74fa2d6da83f47e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:36.883395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1091832241 {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:32:36.890883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.891420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.891872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.892615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:36.893090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:36.893533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:36.915381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Getting quotas for project 30da8aecfbd64d1b9b6516c51d133d9f. Resources: {'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:36.920836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Getting quotas for user 7ec5f550e4dc42ed9b7de24a22259cfd and project 30da8aecfbd64d1b9b6516c51d133d9f. Resources: {'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:36.935102 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.compute.api [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] cores quota exceeded for 6d98629c1b6e4c47a74fa2d6da83f47e, tried to resize instance. Aug 29 16:32:36.935645 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Request method failure captured: Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359/action HTTP/1.1 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 39 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOoZqTM_lk44G2X4AovJHeT51NPZQTHgFUWvzjrIPIauwjw9k1atz8rBq09SvAOYht2eiTZU2vE_Ax_LzhQJa6MXOeUZA1dYYR9O6HmqPSYN74YNntVVh6lMHgBPu5ufyo6qiahkrM8V6o-sthxAJPk0imxUyzO-0Er0C8neJ_Axnjo Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6d98629c1b6e4c47a74fa2d6da83f47e Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-4475805 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member,admin Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member,admin Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d98629c1b6e4c47a74fa2d6da83f47e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6d98629c1b6e4c47a74fa2d6da83f47e", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6d98629c1b6e4c47a74fa2d6da83f47e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6d98629c1b6e4c47a74fa2d6da83f47e"}]}] Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersAdminNegativeTestJSON-4475805 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6d98629c1b6e4c47a74fa2d6da83f47e Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-4475805 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersAdminNegativeTestJSON-4475805-project-admin Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 873ca821b87f41eda08246e7a98432b6 Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersAdminNegativeTestJSON-4475805-project-admin Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: {"resize": {"flavorRef": "1678594133"}} Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '8e6b8163-5628-4dca-8b65-509d5efbd359', 'body': {'resize': {'flavorRef': '1678594133'}}} Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:32:36.937787 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-edfa6223-826a-4de5-bdcc-a946dc9742c0 tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "POST /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359/action" status: 403 len: 113 microversion: 2.1 time: 0.169131 Aug 29 16:32:36.941691 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3629/7085] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:32:36 2022] POST /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359/action => generated 113 bytes in 170 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:36.949278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26e17aee-5715-484a-9d5f-87929c09e48f tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.966449 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26e17aee-5715-484a-9d5f-87929c09e48f tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "DELETE /compute/v2.1/flavors/1678594133" status: 202 len: 0 microversion: 2.1 time: 0.021799 Aug 29 16:32:36.967017 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3457/7086] 10.222.0.83 () {58 vars in 1161 bytes} [Mon Aug 29 16:32:36 2022] DELETE /compute/v2.1/flavors/1678594133 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:32:36.974963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89ae61e2-c036-45f4-b98b-7d66744bd43a tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:36.996201 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89ae61e2-c036-45f4-b98b-7d66744bd43a tempest-ServersAdminNegativeTestJSON-4475805 tempest-ServersAdminNegativeTestJSON-4475805-project-admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024895 Aug 29 16:32:36.996698 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3630/7087] 10.222.0.83 () {58 vars in 1146 bytes} [Mon Aug 29 16:32:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:37.016522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:37.017030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:37.023064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:37.023551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:37.023994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:37.024951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:37.025419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:37.025847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:37.065417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:32:37.147865 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-43f91d9b-3040-4d99-8b26-1e5b1825aaed tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 204 len: 0 microversion: 2.1 time: 0.134975 Aug 29 16:32:37.152074 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3458/7088] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:32:37 2022] DELETE /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:32:37.157162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:37.157795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:37.163889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:37.164391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:37.164841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:37.165603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:37.166067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:37.166500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:37.298276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:37.306721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8dee67d0-ab21-43c5-ad77-3a4180fd7290 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1477 microversion: 2.1 time: 0.153376 Aug 29 16:32:37.307322 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3631/7089] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:37 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:38.328365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:38.328974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:38.336599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:38.337672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:38.338038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:38.338735 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:38.339211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:38.339636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:38.566171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec5f550e4dc42ed9b7de24a22259cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30da8aecfbd64d1b9b6516c51d133d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:38.575068 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-23d39fc3-152d-4d3f-8847-2c3a033c0ffd tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 200 len: 1477 microversion: 2.1 time: 0.251234 Aug 29 16:32:38.575614 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3459/7090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:38 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 1477 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:38.912893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b75c7b36-125e-4be0-925e-f04a29eceae9 req-97dd5aae-566e-4d0e-af2f-dcc559c4b90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6b8163-5628-4dca-8b65-509d5efbd359", "name": "network-vif-deleted", "tag": "c589310c-b6ed-460d-a90b-f6203698c205"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:38.933025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b75c7b36-125e-4be0-925e-f04a29eceae9 req-97dd5aae-566e-4d0e-af2f-dcc559c4b90b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:38.933977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b75c7b36-125e-4be0-925e-f04a29eceae9 req-97dd5aae-566e-4d0e-af2f-dcc559c4b90b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:38.934674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b75c7b36-125e-4be0-925e-f04a29eceae9 req-97dd5aae-566e-4d0e-af2f-dcc559c4b90b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:38.947859 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b75c7b36-125e-4be0-925e-f04a29eceae9 req-97dd5aae-566e-4d0e-af2f-dcc559c4b90b service nova] Creating event network-vif-deleted:c589310c-b6ed-460d-a90b-f6203698c205 for instance 8e6b8163-5628-4dca-8b65-509d5efbd359 on n-h1-836830-13 Aug 29 16:32:38.953924 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b75c7b36-125e-4be0-925e-f04a29eceae9 req-97dd5aae-566e-4d0e-af2f-dcc559c4b90b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045090 Aug 29 16:32:38.955143 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3632/7091] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:32:39.596232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:39.596764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] [instance: 8e6b8163-5628-4dca-8b65-509d5efbd359] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:39.604376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:39.604855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:39.605287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:39.605993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:39.606441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:39.606857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:39.620902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] HTTP exception thrown: Instance 8e6b8163-5628-4dca-8b65-509d5efbd359 could not be found. Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Request method failure captured: Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 HTTP/1.1 Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOoZlXLRP39g4ghK_77-GX_nm5b353ln96kLDiFIWsjrgTcFw8HJ8D1nyU14DZRF6S5BxGpU75GeDi7kkO76ijm7cqdkT7ojm-Z9vhvwOo_P3j7AZvPMizta5PlSoXosnsxaxiqDrGsE5rLLtiiKsSJiDHtIa-kVHJ0cqofBlAahPqs Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 30da8aecfbd64d1b9b6516c51d133d9f Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-563820821 Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30da8aecfbd64d1b9b6516c51d133d9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_30da8aecfbd64d1b9b6516c51d133d9f", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/30da8aecfbd64d1b9b6516c51d133d9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/30da8aecfbd64d1b9b6516c51d133d9f"}]}] Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersAdminNegativeTestJSON-563820821 Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 30da8aecfbd64d1b9b6516c51d133d9f Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-563820821 Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersAdminNegativeTestJSON-563820821-project Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 7ec5f550e4dc42ed9b7de24a22259cfd Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersAdminNegativeTestJSON-563820821-project Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 8e6b8163-5628-4dca-8b65-509d5efbd359 could not be found. Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '8e6b8163-5628-4dca-8b65-509d5efbd359'} Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e6b8163-5628-4dca-8b65-509d5efbd359 could not be found. Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6b8163-5628-4dca-8b65-509d5efbd359 could not be found. Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:39.622551 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6b8163-5628-4dca-8b65-509d5efbd359 could not be found. Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] Returning 404 to user: Instance 8e6b8163-5628-4dca-8b65-509d5efbd359 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7cba0fba-e782-4b8c-b021-61170814e014 tempest-ServersAdminNegativeTestJSON-563820821 tempest-ServersAdminNegativeTestJSON-563820821-project] 10.222.0.83 "GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359" status: 404 len: 111 microversion: 2.1 time: 0.031813 Aug 29 16:32:39.626280 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3460/7092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:39 2022] GET /compute/v2.1/servers/8e6b8163-5628-4dca-8b65-509d5efbd359 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:32:46.397256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1392024553", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "90af370c-4191-4ea4-9f88-e9e1fcd7725b"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:46.454379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] validate_networks() for [('90af370c-4191-4ea4-9f88-e9e1fcd7725b', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:32:46.716763 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:46.892491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:32:46.893169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:32:46.893582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:32:46.894090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:32:46.894591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:32:46.903574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:46.906721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:46.907318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:46.907691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:46.910980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:46.911675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:46.912301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:46.941701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Getting quotas for project 40f75c929253424abd606d18c4b75a33. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:32:46.949076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Getting quotas for user b8318bf000774d6189903e8bc8333440 and project 40f75c929253424abd606d18c4b75a33. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:32:46.963689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:32:46.966404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:32:47.016045 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c03e219-85e4-4571-ae32-5077281c26ee tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758383 Aug 29 16:32:47.016860 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3633/7093] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:32:47.034651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed2b1333-833f-4a43-b55b-d491fb4b1045 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:47.035410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed2b1333-833f-4a43-b55b-d491fb4b1045 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:47.043815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:47.044966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:47.099560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed2b1333-833f-4a43-b55b-d491fb4b1045 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:47.107799 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed2b1333-833f-4a43-b55b-d491fb4b1045 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1215 microversion: 2.1 time: 0.083665 Aug 29 16:32:47.108399 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3461/7094] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:47 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:48.130523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-97dc8135-3fe0-4601-a0eb-d7d33b107f74 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:48.131181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-97dc8135-3fe0-4601-a0eb-d7d33b107f74 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:48.189226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-97dc8135-3fe0-4601-a0eb-d7d33b107f74 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:48.196287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-97dc8135-3fe0-4601-a0eb-d7d33b107f74 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1215 microversion: 2.1 time: 0.071040 Aug 29 16:32:48.197941 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3634/7095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:48 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:49.218640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7c82b3f2-a9c4-4d83-8b35-fb58e1684b8e tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:49.219394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7c82b3f2-a9c4-4d83-8b35-fb58e1684b8e tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:49.280548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7c82b3f2-a9c4-4d83-8b35-fb58e1684b8e tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:49.299896 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7c82b3f2-a9c4-4d83-8b35-fb58e1684b8e tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1215 microversion: 2.1 time: 0.085303 Aug 29 16:32:49.300798 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3462/7096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:49 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:50.324742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0cb019db-9c6b-49b7-824e-8abc8db6ea5d tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:50.325290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0cb019db-9c6b-49b7-824e-8abc8db6ea5d tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:50.377613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0cb019db-9c6b-49b7-824e-8abc8db6ea5d tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:50.385665 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0cb019db-9c6b-49b7-824e-8abc8db6ea5d tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1215 microversion: 2.1 time: 0.065707 Aug 29 16:32:50.386017 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3635/7097] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:50 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:51.405156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:51.405786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:51.407664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:51.414794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:51.415860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:51.416305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:51.417003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:51.417461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:51.417892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:51.483928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:51.491585 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11dbde60-d23f-493e-834a-fb7e4df577b9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1219 microversion: 2.1 time: 0.090359 Aug 29 16:32:51.492297 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3463/7098] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:51 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:52.512060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:52.512687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:52.520834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.521337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.521794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.522510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:52.522975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:52.523439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:52.596074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:52.605882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b152956-0661-423a-9932-8cb5e7543d25 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1273 microversion: 2.1 time: 0.096940 Aug 29 16:32:52.606629 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3636/7099] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:52 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:32:53.488066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-29297e3b-d91a-47f1-a71f-2edbd07e83cb req-390d3fc2-1e54-4f32-b1d2-f243c0397db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c8f18c-c98d-4ac0-ab6b-8ede2028c246", "tag": "1ee6548b-4b57-4641-bedb-840971b3e772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:53.499841 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29297e3b-d91a-47f1-a71f-2edbd07e83cb req-390d3fc2-1e54-4f32-b1d2-f243c0397db2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:53.500338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29297e3b-d91a-47f1-a71f-2edbd07e83cb req-390d3fc2-1e54-4f32-b1d2-f243c0397db2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:53.500919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29297e3b-d91a-47f1-a71f-2edbd07e83cb req-390d3fc2-1e54-4f32-b1d2-f243c0397db2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:53.514073 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-29297e3b-d91a-47f1-a71f-2edbd07e83cb req-390d3fc2-1e54-4f32-b1d2-f243c0397db2 service nova] Creating event network-changed:1ee6548b-4b57-4641-bedb-840971b3e772 for instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 on n-h1-836830-13 Aug 29 16:32:53.519147 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-29297e3b-d91a-47f1-a71f-2edbd07e83cb req-390d3fc2-1e54-4f32-b1d2-f243c0397db2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035395 Aug 29 16:32:53.519771 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3464/7100] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:53.626676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:53.627370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:53.634406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:53.634839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:53.635322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:53.636073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:53.636628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:53.637082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:53.770842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:53.780094 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-28e7c7a4-9c02-4e66-90d4-12cc64efdcd9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1315 microversion: 2.1 time: 0.157221 Aug 29 16:32:53.780702 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3637/7101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:53 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:54.801994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:54.802688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:54.809027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:54.809502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:54.809983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:54.810662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:54.811137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:54.811551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:54.950694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:54.958700 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a7ab618-d88d-4fe7-852e-042504701ce1 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1315 microversion: 2.1 time: 0.161846 Aug 29 16:32:54.959334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3465/7102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:54 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:55.979664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:55.980369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:55.987376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:55.987883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:55.988336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:55.989074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:55.989546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:55.989991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:56.126020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:56.133793 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-380d04ce-4105-4b97-8a5d-1d1496b67166 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1315 microversion: 2.1 time: 0.158236 Aug 29 16:32:56.134377 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3638/7103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:55 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:57.155491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:57.156115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:57.163244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:57.163734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:57.164174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:57.164869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:57.165327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:57.165758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:57.295345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:57.303061 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ecca9c5-1b85-4460-bc7a-cfdd46ac84a8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1315 microversion: 2.1 time: 0.151702 Aug 29 16:32:57.303625 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3466/7104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:57 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:58.328383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:58.329010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:58.330895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:58.332839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:58.340928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:58.341545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:58.342003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:58.342709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:58.343222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:58.343659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:58.346850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=66 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:58.484710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:58.493431 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d3c4f114-c054-4db6-8dab-b967ea952569 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1315 microversion: 2.1 time: 0.169509 Aug 29 16:32:58.494073 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3639/7105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:58 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:32:58.678003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-48a546d6-767a-495e-b17b-74ddb71d7e06 req-89e36442-084f-48e6-aac6-a6c85409b50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c8f18c-c98d-4ac0-ab6b-8ede2028c246", "name": "network-vif-plugged", "status": "completed", "tag": "1ee6548b-4b57-4641-bedb-840971b3e772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:32:58.682983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:32:58.689070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-48a546d6-767a-495e-b17b-74ddb71d7e06 req-89e36442-084f-48e6-aac6-a6c85409b50d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:58.689549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-48a546d6-767a-495e-b17b-74ddb71d7e06 req-89e36442-084f-48e6-aac6-a6c85409b50d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:58.689981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-48a546d6-767a-495e-b17b-74ddb71d7e06 req-89e36442-084f-48e6-aac6-a6c85409b50d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:58.703763 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-48a546d6-767a-495e-b17b-74ddb71d7e06 req-89e36442-084f-48e6-aac6-a6c85409b50d service nova] Creating event network-vif-plugged:1ee6548b-4b57-4641-bedb-840971b3e772 for instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 on n-h1-836830-13 Aug 29 16:32:58.708922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-48a546d6-767a-495e-b17b-74ddb71d7e06 req-89e36442-084f-48e6-aac6-a6c85409b50d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110721 Aug 29 16:32:58.709525 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3467/7106] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:32:59.514532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:32:59.515184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:32:59.522164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:59.522707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:59.523190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:59.523936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:32:59.524411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:32:59.524857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:32:59.657478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:32:59.666089 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-12e39213-4b8d-4344-9d2f-bc2ee130531b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1315 microversion: 2.1 time: 0.156221 Aug 29 16:32:59.666664 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3640/7107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:32:59 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:00.684879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:00.690254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:00.690952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:00.697866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:00.698351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:00.698782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:00.699792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:00.700400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:00.700827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:00.832098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:00.839808 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69059c70-7a18-459d-96c0-12381af4bb18 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1503 microversion: 2.1 time: 0.156624 Aug 29 16:33:00.840959 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3468/7108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:00 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:00.861059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:00.863499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:00.865534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:00.872289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:00.872792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:00.873275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:00.873983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:00.874454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:00.874894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:00.904792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:00.910964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Old instance type m1.heat2, new instance type m1.heat {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:33:00.917349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:33:00.917789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:33:00.918393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:33:00.918977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:33:00.919213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:33:00.984181 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1e6077f-8555-4b33-872a-3f0f1d5a115c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "POST /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246/action" status: 202 len: 0 microversion: 2.1 time: 0.126991 Aug 29 16:33:00.984803 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3641/7109] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:33:00 2022] POST /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:33:00.993442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:00.994042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:01.000180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:01.000745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:01.001251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:01.002028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:01.002555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:01.003069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:01.135099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:01.144043 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47b0400a-e334-411d-9cad-044bbad136d2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1512 microversion: 2.1 time: 0.154678 Aug 29 16:33:01.144748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3469/7110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:00 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:02.165245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:02.165885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:02.174712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:02.175253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:02.175708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:02.176422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:02.176892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:02.177333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:02.309201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:02.316948 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91aac704-d65f-4d5b-91e4-f9533bf36099 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1512 microversion: 2.1 time: 0.155792 Aug 29 16:33:02.317518 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3642/7111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:02 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:03.338213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:03.338939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:03.348564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:03.349059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:03.349501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:03.350205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:03.350665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:03.351269 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:03.511610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:03.520155 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ce84930a-075f-438d-96da-048ef10e9606 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.185841 Aug 29 16:33:03.520796 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3470/7112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:03 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:04.541671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:04.542200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:04.548678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:04.549186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:04.549641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:04.550349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:04.550822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:04.551300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:04.686095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:04.693872 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-185faca9-2717-424c-9ca6-7122fab0ba7c tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.156352 Aug 29 16:33:04.694647 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3643/7113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:04 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:05.714009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:05.714656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:05.721644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:05.722127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:05.722562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:05.723270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:05.723727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:05.724156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:05.855829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:05.863829 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-949d16bc-35bf-4616-a1d2-4de434810e04 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.153787 Aug 29 16:33:05.864409 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3471/7114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:05 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:06.884750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:06.885384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:06.892510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:06.893006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:06.893458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:06.894161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:06.894629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:06.895092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:07.031750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:07.039626 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c7d9654a-c480-4d98-b027-55508de56f08 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.158820 Aug 29 16:33:07.040205 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3644/7115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:06 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:08.062050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:08.062652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:08.070134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:08.070631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:08.071158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:08.071855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:08.072334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:08.072766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:08.204767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:08.212598 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1cf9a8d5-1217-4185-9076-2f3566d13602 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.155179 Aug 29 16:33:08.213168 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3472/7116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:08 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:09.233943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:09.234571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:09.241537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:09.242035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:09.242482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:09.243217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:09.243687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:09.244125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:09.382019 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:09.390503 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-01ae85d7-3bc9-4df1-ae92-9f7578d4dd84 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.160511 Aug 29 16:33:09.391320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3645/7117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:09 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:10.411106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:10.411773 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:10.418516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:10.418999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:10.419465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:10.420881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:10.421343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:10.421768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:10.554846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:10.562696 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d48fbf8-34cf-4766-9bbf-e598d7434c8b tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.155590 Aug 29 16:33:10.563315 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3473/7118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:10 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:11.583813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:11.584451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:11.591946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:11.592448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:11.592920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:11.593852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:11.594185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:11.594629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:11.733444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:11.741384 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-465a6623-fa2a-418e-8024-f6612245df48 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.161851 Aug 29 16:33:11.741953 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3646/7119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:11 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:12.762656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:12.763304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:12.770733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:12.771246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:12.771681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:12.772357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:12.772805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:12.773225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:12.907833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:12.917363 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8ffee15-4fba-4b9b-b817-2c72f226c4e3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.158530 Aug 29 16:33:12.917963 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3474/7120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:12 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:13.938412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:13.939089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:13.946082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:13.946580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:13.947103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:13.947749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:13.948206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:13.948638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:14.078608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:14.090864 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-87d08ded-f558-4c71-b551-2841e9148427 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.156585 Aug 29 16:33:14.091477 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3647/7121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:13 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:15.112534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:15.113076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:15.120066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:15.120555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:15.120994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:15.121687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:15.122148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:15.122578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:15.256646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:15.264393 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e69db3e-e773-41c8-bed3-1efbd7334675 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.156713 Aug 29 16:33:15.265238 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3475/7122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:15 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:16.285923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:16.286582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:16.293495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:16.293996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:16.294447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:16.295240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:16.295804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:16.296298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:16.430441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:16.439290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa696369-7403-43b6-90c6-763604828cc8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.157279 Aug 29 16:33:16.439868 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3648/7123] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:16 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:17.461284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:17.461919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:17.469589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.470066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.470503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.471226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:17.471683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:17.472107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:17.604952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:17.612996 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-463ae86c-d37e-4e0e-9edb-e8659649522f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.155683 Aug 29 16:33:17.613573 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3476/7124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:17 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:18.634310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:18.634942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:18.641994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:18.642492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:18.642940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:18.643669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:18.644140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:18.644579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:18.776910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:18.785893 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3afb1077-14be-4f24-983c-1be1f760ef90 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.155590 Aug 29 16:33:18.786468 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3649/7125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:18 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:19.807146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:19.807760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:19.815446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:19.815927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:19.816357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:19.817041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:19.817493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:19.817913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:19.951673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:19.959789 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9dd500c-6fa7-420a-b1b2-d40794f7f40f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.156560 Aug 29 16:33:19.960310 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3477/7126] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:19 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:20.981245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:20.981877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:20.989090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:20.989586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:20.990038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:20.990736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:20.991245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:20.991678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:21.127700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:21.135660 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75f0fe65-cc02-41fa-af5b-703669dad3e9 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.158379 Aug 29 16:33:21.136249 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3650/7127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:20 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:22.157138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:22.157681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:22.164623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:22.165102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:22.165534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:22.166212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:22.166664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:22.167119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:22.169634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=83 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:22.299529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:22.308181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b4ac658f-bc60-48ae-9267-7ed282361b71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.155148 Aug 29 16:33:22.308764 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3478/7128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:22 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:23.330148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:23.330808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:23.338683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:23.339154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:23.339608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:23.340316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:23.340789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:23.341231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:23.477338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:23.485171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2c08335b-2bd5-40c4-a47a-eaf3ca70a125 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.159470 Aug 29 16:33:23.485750 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3651/7129] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:23 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:24.506298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:24.506890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:24.513806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:24.514229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:24.515313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:24.515999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:24.516444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:24.516862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:24.645705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:24.653476 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-77e89034-8373-4928-9c6b-d8214052029f tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.151375 Aug 29 16:33:24.654053 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3479/7130] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:24 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:25.674673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:25.675240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:25.682445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:25.682945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:25.683431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:25.684132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:25.684602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:25.685127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:25.816842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:25.824680 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59f62d11-fd0d-43b1-b6bf-ae6e435b6aa3 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.154340 Aug 29 16:33:25.825535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3652/7131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:25 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:26.847010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:26.847603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:26.855053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.855607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.856091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:26.856869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:26.857364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:26.857822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:27.001360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:27.011841 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8e2699f-f06b-4d9d-9eb6-8c11a340c5e5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.169716 Aug 29 16:33:27.012435 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3480/7132] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:26 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:28.033325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:28.034044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:28.041155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:28.041654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:28.042099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:28.043457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:28.043603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:28.044376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:28.179861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:28.187750 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f7d55276-22eb-4589-ae42-9e5bfa49ffff tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.158309 Aug 29 16:33:28.188331 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3653/7133] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:28 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:29.209200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:29.209818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:29.216845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:29.217333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:29.217818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:29.218588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:29.219062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:29.219491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:29.350189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:29.358629 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-873e10dc-6f86-4e11-ba3b-704d2391f3f2 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1517 microversion: 2.1 time: 0.152763 Aug 29 16:33:29.359439 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3481/7134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:29 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:30.380526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:30.381399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:30.384145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=34 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:30.390872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:30.391407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:30.391862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:30.392577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:30.393054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:30.393496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:30.397898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:30.636057 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:30.644679 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b904b7d-34e5-417a-8a05-08625c72a6f8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1516 microversion: 2.1 time: 0.268066 Aug 29 16:33:30.645268 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3654/7135] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:30 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:33:30.798484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-326457a9-7eee-4ef6-b694-2d3260a59d52 req-ab812c3e-815e-44b4-9ac1-c4a573f79113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c8f18c-c98d-4ac0-ab6b-8ede2028c246", "name": "network-vif-unplugged", "status": "completed", "tag": "1ee6548b-4b57-4641-bedb-840971b3e772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:30.806199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=30 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:30.815056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-326457a9-7eee-4ef6-b694-2d3260a59d52 req-ab812c3e-815e-44b4-9ac1-c4a573f79113 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:30.815543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-326457a9-7eee-4ef6-b694-2d3260a59d52 req-ab812c3e-815e-44b4-9ac1-c4a573f79113 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:30.815978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-326457a9-7eee-4ef6-b694-2d3260a59d52 req-ab812c3e-815e-44b4-9ac1-c4a573f79113 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:30.831176 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-326457a9-7eee-4ef6-b694-2d3260a59d52 req-ab812c3e-815e-44b4-9ac1-c4a573f79113 service nova] Creating event network-vif-unplugged:1ee6548b-4b57-4641-bedb-840971b3e772 for instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 on n-h2-836830-13 Aug 29 16:33:30.839297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-326457a9-7eee-4ef6-b694-2d3260a59d52 req-ab812c3e-815e-44b4-9ac1-c4a573f79113 service nova] Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:33:30.851200 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-326457a9-7eee-4ef6-b694-2d3260a59d52 req-ab812c3e-815e-44b4-9ac1-c4a573f79113 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124504 Aug 29 16:33:30.851973 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3482/7136] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:33:31.667674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:31.668251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:31.675893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:31.676403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:31.676860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:31.677577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:31.678047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:31.678485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:31.921345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:31.929466 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ebc3ee43-5613-4595-b729-d5d25bdaebe8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1516 microversion: 2.1 time: 0.266028 Aug 29 16:33:31.930064 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3655/7137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:31 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:32.867605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-8e1b10dc-2986-46b9-ab51-48b2d1fa6502 req-212424e8-af8c-485c-936c-78b3960e9454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c8f18c-c98d-4ac0-ab6b-8ede2028c246", "tag": "1ee6548b-4b57-4641-bedb-840971b3e772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:32.878175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8e1b10dc-2986-46b9-ab51-48b2d1fa6502 req-212424e8-af8c-485c-936c-78b3960e9454 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:32.878589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8e1b10dc-2986-46b9-ab51-48b2d1fa6502 req-212424e8-af8c-485c-936c-78b3960e9454 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:32.879049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-8e1b10dc-2986-46b9-ab51-48b2d1fa6502 req-212424e8-af8c-485c-936c-78b3960e9454 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:32.890727 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-8e1b10dc-2986-46b9-ab51-48b2d1fa6502 req-212424e8-af8c-485c-936c-78b3960e9454 service nova] Creating event network-changed:1ee6548b-4b57-4641-bedb-840971b3e772 for instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 on n-h2-836830-13 Aug 29 16:33:32.896162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-8e1b10dc-2986-46b9-ab51-48b2d1fa6502 req-212424e8-af8c-485c-936c-78b3960e9454 service nova] Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:33:32.908196 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-8e1b10dc-2986-46b9-ab51-48b2d1fa6502 req-212424e8-af8c-485c-936c-78b3960e9454 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044619 Aug 29 16:33:32.908803 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3483/7138] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:32.950788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:32.951452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:32.959066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:32.959591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:32.960040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:32.960791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:32.961261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:32.961702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:33.104893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:33.112965 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b50c2a9-1cc3-4bf4-8a71-f2439797d439 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1514 microversion: 2.1 time: 0.166404 Aug 29 16:33:33.113553 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3656/7139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:32 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:34.135433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:34.136058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:34.142299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:34.142788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:34.143257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:34.143948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:34.144407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:34.144834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:34.283489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:34.291301 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f66e691-8304-4c78-ac45-586427280100 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1514 microversion: 2.1 time: 0.161039 Aug 29 16:33:34.291879 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3484/7140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:34 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:35.313004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:35.313875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:35.320457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:35.320970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:35.321428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:35.322147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:35.322623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:35.323086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:35.568015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:35.580770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-982174fb-0578-41d1-a9c7-c5983fee7147 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1511 microversion: 2.1 time: 0.272455 Aug 29 16:33:35.581486 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3657/7141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:35 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:35.608626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:35.609391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:35.616764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:35.617257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:35.617693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:35.618445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:35.618900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:35.619355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:35.656829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:33:35.719118 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.compute.api [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Found an unconfirmed migration during delete, id: 16, status: finished Aug 29 16:33:37.260833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fd17d9f-65a3-4cba-a7e1-768bc1617fcd tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "DELETE /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 204 len: 0 microversion: 2.1 time: 1.661113 Aug 29 16:33:37.261856 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3485/7142] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:33:35 2022] DELETE /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 0 bytes in 1663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:33:37.271746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:37.271746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:37.278612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:37.279150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:37.279603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:37.280832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:37.281303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:37.281742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:37.422753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:37.430710 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79a8525d-3a8b-45d6-bebb-b7080b1add86 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1503 microversion: 2.1 time: 0.164112 Aug 29 16:33:37.431331 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3658/7143] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:37 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:37.455385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-449186d5-1545-4de3-b298-c758961d525f req-80e6f53b-67ec-4297-a994-36526762863b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c8f18c-c98d-4ac0-ab6b-8ede2028c246", "name": "network-vif-plugged", "status": "completed", "tag": "1ee6548b-4b57-4641-bedb-840971b3e772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:37.465611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-449186d5-1545-4de3-b298-c758961d525f req-80e6f53b-67ec-4297-a994-36526762863b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:37.466248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-449186d5-1545-4de3-b298-c758961d525f req-80e6f53b-67ec-4297-a994-36526762863b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:37.466779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-449186d5-1545-4de3-b298-c758961d525f req-80e6f53b-67ec-4297-a994-36526762863b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:37.480817 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-449186d5-1545-4de3-b298-c758961d525f req-80e6f53b-67ec-4297-a994-36526762863b service nova] Creating event network-vif-plugged:1ee6548b-4b57-4641-bedb-840971b3e772 for instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 on n-h2-836830-13 Aug 29 16:33:37.486596 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-449186d5-1545-4de3-b298-c758961d525f req-80e6f53b-67ec-4297-a994-36526762863b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035281 Aug 29 16:33:37.487424 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3486/7144] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:38.451818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:38.452625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:38.459603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:38.460103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:38.460548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:38.461250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:38.461719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:38.462155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:38.592663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:38.600721 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5f63a903-6420-4911-bba2-bc2194e43667 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1503 microversion: 2.1 time: 0.153167 Aug 29 16:33:38.601302 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3659/7145] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:38 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:39.386408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4654be09-3032-425d-a724-ece49d043d90 req-27b85520-cfb4-43bf-bf6f-887eb21e6f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c8f18c-c98d-4ac0-ab6b-8ede2028c246", "name": "network-vif-deleted", "tag": "1ee6548b-4b57-4641-bedb-840971b3e772"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:39.396384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4654be09-3032-425d-a724-ece49d043d90 req-27b85520-cfb4-43bf-bf6f-887eb21e6f43 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:39.396874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4654be09-3032-425d-a724-ece49d043d90 req-27b85520-cfb4-43bf-bf6f-887eb21e6f43 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:39.397299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4654be09-3032-425d-a724-ece49d043d90 req-27b85520-cfb4-43bf-bf6f-887eb21e6f43 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:39.408827 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4654be09-3032-425d-a724-ece49d043d90 req-27b85520-cfb4-43bf-bf6f-887eb21e6f43 service nova] Creating event network-vif-deleted:1ee6548b-4b57-4641-bedb-840971b3e772 for instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 on n-h2-836830-13 Aug 29 16:33:39.414093 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4654be09-3032-425d-a724-ece49d043d90 req-27b85520-cfb4-43bf-bf6f-887eb21e6f43 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033383 Aug 29 16:33:39.414699 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3487/7146] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:39.622144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:39.622718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:39.630597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:39.631246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:39.631745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:39.632473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:39.632946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:39.633390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:39.669095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:39.669597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:39.670047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:39.671205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lazy-loading 'fault' on Instance uuid 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:33:39.717790 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8318bf000774d6189903e8bc8333440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f75c929253424abd606d18c4b75a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:39.725370 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a3df71e-ec05-429a-b419-6f3486023ee8 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 200 len: 1305 microversion: 2.1 time: 0.107236 Aug 29 16:33:39.725961 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3660/7147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:39 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:40.750413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:40.751139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:40.757580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:40.758062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:40.758492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:40.759207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:40.759656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:40.760074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:40.773388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] HTTP exception thrown: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Request method failure captured: Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 HTTP/1.1 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOou9aFPrBMw3xD7kR9k-85v_Q_kQRdEWYFhaGmfpnhPS35txp6Vl8aAghqim7JXx0TMz0xNF30_weZJTdvn_8OeMVg6eAf_GQk7qXn2QekC5lOkjfOvDvyQEfnAxiVZN_1Pz0aQoB_ebWR-Kav3DQyr0sQlUhYahW72GWSiS2bp124 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 40f75c929253424abd606d18c4b75a33 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40f75c929253424abd606d18c4b75a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_40f75c929253424abd606d18c4b75a33", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40f75c929253424abd606d18c4b75a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/40f75c929253424abd606d18c4b75a33"}]}] Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 40f75c929253424abd606d18c4b75a33 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-1197965768-project Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: b8318bf000774d6189903e8bc8333440 Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-1197965768-project Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '70c8f18c-c98d-4ac0-ab6b-8ede2028c246'} Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:40.775001 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Returning 404 to user: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2eb2d4d6-009b-48db-8f87-d1f1e81f01ca tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 404 len: 111 microversion: 2.1 time: 0.032770 Aug 29 16:33:40.779232 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3488/7148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:40 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:33:40.792940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:40.793447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:40.800103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:40.800604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:40.801051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:40.801745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:40.802221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:40.802661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:40.816450 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] HTTP exception thrown: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Request method failure captured: Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 HTTP/1.1 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOou9aFPrBMw3xD7kR9k-85v_Q_kQRdEWYFhaGmfpnhPS35txp6Vl8aAghqim7JXx0TMz0xNF30_weZJTdvn_8OeMVg6eAf_GQk7qXn2QekC5lOkjfOvDvyQEfnAxiVZN_1Pz0aQoB_ebWR-Kav3DQyr0sQlUhYahW72GWSiS2bp124 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 40f75c929253424abd606d18c4b75a33 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40f75c929253424abd606d18c4b75a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_40f75c929253424abd606d18c4b75a33", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40f75c929253424abd606d18c4b75a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/40f75c929253424abd606d18c4b75a33"}]}] Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 40f75c929253424abd606d18c4b75a33 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-DeleteServersTestJSON-1197965768-project Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: b8318bf000774d6189903e8bc8333440 Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-DeleteServersTestJSON-1197965768-project Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '70c8f18c-c98d-4ac0-ab6b-8ede2028c246'} Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:33:40.818126 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Returning 404 to user: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f3e5298a-6756-4c86-9a39-9bd97804ad71 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "DELETE /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 404 len: 111 microversion: 2.1 time: 0.031421 Aug 29 16:33:40.822137 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3661/7149] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:33:40 2022] DELETE /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:33:40.828402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:40.829023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] [instance: 70c8f18c-c98d-4ac0-ab6b-8ede2028c246] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:40.835061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:40.835575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:40.836013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:40.836696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:40.837149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:40.837571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:40.851212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] HTTP exception thrown: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Request method failure captured: Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 HTTP/1.1 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOou9aFPrBMw3xD7kR9k-85v_Q_kQRdEWYFhaGmfpnhPS35txp6Vl8aAghqim7JXx0TMz0xNF30_weZJTdvn_8OeMVg6eAf_GQk7qXn2QekC5lOkjfOvDvyQEfnAxiVZN_1Pz0aQoB_ebWR-Kav3DQyr0sQlUhYahW72GWSiS2bp124 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 40f75c929253424abd606d18c4b75a33 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40f75c929253424abd606d18c4b75a33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_40f75c929253424abd606d18c4b75a33", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/40f75c929253424abd606d18c4b75a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/40f75c929253424abd606d18c4b75a33"}]}] Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 40f75c929253424abd606d18c4b75a33 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-DeleteServersTestJSON-1197965768 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-DeleteServersTestJSON-1197965768-project Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: b8318bf000774d6189903e8bc8333440 Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-DeleteServersTestJSON-1197965768-project Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '70c8f18c-c98d-4ac0-ab6b-8ede2028c246'} Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:33:40.852667 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] Returning 404 to user: Instance 70c8f18c-c98d-4ac0-ab6b-8ede2028c246 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3ae79e77-5de5-4c03-b915-cd42c27b41f5 tempest-DeleteServersTestJSON-1197965768 tempest-DeleteServersTestJSON-1197965768-project] 10.222.0.83 "GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246" status: 404 len: 111 microversion: 2.1 time: 0.029872 Aug 29 16:33:40.856921 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3489/7150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:40 2022] GET /compute/v2.1/servers/70c8f18c-c98d-4ac0-ab6b-8ede2028c246 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:33:49.630518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-269160467", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "04ea36f3-3d66-431d-8819-c216c18bf836"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:49.686520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] validate_networks() for [('04ea36f3-3d66-431d-8819-c216c18bf836', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:33:50.070580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:33:50.071053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:33:50.071543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:33:50.071977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:33:50.072408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:33:50.082567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:50.083215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:50.083673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:50.084438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:50.084915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:50.085362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:50.104121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Getting quotas for project bd54d609ed014dea947a1ce0b27b2d94. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:33:50.110359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Getting quotas for user 8fa173eefc8a420da1c367c8ad53e44c and project bd54d609ed014dea947a1ce0b27b2d94. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:33:50.123692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:33:50.126060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:33:50.172623 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7acc2438-8979-42cf-b750-6a0638b83bd9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680507 Aug 29 16:33:50.173270 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3662/7151] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:33:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:33:50.184523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa5c0bb9-38d6-4b1b-acf2-3674029d1ac6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:50.185233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa5c0bb9-38d6-4b1b-acf2-3674029d1ac6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:50.248370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa5c0bb9-38d6-4b1b-acf2-3674029d1ac6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:50.255888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa5c0bb9-38d6-4b1b-acf2-3674029d1ac6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1217 microversion: 2.1 time: 0.075481 Aug 29 16:33:50.256481 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3490/7152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:50 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:51.278636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:51.279290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:51.286331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:51.287037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:51.287688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:51.288414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:51.288865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:51.289517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:51.356009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:51.365216 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7735de79-af5c-437a-a920-2964f3a62f42 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1269 microversion: 2.1 time: 0.091371 Aug 29 16:33:51.365818 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3663/7153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:51 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:52.395121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:52.396366 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:52.403618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:33:52.412741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:52.413270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:52.413749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:52.414755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:52.415260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:52.415748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:52.566941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:52.579123 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3baa42d5-eb11-41e0-8b85-2da9c049b630 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.194195 Aug 29 16:33:52.579760 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3491/7154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:52 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:33:52.960449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-bebabb79-bceb-43e4-bec2-9da2e7ff721d req-48d4e165-5446-43a0-a40a-209e8a4a4140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4c7462-9928-470e-9e59-7008f390858b", "tag": "8bdf5e98-7f74-4114-8c65-fe90e8e0a34d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:52.982591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bebabb79-bceb-43e4-bec2-9da2e7ff721d req-48d4e165-5446-43a0-a40a-209e8a4a4140 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:52.987661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bebabb79-bceb-43e4-bec2-9da2e7ff721d req-48d4e165-5446-43a0-a40a-209e8a4a4140 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:52.988237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-bebabb79-bceb-43e4-bec2-9da2e7ff721d req-48d4e165-5446-43a0-a40a-209e8a4a4140 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:53.018831 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-bebabb79-bceb-43e4-bec2-9da2e7ff721d req-48d4e165-5446-43a0-a40a-209e8a4a4140 service nova] Creating event network-changed:8bdf5e98-7f74-4114-8c65-fe90e8e0a34d for instance ba4c7462-9928-470e-9e59-7008f390858b on n-h2-836830-13 Aug 29 16:33:53.031914 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-bebabb79-bceb-43e4-bec2-9da2e7ff721d req-48d4e165-5446-43a0-a40a-209e8a4a4140 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082104 Aug 29 16:33:53.032537 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3664/7155] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:53.600389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:53.601010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:53.607892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:53.608425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:53.609410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:53.610171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:53.610682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:53.611131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:53.748469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:53.756263 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4022ec21-c5c2-4de7-b84f-89a17895c8cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.159904 Aug 29 16:33:53.756847 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3492/7156] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:53 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:33:54.777230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:54.777978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:54.785188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:54.785689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:54.786144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:54.786844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:54.787338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:54.787777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:54.925792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:54.933988 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dc2761d3-9b51-4447-8175-2c5df846d539 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.161068 Aug 29 16:33:54.934711 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3665/7157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:54 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:55.956830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:55.957479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:55.964283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:55.964770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:55.965206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:55.966217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:55.966672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:55.967122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:56.103305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:56.112408 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-281b3202-6fb5-4d53-b800-6c1a45fb7168 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.160196 Aug 29 16:33:56.113023 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3493/7158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:55 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:57.133342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:57.134056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:57.142266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:57.142771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:57.143327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:57.144167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:57.144683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:57.145159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:57.276162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:57.284592 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b1aaa27a-f237-4231-9947-708c3ef81b14 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.155557 Aug 29 16:33:57.285164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3666/7159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:57 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:58.305066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:58.305591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:58.312444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:58.312923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:58.313350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:58.314031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:58.314479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:58.314922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:58.451661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:58.461370 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-27b6781b-6e43-4fa0-b68f-100a33fbd5e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.160166 Aug 29 16:33:58.461996 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3494/7160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:58 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:33:59.483641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:33:59.484389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:33:59.491296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.491803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.492241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.492952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.493418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.493849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.565125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-98ec145d-dfcb-4e69-a873-80e832cbfb52 req-f1818ab4-8078-4303-b07f-d282e37f4f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4c7462-9928-470e-9e59-7008f390858b", "name": "network-vif-plugged", "status": "completed", "tag": "8bdf5e98-7f74-4114-8c65-fe90e8e0a34d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:33:59.575965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-98ec145d-dfcb-4e69-a873-80e832cbfb52 req-f1818ab4-8078-4303-b07f-d282e37f4f21 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:33:59.577185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-98ec145d-dfcb-4e69-a873-80e832cbfb52 req-f1818ab4-8078-4303-b07f-d282e37f4f21 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:33:59.577861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-98ec145d-dfcb-4e69-a873-80e832cbfb52 req-f1818ab4-8078-4303-b07f-d282e37f4f21 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:33:59.590341 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-98ec145d-dfcb-4e69-a873-80e832cbfb52 req-f1818ab4-8078-4303-b07f-d282e37f4f21 service nova] Creating event network-vif-plugged:8bdf5e98-7f74-4114-8c65-fe90e8e0a34d for instance ba4c7462-9928-470e-9e59-7008f390858b on n-h2-836830-13 Aug 29 16:33:59.596289 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-98ec145d-dfcb-4e69-a873-80e832cbfb52 req-f1818ab4-8078-4303-b07f-d282e37f4f21 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034874 Aug 29 16:33:59.597129 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3495/7161] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:33:59.645397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:33:59.654154 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-35703bff-61b6-4c2d-835e-84198ef7476b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.174644 Aug 29 16:33:59.654916 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3667/7162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:33:59 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:00.676498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:00.677198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:00.679189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:00.685429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:00.685972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:00.686379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:00.687099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:00.687542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:00.687960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:00.823392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:00.831760 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee2c329b-d4c2-4753-a443-92c94236c7cd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1317 microversion: 2.1 time: 0.159610 Aug 29 16:34:00.832660 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3496/7163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:00 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:01.852819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:01.853356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:01.855379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:01.856123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:01.857626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:01.864444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:01.864946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:01.865394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:01.866103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:01.866570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:01.867010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:01.871554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=74 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:02.002861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:02.010801 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c2b73227-588b-4418-b99f-4fc94ffe2a56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1507 microversion: 2.1 time: 0.161999 Aug 29 16:34:02.011405 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3668/7164] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:01 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:02.031894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:02.032522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:02.035234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:02.040531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.041026 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.041471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.042162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.042622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.043076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.181506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:02.190010 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f0f542b-96df-4072-bc56-cff4ed1143b8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1507 microversion: 2.1 time: 0.162221 Aug 29 16:34:02.190621 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3497/7165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:02 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:02.210822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:02.213340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:02.219976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.220471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.220924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.221622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.222090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.222529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.292341 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf82ea6f-8826-41ba-919c-3567e0702203 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "PUT /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1079 microversion: 2.1 time: 0.085416 Aug 29 16:34:02.293201 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3669/7166] 10.222.0.83 () {60 vars in 1256 bytes} [Mon Aug 29 16:34:02 2022] PUT /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1079 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:02.309919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:02.310534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:02.317320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.317805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.318240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.318923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.319407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.319834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.452699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:02.460533 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-174cf1ab-a9ce-4bca-953a-7b0c57f058cb tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1505 microversion: 2.1 time: 0.154502 Aug 29 16:34:02.461111 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3498/7167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:02 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:02.480326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:02.481017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:02.487416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.487934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.488360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.489059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.489521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.489959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.623050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:02.631599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-84101b0e-e227-4fc3-b3ca-66c238d60bad tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1505 microversion: 2.1 time: 0.155201 Aug 29 16:34:02.632180 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3670/7168] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:02 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:02.651708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:02.653968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:02.660323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.660882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.661589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.662352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.662977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.663498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.692139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:02.698012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Old instance type m1.heat2, new instance type m1.heat {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:34:02.705751 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:34:02.705852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:34:02.706285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:34:02.706688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:34:02.707121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:34:02.772877 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0710e5c2-f7de-43ac-9038-faa28a89a70a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "POST /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b/action" status: 202 len: 0 microversion: 2.1 time: 0.125161 Aug 29 16:34:02.774510 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3499/7169] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:34:02 2022] POST /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:34:02.781958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:02.782598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:02.788704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.789211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.789666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.790373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:02.790846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:02.791315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:02.949303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:02.958140 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b9ce253b-2952-4c29-b07e-63e3e5b522c1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1516 microversion: 2.1 time: 0.180300 Aug 29 16:34:02.958856 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3671/7170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:02 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:03.980871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:03.981430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:03.988927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:03.989417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:03.989848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:03.990539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:03.990991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:03.991433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:04.127139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:04.135447 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-54a712b1-30f4-4c52-bd5d-d0584d547da6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1516 microversion: 2.1 time: 0.160376 Aug 29 16:34:04.136056 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3500/7171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:03 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:05.157912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:05.158479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:05.164855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:05.165350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:05.165873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:05.166573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:05.167067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:05.167512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:05.299225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:05.307083 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a85b0e4e-5ae0-4e0a-b80c-121f1d6e563a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.154094 Aug 29 16:34:05.307662 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3672/7172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:05 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:06.328843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:06.329446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:06.336640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:06.337128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:06.337567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:06.338255 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:06.338709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:06.339165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:06.466720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:06.475134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbada1cb-5d90-4321-b0b2-2f92ca25ac11 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.150834 Aug 29 16:34:06.475713 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3501/7173] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:06 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:07.496240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:07.496862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:07.505297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:07.505799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:07.506242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:07.506946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:07.507430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:07.507861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:07.636962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:07.644813 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f383c37c-a41f-47f4-8ee9-1d3f098bd105 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.152584 Aug 29 16:34:07.645388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3673/7174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:07 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:08.665948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:08.666589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:08.673485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:08.673981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:08.674405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:08.675115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:08.675575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:08.675993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:08.811642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:08.820488 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15a992e9-9c16-4bdf-b4f4-4be34ca7cd3d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.158941 Aug 29 16:34:08.821070 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3502/7175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:08 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:09.841296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:09.842675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:09.849607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:09.850098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:09.850542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:09.851262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:09.851727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:09.852159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:09.988327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:09.996153 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7534201c-9ddd-4422-aedd-47413c22efdf tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.158851 Aug 29 16:34:09.996731 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3674/7176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:09 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:11.017538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:11.018071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:11.025137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.025625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.026067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.026758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:11.027257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:11.027687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:11.160640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:11.168545 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-25c79bdf-e25b-44d5-991b-753edf0c3d50 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.155644 Aug 29 16:34:11.169116 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3503/7177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:11 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:12.189786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:12.190415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:12.197446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:12.197943 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:12.198389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:12.199401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:12.199869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:12.200307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:12.334251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:12.342179 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cfa45dc-e5f2-4141-bee0-7ad98b46d4d8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.156367 Aug 29 16:34:12.342784 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3675/7178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:12 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:13.363547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:13.364163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:13.371233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:13.371724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:13.372165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:13.372848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:13.373304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:13.373730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:13.509391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:13.517979 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5909a156-0021-4ea8-8335-25bdf2e93d6d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.158580 Aug 29 16:34:13.518559 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3504/7179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:13 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:14.539659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:14.540200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:14.547745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:14.548349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:14.548684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:14.549388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:14.549849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:14.550283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:14.687154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:14.694988 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-17d2e1b1-69e2-44be-a4ee-bab8ee3cbf9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.159374 Aug 29 16:34:14.695581 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3676/7180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:14 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:15.715561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:15.716176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:15.723887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:15.724375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:15.724814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:15.725505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:15.725961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:15.726385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:15.857330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:15.865151 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7e0241f5-3b30-40d3-b1d9-6d3810bd9ef2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.153552 Aug 29 16:34:15.865727 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3505/7181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:15 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:16.885341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:16.885999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:16.892939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:16.893424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:16.893879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:16.894671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:16.895167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:16.895609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:17.031046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:17.039639 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0337ce7-ff04-4e22-a89a-ee62acbc02db tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.158296 Aug 29 16:34:17.040217 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3677/7182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:16 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:18.060788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:18.061335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:18.068447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:18.068931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:18.069360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:18.070038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:18.070486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:18.070902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:18.204265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:18.207778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:18.212821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed6433e9-1e72-4e85-8e52-a076688789f1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.156030 Aug 29 16:34:18.213399 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3506/7183] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:18 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:19.233482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:19.234138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:19.241814 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:19.242319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:19.242773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:19.243517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:19.243987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:19.244430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:19.380704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:19.388886 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ddc6d166-3949-47c4-9e55-71f672653552 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.159346 Aug 29 16:34:19.389472 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3678/7184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:19 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:20.410958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:20.411599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:20.419854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:20.420340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:20.420774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:20.421459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:20.422546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:20.422972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:20.553373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:20.561097 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e69443d5-5ff4-47cf-91b0-a0f0c4ea5006 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.154176 Aug 29 16:34:20.561668 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3507/7185] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:20 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:21.584256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:21.585155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:21.592058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:21.592556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:21.593007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:21.593994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:21.594542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:21.594986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:21.995548 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:22.003329 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2eb79437-b2a9-4cd1-872d-81a6a55dbc4c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.423018 Aug 29 16:34:22.003927 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3679/7186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:21 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:23.024453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:23.024998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:23.032832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:23.033544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:23.033834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:23.034560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:23.035053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:23.035475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:23.168151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:23.176671 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e9d32f83-83df-46ac-bdc6-4846d5c2ec23 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.156179 Aug 29 16:34:23.177254 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3508/7187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:23 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:24.197752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:24.198653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:24.205973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:24.206465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:24.206935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:24.207659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:24.208121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:24.208555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:24.339913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:24.348493 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30829157-6e41-4966-8d5d-4b600b96520b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.154699 Aug 29 16:34:24.349078 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3680/7188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:24 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:25.370408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:25.371045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:25.378004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:25.378516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:25.378956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:25.379707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:25.380163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:25.380592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:25.517759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:25.525582 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d71dc01-db57-4e9c-9fa3-42ccd9e82d6b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.159220 Aug 29 16:34:25.526165 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3509/7189] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:25 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:26.545993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:26.546918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:26.553715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:26.554561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:26.555048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:26.555771 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:26.556414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:26.556864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:26.703352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:26.710035 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8630ed32-def7-4534-8609-6473bc568f45 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.168089 Aug 29 16:34:26.710686 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3681/7190] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:26 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:27.731824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:27.732503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:27.740486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.740977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.741418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.742125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:27.742582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:27.743009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:27.881401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:27.889165 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4cab0470-5761-4245-ad5c-53c21232f1a7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.161321 Aug 29 16:34:27.889786 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3510/7191] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:27 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:28.909788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:28.910409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:28.917232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:28.917723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:28.918168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:28.918862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:28.919358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:28.919793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:29.047718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:29.055511 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c83d82e-c19b-4ad7-a4f2-f0dcd8620ffc tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.149623 Aug 29 16:34:29.056093 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3682/7192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:28 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:30.077005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:30.078136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:30.085281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:30.085776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:30.086224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.086923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:30.087411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:30.087845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:30.221715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:30.229466 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dfbefbfd-77c7-49f1-b6bb-afddb06a8657 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.156826 Aug 29 16:34:30.230041 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3511/7193] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:30 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:31.249963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:31.250600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:31.257575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:31.258075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:31.258525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:31.259254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:31.259726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:31.260169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:31.393618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:31.401478 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-105c9deb-f3a6-46c3-ae3b-f08c286a49a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1521 microversion: 2.1 time: 0.155542 Aug 29 16:34:31.402043 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3683/7194] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:31 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:32.238644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9b98445b-bed4-41cb-9e85-052dc2d5886f req-357f0940-a4b1-441f-bcc2-467f90c5a03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4c7462-9928-470e-9e59-7008f390858b", "name": "network-vif-unplugged", "status": "completed", "tag": "8bdf5e98-7f74-4114-8c65-fe90e8e0a34d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:32.245493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=34 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:32.250298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9b98445b-bed4-41cb-9e85-052dc2d5886f req-357f0940-a4b1-441f-bcc2-467f90c5a03d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:32.250811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9b98445b-bed4-41cb-9e85-052dc2d5886f req-357f0940-a4b1-441f-bcc2-467f90c5a03d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:32.251248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9b98445b-bed4-41cb-9e85-052dc2d5886f req-357f0940-a4b1-441f-bcc2-467f90c5a03d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:32.263793 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9b98445b-bed4-41cb-9e85-052dc2d5886f req-357f0940-a4b1-441f-bcc2-467f90c5a03d service nova] Creating event network-vif-unplugged:8bdf5e98-7f74-4114-8c65-fe90e8e0a34d for instance ba4c7462-9928-470e-9e59-7008f390858b on n-h1-836830-13 Aug 29 16:34:32.269961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-9b98445b-bed4-41cb-9e85-052dc2d5886f req-357f0940-a4b1-441f-bcc2-467f90c5a03d service nova] Instance ba4c7462-9928-470e-9e59-7008f390858b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:34:32.282043 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9b98445b-bed4-41cb-9e85-052dc2d5886f req-357f0940-a4b1-441f-bcc2-467f90c5a03d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047043 Aug 29 16:34:32.282665 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3512/7195] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:34:32.424755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:32.425417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:32.429491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=32 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:32.433870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:32.434379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:32.434917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:32.435668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:32.436166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:32.436861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:32.439990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:32.575515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:32.584786 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-066e9e0c-7661-406a-a2ea-cf32c819e6ce tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1520 microversion: 2.1 time: 0.164283 Aug 29 16:34:32.585369 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3684/7196] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:32 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:33.607545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:33.608186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:33.615643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:33.616125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:33.616559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:33.617234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:33.617681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:33.618098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:33.756063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:33.763977 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d847d11f-a811-4385-a1f7-ebe46a8ac6e1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1518 microversion: 2.1 time: 0.161757 Aug 29 16:34:33.764548 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3513/7197] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:33 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:34.310034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d22fee9a-bab8-4fd9-b59a-72755c1a6e2d req-a18555a4-57a0-4e80-914e-d5f088794e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4c7462-9928-470e-9e59-7008f390858b", "tag": "8bdf5e98-7f74-4114-8c65-fe90e8e0a34d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:34.320533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d22fee9a-bab8-4fd9-b59a-72755c1a6e2d req-a18555a4-57a0-4e80-914e-d5f088794e59 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:34.321020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d22fee9a-bab8-4fd9-b59a-72755c1a6e2d req-a18555a4-57a0-4e80-914e-d5f088794e59 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:34.321460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d22fee9a-bab8-4fd9-b59a-72755c1a6e2d req-a18555a4-57a0-4e80-914e-d5f088794e59 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:34.334240 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d22fee9a-bab8-4fd9-b59a-72755c1a6e2d req-a18555a4-57a0-4e80-914e-d5f088794e59 service nova] Creating event network-changed:8bdf5e98-7f74-4114-8c65-fe90e8e0a34d for instance ba4c7462-9928-470e-9e59-7008f390858b on n-h1-836830-13 Aug 29 16:34:34.339629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-d22fee9a-bab8-4fd9-b59a-72755c1a6e2d req-a18555a4-57a0-4e80-914e-d5f088794e59 service nova] Instance ba4c7462-9928-470e-9e59-7008f390858b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:34:34.350619 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d22fee9a-bab8-4fd9-b59a-72755c1a6e2d req-a18555a4-57a0-4e80-914e-d5f088794e59 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044530 Aug 29 16:34:34.351242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3685/7198] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:34.786436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:34.787774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:34.794890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:34.795326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:34.796642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:34.797540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:34.798157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:34.798733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:35.049055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:35.057297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7196ce42-e8f3-4ec7-a895-962fb34f2cf1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1515 microversion: 2.1 time: 0.275167 Aug 29 16:34:35.058206 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3514/7199] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:34 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:35.080916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:35.082407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:35.089654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:35.090479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:35.090939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:35.092193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:35.094642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:35.095138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:35.160423 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-66050e88-4ba7-4162-92b9-5acfa74deeac tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "POST /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b/action" status: 204 len: 0 microversion: 2.1 time: 0.084145 Aug 29 16:34:35.161235 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3686/7200] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:34:35 2022] POST /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:34:35.169443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:35.170486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:35.179861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:35.180461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:35.181118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:35.181973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:35.182591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:35.183299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:35.410252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:35.420438 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3c595131-d849-442a-a363-005d124a19c0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1515 microversion: 2.1 time: 0.254805 Aug 29 16:34:35.422008 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3515/7201] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:35 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:36.444071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:36.444793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:36.451466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:36.452691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:36.453291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:36.454053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:36.454516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:36.455017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:36.597628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:36.605588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5760e92-5820-4e8f-812f-2d2910cc8519 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1515 microversion: 2.1 time: 0.166645 Aug 29 16:34:36.606233 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3687/7202] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:36 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:37.139339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a0d7febc-6e29-4800-b14c-184addf3aa82 req-cbfab78a-3577-4a77-8320-4d0261284d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4c7462-9928-470e-9e59-7008f390858b", "name": "network-vif-plugged", "status": "completed", "tag": "8bdf5e98-7f74-4114-8c65-fe90e8e0a34d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:37.150803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a0d7febc-6e29-4800-b14c-184addf3aa82 req-cbfab78a-3577-4a77-8320-4d0261284d0e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:37.151322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a0d7febc-6e29-4800-b14c-184addf3aa82 req-cbfab78a-3577-4a77-8320-4d0261284d0e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:37.151757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a0d7febc-6e29-4800-b14c-184addf3aa82 req-cbfab78a-3577-4a77-8320-4d0261284d0e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:37.166257 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a0d7febc-6e29-4800-b14c-184addf3aa82 req-cbfab78a-3577-4a77-8320-4d0261284d0e service nova] Creating event network-vif-plugged:8bdf5e98-7f74-4114-8c65-fe90e8e0a34d for instance ba4c7462-9928-470e-9e59-7008f390858b on n-h1-836830-13 Aug 29 16:34:37.171618 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a0d7febc-6e29-4800-b14c-184addf3aa82 req-cbfab78a-3577-4a77-8320-4d0261284d0e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Aug 29 16:34:37.172611 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3516/7203] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:37.627546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:37.628092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:37.635000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:37.635520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:37.635965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:37.636661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:37.637125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:37.637559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:37.772758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:37.781096 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dfa003f7-646c-4bcb-9e7a-56a1666ca2ee tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1507 microversion: 2.1 time: 0.158482 Aug 29 16:34:37.781680 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3688/7204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:37 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:37.801772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:37.802480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:37.808683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:37.809168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:37.809605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:37.810332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:37.810779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:37.811252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:37.946288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:37.955243 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-43a2d0dd-2767-43ab-beab-bf3c34f4edb3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1507 microversion: 2.1 time: 0.157621 Aug 29 16:34:37.955824 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3517/7205] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:37 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:37.978158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9d7473e3-5308-4101-bc9c-38fdf8b40b46 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'create', calling method: .version_select at 0x7f32efc0aee0>, body: {"keypair": {"name": "tempest-keypair-1574288518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYJT5vyclnLTZe9qyX/wVhueY/RCAdbTtKQSiFEuv5/C1HV6DeMDOjctDyJt7mCxZ3u/cZFYW6dNUc+5PGMXCzME0iAthATEmXr+bFesc7DAx9xBo9dLemPm8RQ7WdHuw=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:37.995100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-9d7473e3-5308-4101-bc9c-38fdf8b40b46 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Getting quotas for project bd54d609ed014dea947a1ce0b27b2d94. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:34:38.001378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-9d7473e3-5308-4101-bc9c-38fdf8b40b46 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Getting quotas for user 8fa173eefc8a420da1c367c8ad53e44c and project bd54d609ed014dea947a1ce0b27b2d94. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:34:38.030821 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9d7473e3-5308-4101-bc9c-38fdf8b40b46 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056484 Aug 29 16:34:38.031437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3689/7206] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:34:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:39.291574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:39.292281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:39.299933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:39.300419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:39.300853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:39.301539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:39.301997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:39.302423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:39.443720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:39.451835 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-611703c6-a616-4b6a-9e08-684834ab7ff0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 200 len: 1507 microversion: 2.1 time: 0.164165 Aug 29 16:34:39.452417 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3518/7207] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:39 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:39.473242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:39.473801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:39.480455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:39.480960 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:39.481415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:39.482121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:39.482594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:39.483104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:39.508113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:34:39.586647 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cb80187-6fd1-4336-ac11-270a42676362 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 204 len: 0 microversion: 2.1 time: 0.117868 Aug 29 16:34:39.587247 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3690/7208] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:34:39 2022] DELETE /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:34:39.645899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-393851200", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "04ea36f3-3d66-431d-8819-c216c18bf836"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:39.699979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] validate_networks() for [('04ea36f3-3d66-431d-8819-c216c18bf836', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:34:40.088533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:34:40.088948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:34:40.089421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:34:40.089845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:34:40.090251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:34:40.099605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:40.100080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:40.100508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:40.101223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:40.101668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:40.102085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:40.118716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Getting quotas for project bd54d609ed014dea947a1ce0b27b2d94. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:34:40.124527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Getting quotas for user 8fa173eefc8a420da1c367c8ad53e44c and project bd54d609ed014dea947a1ce0b27b2d94. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:34:40.136558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:34:40.138816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:34:40.183598 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b33f4e4-e83e-4c07-8214-fbf7cd936b95 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541548 Aug 29 16:34:40.184251 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3519/7209] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:34:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:34:40.196343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea8580ab-753a-4ad7-ae90-7b1f925358f6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:40.197063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea8580ab-753a-4ad7-ae90-7b1f925358f6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:40.256129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ea8580ab-753a-4ad7-ae90-7b1f925358f6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:40.263266 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea8580ab-753a-4ad7-ae90-7b1f925358f6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1217 microversion: 2.1 time: 0.071231 Aug 29 16:34:40.264047 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3691/7210] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:40 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:41.286614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:41.288232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:41.295717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:41.296485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:41.296936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:41.297744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:41.298243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:41.298705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:41.411923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:41.422382 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa77f782-459f-4f0c-8c7b-600786449e97 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1277 microversion: 2.1 time: 0.141112 Aug 29 16:34:41.423643 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3520/7211] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:41 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:41.585231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6362c843-234a-48ea-bcf0-5ba2d9450a5e req-cf0fc30e-6ec9-4d48-a9a9-38cde85cf9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4c7462-9928-470e-9e59-7008f390858b", "name": "network-vif-deleted", "tag": "8bdf5e98-7f74-4114-8c65-fe90e8e0a34d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:41.604081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6362c843-234a-48ea-bcf0-5ba2d9450a5e req-cf0fc30e-6ec9-4d48-a9a9-38cde85cf9f1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:41.604976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6362c843-234a-48ea-bcf0-5ba2d9450a5e req-cf0fc30e-6ec9-4d48-a9a9-38cde85cf9f1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:41.605671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6362c843-234a-48ea-bcf0-5ba2d9450a5e req-cf0fc30e-6ec9-4d48-a9a9-38cde85cf9f1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:41.621774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6362c843-234a-48ea-bcf0-5ba2d9450a5e req-cf0fc30e-6ec9-4d48-a9a9-38cde85cf9f1 service nova] Creating event network-vif-deleted:8bdf5e98-7f74-4114-8c65-fe90e8e0a34d for instance ba4c7462-9928-470e-9e59-7008f390858b on n-h1-836830-13 Aug 29 16:34:41.632889 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6362c843-234a-48ea-bcf0-5ba2d9450a5e req-cf0fc30e-6ec9-4d48-a9a9-38cde85cf9f1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051725 Aug 29 16:34:41.636164 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3692/7212] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:42.443809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:42.444423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:42.451636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:42.452662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:42.453212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:42.453915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:42.454367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:42.454790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:42.662033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:42.670952 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4019a97f-a9e9-4720-ad5b-07d22d90f67f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1317 microversion: 2.1 time: 0.230530 Aug 29 16:34:42.671669 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3521/7213] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:42 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:43.661723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ad46bf03-9f68-4539-b71d-54d081104fea req-33d79a84-b498-49c9-a9f4-4079bcd8d340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfe7b50-9356-46ba-b8eb-ef9faf281b6a", "tag": "d5b0cafb-74f5-442c-a0a1-e18b80ea7b02"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:43.672044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ad46bf03-9f68-4539-b71d-54d081104fea req-33d79a84-b498-49c9-a9f4-4079bcd8d340 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:43.672540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ad46bf03-9f68-4539-b71d-54d081104fea req-33d79a84-b498-49c9-a9f4-4079bcd8d340 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:43.672992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ad46bf03-9f68-4539-b71d-54d081104fea req-33d79a84-b498-49c9-a9f4-4079bcd8d340 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:43.683977 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ad46bf03-9f68-4539-b71d-54d081104fea req-33d79a84-b498-49c9-a9f4-4079bcd8d340 service nova] Creating event network-changed:d5b0cafb-74f5-442c-a0a1-e18b80ea7b02 for instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a on n-h1-836830-13 Aug 29 16:34:43.689770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ad46bf03-9f68-4539-b71d-54d081104fea req-33d79a84-b498-49c9-a9f4-4079bcd8d340 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032882 Aug 29 16:34:43.690404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3693/7214] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:34:43.692778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:43.693350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:43.700659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:43.701148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:43.701769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:43.702493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:43.702948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:43.703399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:43.834317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:43.842486 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8fee0c7f-7e1f-4361-9807-5db4cc8e7030 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1317 microversion: 2.1 time: 0.153209 Aug 29 16:34:43.843210 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3522/7215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:43 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:44.865249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:44.865968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:44.872283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:44.872786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:44.873325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:44.874101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:44.874572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:44.875012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:45.004844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:45.012606 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a85d1286-d2b5-46ee-815c-2f8ab45e7d38 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1317 microversion: 2.1 time: 0.152517 Aug 29 16:34:45.013173 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3694/7216] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:44 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:46.034423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:46.034967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:46.042184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:46.042679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:46.043152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:46.043857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:46.044332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:46.044764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:46.180999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:46.189777 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-10dd8aba-07a5-4c67-ac5e-0175b0a2d004 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1317 microversion: 2.1 time: 0.159335 Aug 29 16:34:46.190328 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3523/7217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:46 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:47.183833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a0ab898e-68fe-41ed-9388-c727b761f04c req-3d9bbd04-2db0-4cef-bc72-1587103bace5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfe7b50-9356-46ba-b8eb-ef9faf281b6a", "name": "network-vif-plugged", "status": "completed", "tag": "d5b0cafb-74f5-442c-a0a1-e18b80ea7b02"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:47.195241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a0ab898e-68fe-41ed-9388-c727b761f04c req-3d9bbd04-2db0-4cef-bc72-1587103bace5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:47.195745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a0ab898e-68fe-41ed-9388-c727b761f04c req-3d9bbd04-2db0-4cef-bc72-1587103bace5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:47.196187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a0ab898e-68fe-41ed-9388-c727b761f04c req-3d9bbd04-2db0-4cef-bc72-1587103bace5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:47.207795 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a0ab898e-68fe-41ed-9388-c727b761f04c req-3d9bbd04-2db0-4cef-bc72-1587103bace5 service nova] Creating event network-vif-plugged:d5b0cafb-74f5-442c-a0a1-e18b80ea7b02 for instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a on n-h1-836830-13 Aug 29 16:34:47.212459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:47.212938 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a0ab898e-68fe-41ed-9388-c727b761f04c req-3d9bbd04-2db0-4cef-bc72-1587103bace5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032567 Aug 29 16:34:47.213055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:47.213387 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3695/7218] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:34:47.220767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:47.221905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:47.222724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:47.223478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:47.223949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:47.224382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:47.423498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:47.431297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2db51808-6307-4fef-8cb5-a27361742530 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1317 microversion: 2.1 time: 0.223568 Aug 29 16:34:47.431872 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3524/7219] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:47 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:48.454255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:48.455238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:48.461727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.462270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.462679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:48.463457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.463929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.464368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:48.602582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:48.611196 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-24a95ecf-9fb4-48de-8233-4a2328d479d2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1508 microversion: 2.1 time: 0.162354 Aug 29 16:34:48.611779 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3696/7220] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:48 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:48.631813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:48.632438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:48.639930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.640418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.640855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:48.641541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.641995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.642419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:48.646541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=100 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:48.773813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:48.782686 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f569fab-5799-4374-933f-f24be3b60b0b tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1508 microversion: 2.1 time: 0.154708 Aug 29 16:34:48.784031 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3525/7221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:48 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:48.804922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:34:48.807240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:48.813236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.813726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.814170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:48.814862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.815351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.815779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:48.848129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:48.853906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Old instance type m1.heat2, new instance type m1.heat {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:34:48.860584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:34:48.861012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:34:48.861521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:34:48.861936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:34:48.862354 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:34:48.926043 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4676ef02-e7db-4e6c-82a9-41a4c0fe72f3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "POST /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a/action" status: 202 len: 0 microversion: 2.1 time: 0.125212 Aug 29 16:34:48.926656 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3697/7222] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:34:48 2022] POST /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:34:48.934981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:48.936552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:48.942244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.942743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.943278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:48.943985 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:48.944447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:48.944876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:49.087070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:49.095561 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8382ee19-884e-4738-b7b7-99d324ced41f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1515 microversion: 2.1 time: 0.164488 Aug 29 16:34:49.096138 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3526/7223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:48 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:50.119277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:50.119863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:50.126600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:50.127123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:50.127578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:50.128313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:50.128779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:50.129217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:50.260326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:50.271777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:50.280007 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0eaa3928-d2ee-43d0-8f89-f1469d9687d6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1515 microversion: 2.1 time: 0.166706 Aug 29 16:34:50.280380 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3698/7224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:50 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:51.301210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:51.301829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:51.304703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:51.305388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:51.312288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:51.312783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:51.313224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:51.313923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:51.314383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:51.314814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:51.443403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:51.452299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-18dfbf38-135b-45ba-b7d6-c1a15da8ba0d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.154829 Aug 29 16:34:51.452887 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3527/7225] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:51 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:52.473888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:52.474516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:52.482471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:52.482970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:52.483447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:52.484149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:52.484620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:52.485068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:52.620361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:52.628143 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6702bf1-efb8-4a18-8c19-46342f9acc68 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.158159 Aug 29 16:34:52.628715 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3699/7226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:52 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:34:53.649226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:53.649842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:53.657724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:53.658209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:53.658645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:53.659355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:53.659807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:53.660225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:53.796434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:53.804217 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0bd8e5a7-849e-4dc1-a720-643e0e8c27ab tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.158933 Aug 29 16:34:53.804797 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3528/7227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:53 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:54.825248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:54.826388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:54.833340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:54.833839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:54.834288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:54.834987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:54.835480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:54.835918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:54.976984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:54.980464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:34:54.985978 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b523ba41-28fa-4032-8258-556c1c459180 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.164909 Aug 29 16:34:54.986580 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3700/7228] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:54 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:56.007679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:56.008200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:56.014363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:56.014875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:56.015338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:56.016030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:56.016484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:56.016910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:56.150272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:56.158978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e4ee956e-60f6-4165-bbfd-5b115b4048d1 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.155539 Aug 29 16:34:56.159581 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3529/7229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:56 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:57.180608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:57.181240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:57.191251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:57.191765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:57.192219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:57.192930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:57.193405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:57.193844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:57.329615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:57.337385 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f3d28f4-add1-48fc-aba1-2e3c7f005182 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.161170 Aug 29 16:34:57.337959 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3701/7230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:57 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:58.359897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:58.360422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:58.367282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:58.367762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:58.368195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:58.368874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:58.369322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:58.369738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:58.501574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:58.509466 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ee6f191-fa0b-4569-93ed-d7e8d778588f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.154219 Aug 29 16:34:58.510045 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3530/7231] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:58 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:34:59.532235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:34:59.532937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:34:59.540079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:59.540580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:59.541033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:59.541737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:34:59.542208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:34:59.542648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:34:59.679348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:34:59.687882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c182ae56-da4c-411e-971a-c12c3609a541 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.160798 Aug 29 16:34:59.688456 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3702/7232] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:34:59 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:00.708835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:00.709455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:00.716404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:00.717086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:00.717688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:00.718398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:00.718855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:00.719309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:00.849760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:00.858133 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9e0e718f-9c96-45ad-b5d1-3659c4a98bd0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.153194 Aug 29 16:35:00.858936 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3531/7233] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:00 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:01.881551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:01.882188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:01.889999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:01.890498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:01.890953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:01.891687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:01.892157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:01.892605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:02.025097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:02.032800 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9abad01a-6207-4a1c-a315-7c1ed86b9dda tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.155241 Aug 29 16:35:02.033382 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3703/7234] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:01 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:03.053606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:03.054227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:03.057094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:03.062525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:03.063041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:03.063495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:03.064192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:03.064656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:03.065092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:03.196864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:03.205256 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bce8cd17-d2e6-437e-9d0d-a448560ac687 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.155572 Aug 29 16:35:03.205838 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3532/7235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:03 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:04.227823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:04.228462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:04.230888 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:04.236629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:04.237134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:04.237589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:04.238297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:04.238772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:04.239255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:04.376047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:04.383844 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-20e8ce20-c69d-47a9-8c6b-dc2e6d6cddc7 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.160472 Aug 29 16:35:04.384414 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3704/7236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:04 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:05.405094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:05.405825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:05.408618 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:35:05.408749 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:35:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a (ip 10.222.0.83) !!! Aug 29 16:35:05.417540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:05.418034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:05.418472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:05.419733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:05.420212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:05.420682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:05.552377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:05.560280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9f52d528-f697-43ef-9e57-eda9253c80b5 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.159191 Aug 29 16:35:05.560867 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3533/7237] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:05 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:06.581508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:06.582130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:06.589028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:06.589521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:06.589966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:06.590655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:06.591663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:06.592100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:06.722301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:06.730061 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae7f9cae-0862-487e-a31e-8c7acb0cf040 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.152572 Aug 29 16:35:06.730628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3705/7238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:06 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:07.750633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:07.751276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:07.758475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:07.758963 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:07.759434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:07.760122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:07.760578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:07.761005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:07.893337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:07.901081 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ec88d30-0509-4223-bdd0-79d8ef27960f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.154875 Aug 29 16:35:07.901657 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3534/7239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:07 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:08.922224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:08.922859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:08.929852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:08.930357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:08.930843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:08.931575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:08.932046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:08.932486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:09.068964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:09.077888 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec49de77-0b1c-4c75-98a2-4765e370fa7c tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.159934 Aug 29 16:35:09.078459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3706/7240] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:08 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:10.098119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:10.098671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:10.105603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:10.106087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:10.107511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:10.108200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:10.108680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:10.109105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:10.247353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:10.255296 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e94823f-9333-46a0-9e52-a4245db771a8 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.161081 Aug 29 16:35:10.255894 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3535/7241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:10 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:11.276162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:11.276709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:11.284407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:11.284895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:11.285335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:11.286028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:11.286488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:11.286917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:11.416649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:11.424590 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-15d3c674-2acf-48f3-a78c-72abd8366464 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.152501 Aug 29 16:35:11.425176 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3707/7242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:11 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:12.444824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:12.445440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:12.453370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:12.453853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:12.454295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:12.454993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:12.455544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:12.455973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:12.586823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:12.594833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd009659-cfa3-4f64-a4f7-d40c669194c2 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.153945 Aug 29 16:35:12.595436 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3536/7243] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:12 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:13.617525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:13.618150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:13.625345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:13.625838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:13.626279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:13.626971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:13.627454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:13.627884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:13.765812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:13.773565 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-96a47c63-5a28-4dfa-8058-b455c46746e6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.160018 Aug 29 16:35:13.774131 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3708/7244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:13 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:14.795928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:14.796610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:14.803728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:14.804221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:14.804667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:14.805364 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:14.805829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:14.806258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:14.938442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:14.946454 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17b87841-87a5-4536-b001-ff760c065053 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.154619 Aug 29 16:35:14.947045 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3537/7245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:14 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:15.968222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:15.968765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:15.975947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:15.976449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:15.976902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:15.977612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:15.978083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:15.978526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:16.115798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:16.124393 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42a37b4b-cd45-444f-95ff-37a436ab82e9 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.159700 Aug 29 16:35:16.125720 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3709/7246] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:15 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:17.146689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:17.147402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:17.154600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:17.155829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:17.156460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:17.157175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:17.157637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:17.158069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:17.298252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:17.306503 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-637be4f6-f6f0-4475-aac4-7a4ff6400233 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1520 microversion: 2.1 time: 0.163957 Aug 29 16:35:17.307126 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3538/7247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:17 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:18.251306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-574057c7-6ad9-4a0d-9d11-47aaea2e12f5 req-8a344f8f-b021-41b8-b888-892722c29f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfe7b50-9356-46ba-b8eb-ef9faf281b6a", "name": "network-vif-unplugged", "status": "completed", "tag": "d5b0cafb-74f5-442c-a0a1-e18b80ea7b02"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:18.262506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-574057c7-6ad9-4a0d-9d11-47aaea2e12f5 req-8a344f8f-b021-41b8-b888-892722c29f9a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:18.263016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-574057c7-6ad9-4a0d-9d11-47aaea2e12f5 req-8a344f8f-b021-41b8-b888-892722c29f9a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:18.263534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-574057c7-6ad9-4a0d-9d11-47aaea2e12f5 req-8a344f8f-b021-41b8-b888-892722c29f9a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:18.277032 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-574057c7-6ad9-4a0d-9d11-47aaea2e12f5 req-8a344f8f-b021-41b8-b888-892722c29f9a service nova] Creating event network-vif-unplugged:d5b0cafb-74f5-442c-a0a1-e18b80ea7b02 for instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a on n-h2-836830-13 Aug 29 16:35:18.283259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-574057c7-6ad9-4a0d-9d11-47aaea2e12f5 req-8a344f8f-b021-41b8-b888-892722c29f9a service nova] Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:35:18.294287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-574057c7-6ad9-4a0d-9d11-47aaea2e12f5 req-8a344f8f-b021-41b8-b888-892722c29f9a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047437 Aug 29 16:35:18.294897 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3710/7248] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:18.328501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:18.329598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:18.335813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:18.336308 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:18.336731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:18.337457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:18.337910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:18.338330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:18.481825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:18.490148 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-68af4c08-983b-42fa-9622-701fa84f5417 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1519 microversion: 2.1 time: 0.166637 Aug 29 16:35:18.490742 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3539/7249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:18 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:19.514238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:19.515163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:19.521489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:19.521988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:19.522445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:19.523209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:19.523680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:19.524118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:19.658855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:19.666704 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c52e991d-2c9f-4ef6-b7f7-ace0a1ff8ba0 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1517 microversion: 2.1 time: 0.157676 Aug 29 16:35:19.667337 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3711/7250] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:19 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:20.324516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-433b640d-2bdb-45a9-98c0-5087ba850983 req-e5f8e9fb-b930-47df-8b65-dc2fdc32806b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbfe7b50-9356-46ba-b8eb-ef9faf281b6a", "tag": "d5b0cafb-74f5-442c-a0a1-e18b80ea7b02"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:20.335638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-433b640d-2bdb-45a9-98c0-5087ba850983 req-e5f8e9fb-b930-47df-8b65-dc2fdc32806b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:20.336124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-433b640d-2bdb-45a9-98c0-5087ba850983 req-e5f8e9fb-b930-47df-8b65-dc2fdc32806b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:20.336563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-433b640d-2bdb-45a9-98c0-5087ba850983 req-e5f8e9fb-b930-47df-8b65-dc2fdc32806b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:20.340264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=89 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:20.349642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-433b640d-2bdb-45a9-98c0-5087ba850983 req-e5f8e9fb-b930-47df-8b65-dc2fdc32806b service nova] Creating event network-changed:d5b0cafb-74f5-442c-a0a1-e18b80ea7b02 for instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a on n-h2-836830-13 Aug 29 16:35:20.355129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-433b640d-2bdb-45a9-98c0-5087ba850983 req-e5f8e9fb-b930-47df-8b65-dc2fdc32806b service nova] Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:35:20.365888 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-433b640d-2bdb-45a9-98c0-5087ba850983 req-e5f8e9fb-b930-47df-8b65-dc2fdc32806b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045309 Aug 29 16:35:20.366514 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3540/7251] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:20.689118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:20.689885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:20.697279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:20.701123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:20.701123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:20.701123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:20.701123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:20.701123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:20.835744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:20.844491 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dfc033b8-cc72-477b-8082-049b902f3356 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1517 microversion: 2.1 time: 0.159507 Aug 29 16:35:20.845085 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3712/7252] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:20 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:21.866802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:21.867535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:21.874377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:21.874867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:21.875341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:21.876038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:21.876491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:21.876920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:22.008115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:22.016139 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-23c6bca5-08fe-48dd-bdd8-e1a2d411b374 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1517 microversion: 2.1 time: 0.154399 Aug 29 16:35:22.016723 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3541/7253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:21 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:23.037109 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:23.037739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:23.044606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.045103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.046323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.047046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.047533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.047974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.181512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:23.189673 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f215c678-7913-4182-9b33-d7b4096b121f tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1514 microversion: 2.1 time: 0.156472 Aug 29 16:35:23.190248 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3713/7254] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:23 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:23.210331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:23.210873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:23.218829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.219384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.219822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.220552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.221006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.221433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.286192 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e11cb649-b7f9-407d-be09-889b653a264d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "POST /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a/action" status: 204 len: 0 microversion: 2.1 time: 0.079514 Aug 29 16:35:23.287122 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3542/7255] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:35:23 2022] POST /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:35:23.297353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:23.297978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:23.304516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.305273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.306148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.307596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:23.308071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:23.308510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:23.444010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:23.452471 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cba6bea2-8061-4ede-b03c-b41366b77a9a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1514 microversion: 2.1 time: 0.159984 Aug 29 16:35:23.453098 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3714/7256] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:23 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:24.474607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:24.475360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:24.481984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:24.482467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:24.482900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:24.484539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:24.485000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:24.485426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:24.641002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:24.648759 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-96716a58-9b2e-482b-a4bc-e16613c0545d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1506 microversion: 2.1 time: 0.178388 Aug 29 16:35:24.649342 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3543/7257] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:24 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:24.669364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:24.670023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:24.677772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:24.678265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:24.678711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:24.679518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:24.679985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:24.680453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:24.813414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:24.821466 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed4372a2-4413-414e-9cc6-22a0350dde8a tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1506 microversion: 2.1 time: 0.156134 Aug 29 16:35:24.822045 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3715/7258] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:24 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:24.840850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:24.841468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:24.847981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:24.848481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:24.848922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:24.849618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:24.850076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:24.850505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:24.978837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:24.987134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3d3dda8-04bc-42f3-bd81-e2076a38fe64 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1506 microversion: 2.1 time: 0.150153 Aug 29 16:35:24.987716 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3544/7259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:24 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:25.007061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:25.007585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:25.013665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.014250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.015302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.016009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.016485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.016930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.041833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:35:25.076611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:25.119890 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1d2c00a-6e11-4e75-a184-47e107f3ed9d tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 204 len: 0 microversion: 2.1 time: 0.116455 Aug 29 16:35:25.120642 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3716/7260] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:35:25 2022] DELETE /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:35:25.138216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:25.138721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:25.146318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.146812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.147285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.147987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.148448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.148876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.174588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:35:25.220347 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.compute.api [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Instance is already in deleting state, ignoring this request Aug 29 16:35:25.221223 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-326c9461-f7bf-44da-a9fb-4a69c6a8aff6 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 204 len: 0 microversion: 2.1 time: 0.086968 Aug 29 16:35:25.221920 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3545/7261] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:35:25 2022] DELETE /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:35:25.230569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:25.231274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:25.237483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.237988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.238440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.239175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:25.239645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:25.240088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:25.377458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:25.385550 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-56c11140-c4c3-4be2-93f5-7cebedf4befd tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1512 microversion: 2.1 time: 0.159295 Aug 29 16:35:25.386130 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3717/7262] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:25 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:26.239493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9adfe7be-93ea-4621-90fe-50b29e427a3a req-de4b8a39-8681-4ef6-8826-b00691a89074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfe7b50-9356-46ba-b8eb-ef9faf281b6a", "name": "network-vif-plugged", "status": "completed", "tag": "d5b0cafb-74f5-442c-a0a1-e18b80ea7b02"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:26.250286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9adfe7be-93ea-4621-90fe-50b29e427a3a req-de4b8a39-8681-4ef6-8826-b00691a89074 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:26.251365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9adfe7be-93ea-4621-90fe-50b29e427a3a req-de4b8a39-8681-4ef6-8826-b00691a89074 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:26.251365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9adfe7be-93ea-4621-90fe-50b29e427a3a req-de4b8a39-8681-4ef6-8826-b00691a89074 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:26.269715 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9adfe7be-93ea-4621-90fe-50b29e427a3a req-de4b8a39-8681-4ef6-8826-b00691a89074 service nova] Creating event network-vif-plugged:d5b0cafb-74f5-442c-a0a1-e18b80ea7b02 for instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a on n-h2-836830-13 Aug 29 16:35:26.274931 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9adfe7be-93ea-4621-90fe-50b29e427a3a req-de4b8a39-8681-4ef6-8826-b00691a89074 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039342 Aug 29 16:35:26.276046 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3546/7263] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:26.408399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:26.408978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:26.415980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:26.416476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:26.416920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:26.417614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:26.418075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:26.418509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:26.550517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:26.558661 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8041a142-85c8-40ff-965a-40206d5cb8e3 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1512 microversion: 2.1 time: 0.154344 Aug 29 16:35:26.559272 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3718/7264] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:26 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:27.453992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ec509fc5-a4ea-4528-b043-d11b371751d8 req-25c8def5-1feb-40d5-a1d4-7f49af15f4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbfe7b50-9356-46ba-b8eb-ef9faf281b6a", "name": "network-vif-deleted", "tag": "d5b0cafb-74f5-442c-a0a1-e18b80ea7b02"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:27.463944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ec509fc5-a4ea-4528-b043-d11b371751d8 req-25c8def5-1feb-40d5-a1d4-7f49af15f4d8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:27.464445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ec509fc5-a4ea-4528-b043-d11b371751d8 req-25c8def5-1feb-40d5-a1d4-7f49af15f4d8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:27.464896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ec509fc5-a4ea-4528-b043-d11b371751d8 req-25c8def5-1feb-40d5-a1d4-7f49af15f4d8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:27.477280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ec509fc5-a4ea-4528-b043-d11b371751d8 req-25c8def5-1feb-40d5-a1d4-7f49af15f4d8 service nova] Creating event network-vif-deleted:d5b0cafb-74f5-442c-a0a1-e18b80ea7b02 for instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a on n-h2-836830-13 Aug 29 16:35:27.482516 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ec509fc5-a4ea-4528-b043-d11b371751d8 req-25c8def5-1feb-40d5-a1d4-7f49af15f4d8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034045 Aug 29 16:35:27.483601 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3547/7265] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:27.580007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:27.580640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:27.588083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:27.588588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:27.589076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:27.589788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:27.590318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:27.590759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:27.626031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:27.626561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:27.627014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:27.627530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lazy-loading 'fault' on Instance uuid dbfe7b50-9356-46ba-b8eb-ef9faf281b6a {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:35:27.671069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa173eefc8a420da1c367c8ad53e44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd54d609ed014dea947a1ce0b27b2d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:27.679109 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bb96e876-e9c4-45ee-9f78-989e7387a353 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 200 len: 1305 microversion: 2.1 time: 0.103035 Aug 29 16:35:27.679761 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3719/7266] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:27 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:28.703976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:28.704783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: dbfe7b50-9356-46ba-b8eb-ef9faf281b6a] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:28.711236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:28.711718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:28.712148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:28.712831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:28.713279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:28.713697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:28.727103 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] HTTP exception thrown: Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a could not be found. Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Request method failure captured: Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a HTTP/1.1 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOptVrmmcllx0Em_4p3-sqvtJYLbSQsOsxP4TgoYdIW9v-Jg7TRT3pDr51AlUnVAb9FWBJRRM8TC5uTyyrnTSOE0Iu_RUZ2MZp-kTxYBAJLHIf5viYQATwgxrGjcTmx_1VJ--g77RFvY78sC1KDq0sXsTDzoa30DwiLgHCsKLyEpS-Y Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: bd54d609ed014dea947a1ce0b27b2d94 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd54d609ed014dea947a1ce0b27b2d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bd54d609ed014dea947a1ce0b27b2d94", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd54d609ed014dea947a1ce0b27b2d94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bd54d609ed014dea947a1ce0b27b2d94"}]}] Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: bd54d609ed014dea947a1ce0b27b2d94 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerDiskConfigTestJSON-719135694-project Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8fa173eefc8a420da1c367c8ad53e44c Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerDiskConfigTestJSON-719135694-project Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a could not be found. Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'dbfe7b50-9356-46ba-b8eb-ef9faf281b6a'} Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a could not be found. Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a could not be found. Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:28.728728 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a could not be found. Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Returning 404 to user: Instance dbfe7b50-9356-46ba-b8eb-ef9faf281b6a could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13875dc6-837f-442c-b29b-f5247e242c39 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a" status: 404 len: 111 microversion: 2.1 time: 0.032137 Aug 29 16:35:28.733102 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3548/7267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:28 2022] GET /compute/v2.1/servers/dbfe7b50-9356-46ba-b8eb-ef9faf281b6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:35:28.738953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07d7f003-0693-4dc6-bae6-9123d3db5b56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '.version_select at 0x7f32ed0cb700>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:28.761499 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-07d7f003-0693-4dc6-bae6-9123d3db5b56 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574288518" status: 202 len: 0 microversion: 2.1 time: 0.026403 Aug 29 16:35:28.762081 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3720/7268] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:35:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574288518 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:35:29.394370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:29.395183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:29.401379 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:29.401865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:29.402313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:29.402999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:29.403478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:29.403904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:29.419614 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] HTTP exception thrown: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Request method failure captured: Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b HTTP/1.1 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOptVrmmcllx0Em_4p3-sqvtJYLbSQsOsxP4TgoYdIW9v-Jg7TRT3pDr51AlUnVAb9FWBJRRM8TC5uTyyrnTSOE0Iu_RUZ2MZp-kTxYBAJLHIf5viYQATwgxrGjcTmx_1VJ--g77RFvY78sC1KDq0sXsTDzoa30DwiLgHCsKLyEpS-Y Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: bd54d609ed014dea947a1ce0b27b2d94 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd54d609ed014dea947a1ce0b27b2d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bd54d609ed014dea947a1ce0b27b2d94", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd54d609ed014dea947a1ce0b27b2d94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bd54d609ed014dea947a1ce0b27b2d94"}]}] Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: bd54d609ed014dea947a1ce0b27b2d94 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerDiskConfigTestJSON-719135694-project Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 8fa173eefc8a420da1c367c8ad53e44c Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerDiskConfigTestJSON-719135694-project Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'ba4c7462-9928-470e-9e59-7008f390858b'} Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:35:29.422460 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Returning 404 to user: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-523c18f1-8817-4e78-928a-1b5116a41016 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 404 len: 111 microversion: 2.1 time: 0.036958 Aug 29 16:35:29.426645 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3549/7269] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:35:29 2022] DELETE /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:35:29.432780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:29.433407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] [instance: ba4c7462-9928-470e-9e59-7008f390858b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:29.440687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:29.441180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:29.441627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:29.442323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:29.442794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:29.443258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:29.459675 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] HTTP exception thrown: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Request method failure captured: Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b HTTP/1.1 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOptVrmmcllx0Em_4p3-sqvtJYLbSQsOsxP4TgoYdIW9v-Jg7TRT3pDr51AlUnVAb9FWBJRRM8TC5uTyyrnTSOE0Iu_RUZ2MZp-kTxYBAJLHIf5viYQATwgxrGjcTmx_1VJ--g77RFvY78sC1KDq0sXsTDzoa30DwiLgHCsKLyEpS-Y Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: bd54d609ed014dea947a1ce0b27b2d94 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd54d609ed014dea947a1ce0b27b2d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_bd54d609ed014dea947a1ce0b27b2d94", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/bd54d609ed014dea947a1ce0b27b2d94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/bd54d609ed014dea947a1ce0b27b2d94"}]}] Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: bd54d609ed014dea947a1ce0b27b2d94 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-719135694 Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerDiskConfigTestJSON-719135694-project Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 8fa173eefc8a420da1c367c8ad53e44c Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerDiskConfigTestJSON-719135694-project Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ba4c7462-9928-470e-9e59-7008f390858b'} Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:35:29.461337 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] Returning 404 to user: Instance ba4c7462-9928-470e-9e59-7008f390858b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72d54482-d903-4f66-a892-8476a19a1a93 tempest-ServerDiskConfigTestJSON-719135694 tempest-ServerDiskConfigTestJSON-719135694-project] 10.222.0.83 "GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b" status: 404 len: 111 microversion: 2.1 time: 0.033863 Aug 29 16:35:29.465529 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3721/7270] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:29 2022] GET /compute/v2.1/servers/ba4c7462-9928-470e-9e59-7008f390858b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:35:37.975545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a61d806-a2b5-403b-8796-f770c9534550 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'create', calling method: .version_select at 0x7f32ee8df4c0>, body: {"keypair": {"name": "tempest-keypair-1107980636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdHWfJFncYmSdA1MseLTfwWVQabCjyjm3yBA0FJrWaI6mWlfjW2xprMqiOlZya4ulIey9lO1Ox5l017DcyNNWK+fPSYbR8o+w3xloomitzu0EzDyLNc+dQVrwSMjUnOxg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:37.981882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=36 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:37.996265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5a61d806-a2b5-403b-8796-f770c9534550 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for project fe2904332eef460b8b57f38b445a30aa. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:35:38.004512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-5a61d806-a2b5-403b-8796-f770c9534550 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for user ea14a64fabd24976a0946f6817d2f679 and project fe2904332eef460b8b57f38b445a30aa. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:35:38.042527 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5a61d806-a2b5-403b-8796-f770c9534550 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209291 Aug 29 16:35:38.043229 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3550/7271] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:35:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:39.742727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-51667300", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90bebefd-832e-4ea2-9620-b36815838958"}], "security_groups": [{"name": "tempest-securitygroup--238018108"}], "key_name": "tempest-keypair-1107980636", "user_data": "}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:39.753169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:39.754017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:39.855807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] validate_networks() for [('90bebefd-832e-4ea2-9620-b36815838958', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:35:40.264171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:35:40.264622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:35:40.265138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:35:40.265598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:35:40.266031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:35:40.275510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:40.276013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:40.276599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:40.277349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:40.277822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:40.278265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:40.305542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:35:40.312007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for user ea14a64fabd24976a0946f6817d2f679 and project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:35:40.325091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:35:40.327890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:35:40.376086 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-971107cc-7435-4df9-b25d-45c34df2da9f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.638132 Aug 29 16:35:40.376921 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3722/7272] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:35:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:35:40.388257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6df57abb-b77e-485b-9dd2-990a11478721 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:40.389840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6df57abb-b77e-485b-9dd2-990a11478721 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:40.392540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:40.458166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6df57abb-b77e-485b-9dd2-990a11478721 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:40.465325 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6df57abb-b77e-485b-9dd2-990a11478721 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1237 microversion: 2.1 time: 0.081720 Aug 29 16:35:40.467379 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3551/7273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:40 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:41.489756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:41.490397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:41.496949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:41.497974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:41.499006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:41.499840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:41.500543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:41.501207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:41.581737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:41.592594 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4748527b-a816-48bc-ad1d-6ddad7e70ebc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1297 microversion: 2.1 time: 0.107514 Aug 29 16:35:41.593219 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3723/7274] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:41 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:42.613953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:42.614652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:42.625075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:42.625581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:42.626073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:42.626878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:42.627407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:42.627898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:43.131831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:43.141655 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-99a3d919-bb9e-4a78-b3e3-c5ad1ff33b1b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1362 microversion: 2.1 time: 0.531877 Aug 29 16:35:43.142500 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3552/7275] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:42 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:43.226169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e5abb0f0-4f47-416c-88fb-3a51613a5def req-8516a5d6-6331-4091-98a3-49fcb1215bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea861908-2f1a-4d44-9c6e-6c1208d3311b", "tag": "53ad2013-5323-4020-a397-80c9fc6e243c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:43.244481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5abb0f0-4f47-416c-88fb-3a51613a5def req-8516a5d6-6331-4091-98a3-49fcb1215bda service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:43.252371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5abb0f0-4f47-416c-88fb-3a51613a5def req-8516a5d6-6331-4091-98a3-49fcb1215bda service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:43.256221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5abb0f0-4f47-416c-88fb-3a51613a5def req-8516a5d6-6331-4091-98a3-49fcb1215bda service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:43.270808 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e5abb0f0-4f47-416c-88fb-3a51613a5def req-8516a5d6-6331-4091-98a3-49fcb1215bda service nova] Creating event network-changed:53ad2013-5323-4020-a397-80c9fc6e243c for instance ea861908-2f1a-4d44-9c6e-6c1208d3311b on n-h1-836830-13 Aug 29 16:35:43.276450 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e5abb0f0-4f47-416c-88fb-3a51613a5def req-8516a5d6-6331-4091-98a3-49fcb1215bda service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054023 Aug 29 16:35:43.277654 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3724/7276] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:44.162960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:44.163693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:44.170781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:44.171304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:44.171746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:44.172444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:44.172911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:44.173370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:44.311945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:44.319934 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9aaa1c0d-4e90-4e28-aaa3-e7085326df5c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1362 microversion: 2.1 time: 0.160941 Aug 29 16:35:44.320539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3553/7277] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:44 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:45.342724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:45.343506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:45.350115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:45.350624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:45.351099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:45.351808 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:45.352276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:45.352715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:45.488842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:45.496809 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4d992d82-750e-46ec-afde-b8411b8bd44b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1362 microversion: 2.1 time: 0.159316 Aug 29 16:35:45.498435 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3725/7278] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:45 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:46.519367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:46.519986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:46.527043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:46.527615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:46.528061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:46.528845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:46.529315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:46.529742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:46.734986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:46.742938 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4d36d174-39de-460c-979f-13bd28bb95bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1362 microversion: 2.1 time: 0.227505 Aug 29 16:35:46.743577 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3554/7279] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:46 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:47.512474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-300bbd55-8039-4186-a637-4e76e9b9d24e req-1b4bae69-9800-40b2-823c-3a6a9b63f2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea861908-2f1a-4d44-9c6e-6c1208d3311b", "name": "network-vif-plugged", "status": "completed", "tag": "53ad2013-5323-4020-a397-80c9fc6e243c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:47.523907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-300bbd55-8039-4186-a637-4e76e9b9d24e req-1b4bae69-9800-40b2-823c-3a6a9b63f2de service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:47.524402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-300bbd55-8039-4186-a637-4e76e9b9d24e req-1b4bae69-9800-40b2-823c-3a6a9b63f2de service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:47.524843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-300bbd55-8039-4186-a637-4e76e9b9d24e req-1b4bae69-9800-40b2-823c-3a6a9b63f2de service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:47.536827 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-300bbd55-8039-4186-a637-4e76e9b9d24e req-1b4bae69-9800-40b2-823c-3a6a9b63f2de service nova] Creating event network-vif-plugged:53ad2013-5323-4020-a397-80c9fc6e243c for instance ea861908-2f1a-4d44-9c6e-6c1208d3311b on n-h1-836830-13 Aug 29 16:35:47.541723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-300bbd55-8039-4186-a637-4e76e9b9d24e req-1b4bae69-9800-40b2-823c-3a6a9b63f2de service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033368 Aug 29 16:35:47.542335 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3726/7280] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:35:47.763568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:47.764212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:47.771186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:47.771669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:47.772100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:47.772779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:47.773231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:47.773650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:47.902580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:47.910927 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ea2929b0-47f8-4047-b8ec-10640189fde3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1362 microversion: 2.1 time: 0.151525 Aug 29 16:35:47.911530 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3555/7281] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:47 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:48.933588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:48.934353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:48.941710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:48.942207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:48.942651 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:48.943384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:48.943845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:48.944280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:49.120469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:35:49.129009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1c29e404-2394-4cd7-9400-22c6c95b31fb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1550 microversion: 2.1 time: 0.200597 Aug 29 16:35:49.129584 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3727/7282] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:35:48 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1550 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:35:49.149111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:35:49.149634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:35:49.156594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:49.157073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:49.157505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:49.158187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:49.158637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:49.159079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:49.326819 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3e0e622-b13c-4d94-a34a-d3cc7270d8e8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181543 Aug 29 16:35:49.327701 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3556/7283] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:35:49 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:35:50.384105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-264f6806-4cf9-4bf4-8e27-f96eaae27ec5 req-e6665380-6e83-4591-b672-ab4745205325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea861908-2f1a-4d44-9c6e-6c1208d3311b", "tag": "53ad2013-5323-4020-a397-80c9fc6e243c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:35:50.390204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:50.390921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:35:50.397530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-264f6806-4cf9-4bf4-8e27-f96eaae27ec5 req-e6665380-6e83-4591-b672-ab4745205325 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:35:50.398028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-264f6806-4cf9-4bf4-8e27-f96eaae27ec5 req-e6665380-6e83-4591-b672-ab4745205325 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:35:50.398470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-264f6806-4cf9-4bf4-8e27-f96eaae27ec5 req-e6665380-6e83-4591-b672-ab4745205325 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:35:50.410416 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-264f6806-4cf9-4bf4-8e27-f96eaae27ec5 req-e6665380-6e83-4591-b672-ab4745205325 service nova] Creating event network-changed:53ad2013-5323-4020-a397-80c9fc6e243c for instance ea861908-2f1a-4d44-9c6e-6c1208d3311b on n-h1-836830-13 Aug 29 16:35:50.415403 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-264f6806-4cf9-4bf4-8e27-f96eaae27ec5 req-e6665380-6e83-4591-b672-ab4745205325 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035039 Aug 29 16:35:50.416009 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3728/7284] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:19.951939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:19.952936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:19.953571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=28 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:19.957479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:19.958031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:19.965685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:19.966224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:19.966655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:19.967368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:19.967820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:19.968241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.100497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:20.109173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a9deaec6-4b7a-4b3d-9919-95237d4e81ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1668 microversion: 2.1 time: 0.159067 Aug 29 16:36:20.109747 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3557/7285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:19 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:20.128946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:20.129823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=26 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:20.134448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:20.135280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:20.142950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.143479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.143935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.144644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.145122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.145570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.423183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:20.430947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e00ae9c-55be-4c03-b3ce-bb249346f32a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1668 microversion: 2.1 time: 0.304182 Aug 29 16:36:20.431547 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3729/7286] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:20 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1668 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:20.451888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:20.452506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:20.458486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.458976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.459497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.460133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.460592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.461017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.597769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:20.605496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e992c4ed-3212-4cdf-9bc4-cc82729741d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1668 microversion: 2.1 time: 0.158093 Aug 29 16:36:20.606074 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3558/7287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:20 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:20.625443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:20.627692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:20.633737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.634237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.634683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.635445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.635912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.636352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.668986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:20.675287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Old instance type m1.heat2, new instance type m1.heat {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:36:20.681738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:36:20.682167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:36:20.682655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:36:20.683098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:36:20.683520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:36:20.747795 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b2d96a7-b7f2-4273-9518-89dd24960ae7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b/action" status: 202 len: 0 microversion: 2.1 time: 0.125962 Aug 29 16:36:20.748263 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3730/7288] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:36:20 2022] POST /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:36:20.756918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:20.757913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:20.766563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.767250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.767808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.769073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:20.769821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:20.770300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:20.915693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:20.923694 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd3564ae-6f10-4a0f-a2eb-64168976e54b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1677 microversion: 2.1 time: 0.171156 Aug 29 16:36:20.924281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3559/7289] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:20 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:21.946838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:21.947584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:21.954506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:21.955015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:21.955496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:21.956247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:21.956720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:21.957192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:22.095298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:22.103228 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba0330f8-a353-4971-aa8d-30883484026e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1677 microversion: 2.1 time: 0.161746 Aug 29 16:36:22.103908 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3731/7290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:21 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:23.125606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:23.126220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:23.133101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:23.133581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:23.134019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:23.134708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:23.135195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:23.135615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:23.272944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:23.281380 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e24ab12f-ad21-48d9-bba1-00dc97516a6e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.159809 Aug 29 16:36:23.281962 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3560/7291] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:23 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:24.303734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:24.304360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:24.311481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:24.311980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:24.312428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:24.313127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:24.313594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:24.314029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:24.446462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:24.454954 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7ddb1753-7e2e-4cd3-8ade-a4e8003c5a40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.155235 Aug 29 16:36:24.455607 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3732/7292] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:24 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:25.476935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:25.477589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:25.485557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:25.486420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:25.487288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:25.488543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:25.489368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:25.490136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:25.622813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:25.630660 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-949db7d7-b4cb-41f5-9583-446744d89a2f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.157683 Aug 29 16:36:25.631259 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3561/7293] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:25 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:26.652685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:26.653896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:26.662075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:26.662572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:26.663324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:26.664037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:26.664508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:26.664948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:26.802760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:26.810857 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72eb1dd4-4610-4486-a410-ee02315c2498 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.162024 Aug 29 16:36:26.811486 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3733/7294] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:26 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:27.832402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:27.832938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:27.839755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:27.840241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:27.840869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:27.841660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:27.842119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:27.842546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:27.975080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:27.983390 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-03043cb6-a925-42e7-b1fc-3ccdbd8bb462 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.155019 Aug 29 16:36:27.983967 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3562/7295] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:27 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:29.003983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:29.004556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:29.011970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:29.012991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:29.013421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:29.014134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:29.014605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:29.015072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:29.147271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:29.155406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ada5f38d-756b-4dd9-95f1-ed25f9d6366a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.155450 Aug 29 16:36:29.155986 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3734/7296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:28 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:30.176257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:30.176816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:30.187643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:30.188135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:30.188574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:30.189271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:30.189745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:30.190162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:30.326190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:30.335081 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0877bd78-775d-426f-a4de-bbf762022897 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.162753 Aug 29 16:36:30.335550 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3563/7297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:30 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:31.356329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:31.356968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:31.364077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.364585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.365040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:31.365759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:31.366234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:31.366681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:31.504183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:31.512034 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7a3ce4b-8720-4f28-8b13-616faf66f924 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.159761 Aug 29 16:36:31.513116 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3735/7298] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:31 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:32.533835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:32.534449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:32.541355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:32.541836 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:32.542271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:32.542955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:32.543464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:32.543902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:32.681474 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:32.689295 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73dcf549-41be-4604-89d7-09a2c53c72f3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.159388 Aug 29 16:36:32.689879 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3564/7299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:32 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:33.711346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:33.711983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:33.718947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:33.719471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:33.719918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:33.720623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:33.721088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:33.721524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:33.853398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:33.861513 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a7eec87-cbc0-49e7-9dcc-b2cc31ede9ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1682 microversion: 2.1 time: 0.154217 Aug 29 16:36:33.862093 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3736/7300] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:33 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:34.882742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:34.883415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:34.891221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:34.891724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:34.892164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:34.892863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:34.893321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:34.893752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:35.038595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:35.047314 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-325902bd-b730-47fc-857a-2d86a389134f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1681 microversion: 2.1 time: 0.168653 Aug 29 16:36:35.047904 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3565/7301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:34 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:35.504342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e50c5b6f-b2ca-46ab-bcd5-0279b2b0a61c req-d1f9761f-195a-4c4f-84ef-e2842ca9977a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea861908-2f1a-4d44-9c6e-6c1208d3311b", "name": "network-vif-unplugged", "status": "completed", "tag": "53ad2013-5323-4020-a397-80c9fc6e243c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:35.514563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e50c5b6f-b2ca-46ab-bcd5-0279b2b0a61c req-d1f9761f-195a-4c4f-84ef-e2842ca9977a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:35.515080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e50c5b6f-b2ca-46ab-bcd5-0279b2b0a61c req-d1f9761f-195a-4c4f-84ef-e2842ca9977a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:35.515519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e50c5b6f-b2ca-46ab-bcd5-0279b2b0a61c req-d1f9761f-195a-4c4f-84ef-e2842ca9977a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:35.528234 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e50c5b6f-b2ca-46ab-bcd5-0279b2b0a61c req-d1f9761f-195a-4c4f-84ef-e2842ca9977a service nova] Creating event network-vif-unplugged:53ad2013-5323-4020-a397-80c9fc6e243c for instance ea861908-2f1a-4d44-9c6e-6c1208d3311b on n-h2-836830-13 Aug 29 16:36:35.533822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-e50c5b6f-b2ca-46ab-bcd5-0279b2b0a61c req-d1f9761f-195a-4c4f-84ef-e2842ca9977a service nova] Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:36:35.545583 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e50c5b6f-b2ca-46ab-bcd5-0279b2b0a61c req-d1f9761f-195a-4c4f-84ef-e2842ca9977a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096882 Aug 29 16:36:35.546224 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3737/7302] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:36.070214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:36.071106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:36.078146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:36.078633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:36.079086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:36.079787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:36.080238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:36.080712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:36.218884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:36.227117 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8875a318-36b3-49a6-9afb-48bdb82ab45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1681 microversion: 2.1 time: 0.161256 Aug 29 16:36:36.227699 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3566/7303] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:36 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:37.250831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:37.251582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:37.257789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:37.258288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:37.258737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:37.259463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:37.259935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:37.260373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:37.406200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:37.414472 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e7d3e02-e22d-43a7-8280-4d4aac1d5f72 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1679 microversion: 2.1 time: 0.169295 Aug 29 16:36:37.415094 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3738/7304] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:37 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:37.560869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-695043fc-5908-4efa-962f-4063aff7e1dc req-e5a1286d-4a67-4d55-987b-a0faa0768861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea861908-2f1a-4d44-9c6e-6c1208d3311b", "tag": "53ad2013-5323-4020-a397-80c9fc6e243c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:37.571696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-695043fc-5908-4efa-962f-4063aff7e1dc req-e5a1286d-4a67-4d55-987b-a0faa0768861 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:37.572186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-695043fc-5908-4efa-962f-4063aff7e1dc req-e5a1286d-4a67-4d55-987b-a0faa0768861 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:37.572630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-695043fc-5908-4efa-962f-4063aff7e1dc req-e5a1286d-4a67-4d55-987b-a0faa0768861 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:37.585756 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-695043fc-5908-4efa-962f-4063aff7e1dc req-e5a1286d-4a67-4d55-987b-a0faa0768861 service nova] Creating event network-changed:53ad2013-5323-4020-a397-80c9fc6e243c for instance ea861908-2f1a-4d44-9c6e-6c1208d3311b on n-h2-836830-13 Aug 29 16:36:37.591842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-695043fc-5908-4efa-962f-4063aff7e1dc req-e5a1286d-4a67-4d55-987b-a0faa0768861 service nova] Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:36:37.603066 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-695043fc-5908-4efa-962f-4063aff7e1dc req-e5a1286d-4a67-4d55-987b-a0faa0768861 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046355 Aug 29 16:36:37.603619 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3567/7305] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:38.436937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:38.437632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:38.448366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:38.449191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:38.449918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:38.451150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:38.451688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:38.452143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:38.600077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:38.609377 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f9960b37-c9dd-4d85-b2a7-834c0a355c0f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1679 microversion: 2.1 time: 0.176350 Aug 29 16:36:38.609975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3739/7306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:38 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:39.634164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:39.634871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:39.642449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:39.642949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:39.643415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:39.644112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:39.644571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:39.644997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:39.797341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:39.805299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1e4f02fd-de68-4402-aea4-a57e1460eb39 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1676 microversion: 2.1 time: 0.176392 Aug 29 16:36:39.805890 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3568/7307] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:39 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:39.827124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:39.827688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:39.834713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:39.835254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:39.835712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:39.836424 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:39.836880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:39.837311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:39.897290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c86b1dc3-27b2-45a3-9fce-5ecc646f6023 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b/action" status: 204 len: 0 microversion: 2.1 time: 0.074605 Aug 29 16:36:39.898020 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3740/7308] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:36:39 2022] POST /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:36:39.906493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:39.907130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:39.913339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:39.913840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:39.914293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:39.915003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:39.915521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:39.915980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:40.139723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:40.148108 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-64c1a0e9-47c4-45d2-a9ef-1a0464d1c8e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1676 microversion: 2.1 time: 0.245794 Aug 29 16:36:40.148688 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3569/7309] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:39 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:41.171371 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:41.172209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:41.180090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.180514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.181066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.181872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.182436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.182965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.325957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:41.333820 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b91e089-d893-4f96-9579-60a23be1e4b5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1668 microversion: 2.1 time: 0.168137 Aug 29 16:36:41.334399 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3741/7310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:41 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:36:41.354185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:41.354790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:41.361982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.362470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.362909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.363633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.364086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.364510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.494414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:41.502945 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-28d19cfe-08bb-4ded-b494-6da8209f067c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1668 microversion: 2.1 time: 0.153039 Aug 29 16:36:41.503555 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3570/7311] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:41 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:41.522561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:41.523275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:41.529655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.530160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.530616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.531357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.531828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.532272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.666018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:41.674650 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b8b918aa-edc5-4b7f-ac13-f88709a063bb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1668 microversion: 2.1 time: 0.155931 Aug 29 16:36:41.675261 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3742/7312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:41 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:41.696259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:41.696764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:41.703046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.703572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.704021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.704721 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.705185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.705614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.731365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:36:41.811425 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f977ba1-25ea-4817-9481-4d78a4046c77 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 204 len: 0 microversion: 2.1 time: 0.118903 Aug 29 16:36:41.812163 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3571/7313] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:36:41 2022] DELETE /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:36:41.821149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:41.821782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:41.828442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.828948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.829403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.830183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:41.830656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:41.831128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:41.849468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:41.974564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:41.983263 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f160eeb7-fa0d-4b01-ad09-5e67598c6de8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1674 microversion: 2.1 time: 0.166552 Aug 29 16:36:41.983859 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3743/7314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:41 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:42.583531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-0572bd3c-1a25-4731-9da6-fbeb4773561e req-3ae6a29b-8e18-4cc8-b9ba-d1d60e77dce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea861908-2f1a-4d44-9c6e-6c1208d3311b", "name": "network-vif-plugged", "status": "completed", "tag": "53ad2013-5323-4020-a397-80c9fc6e243c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:42.593941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0572bd3c-1a25-4731-9da6-fbeb4773561e req-3ae6a29b-8e18-4cc8-b9ba-d1d60e77dce2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:42.594421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0572bd3c-1a25-4731-9da6-fbeb4773561e req-3ae6a29b-8e18-4cc8-b9ba-d1d60e77dce2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:42.594854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-0572bd3c-1a25-4731-9da6-fbeb4773561e req-3ae6a29b-8e18-4cc8-b9ba-d1d60e77dce2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:42.598886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:42.608353 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-0572bd3c-1a25-4731-9da6-fbeb4773561e req-3ae6a29b-8e18-4cc8-b9ba-d1d60e77dce2 service nova] Creating event network-vif-plugged:53ad2013-5323-4020-a397-80c9fc6e243c for instance ea861908-2f1a-4d44-9c6e-6c1208d3311b on n-h2-836830-13 Aug 29 16:36:42.613500 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-0572bd3c-1a25-4731-9da6-fbeb4773561e req-3ae6a29b-8e18-4cc8-b9ba-d1d60e77dce2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087943 Aug 29 16:36:42.614102 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3572/7315] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:43.004506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:43.005126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:43.012609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:43.013476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:43.014190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:43.014901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:43.015398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:43.015836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:43.164866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:43.173179 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c5db083-2ee2-4d78-9d0d-ec3453d21bb4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1674 microversion: 2.1 time: 0.172555 Aug 29 16:36:43.173735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3744/7316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:42 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:44.195456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:44.196157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:44.203580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:44.204076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:44.204504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:44.205196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:44.205642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:44.206063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:44.350782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:44.359932 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fea94cb6-5e63-47c1-8f55-3ab5f292c3a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 200 len: 1674 microversion: 2.1 time: 0.169802 Aug 29 16:36:44.360629 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3573/7317] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:44 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:44.676029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-09670cb5-54be-4570-b728-5ff26a7dadb9 req-cdaee045-73a0-46c8-887c-2bafb92cb692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea861908-2f1a-4d44-9c6e-6c1208d3311b", "name": "network-vif-deleted", "tag": "53ad2013-5323-4020-a397-80c9fc6e243c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:44.689277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-09670cb5-54be-4570-b728-5ff26a7dadb9 req-cdaee045-73a0-46c8-887c-2bafb92cb692 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:44.689778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-09670cb5-54be-4570-b728-5ff26a7dadb9 req-cdaee045-73a0-46c8-887c-2bafb92cb692 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:44.690231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-09670cb5-54be-4570-b728-5ff26a7dadb9 req-cdaee045-73a0-46c8-887c-2bafb92cb692 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:44.702476 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-09670cb5-54be-4570-b728-5ff26a7dadb9 req-cdaee045-73a0-46c8-887c-2bafb92cb692 service nova] Creating event network-vif-deleted:53ad2013-5323-4020-a397-80c9fc6e243c for instance ea861908-2f1a-4d44-9c6e-6c1208d3311b on n-h2-836830-13 Aug 29 16:36:44.709150 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-09670cb5-54be-4570-b728-5ff26a7dadb9 req-cdaee045-73a0-46c8-887c-2bafb92cb692 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036980 Aug 29 16:36:44.713230 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3745/7318] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:45.381570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:45.382121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:45.389521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:45.390014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:45.390443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:45.391166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:45.391618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:45.392039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:45.406154 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b HTTP/1.1 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'ea861908-2f1a-4d44-9c6e-6c1208d3311b'} Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:36:45.407939 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95c9859f-07cd-44b0-bd7c-d4affddaa6de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 404 len: 111 microversion: 2.1 time: 0.031871 Aug 29 16:36:45.411794 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3574/7319] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:45 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:36:45.425547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:45.426258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:45.434095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:45.434669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:45.435346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:45.436063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:45.436527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:45.436964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:45.452400 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b HTTP/1.1 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ea861908-2f1a-4d44-9c6e-6c1208d3311b'} Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:36:45.454072 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cbc8551-1d22-4298-a4d3-930d03b42a23 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 404 len: 111 microversion: 2.1 time: 0.034328 Aug 29 16:36:45.458327 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3746/7320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:45 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:36:45.513367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1827103649", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "90bebefd-832e-4ea2-9620-b36815838958"}], "security_groups": [{"name": "tempest-securitygroup--238018108"}], "key_name": "tempest-keypair-1107980636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:45.522916 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:36:45.523157 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.83) !!! Aug 29 16:36:45.626472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] validate_networks() for [('90bebefd-832e-4ea2-9620-b36815838958', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:36:46.089726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:36:46.090230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:36:46.090700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:36:46.091330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:36:46.091785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:36:46.100758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:46.101233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:46.101663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:46.102373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:46.102825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:46.103267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:46.121209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:36:46.126597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for user ea14a64fabd24976a0946f6817d2f679 and project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:36:46.139438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:36:46.141732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:36:46.191284 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b086d0c-66f0-4c50-9dd4-f25d24f9f767 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681841 Aug 29 16:36:46.192495 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3575/7321] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:36:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:36:46.203663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c764302-3afe-4fe0-8534-d7f6dc31bc9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:46.204258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c764302-3afe-4fe0-8534-d7f6dc31bc9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:46.270981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c764302-3afe-4fe0-8534-d7f6dc31bc9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:46.280206 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c764302-3afe-4fe0-8534-d7f6dc31bc9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1239 microversion: 2.1 time: 0.080359 Aug 29 16:36:46.280790 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3747/7322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:46 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:47.304412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:47.307385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:47.318972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:47.320699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:47.321149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:47.322769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:47.322769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:47.322769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:47.401884 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:47.410822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c01fc8d1-2bfb-4c37-a67d-f6540208eae6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1309 microversion: 2.1 time: 0.112773 Aug 29 16:36:47.412883 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3576/7323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:47 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:48.434565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:48.435246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:48.442135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:48.442889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:48.443373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:48.444084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:48.444553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:48.444994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:48.652347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:48.662807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a490a60a-f451-49f3-84ab-e4c38c6ec0ae tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1364 microversion: 2.1 time: 0.232739 Aug 29 16:36:48.663713 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3748/7324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:48 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:48.846866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-23275839-590d-475f-a2a3-34362103406d req-6ae72844-b1e0-4d7a-bf48-fd4fe7221141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4025dfa5-add4-400d-bb67-0b8ad672be12", "tag": "46b557c2-7be6-449a-b58a-45c5db4442cb"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:48.857982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-23275839-590d-475f-a2a3-34362103406d req-6ae72844-b1e0-4d7a-bf48-fd4fe7221141 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:48.858494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-23275839-590d-475f-a2a3-34362103406d req-6ae72844-b1e0-4d7a-bf48-fd4fe7221141 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:48.859099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-23275839-590d-475f-a2a3-34362103406d req-6ae72844-b1e0-4d7a-bf48-fd4fe7221141 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:48.871157 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-23275839-590d-475f-a2a3-34362103406d req-6ae72844-b1e0-4d7a-bf48-fd4fe7221141 service nova] Creating event network-changed:46b557c2-7be6-449a-b58a-45c5db4442cb for instance 4025dfa5-add4-400d-bb67-0b8ad672be12 on n-h2-836830-13 Aug 29 16:36:48.876008 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-23275839-590d-475f-a2a3-34362103406d req-6ae72844-b1e0-4d7a-bf48-fd4fe7221141 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Aug 29 16:36:48.876604 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3577/7325] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:49.685535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:49.686079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:49.693104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:49.693621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:49.694063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:49.694783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:49.695274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:49.695702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:49.825613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:49.833586 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5633744-6a16-468e-8ae6-555c177d88ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1364 microversion: 2.1 time: 0.152108 Aug 29 16:36:49.834165 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3749/7326] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:49 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:50.857051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:50.857783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:50.859747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:50.866012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:50.866502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:50.866937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:50.867652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:50.868107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:50.868530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:51.007901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:51.015666 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fca19a67-0c64-4f2f-88cb-74bb0c257a67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1364 microversion: 2.1 time: 0.164279 Aug 29 16:36:51.016243 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3578/7327] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:50 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:52.036567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:52.037196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:52.041033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=49 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:52.047665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:52.048172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:52.048626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:52.049340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:52.049809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:52.050251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:52.185680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:52.193565 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ea38a439-cee6-42b1-83ed-07d7309b3cca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1364 microversion: 2.1 time: 0.160893 Aug 29 16:36:52.194141 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3750/7328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:52 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:53.214915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:53.215566 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:53.222495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:53.222979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:53.223442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:53.224121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:53.224574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:53.224997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:53.355817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:53.363740 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b54264b4-66a4-484b-8554-fbdc78d2a7a7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1364 microversion: 2.1 time: 0.153054 Aug 29 16:36:53.364334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3579/7329] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:53 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:54.385278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:54.386470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:54.393755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:54.394251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:54.394704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:54.395438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:54.395906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:54.396343 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:54.533289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:54.541118 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3cbbcd12-1343-4e51-8a42-b449362c8274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1364 microversion: 2.1 time: 0.159628 Aug 29 16:36:54.541640 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3751/7330] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:54 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:54.572898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-589a38ba-13fb-40cd-8d39-6520789365d9 req-c1987985-0b64-4523-9605-c53202ec4d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025dfa5-add4-400d-bb67-0b8ad672be12", "name": "network-vif-plugged", "status": "completed", "tag": "46b557c2-7be6-449a-b58a-45c5db4442cb"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:54.588226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-589a38ba-13fb-40cd-8d39-6520789365d9 req-c1987985-0b64-4523-9605-c53202ec4d12 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:54.589495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-589a38ba-13fb-40cd-8d39-6520789365d9 req-c1987985-0b64-4523-9605-c53202ec4d12 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:54.590000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-589a38ba-13fb-40cd-8d39-6520789365d9 req-c1987985-0b64-4523-9605-c53202ec4d12 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:54.602627 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-589a38ba-13fb-40cd-8d39-6520789365d9 req-c1987985-0b64-4523-9605-c53202ec4d12 service nova] Creating event network-vif-plugged:46b557c2-7be6-449a-b58a-45c5db4442cb for instance 4025dfa5-add4-400d-bb67-0b8ad672be12 on n-h2-836830-13 Aug 29 16:36:54.608334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-589a38ba-13fb-40cd-8d39-6520789365d9 req-c1987985-0b64-4523-9605-c53202ec4d12 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039278 Aug 29 16:36:54.609089 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3580/7331] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:36:55.562612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:55.563271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:55.570314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:55.570809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:55.571290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:55.571985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:55.572504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:55.572944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:55.705346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:55.713218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60f3787f-99a1-480a-9ff4-adcf48fb1738 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1364 microversion: 2.1 time: 0.154457 Aug 29 16:36:55.713797 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3752/7332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:55 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:56.735895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:56.736659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:56.739470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:56.740154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:56.747390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:56.747886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:56.748326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:56.749025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:56.749479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:56.749904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:56.882829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:36:56.891856 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a1abdf62-6cf6-42c3-a5f3-26e17cee59f6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1551 microversion: 2.1 time: 0.160254 Aug 29 16:36:56.892427 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3581/7333] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:36:56 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:36:56.913250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:36:56.913786 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:36:56.915679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:36:56.922826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:56.923352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:56.923805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:56.924506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:56.924976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:56.925415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:57.004738 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-576fb3a5-672f-4d7d-94f4-ebeb4e5ef01d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095775 Aug 29 16:36:57.005338 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3753/7334] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:36:56 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:36:58.223253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-687c599d-ac24-4feb-a2a3-d929131e6853 req-ab24c7e0-c665-4088-ab74-97944df719ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4025dfa5-add4-400d-bb67-0b8ad672be12", "tag": "46b557c2-7be6-449a-b58a-45c5db4442cb"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:36:58.234017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-687c599d-ac24-4feb-a2a3-d929131e6853 req-ab24c7e0-c665-4088-ab74-97944df719ce service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:36:58.234507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-687c599d-ac24-4feb-a2a3-d929131e6853 req-ab24c7e0-c665-4088-ab74-97944df719ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:36:58.235006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-687c599d-ac24-4feb-a2a3-d929131e6853 req-ab24c7e0-c665-4088-ab74-97944df719ce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:36:58.246395 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-687c599d-ac24-4feb-a2a3-d929131e6853 req-ab24c7e0-c665-4088-ab74-97944df719ce service nova] Creating event network-changed:46b557c2-7be6-449a-b58a-45c5db4442cb for instance 4025dfa5-add4-400d-bb67-0b8ad672be12 on n-h2-836830-13 Aug 29 16:36:58.251426 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-687c599d-ac24-4feb-a2a3-d929131e6853 req-ab24c7e0-c665-4088-ab74-97944df719ce service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Aug 29 16:36:58.252028 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3582/7335] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:10.277312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=7 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:10.278127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=47 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:10.282565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eef2c61b-8083-4be4-86ac-7e03cb3670aa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:10.292099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef2c61b-8083-4be4-86ac-7e03cb3670aa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:10.292601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef2c61b-8083-4be4-86ac-7e03cb3670aa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:10.293045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef2c61b-8083-4be4-86ac-7e03cb3670aa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:10.319583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eef2c61b-8083-4be4-86ac-7e03cb3670aa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Going to try to stop instance {{(pid=129133) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:38:10.361201 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eef2c61b-8083-4be4-86ac-7e03cb3670aa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action" status: 202 len: 0 microversion: 2.1 time: 0.086171 Aug 29 16:38:10.361795 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3754/7336] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:10 2022] POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:38:10.370060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=9 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:10.371187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=40 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:10.377245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:10.378151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:10.388699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:10.389188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:10.389624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:10.390317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:10.390872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:10.391328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:10.529857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:10.538090 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cb988d01-2233-4c2a-88e4-732e34546285 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.171045 Aug 29 16:38:10.538672 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3583/7337] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:10 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:11.561398 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:11.562104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:11.571177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:11.571673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:11.572117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:11.572809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:11.573298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:11.573728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:11.717316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:11.727507 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8458e24-bd10-49c6-a237-b31260f619c3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.171191 Aug 29 16:38:11.728080 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3755/7338] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:11 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:38:12.749360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:12.750011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:12.759367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:12.759863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:12.760303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:12.761001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:12.761465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:12.761893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:12.890808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:12.899744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ffdc981a-aad5-4a65-b0c4-ad03bcbf8104 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.154336 Aug 29 16:38:12.900530 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3584/7339] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:12 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:13.921387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:13.922020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:13.929722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:13.930222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:13.930673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:13.931404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:13.931875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:13.932316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:14.069306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:14.077432 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-191f3d37-8ee5-4ac4-9820-b7d3f7ecb048 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.159998 Aug 29 16:38:14.078004 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3756/7340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:13 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:15.098813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:15.099464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:15.106339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:15.106828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:15.107309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:15.108005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:15.108466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:15.108901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:15.246756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:15.254822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-53290393-319d-4daa-a5f9-66ffc84bd45a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.160614 Aug 29 16:38:15.255431 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3585/7341] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:15 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:16.276736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:16.277369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:16.284408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:16.284908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:16.285390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:16.286098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:16.286571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:16.287013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:16.421485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:16.429912 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-49dbb9ef-acdd-4021-9085-710a2c071ff4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.157169 Aug 29 16:38:16.430502 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3757/7342] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:16 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:17.451666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:17.452289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:17.459895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:17.460387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:17.460827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:17.461525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:17.461986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:17.462413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:17.594179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:17.602770 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bead2c0-796d-4ba6-a581-ebda673b74d1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.155077 Aug 29 16:38:17.603411 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3586/7343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:17 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:18.623663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:18.624295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:18.631841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:18.632340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:18.632793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:18.633489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:18.633955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:18.634390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:18.771363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:18.779214 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a9f5fa3-b045-41ac-8dcf-ba0db8912d37 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.159435 Aug 29 16:38:18.779788 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3758/7344] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:18 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:19.800582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:19.801202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:19.808155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:19.808640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:19.809079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:19.809774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:19.810259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:19.810685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:19.944548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:19.952329 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-61e4e838-d14e-4484-9d2b-4d79af30073e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.156232 Aug 29 16:38:19.952907 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3587/7345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:19 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:20.974143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:20.974684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:20.981839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:20.982342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:20.982797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:20.983545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:20.984021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:20.984466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:21.114996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:21.122834 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-315d6c3b-ed2d-4b30-8cdc-8375edbffc2b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1656 microversion: 2.1 time: 0.152780 Aug 29 16:38:21.123440 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3759/7346] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:20 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:21.144239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:21.146503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:21.153547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:21.154029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:21.154460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:21.155173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:21.155631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:21.156057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:21.185166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:21.192249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Old instance type m1.heat2, new instance type m1.heat {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:38:21.198624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:38:21.199105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:38:21.199579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:38:21.199983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:38:21.200390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:38:21.264982 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-50155cb2-b39c-4f1a-9234-65b1cc94cf8c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action" status: 202 len: 0 microversion: 2.1 time: 0.125596 Aug 29 16:38:21.265514 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3588/7347] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:21 2022] POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:38:21.273626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:21.274334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:21.280541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:21.281039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:21.281478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:21.282521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:21.283092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:21.283536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:21.425280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:21.433335 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8844b2d4-6278-4511-bedd-869cee012979 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.163526 Aug 29 16:38:21.434001 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3760/7348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:21 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:22.457095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:22.457717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:22.463758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:22.464249 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:22.464689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:22.465380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:22.465838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:22.466266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:22.598170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:22.606085 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c9018823-fa19-4925-8254-1445b8484bc0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1679 microversion: 2.1 time: 0.154449 Aug 29 16:38:22.606664 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3589/7349] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:22 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:23.628854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:23.629511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:23.636486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:23.636985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:23.637437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:23.638136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:23.638604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:23.639068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:23.776563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:23.784575 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-384769fb-6218-44c2-b0f1-8c2be5879905 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1684 microversion: 2.1 time: 0.160298 Aug 29 16:38:23.785163 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3761/7350] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:23 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:24.806035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:24.806655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:24.813301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:24.813835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:24.814533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:24.815266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:24.815728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:24.816161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:24.947457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:24.956071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-17aa46a8-107d-4450-81f6-791d47d3394d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1684 microversion: 2.1 time: 0.154137 Aug 29 16:38:24.956582 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3590/7351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:24 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:25.977553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:25.978187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:25.981734 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:38:25.981883 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:38:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 (ip 10.222.0.83) !!! Aug 29 16:38:25.988525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:25.989036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:25.989489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:25.990206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:25.990681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:25.991147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:26.140003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:26.148651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6217518d-3346-4d7a-af66-bc398b046cfd tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1683 microversion: 2.1 time: 0.174975 Aug 29 16:38:26.149235 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3762/7352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:25 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:26.300752 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:38:26.300752 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 16:38:26.357391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e8d69193-a81a-4901-9013-633c09c4fa2e req-6edee2ad-ee82-4637-a171-c650cd9be7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025dfa5-add4-400d-bb67-0b8ad672be12", "name": "network-vif-unplugged", "status": "completed", "tag": "46b557c2-7be6-449a-b58a-45c5db4442cb"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:26.369483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e8d69193-a81a-4901-9013-633c09c4fa2e req-6edee2ad-ee82-4637-a171-c650cd9be7cc service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:26.369974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e8d69193-a81a-4901-9013-633c09c4fa2e req-6edee2ad-ee82-4637-a171-c650cd9be7cc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:26.370410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e8d69193-a81a-4901-9013-633c09c4fa2e req-6edee2ad-ee82-4637-a171-c650cd9be7cc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:26.390939 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e8d69193-a81a-4901-9013-633c09c4fa2e req-6edee2ad-ee82-4637-a171-c650cd9be7cc service nova] Creating event network-vif-unplugged:46b557c2-7be6-449a-b58a-45c5db4442cb for instance 4025dfa5-add4-400d-bb67-0b8ad672be12 on n-h1-836830-13 Aug 29 16:38:26.396915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-e8d69193-a81a-4901-9013-633c09c4fa2e req-6edee2ad-ee82-4637-a171-c650cd9be7cc service nova] Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:38:26.408549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e8d69193-a81a-4901-9013-633c09c4fa2e req-6edee2ad-ee82-4637-a171-c650cd9be7cc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114897 Aug 29 16:38:26.409454 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3591/7353] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:27.169942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:27.170948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:27.177867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:27.178637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:27.179251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:27.180068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:27.180620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:27.181337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:27.342266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:27.351102 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c0e20c9c-3b4e-45ec-822d-cb517b695e34 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1683 microversion: 2.1 time: 0.185077 Aug 29 16:38:27.351772 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3763/7354] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:27 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:28.373626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:28.374247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:28.381529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.382015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.382454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.383178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.383633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.384080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.441399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-02280ef4-5811-4c50-9f44-7b91f5227d9a req-5ba96fb0-48ca-4039-85b7-7b05385db4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4025dfa5-add4-400d-bb67-0b8ad672be12", "tag": "46b557c2-7be6-449a-b58a-45c5db4442cb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:28.451449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-02280ef4-5811-4c50-9f44-7b91f5227d9a req-5ba96fb0-48ca-4039-85b7-7b05385db4bb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:28.451942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-02280ef4-5811-4c50-9f44-7b91f5227d9a req-5ba96fb0-48ca-4039-85b7-7b05385db4bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:28.452386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-02280ef4-5811-4c50-9f44-7b91f5227d9a req-5ba96fb0-48ca-4039-85b7-7b05385db4bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:28.467256 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-02280ef4-5811-4c50-9f44-7b91f5227d9a req-5ba96fb0-48ca-4039-85b7-7b05385db4bb service nova] Creating event network-changed:46b557c2-7be6-449a-b58a-45c5db4442cb for instance 4025dfa5-add4-400d-bb67-0b8ad672be12 on n-h1-836830-13 Aug 29 16:38:28.473418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-02280ef4-5811-4c50-9f44-7b91f5227d9a req-5ba96fb0-48ca-4039-85b7-7b05385db4bb service nova] Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:38:28.485047 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-02280ef4-5811-4c50-9f44-7b91f5227d9a req-5ba96fb0-48ca-4039-85b7-7b05385db4bb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047928 Aug 29 16:38:28.485746 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3764/7355] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:38:28.569414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:28.577649 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b5da3ce-8439-45c5-8db2-155fda739e6b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1681 microversion: 2.1 time: 0.209209 Aug 29 16:38:28.578409 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3592/7356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:28 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:38:29.601145 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:29.601886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:29.608089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.608588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.609039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:29.610375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.610852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.611316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:29.742934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:29.751889 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-453d3c9d-3160-46e0-9790-8e525aa1770f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1677 microversion: 2.1 time: 0.155822 Aug 29 16:38:29.752471 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3765/7357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:29 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:29.773022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:29.773602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:29.780504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.781003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.781511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:29.782209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.782663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.783124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:29.857620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ef3a6c6-a036-415a-bf0f-fe4e1aeace25 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action" status: 204 len: 0 microversion: 2.1 time: 0.087969 Aug 29 16:38:29.858547 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3593/7358] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:29 2022] POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:38:29.866921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:29.867573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:29.873594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.874095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.874581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:29.875822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:29.876328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:29.876722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:30.085275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:30.093426 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c03c7f53-966b-4103-95a8-d51b0bda72fc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1677 microversion: 2.1 time: 0.230328 Aug 29 16:38:30.094814 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3766/7359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:29 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:31.116614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:31.117883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:31.125950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:31.126453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:31.126900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:31.127623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:31.128091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:31.129087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:31.295268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:31.305713 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-20002879-cc85-4efc-bfff-498389b747e1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1677 microversion: 2.1 time: 0.193796 Aug 29 16:38:31.306295 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3594/7360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:31 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:32.124058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-015048f0-9196-4ecc-9959-d149a4eca6ad req-5cb35c56-8f46-4e86-9bd9-cbacf4b5b162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025dfa5-add4-400d-bb67-0b8ad672be12", "name": "network-vif-plugged", "status": "completed", "tag": "46b557c2-7be6-449a-b58a-45c5db4442cb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:32.136372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-015048f0-9196-4ecc-9959-d149a4eca6ad req-5cb35c56-8f46-4e86-9bd9-cbacf4b5b162 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.136868 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-015048f0-9196-4ecc-9959-d149a4eca6ad req-5cb35c56-8f46-4e86-9bd9-cbacf4b5b162 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.137506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-015048f0-9196-4ecc-9959-d149a4eca6ad req-5cb35c56-8f46-4e86-9bd9-cbacf4b5b162 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.149720 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-015048f0-9196-4ecc-9959-d149a4eca6ad req-5cb35c56-8f46-4e86-9bd9-cbacf4b5b162 service nova] Creating event network-vif-plugged:46b557c2-7be6-449a-b58a-45c5db4442cb for instance 4025dfa5-add4-400d-bb67-0b8ad672be12 on n-h1-836830-13 Aug 29 16:38:32.154719 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-015048f0-9196-4ecc-9959-d149a4eca6ad req-5cb35c56-8f46-4e86-9bd9-cbacf4b5b162 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Aug 29 16:38:32.155355 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3767/7361] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:32.328681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:32.329323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:32.336129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.336607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.337041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.337727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.338180 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.338599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.465389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:32.473317 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0ce2279c-9718-42db-ac83-ea343e0ef71e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1656 microversion: 2.1 time: 0.148552 Aug 29 16:38:32.473896 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3595/7362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:32 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1656 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:38:32.494004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:32.494720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:32.501718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.502046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.502503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.503239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.503713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.504152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.638529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:32.646610 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-520714e8-38c2-40bd-8745-b0097f30c6cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1656 microversion: 2.1 time: 0.156781 Aug 29 16:38:32.647217 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3768/7363] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:32 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:32.666938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a30510c2-abba-45a7-bd3e-a38a015275d0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:32.673809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a30510c2-abba-45a7-bd3e-a38a015275d0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.674305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a30510c2-abba-45a7-bd3e-a38a015275d0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.674756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a30510c2-abba-45a7-bd3e-a38a015275d0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.697305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a30510c2-abba-45a7-bd3e-a38a015275d0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Going to try to start instance {{(pid=129132) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:38:32.720747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:32.739801 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a30510c2-abba-45a7-bd3e-a38a015275d0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action" status: 202 len: 0 microversion: 2.1 time: 0.076645 Aug 29 16:38:32.740407 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3596/7364] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:38:32 2022] POST /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:38:32.751360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:32.752028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:32.758980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.759524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.759980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.760692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:32.761191 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:32.761634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:32.898977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:32.907819 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a874eb9b-d467-4fef-95d7-e25caa0dca57 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1665 microversion: 2.1 time: 0.160666 Aug 29 16:38:32.908403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3769/7365] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:32 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:33.929451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:33.930082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:33.938357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:33.938849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:33.939581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:33.940276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:33.940739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:33.941251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:34.077235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:34.085200 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c95acba-99a8-4270-90af-1e8a18fb3278 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1665 microversion: 2.1 time: 0.160225 Aug 29 16:38:34.085786 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3597/7366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:33 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:35.106051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:35.106678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:35.113890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:35.114391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:35.114837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:35.115561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:35.116029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:35.116465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:35.134583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:35.253035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:35.261035 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc0e533c-d750-4e24-b916-2840b66b491a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1669 microversion: 2.1 time: 0.158914 Aug 29 16:38:35.261609 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3770/7367] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:35 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:35.281902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:35.282435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:35.289539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:35.290031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:35.290466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:35.291205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:35.291664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:35.292098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:35.320507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:38:35.397022 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d899d5f1-ea91-45c1-b864-7d7d4d1c221d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 204 len: 0 microversion: 2.1 time: 0.119113 Aug 29 16:38:35.397541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3598/7368] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:38:35 2022] DELETE /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:38:35.405591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:35.407067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:35.413064 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:35.413559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:35.414001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:35.414689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:35.415184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:35.415619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:35.547463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:35.555388 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-469c56a0-f076-4fdd-a791-08da5ef79f9e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1675 microversion: 2.1 time: 0.153535 Aug 29 16:38:35.555968 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3771/7369] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:35 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:36.580286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:36.580904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:36.587816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:36.588303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:36.588772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:36.589465 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:36.589918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:36.590343 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:36.760686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:36.768982 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6e54c0d4-5cd7-473e-8420-dc5b86916548 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1675 microversion: 2.1 time: 0.193852 Aug 29 16:38:36.769570 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3599/7370] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:36 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:37.544821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3ab4d8c9-d742-4adc-8887-74aab3b1d53e req-366acbf8-37e5-4511-9a6f-883a2644e13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4025dfa5-add4-400d-bb67-0b8ad672be12", "name": "network-vif-deleted", "tag": "46b557c2-7be6-449a-b58a-45c5db4442cb"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:37.556392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3ab4d8c9-d742-4adc-8887-74aab3b1d53e req-366acbf8-37e5-4511-9a6f-883a2644e13d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.556984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3ab4d8c9-d742-4adc-8887-74aab3b1d53e req-366acbf8-37e5-4511-9a6f-883a2644e13d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.557507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3ab4d8c9-d742-4adc-8887-74aab3b1d53e req-366acbf8-37e5-4511-9a6f-883a2644e13d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.572387 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3ab4d8c9-d742-4adc-8887-74aab3b1d53e req-366acbf8-37e5-4511-9a6f-883a2644e13d service nova] Creating event network-vif-deleted:46b557c2-7be6-449a-b58a-45c5db4442cb for instance 4025dfa5-add4-400d-bb67-0b8ad672be12 on n-h1-836830-13 Aug 29 16:38:37.577752 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3ab4d8c9-d742-4adc-8887-74aab3b1d53e req-366acbf8-37e5-4511-9a6f-883a2644e13d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036597 Aug 29 16:38:37.578812 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3772/7371] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:37.789660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:37.790391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:37.797777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.798489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.798992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.799780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.800322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.800809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.835244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:37.835724 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:37.836158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:37.836607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lazy-loading 'fault' on Instance uuid 4025dfa5-add4-400d-bb67-0b8ad672be12 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:38:37.878936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:37.886771 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4132a6c1-e54c-4687-befc-ce1f158d5623 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 200 len: 1329 microversion: 2.1 time: 0.101013 Aug 29 16:38:37.887684 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3600/7372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:37 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:38.911252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:38.911875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:38.918103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:38.918602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:38.919075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:38.919776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:38.920245 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:38.920681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:38.934931 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 HTTP/1.1 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '4025dfa5-add4-400d-bb67-0b8ad672be12'} Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:38.936660 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3eacc99-fabe-4d29-88a6-b356732f30ca tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 404 len: 111 microversion: 2.1 time: 0.033409 Aug 29 16:38:38.941584 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3773/7373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:38 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:38:38.956786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:38.957412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:38.964335 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:38.964826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:38.965261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:38.965952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:38.966421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:38.966830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:38.981632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 HTTP/1.1 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '4025dfa5-add4-400d-bb67-0b8ad672be12'} Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:38:38.983403 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e809a64-c450-4f95-96a3-23dacae02289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 404 len: 111 microversion: 2.1 time: 0.033708 Aug 29 16:38:38.988382 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3601/7374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:38 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:38:39.036304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-264661567", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "90bebefd-832e-4ea2-9620-b36815838958"}], "security_groups": [{"name": "tempest-securitygroup--238018108"}], "key_name": "tempest-keypair-1107980636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:39.140238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] validate_networks() for [('90bebefd-832e-4ea2-9620-b36815838958', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:38:39.620869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:38:39.621309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:38:39.621795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:38:39.622243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:38:39.622676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:38:39.639906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:39.640409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:39.641658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:39.642436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:39.642906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:39.643374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:39.666452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:38:39.672677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for user ea14a64fabd24976a0946f6817d2f679 and project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:38:39.692637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:38:39.695673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:38:39.753782 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6b24abc-a217-4f5b-8824-de2b214ccf90 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.722250 Aug 29 16:38:39.754445 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3774/7375] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:38:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:38:39.766729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-27d022a9-3f87-4093-a5a6-66ce1924dc8f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:39.767490 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-27d022a9-3f87-4093-a5a6-66ce1924dc8f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:39.830571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27d022a9-3f87-4093-a5a6-66ce1924dc8f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:39.840632 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-27d022a9-3f87-4093-a5a6-66ce1924dc8f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1238 microversion: 2.1 time: 0.078018 Aug 29 16:38:39.841232 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3602/7376] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:39 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:38:40.862756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:40.863404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:40.865403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:40.871810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.872309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.872753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.873458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:40.873920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:40.874357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:40.940999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:40.949297 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ea3c0c0-68c9-415b-8488-4c929616320f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1290 microversion: 2.1 time: 0.091288 Aug 29 16:38:40.949887 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3775/7377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:40 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:41.972525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:41.973388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:41.977276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:38:41.982954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:41.983481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:41.983920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:41.985274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:41.985734 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:41.986190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:42.209334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:42.217168 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d9a8fdfe-7832-4af2-8e87-f9d91f75296e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1363 microversion: 2.1 time: 0.249395 Aug 29 16:38:42.217757 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3603/7378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:41 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:42.318744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6acb22b1-1e10-45d8-bbea-8665ca80ce3c req-1de88974-99f5-4527-8843-2f062378b07c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:42.333375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6acb22b1-1e10-45d8-bbea-8665ca80ce3c req-1de88974-99f5-4527-8843-2f062378b07c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:42.333878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6acb22b1-1e10-45d8-bbea-8665ca80ce3c req-1de88974-99f5-4527-8843-2f062378b07c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:42.334327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6acb22b1-1e10-45d8-bbea-8665ca80ce3c req-1de88974-99f5-4527-8843-2f062378b07c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:42.349677 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6acb22b1-1e10-45d8-bbea-8665ca80ce3c req-1de88974-99f5-4527-8843-2f062378b07c service nova] Creating event network-changed:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h1-836830-13 Aug 29 16:38:42.354957 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6acb22b1-1e10-45d8-bbea-8665ca80ce3c req-1de88974-99f5-4527-8843-2f062378b07c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043190 Aug 29 16:38:42.355819 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3776/7379] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:38:43.239346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:43.239997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:43.246849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:43.247388 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:43.247827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:43.248524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:43.248980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:43.249407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:43.379757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:43.387773 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13590ce9-f53e-41bc-8b71-e5d0b7e7a370 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1363 microversion: 2.1 time: 0.152436 Aug 29 16:38:43.388343 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3604/7380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:43 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:44.411007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:44.411679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:44.419083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:44.419586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:44.420042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:44.420747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:44.421212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:44.421692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:44.556289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:44.565414 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9cebaa4e-afaf-46f7-bfde-2dca39838774 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1363 microversion: 2.1 time: 0.159685 Aug 29 16:38:44.565999 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3777/7381] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:44 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:45.586338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:45.586988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:45.594011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:45.594500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:45.594936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:45.595650 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:45.596100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:45.596525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:45.736129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:45.744213 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-db3e08b4-2242-49d0-bcdb-6ee6dafbf684 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1363 microversion: 2.1 time: 0.161705 Aug 29 16:38:45.744982 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3605/7382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:45 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:46.182453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6aad20ce-ef8d-4fd8-90b5-4b626e8f5aa0 req-b70ceece-5ec4-4d37-b3cd-04f34c0aa294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "name": "network-vif-plugged", "status": "completed", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:46.193395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6aad20ce-ef8d-4fd8-90b5-4b626e8f5aa0 req-b70ceece-5ec4-4d37-b3cd-04f34c0aa294 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:46.193891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6aad20ce-ef8d-4fd8-90b5-4b626e8f5aa0 req-b70ceece-5ec4-4d37-b3cd-04f34c0aa294 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:46.194341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6aad20ce-ef8d-4fd8-90b5-4b626e8f5aa0 req-b70ceece-5ec4-4d37-b3cd-04f34c0aa294 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:46.206157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6aad20ce-ef8d-4fd8-90b5-4b626e8f5aa0 req-b70ceece-5ec4-4d37-b3cd-04f34c0aa294 service nova] Creating event network-vif-plugged:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h1-836830-13 Aug 29 16:38:46.212253 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6aad20ce-ef8d-4fd8-90b5-4b626e8f5aa0 req-b70ceece-5ec4-4d37-b3cd-04f34c0aa294 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033299 Aug 29 16:38:46.212866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3778/7383] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:46.766462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:46.767120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:46.774268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:46.774761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:46.775229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:46.775929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:46.776417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:46.776842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:46.910135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:46.917862 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71be7210-f9ae-4483-bebc-84daa6a275dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1363 microversion: 2.1 time: 0.155984 Aug 29 16:38:46.918435 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3606/7384] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:46 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:47.940947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:47.941659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:47.947929 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:47.948418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:47.948892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:47.949577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:47.950039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:47.950470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:48.082462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:38:48.090228 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-067bd140-9162-4100-af64-45670b69fc40 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1551 microversion: 2.1 time: 0.154827 Aug 29 16:38:48.090809 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3779/7385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:38:47 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:38:48.111859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:38:48.112411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:38:48.119193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:48.119681 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:48.120121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:48.120809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:48.121264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:48.121691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:48.198172 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ae6e49be-c2a8-4417-ac7c-80fe4c4d7cdf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090365 Aug 29 16:38:48.198774 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3607/7386] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:38:48 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:38:49.437603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-056e18d2-3631-4bfe-bc50-13e7bf29038a req-de61503b-d22b-409a-890d-3c94f7abd2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:38:49.448241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-056e18d2-3631-4bfe-bc50-13e7bf29038a req-de61503b-d22b-409a-890d-3c94f7abd2a2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:38:49.448729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-056e18d2-3631-4bfe-bc50-13e7bf29038a req-de61503b-d22b-409a-890d-3c94f7abd2a2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:38:49.449165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-056e18d2-3631-4bfe-bc50-13e7bf29038a req-de61503b-d22b-409a-890d-3c94f7abd2a2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:38:49.461780 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-056e18d2-3631-4bfe-bc50-13e7bf29038a req-de61503b-d22b-409a-890d-3c94f7abd2a2 service nova] Creating event network-changed:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h1-836830-13 Aug 29 16:38:49.466700 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-056e18d2-3631-4bfe-bc50-13e7bf29038a req-de61503b-d22b-409a-890d-3c94f7abd2a2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033010 Aug 29 16:38:49.467400 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3780/7387] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:22.289655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:22.290552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=9 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:22.291261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:22.295786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:22.298122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:22.306909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:22.307442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:22.307885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:22.308587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:22.309050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:22.309482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:22.339403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:22.345317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Old instance type m1.heat2, new instance type m1.heat {{(pid=129132) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:39:22.352395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:39:22.352818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:39:22.353295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:39:22.353705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:39:22.354123 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:39:22.418296 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d1a838ac-d9dc-41ec-9c22-b6a67b776077 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf/action" status: 202 len: 0 microversion: 2.1 time: 0.130393 Aug 29 16:39:22.418904 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3608/7388] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:22 2022] POST /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:39:22.427430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:22.428216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:22.430324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:22.431248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:22.433746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=11 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:22.434619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=38 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:22.443276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:22.443800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:22.444264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:22.444997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:22.445473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:22.445917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:22.898355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:22.907287 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2079710e-a8f7-4cf1-bb1d-b0a3e1bb74cb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1678 microversion: 2.1 time: 0.483933 Aug 29 16:39:22.907982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3781/7389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:22 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1678 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:23.929919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:23.930535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:23.936585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:23.937070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:23.937504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:23.938443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:23.938896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:23.939361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:24.073221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:24.082295 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ac6a022d-e046-422a-86a3-8defeb2f2472 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1678 microversion: 2.1 time: 0.157112 Aug 29 16:39:24.082886 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3609/7390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:23 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:25.102994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:25.103681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:25.110572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:25.111100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:25.112190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:25.112971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:25.113462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:25.114170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:25.247727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:25.256196 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eef8eab6-2f14-432f-9375-8c204c3ababc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.157174 Aug 29 16:39:25.256811 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3782/7391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:25 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:26.277914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:26.278565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:26.286179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:26.286674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:26.287156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:26.287855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:26.288339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:26.288766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:26.422036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:26.430576 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6f7cd378-6e20-4a85-ae6b-97d9a23f926a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.156568 Aug 29 16:39:26.431199 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3610/7392] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:26 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:27.452619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:27.453246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:27.461174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:27.461678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:27.462128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:27.462870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:27.463365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:27.463806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:27.600102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:27.607887 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b439402a-a3b2-48d1-9384-424e353338bf tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.159184 Aug 29 16:39:27.608466 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3783/7393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:27 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:28.629642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:28.630293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:28.637194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:28.637684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:28.638128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:28.638826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:28.639318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:28.639746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:28.785274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:28.793043 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2f9f2d31-ea49-45cb-800a-9ccde8bd6194 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.167473 Aug 29 16:39:28.793628 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3611/7394] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:28 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:29.813325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:29.813956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:29.821769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:29.822268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:29.822717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:29.823440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:29.823905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:29.824345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:29.952917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:29.961499 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e5b8c515-1911-4551-ab0c-8eba94253bec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.152294 Aug 29 16:39:29.962016 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3784/7395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:29 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:30.983154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:30.983769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:30.991195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:30.991687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:30.992125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:30.992810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:30.993267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:30.993695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:31.123445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:31.131970 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5b52cad4-44ca-401c-a8cd-60310341128c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.153075 Aug 29 16:39:31.132544 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3612/7396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:30 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:32.153637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:32.154186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:32.161742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:32.162240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:32.162697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:32.163451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:32.163917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:32.164356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:32.296355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:32.304470 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d078531a-952c-4ed2-8e9b-2e9bd8572fd4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.154783 Aug 29 16:39:32.305021 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3785/7397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:32 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:33.325920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:33.327318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:33.335106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:33.335605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:33.336122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:33.336912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:33.337441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:33.337999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:33.477670 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:33.490540 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-41dd42d8-96fd-4ff0-bf60-8aa11f4a10a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.168671 Aug 29 16:39:33.491144 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3613/7398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:33 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:34.513265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:34.513937 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:34.520764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:34.521278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:34.521734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:34.522446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:34.522919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:34.523404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:34.653895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:34.662761 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f6404331-f4b1-4022-bd74-930e64ce3447 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.153757 Aug 29 16:39:34.663383 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3786/7399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:34 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:35.684365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:35.685030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:35.692400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:35.692890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:35.693339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:35.694020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:35.694477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:35.694905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:35.826622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:35.834485 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0f651ca-ce59-47a0-bbc7-b2a5d991489b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.154014 Aug 29 16:39:35.835081 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3614/7400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:35 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:36.856353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:36.857015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:36.864032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:36.864474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:36.864924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:36.865648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:36.866115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:36.866552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:37.002425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:37.010388 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3f048bb-33aa-4bca-9efe-416e5535f609 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.157900 Aug 29 16:39:37.010967 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3787/7401] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:36 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:38.031316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:38.031968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:38.039349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:38.039832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:38.040271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:38.040962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:38.041418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:38.041843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:38.180526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:38.188605 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26cc7519-f8f5-49b2-a2fe-3173c7202c5b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.161299 Aug 29 16:39:38.189391 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3615/7402] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:38 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:39.209977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:39.210605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:39.217374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:39.217870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:39.218315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:39.219004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:39.219494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:39.219926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:39.366617 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:39.375285 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c63ea208-ea48-4a04-a2c6-57ac51aef300 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.169034 Aug 29 16:39:39.376171 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3788/7403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:39 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:40.397175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:40.397791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:40.404801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:40.405286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:40.405737 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:40.406426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:40.406886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:40.407338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:40.537671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:40.545385 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5dffe10d-e0cf-4042-8ba6-9cc1b99b6dc9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1683 microversion: 2.1 time: 0.152902 Aug 29 16:39:40.545956 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3616/7404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:40 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:41.566753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:41.567423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:41.574397 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.574914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.575405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.576123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:41.576598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:41.577046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:41.806934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:41.816101 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3035decc-7b1e-48a9-9486-9fbee904960c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1682 microversion: 2.1 time: 0.253489 Aug 29 16:39:41.816888 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3789/7405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:41 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:42.049818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-31d21148-bbef-494f-be80-8dbeff350796 req-a4de782e-7d18-42a1-8309-7ce935bb900d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "name": "network-vif-unplugged", "status": "completed", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:42.060853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31d21148-bbef-494f-be80-8dbeff350796 req-a4de782e-7d18-42a1-8309-7ce935bb900d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:42.061486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31d21148-bbef-494f-be80-8dbeff350796 req-a4de782e-7d18-42a1-8309-7ce935bb900d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:42.062179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-31d21148-bbef-494f-be80-8dbeff350796 req-a4de782e-7d18-42a1-8309-7ce935bb900d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:42.078925 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-31d21148-bbef-494f-be80-8dbeff350796 req-a4de782e-7d18-42a1-8309-7ce935bb900d service nova] Creating event network-vif-unplugged:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h2-836830-13 Aug 29 16:39:42.084442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-31d21148-bbef-494f-be80-8dbeff350796 req-a4de782e-7d18-42a1-8309-7ce935bb900d service nova] Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:39:42.096092 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-31d21148-bbef-494f-be80-8dbeff350796 req-a4de782e-7d18-42a1-8309-7ce935bb900d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050692 Aug 29 16:39:42.096717 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3617/7406] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:42.837816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:42.838456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:42.845388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:42.845918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:42.846465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:42.847207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:42.847685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:42.848131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:43.048238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:43.058238 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4910e572-ffc1-47ce-8a4d-50734accdd84 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1682 microversion: 2.1 time: 0.224150 Aug 29 16:39:43.058853 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3790/7407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:42 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:44.082459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:44.083094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:44.090202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:44.090713 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:44.091171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:44.091857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:44.092339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:44.092759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:44.133545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-1225218f-8f07-4acd-9285-45d7d0b3d229 req-984c8106-3afa-460d-95be-5a36154ccada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:44.144782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1225218f-8f07-4acd-9285-45d7d0b3d229 req-984c8106-3afa-460d-95be-5a36154ccada service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:44.145280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1225218f-8f07-4acd-9285-45d7d0b3d229 req-984c8106-3afa-460d-95be-5a36154ccada service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:44.145731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-1225218f-8f07-4acd-9285-45d7d0b3d229 req-984c8106-3afa-460d-95be-5a36154ccada service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:44.157800 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-1225218f-8f07-4acd-9285-45d7d0b3d229 req-984c8106-3afa-460d-95be-5a36154ccada service nova] Creating event network-changed:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h2-836830-13 Aug 29 16:39:44.164313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-1225218f-8f07-4acd-9285-45d7d0b3d229 req-984c8106-3afa-460d-95be-5a36154ccada service nova] Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:39:44.175903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-1225218f-8f07-4acd-9285-45d7d0b3d229 req-984c8106-3afa-460d-95be-5a36154ccada service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045981 Aug 29 16:39:44.176523 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3791/7408] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:39:44.268604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:44.277092 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-34f867aa-a255-4d94-aadd-fdb28529e144 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1680 microversion: 2.1 time: 0.199731 Aug 29 16:39:44.277967 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3618/7409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:44 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:45.300436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:45.301391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:45.308648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:45.309155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:45.309602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:45.310315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:45.310785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:45.311258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:45.442291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:45.450130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e9e9f74-38cf-4115-9f8b-94addea392c8 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1680 microversion: 2.1 time: 0.154671 Aug 29 16:39:45.450712 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3792/7410] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:45 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:46.472226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:46.472829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:46.479877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.480369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.480808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.481500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.481955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.482378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.618763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:46.627009 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-84706254-b87c-4840-87b4-fe903bda524b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1677 microversion: 2.1 time: 0.159471 Aug 29 16:39:46.627803 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3619/7411] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:46 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:46.648692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:46.649267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:46.656387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.656894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.657350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.658781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.659337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.659782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.700058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.700556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.701007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.701739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.702208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.702652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.724623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for project fe2904332eef460b8b57f38b445a30aa. Resources: {'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:39:46.729752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for user ea14a64fabd24976a0946f6817d2f679 and project fe2904332eef460b8b57f38b445a30aa. Resources: {'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:39:46.831136 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8190c5c1-039c-4b83-90e2-0d02972ee635 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf/action" status: 202 len: 0 microversion: 2.1 time: 0.185997 Aug 29 16:39:46.831702 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3793/7412] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:39:46 2022] POST /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:39:46.840624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:46.841244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:46.848236 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.848728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.849164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:46.852365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:46.852850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:46.853397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:47.008907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:47.016759 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7398d363-7d26-4a6b-8777-989ee5d26f55 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1676 microversion: 2.1 time: 0.180804 Aug 29 16:39:47.017325 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3620/7413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:46 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:48.039969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:48.041331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:48.047633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:48.048143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:48.049146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:48.049872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:48.050346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:48.050791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:48.208417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:48.212327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:48.218221 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10267f0b-d1f8-4542-8fa2-9526e2a004fa tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1676 microversion: 2.1 time: 0.183509 Aug 29 16:39:48.218982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3794/7414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:48 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:49.240373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:49.240983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:49.247892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:49.248373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:49.248805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:49.249489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:49.249971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:49.250503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:49.386716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:49.395999 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5c4afc3b-1fcf-4d06-9d3d-d22a8292da3f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1676 microversion: 2.1 time: 0.159952 Aug 29 16:39:49.396791 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3621/7415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:49 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:49.502724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-86ee38a6-5cc3-4ba1-bf10-5fbcd62cd6ec req-adfcd2fb-a939-40dc-acc0-9f2a77cfce9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "name": "network-vif-plugged", "status": "completed", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:49.516445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-86ee38a6-5cc3-4ba1-bf10-5fbcd62cd6ec req-adfcd2fb-a939-40dc-acc0-9f2a77cfce9b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:49.516946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-86ee38a6-5cc3-4ba1-bf10-5fbcd62cd6ec req-adfcd2fb-a939-40dc-acc0-9f2a77cfce9b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:49.517393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-86ee38a6-5cc3-4ba1-bf10-5fbcd62cd6ec req-adfcd2fb-a939-40dc-acc0-9f2a77cfce9b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:49.530041 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-86ee38a6-5cc3-4ba1-bf10-5fbcd62cd6ec req-adfcd2fb-a939-40dc-acc0-9f2a77cfce9b service nova] Creating event network-vif-plugged:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h2-836830-13 Aug 29 16:39:49.536911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-86ee38a6-5cc3-4ba1-bf10-5fbcd62cd6ec req-adfcd2fb-a939-40dc-acc0-9f2a77cfce9b service nova] Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:39:49.550051 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-86ee38a6-5cc3-4ba1-bf10-5fbcd62cd6ec req-adfcd2fb-a939-40dc-acc0-9f2a77cfce9b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052893 Aug 29 16:39:49.551378 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3795/7416] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:50.278350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-be999f7e-5c4c-435b-841c-5edb3205340e req-1e1f8eba-4250-4c00-b165-69c5284e9f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "name": "network-vif-unplugged", "status": "completed", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:50.289978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-be999f7e-5c4c-435b-841c-5edb3205340e req-1e1f8eba-4250-4c00-b165-69c5284e9f25 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:50.290185 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-be999f7e-5c4c-435b-841c-5edb3205340e req-1e1f8eba-4250-4c00-b165-69c5284e9f25 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:50.290600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-be999f7e-5c4c-435b-841c-5edb3205340e req-1e1f8eba-4250-4c00-b165-69c5284e9f25 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:50.303071 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-be999f7e-5c4c-435b-841c-5edb3205340e req-1e1f8eba-4250-4c00-b165-69c5284e9f25 service nova] Creating event network-vif-unplugged:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h1-836830-13 Aug 29 16:39:50.308744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-be999f7e-5c4c-435b-841c-5edb3205340e req-1e1f8eba-4250-4c00-b165-69c5284e9f25 service nova] Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:39:50.320098 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-be999f7e-5c4c-435b-841c-5edb3205340e req-1e1f8eba-4250-4c00-b165-69c5284e9f25 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045507 Aug 29 16:39:50.320993 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3622/7417] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:50.417480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:50.418198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:50.424704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:50.425210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:50.425663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:50.426373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:50.426851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:50.427313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:50.567446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:50.575803 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7b4837c7-7d6e-4520-9e2e-3f8f514b1e05 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1676 microversion: 2.1 time: 0.162592 Aug 29 16:39:50.576389 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3796/7418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:50 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:51.598812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:51.599544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:51.605748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:51.606238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:51.606680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:51.607406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:51.607867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:51.608294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:51.741421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:51.745017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:51.751340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ba44b9c-fcda-471c-a897-154320a3ab94 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1676 microversion: 2.1 time: 0.157649 Aug 29 16:39:51.752527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3623/7419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:51 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:52.335389 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-6328e8f2-3fd9-4535-a0a5-855bf680b961 req-fcac8b82-8451-4bfe-b497-e32416768b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:52.345975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6328e8f2-3fd9-4535-a0a5-855bf680b961 req-fcac8b82-8451-4bfe-b497-e32416768b7d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:52.346462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6328e8f2-3fd9-4535-a0a5-855bf680b961 req-fcac8b82-8451-4bfe-b497-e32416768b7d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:52.346901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-6328e8f2-3fd9-4535-a0a5-855bf680b961 req-fcac8b82-8451-4bfe-b497-e32416768b7d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:52.358483 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-6328e8f2-3fd9-4535-a0a5-855bf680b961 req-fcac8b82-8451-4bfe-b497-e32416768b7d service nova] Creating event network-changed:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h1-836830-13 Aug 29 16:39:52.364699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-6328e8f2-3fd9-4535-a0a5-855bf680b961 req-fcac8b82-8451-4bfe-b497-e32416768b7d service nova] Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:39:52.375274 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-6328e8f2-3fd9-4535-a0a5-855bf680b961 req-fcac8b82-8451-4bfe-b497-e32416768b7d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043519 Aug 29 16:39:52.375878 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3797/7420] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:52.776175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:52.777468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:52.782574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=37 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:52.788770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:52.789600 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:52.790441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:52.791946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:52.792665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:52.793489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.014604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:53.022991 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d56aac0c-9770-4047-818b-1febcefee5ea tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1669 microversion: 2.1 time: 0.251325 Aug 29 16:39:53.023620 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3624/7421] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:52 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1669 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:53.044251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:53.045025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:53.047009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:53.053234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.053744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.054207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.054910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.055406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.055845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.190914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:53.198708 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e37144b-7591-4bdc-8520-53e7b5640274 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1669 microversion: 2.1 time: 0.158696 Aug 29 16:39:53.199314 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3798/7422] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:53 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:53.219120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:53.219741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:53.226449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.226943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.227426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.228127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.228588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.229063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.357850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:53.366181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-622fc2cb-d1d4-411f-8485-6d6e1c7cb8dc tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1669 microversion: 2.1 time: 0.150901 Aug 29 16:39:53.366771 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3625/7423] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:53 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:53.387128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:53.387626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:53.395003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.395751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.396274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.396988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.397466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.397906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.427098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:39:53.506475 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b383844b-9ff8-4d18-9c85-6600315e3d67 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 204 len: 0 microversion: 2.1 time: 0.122662 Aug 29 16:39:53.506987 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3799/7424] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:39:53 2022] DELETE /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:39:53.515328 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:53.515944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:53.523603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.524259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.524695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.525383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:53.525837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:53.526256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:53.656486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:53.665181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-90881081-0514-4b4b-b982-58caa15fb6b3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1675 microversion: 2.1 time: 0.153666 Aug 29 16:39:53.665755 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3626/7425] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:53 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:39:54.687762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:54.688478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:54.696387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:54.696895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:54.697349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:54.698067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:54.698540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:54.698985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:54.833819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:54.841824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-aa3873cd-512d-40c1-901a-56d9d471b9de tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1675 microversion: 2.1 time: 0.158607 Aug 29 16:39:54.842409 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3800/7426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:54 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:55.864834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:55.865555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:55.873027 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:55.873536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:55.873983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:55.875284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:55.875792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:55.876413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:55.876542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-7bfbff83-9b60-4c4b-a1a2-4b5b48d8195b req-a600d739-a7ed-48e8-8f5c-6812afc8ccd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf", "name": "network-vif-deleted", "tag": "062af27c-7805-4819-bc7a-4b84b311758c"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:55.896003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7bfbff83-9b60-4c4b-a1a2-4b5b48d8195b req-a600d739-a7ed-48e8-8f5c-6812afc8ccd6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:55.896536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7bfbff83-9b60-4c4b-a1a2-4b5b48d8195b req-a600d739-a7ed-48e8-8f5c-6812afc8ccd6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:55.896986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-7bfbff83-9b60-4c4b-a1a2-4b5b48d8195b req-a600d739-a7ed-48e8-8f5c-6812afc8ccd6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:55.914518 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-7bfbff83-9b60-4c4b-a1a2-4b5b48d8195b req-a600d739-a7ed-48e8-8f5c-6812afc8ccd6 service nova] Creating event network-vif-deleted:062af27c-7805-4819-bc7a-4b84b311758c for instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf on n-h1-836830-13 Aug 29 16:39:55.920588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-7bfbff83-9b60-4c4b-a1a2-4b5b48d8195b req-a600d739-a7ed-48e8-8f5c-6812afc8ccd6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049998 Aug 29 16:39:55.921809 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3801/7427] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:39:55.962299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:55.975007 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0774a5fc-4fe8-4eef-82a5-311f7e477335 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 200 len: 1608 microversion: 2.1 time: 0.115543 Aug 29 16:39:55.976079 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3627/7428] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:55 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 1608 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:56.997168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:56.997919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:56.999956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:39:57.006291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:57.006783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:57.007296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:57.007990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:57.008457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:57.008896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:57.023311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf HTTP/1.1 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf'} Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:39:57.024981 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:39:57.029737 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bd10204b-4feb-4332-bb0e-6f66c8daded2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 404 len: 111 microversion: 2.1 time: 0.033547 Aug 29 16:39:57.030311 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3802/7429] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:56 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:39:57.045120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:57.045745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:57.053548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:57.054214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:57.054659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:57.055554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:57.056040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:57.056534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:57.071923 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf HTTP/1.1 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf'} Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:39:57.073617 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2f484b4e-84ee-42c3-9224-9dcc7f2a6992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 404 len: 111 microversion: 2.1 time: 0.034146 Aug 29 16:39:57.078289 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3628/7430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:57 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:39:57.125092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1805120802", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "90bebefd-832e-4ea2-9620-b36815838958"}], "security_groups": [{"name": "tempest-securitygroup--238018108"}], "key_name": "tempest-keypair-1107980636", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:39:57.232469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] validate_networks() for [('90bebefd-832e-4ea2-9620-b36815838958', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:39:57.607220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:39:57.607665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:39:57.608185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:39:57.608613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:39:57.609042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:39:57.618202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:57.618705 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:57.619207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:57.619953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:57.620425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:57.620869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:57.637789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:39:57.643112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for user ea14a64fabd24976a0946f6817d2f679 and project fe2904332eef460b8b57f38b445a30aa. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:39:57.656864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:39:57.660030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:39:57.707514 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d0cb991-5b13-4f41-8c1a-652e8203c973 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.586357 Aug 29 16:39:57.708170 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3803/7431] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:39:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:39:57.719005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2533e3f5-ad5d-4dc1-9861-70c878f7bb7d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:57.719646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2533e3f5-ad5d-4dc1-9861-70c878f7bb7d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:57.777978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2533e3f5-ad5d-4dc1-9861-70c878f7bb7d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:57.786229 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2533e3f5-ad5d-4dc1-9861-70c878f7bb7d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1239 microversion: 2.1 time: 0.071140 Aug 29 16:39:57.786805 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3629/7432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:57 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:58.809507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:58.810804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:58.825123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:58.825913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:58.826568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:58.827718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:58.828978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:58.829604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:58.913445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:39:58.923846 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1147d22c-04eb-4366-8da7-be4723173289 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1299 microversion: 2.1 time: 0.119855 Aug 29 16:39:58.924440 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3804/7433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:58 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:39:59.946848 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:39:59.947499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:39:59.956534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:59.957085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:59.957580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:39:59.958285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:39:59.959213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:39:59.959895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:00.104853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:00.114242 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3cc1e5cf-bc6c-4275-adf2-8fe5de79e890 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.171773 Aug 29 16:40:00.115006 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3630/7434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:39:59 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:00.561434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-3efe9e8e-e017-4cb7-a3c1-fb10fc61ca1b req-6bf41dde-1d66-4590-99f0-f29cf9cb2219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:00.574102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3efe9e8e-e017-4cb7-a3c1-fb10fc61ca1b req-6bf41dde-1d66-4590-99f0-f29cf9cb2219 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:00.574688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3efe9e8e-e017-4cb7-a3c1-fb10fc61ca1b req-6bf41dde-1d66-4590-99f0-f29cf9cb2219 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:00.575395 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-3efe9e8e-e017-4cb7-a3c1-fb10fc61ca1b req-6bf41dde-1d66-4590-99f0-f29cf9cb2219 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:00.588144 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-3efe9e8e-e017-4cb7-a3c1-fb10fc61ca1b req-6bf41dde-1d66-4590-99f0-f29cf9cb2219 service nova] Creating event network-changed:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h2-836830-13 Aug 29 16:40:00.593286 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-3efe9e8e-e017-4cb7-a3c1-fb10fc61ca1b req-6bf41dde-1d66-4590-99f0-f29cf9cb2219 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036656 Aug 29 16:40:00.594535 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3805/7435] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:40:01.136726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:01.137486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:01.145426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:01.145924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:01.146396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:01.147167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:01.147633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:01.148064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:01.282919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:01.290812 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30e71d5b-b447-41d1-8012-0e851cf5ff71 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.158123 Aug 29 16:40:01.291404 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3631/7436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:01 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:02.312600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:02.313412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:02.320873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:02.321423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:02.321917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:02.322662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:02.323229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:02.323789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:02.461861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:02.469532 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2bf9480a-4deb-48b3-8238-452f71b532ad tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.161593 Aug 29 16:40:02.470107 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3806/7437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:02 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:03.490383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:03.491078 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:03.497925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:03.498413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:03.498851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:03.499615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:03.500075 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:03.500508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:03.639637 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:03.647978 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-71c4059d-7485-4f36-8939-f8fe9b06bd16 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.161369 Aug 29 16:40:03.648492 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3632/7438] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:03 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:04.669475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:04.670104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:04.676991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:04.677504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:04.677954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:04.678663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:04.679164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:04.679604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:04.817871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:04.825664 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54539202-01ea-43e3-95a8-650a3396e18c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.160387 Aug 29 16:40:04.826245 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3807/7439] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:04 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:05.848219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:05.848757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:05.855709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:05.856200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:05.856638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:05.857333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:05.857792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:05.858219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:05.986166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:05.995587 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8f583ee3-b2a9-4ac6-9c36-004370fa512b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.152114 Aug 29 16:40:05.996203 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3633/7440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:05 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:07.017490 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:07.018015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:07.026256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:07.026747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:07.027259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:07.027954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:07.028415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:07.028849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:07.161670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:07.169543 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-76c86420-cdce-4c99-9186-5da2d1b9bbf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.156049 Aug 29 16:40:07.170127 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3808/7441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:07 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:07.561469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a5743380-50e4-4fa0-9c91-7ca48fe01509 req-5949ca10-a499-4b8d-a62c-bd451406e7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "name": "network-vif-plugged", "status": "completed", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:07.575614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a5743380-50e4-4fa0-9c91-7ca48fe01509 req-5949ca10-a499-4b8d-a62c-bd451406e7fc service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:07.576104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a5743380-50e4-4fa0-9c91-7ca48fe01509 req-5949ca10-a499-4b8d-a62c-bd451406e7fc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:07.576537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a5743380-50e4-4fa0-9c91-7ca48fe01509 req-5949ca10-a499-4b8d-a62c-bd451406e7fc service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:07.588789 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a5743380-50e4-4fa0-9c91-7ca48fe01509 req-5949ca10-a499-4b8d-a62c-bd451406e7fc service nova] Creating event network-vif-plugged:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h2-836830-13 Aug 29 16:40:07.594740 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a5743380-50e4-4fa0-9c91-7ca48fe01509 req-5949ca10-a499-4b8d-a62c-bd451406e7fc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Aug 29 16:40:07.595382 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3634/7442] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:40:08.191451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:08.192122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:08.194355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:08.195099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:08.201928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:08.202437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:08.202918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:08.203653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:08.204127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:08.204569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:08.335347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:08.343157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a0fc6e3-6ed7-433c-9ed6-577c8dee2cf1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1364 microversion: 2.1 time: 0.156625 Aug 29 16:40:08.343737 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3809/7443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:08 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:09.365253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:09.366105 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:09.368181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:40:09.374733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:09.375353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:09.375866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:09.376694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:09.377200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:09.377656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:09.514331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:40:09.522506 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a3d6e66-ae86-47f0-9a42-bd687da1223d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1551 microversion: 2.1 time: 0.162233 Aug 29 16:40:09.523099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3635/7444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:40:09 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:40:09.543481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:40:09.544012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:40:09.551510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:09.552009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:09.552462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:09.553161 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:09.553629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:09.554069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:09.630690 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-72a3e5fb-5a55-49af-89bc-d49b2e7df2c7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091142 Aug 29 16:40:09.631349 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3810/7445] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 16:40:09 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:40:10.571515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e6855526-4e0c-4eaf-b4d8-8e880c6f111c req-a6169e4d-a836-4256-bdf9-7983a76f60aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:40:10.582080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e6855526-4e0c-4eaf-b4d8-8e880c6f111c req-a6169e4d-a836-4256-bdf9-7983a76f60aa service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:40:10.582568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e6855526-4e0c-4eaf-b4d8-8e880c6f111c req-a6169e4d-a836-4256-bdf9-7983a76f60aa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:40:10.583002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e6855526-4e0c-4eaf-b4d8-8e880c6f111c req-a6169e4d-a836-4256-bdf9-7983a76f60aa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:40:10.594426 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e6855526-4e0c-4eaf-b4d8-8e880c6f111c req-a6169e4d-a836-4256-bdf9-7983a76f60aa service nova] Creating event network-changed:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h2-836830-13 Aug 29 16:40:10.599743 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e6855526-4e0c-4eaf-b4d8-8e880c6f111c req-a6169e4d-a836-4256-bdf9-7983a76f60aa service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 Aug 29 16:40:10.600472 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3636/7446] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:41:25.897941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:25.898619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:25.902850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:25.903518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:25.911966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:25.912455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:25.912902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:25.913600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:25.914065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:25.914500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:26.097125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:26.106415 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e01f9cb0-c171-44fa-9d9d-95c12fe07453 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1669 microversion: 2.1 time: 0.211310 Aug 29 16:41:26.106999 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3811/7447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:25 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1669 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:26.133266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=27 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:26.134342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=60 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:26.139532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68be980c-3b8a-4e42-80b0-681c378a7d1a"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:41:26.142885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:26.151237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:26.151663 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:26.152097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:26.152782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:26.153232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:26.153649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:26.497393 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-880822da-2e7e-4c25-bf35-16ed772cb427 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367759 Aug 29 16:41:26.498864 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3637/7448] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:41:26 2022] POST /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:41:37.204302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:41:37.206611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:37.209270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:37.209953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:37.216086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:37.216590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:37.217043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:37.217750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:37.218225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:37.218667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:37.248183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:37.253988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Old instance type m1.heat2, new instance type m1.heat {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:41:37.261629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:41:37.262108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:41:37.262600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:41:37.263348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:41:37.263782 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:41:37.337998 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23ccefac-9981-452d-b6d1-9faa61aeeaa3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/action" status: 202 len: 0 microversion: 2.1 time: 0.136665 Aug 29 16:41:37.337998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3812/7449] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:41:37 2022] POST /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:41:37.346878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:37.347594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:37.350614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:37.351435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:41:37.357414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:37.357957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:37.358444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:37.359207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:37.359691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:37.360247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:37.500961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:37.510821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-09a2ca25-af7b-47c3-a81d-957c9fe869e5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1724 microversion: 2.1 time: 0.168242 Aug 29 16:41:37.511443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3638/7450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:37 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:38.533041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:38.533567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:38.541063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:38.542426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:38.542889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:38.543719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:38.544225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:38.545352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:38.725671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:38.734172 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57203a8f-f3a6-47d6-a863-9d7e13d31efb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1724 microversion: 2.1 time: 0.205181 Aug 29 16:41:38.742746 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3813/7451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:38 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:39.756914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:39.757535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:39.765336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:39.765831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:39.766268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:39.766964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:39.767454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:39.767879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:39.914929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:39.924925 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a7e78bf0-b7f8-46c8-8ad4-aa77d69e20d9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.172589 Aug 29 16:41:39.925509 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3639/7452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:39 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:40.948720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:40.949346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:40.956268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:40.956709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:40.957258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:40.958026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:40.958495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:40.958939 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:41.089993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:41.099562 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-22cfbd90-92a2-4ffc-8b52-6e77bd27a828 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.154729 Aug 29 16:41:41.100150 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3814/7453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:40 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:42.120665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:42.121307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:42.128383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:42.129441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:42.130173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:42.130977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:42.131470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:42.131866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:42.262878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:42.271785 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6c362623-4fdc-4ada-935b-142eaba56bd0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.155067 Aug 29 16:41:42.272364 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3640/7454] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:42 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:43.293963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:43.294616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:43.302640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:43.303186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:43.303642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:43.304373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:43.304858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:43.305306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:43.651539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:43.659936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-199aec4f-c691-4cef-a218-4e26deed80df tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.370089 Aug 29 16:41:43.661226 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3815/7455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:43 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:44.682238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:44.682936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:44.690077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:44.690571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:44.691013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:44.692602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:44.692602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:44.693164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:44.825168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:44.834091 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f0772d70-b9fc-4b77-b14c-7102ea575720 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.155835 Aug 29 16:41:44.834667 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3641/7456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:44 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:45.854844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:45.855493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:45.862334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:45.862866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:45.863452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:45.864748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:45.865218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:45.865658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:45.994588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:46.002804 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cba402b3-abda-4135-869d-18206aec1bb0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.151926 Aug 29 16:41:46.003432 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3816/7457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:45 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:47.024445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:47.025018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:47.031857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:47.032345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:47.032784 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:47.033470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:47.033927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:47.034352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:47.176267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:47.185850 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ad814190-3afe-4466-9a33-c4ac204459ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.164911 Aug 29 16:41:47.186359 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3642/7458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:47 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:48.208748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:48.209373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:48.212685 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:41:48.212821 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:41:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda (ip 10.222.0.83) !!! Aug 29 16:41:48.220913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:48.221417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:48.221866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:48.222730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:48.223317 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:48.223761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:48.360646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:48.369936 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-29f9cd50-7de2-40fe-9354-155533c32666 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.165916 Aug 29 16:41:48.370503 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3817/7459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:48 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:49.391293 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:49.391918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:49.394913 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:41:49.395080 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:41:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda (ip 10.222.0.83) !!! Aug 29 16:41:49.396925 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:41:49.397100 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:41:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda (ip 10.222.0.83) !!! Aug 29 16:41:49.405700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:49.406216 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:49.406641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:49.407369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:49.407832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:49.408257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:49.539664 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:49.548025 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75649feb-8aec-4c66-992d-257896722af1 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.160853 Aug 29 16:41:49.548601 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3643/7460] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:49 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:50.569404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:50.570038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:50.577005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:50.577513 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:50.577969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:50.578673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:50.579177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:50.579622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:50.710012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:50.718281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c581d1c1-7302-4e6e-a96f-ffd5296a80e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.152937 Aug 29 16:41:50.718853 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3818/7461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:50 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:51.742679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:51.743320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:51.751359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:51.751851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:51.752290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:51.752986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:51.753447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:51.754433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:51.892993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:51.901350 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0b79b075-dc92-436c-8566-900fa9d5e084 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.162558 Aug 29 16:41:51.901951 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3644/7462] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:51 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:52.923076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:52.923718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:52.930990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:52.931531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:52.931988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:52.932701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:52.933175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:52.933620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:53.070072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:53.078466 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f827dbb0-eed3-4b72-9174-3e13c906a058 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.159315 Aug 29 16:41:53.079064 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3819/7463] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:52 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:54.101088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:54.101641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:54.108423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:54.108931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:54.109362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:54.110046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:54.110495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:54.110915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:54.243370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:54.251726 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bbd1f377-ff60-4e2e-99a0-5878b3a7a263 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.154900 Aug 29 16:41:54.252306 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3645/7464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:54 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:55.274150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:55.274779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:55.281706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:55.282202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:55.282648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:55.283381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:55.283850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:55.284286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:55.417826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:55.426221 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09e0d757-dc19-44de-a996-ff01227fa1ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.156098 Aug 29 16:41:55.426817 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3820/7465] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:55 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:56.448003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:56.448654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:56.455347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:56.455834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:56.456272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:56.457469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:56.457929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:56.458380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:56.588960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:56.598310 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75f7849d-c18d-4d44-959b-185dcbbf763f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.153391 Aug 29 16:41:56.598905 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3646/7466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:56 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:57.619531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:57.620164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:57.626980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:57.627575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:57.628022 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:57.629226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:57.629691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:57.630126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:57.765514 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:57.774817 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e004095c-6474-4f23-aba5-cab7eadae347 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1729 microversion: 2.1 time: 0.159137 Aug 29 16:41:57.775639 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3821/7467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:57 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:58.796142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:41:58.796772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:41:58.805022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:58.805532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:58.805973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:58.806697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:58.807189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:58.807623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:59.076186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:41:59.085450 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bf084db4-a803-4f7d-86dd-60a84eafe68b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1728 microversion: 2.1 time: 0.293226 Aug 29 16:41:59.086038 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3647/7468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:41:58 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1728 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:41:59.257075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ebf703b0-6d9e-4ecd-9357-50c0911d2fdd req-ce76079c-5308-40f8-a93d-6da15a574095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "name": "network-vif-unplugged", "status": "completed", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:41:59.273909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ebf703b0-6d9e-4ecd-9357-50c0911d2fdd req-ce76079c-5308-40f8-a93d-6da15a574095 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:41:59.274688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ebf703b0-6d9e-4ecd-9357-50c0911d2fdd req-ce76079c-5308-40f8-a93d-6da15a574095 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:41:59.275400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ebf703b0-6d9e-4ecd-9357-50c0911d2fdd req-ce76079c-5308-40f8-a93d-6da15a574095 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:41:59.295281 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ebf703b0-6d9e-4ecd-9357-50c0911d2fdd req-ce76079c-5308-40f8-a93d-6da15a574095 service nova] Creating event network-vif-unplugged:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h1-836830-13 Aug 29 16:41:59.302256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-ebf703b0-6d9e-4ecd-9357-50c0911d2fdd req-ce76079c-5308-40f8-a93d-6da15a574095 service nova] Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:41:59.314185 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ebf703b0-6d9e-4ecd-9357-50c0911d2fdd req-ce76079c-5308-40f8-a93d-6da15a574095 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063759 Aug 29 16:41:59.314794 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3822/7469] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:42:00.108274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:00.108901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:00.116214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:00.116970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:00.117417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:00.118744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:00.119242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:00.119839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:00.274478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:00.282979 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3055cd6b-c862-4e12-8538-0d517fb7f308 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1728 microversion: 2.1 time: 0.178627 Aug 29 16:42:00.283601 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3648/7470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:00 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:01.307805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:01.308526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:01.315132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:01.316171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:01.316635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:01.317344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:01.317810 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:01.318248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:01.347373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ab02c98b-1510-4ff2-8d37-48af1d76ed77 req-4e3de070-f718-4819-8cbc-07bc943121a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:01.358141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ab02c98b-1510-4ff2-8d37-48af1d76ed77 req-4e3de070-f718-4819-8cbc-07bc943121a6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:01.358711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ab02c98b-1510-4ff2-8d37-48af1d76ed77 req-4e3de070-f718-4819-8cbc-07bc943121a6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:01.359270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ab02c98b-1510-4ff2-8d37-48af1d76ed77 req-4e3de070-f718-4819-8cbc-07bc943121a6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:01.371529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ab02c98b-1510-4ff2-8d37-48af1d76ed77 req-4e3de070-f718-4819-8cbc-07bc943121a6 service nova] Creating event network-changed:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h1-836830-13 Aug 29 16:42:01.377133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-ab02c98b-1510-4ff2-8d37-48af1d76ed77 req-4e3de070-f718-4819-8cbc-07bc943121a6 service nova] Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:42:01.389311 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ab02c98b-1510-4ff2-8d37-48af1d76ed77 req-4e3de070-f718-4819-8cbc-07bc943121a6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045839 Aug 29 16:42:01.390304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3649/7471] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:42:01.486042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:01.494984 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9fc7bec6-798a-46a3-b010-1a86eead5d42 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.192337 Aug 29 16:42:01.495798 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3823/7472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:01 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:02.519425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:02.520213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:02.526876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:02.527403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:02.527849 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:02.528558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:02.529020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:02.529457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:02.665665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:02.674642 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c4240ec5-8dd3-417d-a75b-334356c8234e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.161001 Aug 29 16:42:02.675327 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3650/7473] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:02 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:03.697807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:03.698767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:03.705677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:03.706367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:03.706970 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:03.707729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:03.708205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:03.708648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:03.844096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:03.853462 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-253bfd10-5aa5-4218-9c89-986c84840cf0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.160010 Aug 29 16:42:03.854245 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3824/7474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:03 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:04.874716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:04.875367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:04.882863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:04.883396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:04.883825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:04.884524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:04.884971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:04.885430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:05.030685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:05.039933 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e33e521-2f39-4d82-9302-f8bacf55b9ed tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.169291 Aug 29 16:42:05.050468 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3651/7475] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:04 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:06.062133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:06.062677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:06.070111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:06.070627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:06.071097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:06.071806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:06.072279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:06.072720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:06.205346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:06.213746 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-79952856-ae01-4379-8d8e-22d78c67a283 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.155918 Aug 29 16:42:06.214320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3825/7476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:06 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:07.234382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:07.235002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:07.242259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:07.242750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:07.243221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:07.243914 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:07.244372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:07.244801 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:07.381898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:07.390186 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8ddb8a6-8735-483f-83b2-5426162c308e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.159766 Aug 29 16:42:07.390756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3652/7477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:07 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:08.412111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:08.412657 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:08.415559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=33 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:08.421387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:08.421890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:08.422335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:08.423054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:08.423515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:08.423946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:08.427841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:08.558305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:08.567140 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d2e5c0bb-3f3e-4829-849f-653650d9ec96 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.159845 Aug 29 16:42:08.567736 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3826/7478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:08 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:09.588362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:09.588929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:09.591756 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=31 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:09.598095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:09.598596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:09.599042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:09.599743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:09.600200 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:09.600627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:09.603527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=89 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:09.736682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:09.746264 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73851fe7-26c6-439a-9980-fadc0ae2b5eb tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.161901 Aug 29 16:42:09.746857 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3653/7479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:09 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:10.767373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:10.768005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:10.775130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:10.775635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:10.776085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:10.776784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:10.777249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:10.777691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:10.913137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:10.921418 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8b92f42e-2281-4a66-ad00-186d2f0da591 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.158010 Aug 29 16:42:10.921998 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3827/7480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:10 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:11.943548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:11.944163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:11.951376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:11.951864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:11.952549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:11.953190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:11.953646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:11.954073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:12.089771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:12.098810 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fc9dac5-2db1-443e-a2fd-e0aea84995d4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1726 microversion: 2.1 time: 0.159169 Aug 29 16:42:12.099850 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3654/7481] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:11 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:13.120147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:13.121067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:13.129169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.129727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.130244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.131117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.131659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.132172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.271700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:13.280767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7cb7a72a-412f-44c8-be9c-04f99963d3ec tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1723 microversion: 2.1 time: 0.164432 Aug 29 16:42:13.281457 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3828/7482] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:13 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:13.303164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:13.303783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:13.311160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.311655 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.312095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.312790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.313250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.313676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.353390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.353879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.354319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.355066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.355527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.355953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.380667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for project fe2904332eef460b8b57f38b445a30aa. Resources: {'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:42:13.386319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Getting quotas for user ea14a64fabd24976a0946f6817d2f679 and project fe2904332eef460b8b57f38b445a30aa. Resources: {'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:42:13.492771 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-972e2c05-6cd2-42a9-87ea-2295435a9992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "POST /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/action" status: 202 len: 0 microversion: 2.1 time: 0.194088 Aug 29 16:42:13.495583 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3655/7483] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:42:13 2022] POST /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:42:13.501409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:13.502050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:13.509095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.509601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.510049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.510751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:13.511261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:13.511852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:13.651294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:13.659934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-689e0bdf-5876-466a-963a-f8b211cb421e tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.162286 Aug 29 16:42:13.660614 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3829/7484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:13 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:14.683247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:14.683958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:14.692233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:14.692719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:14.693187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:14.693911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:14.694374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:14.694807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:14.831575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:14.840173 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c1a01f28-9946-46e6-8f9a-bbb628b029a4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.162086 Aug 29 16:42:14.840748 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3656/7485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:14 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:15.258855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f13bc7af-6fc2-4836-b744-8258eed06de2 req-e5d79608-11a1-4719-98d3-ebb4175b11f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "name": "network-vif-plugged", "status": "completed", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:15.268400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f13bc7af-6fc2-4836-b744-8258eed06de2 req-e5d79608-11a1-4719-98d3-ebb4175b11f9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:15.268897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f13bc7af-6fc2-4836-b744-8258eed06de2 req-e5d79608-11a1-4719-98d3-ebb4175b11f9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:15.269379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f13bc7af-6fc2-4836-b744-8258eed06de2 req-e5d79608-11a1-4719-98d3-ebb4175b11f9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:15.281184 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f13bc7af-6fc2-4836-b744-8258eed06de2 req-e5d79608-11a1-4719-98d3-ebb4175b11f9 service nova] Creating event network-vif-plugged:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h1-836830-13 Aug 29 16:42:15.286600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-f13bc7af-6fc2-4836-b744-8258eed06de2 req-e5d79608-11a1-4719-98d3-ebb4175b11f9 service nova] Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:42:15.297310 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f13bc7af-6fc2-4836-b744-8258eed06de2 req-e5d79608-11a1-4719-98d3-ebb4175b11f9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106137 Aug 29 16:42:15.297926 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3830/7486] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:15.861803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:15.862424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:15.870807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:15.871430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:15.871943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:15.872733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:15.873322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:15.873822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:16.012344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:16.021368 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f78aa9d2-72cb-45ea-83e9-18da4d3bb07f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.163505 Aug 29 16:42:16.022026 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3657/7487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:15 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:17.044431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:17.045051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:17.052310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:17.052859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:17.053326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:17.054041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:17.054519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:17.054961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:17.191577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:17.200371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d86a9fb9-b2c2-4b2e-9e6f-923baf93df65 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.161169 Aug 29 16:42:17.201142 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3831/7488] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:17 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:18.221856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:18.222479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:18.229964 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:18.230462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:18.230912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:18.231642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:18.232103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:18.232535 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:18.369840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:18.378355 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2e268d06-8a1e-4291-a683-a22e45dceee7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.160481 Aug 29 16:42:18.379161 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3658/7489] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:18 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:18.688000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-438e719d-0afd-4c95-a825-f8f8593c93be req-efa7533f-224b-4303-86b9-ba0494c23dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "name": "network-vif-unplugged", "status": "completed", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:18.698163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-438e719d-0afd-4c95-a825-f8f8593c93be req-efa7533f-224b-4303-86b9-ba0494c23dce service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:18.698637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-438e719d-0afd-4c95-a825-f8f8593c93be req-efa7533f-224b-4303-86b9-ba0494c23dce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:18.699091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-438e719d-0afd-4c95-a825-f8f8593c93be req-efa7533f-224b-4303-86b9-ba0494c23dce service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:18.712922 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-438e719d-0afd-4c95-a825-f8f8593c93be req-efa7533f-224b-4303-86b9-ba0494c23dce service nova] Creating event network-vif-unplugged:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h2-836830-13 Aug 29 16:42:18.717988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-438e719d-0afd-4c95-a825-f8f8593c93be req-efa7533f-224b-4303-86b9-ba0494c23dce service nova] Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:42:18.729146 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-438e719d-0afd-4c95-a825-f8f8593c93be req-efa7533f-224b-4303-86b9-ba0494c23dce service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097017 Aug 29 16:42:18.729756 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3832/7490] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:19.401313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:19.402042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:19.409648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:19.410433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:19.410890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:19.412315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:19.412447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:19.412856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:19.546337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:19.555508 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a60e8fc-5c73-4785-8fdc-78053b37e20a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.159421 Aug 29 16:42:19.556090 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3659/7491] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:19 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:20.579288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:20.579876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:20.586821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.587358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.587806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:20.588505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.588972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.589408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:20.723875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:20.732448 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b83c5175-3d2d-41d3-bf7b-1fdddc0a4f17 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.158409 Aug 29 16:42:20.733028 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3833/7492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:20 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:20.749572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9a826eb0-dce4-4ee6-ab9b-414a43532ee6 req-c834494a-46ef-4a62-babd-13671116e164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:20.760344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9a826eb0-dce4-4ee6-ab9b-414a43532ee6 req-c834494a-46ef-4a62-babd-13671116e164 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:20.760823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9a826eb0-dce4-4ee6-ab9b-414a43532ee6 req-c834494a-46ef-4a62-babd-13671116e164 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:20.761248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9a826eb0-dce4-4ee6-ab9b-414a43532ee6 req-c834494a-46ef-4a62-babd-13671116e164 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:20.773569 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9a826eb0-dce4-4ee6-ab9b-414a43532ee6 req-c834494a-46ef-4a62-babd-13671116e164 service nova] Creating event network-changed:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h2-836830-13 Aug 29 16:42:20.779172 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-9a826eb0-dce4-4ee6-ab9b-414a43532ee6 req-c834494a-46ef-4a62-babd-13671116e164 service nova] Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:42:20.790746 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9a826eb0-dce4-4ee6-ab9b-414a43532ee6 req-c834494a-46ef-4a62-babd-13671116e164 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044896 Aug 29 16:42:20.791451 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3660/7493] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:21.753695 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:21.754399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:21.761834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:21.762346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:21.762807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:21.763635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:21.764112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:21.764556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:21.907739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:21.916900 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d9f1250-be5b-4dff-9f05-8a2feeaaa9da tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.167237 Aug 29 16:42:21.917483 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3834/7494] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:21 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:22.939762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:22.940506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:22.946863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:22.947398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:22.947840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:22.948542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:22.949004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:22.949433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:23.091276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:23.100334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ed4f3377-ec21-44fb-abe6-91c78f3c3b91 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.166059 Aug 29 16:42:23.100935 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3661/7495] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:22 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:24.122197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:24.122756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:24.130437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:24.130933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:24.131422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:24.132138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:24.132604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:24.133045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:24.277092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:24.285852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a2b2e3c-af7b-4086-975a-32755f8165d7 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.167862 Aug 29 16:42:24.286747 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3835/7496] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:24 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:25.307941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:25.308599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:25.310879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:25.317003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:25.317491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:25.317930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:25.318624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:25.319178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:25.319610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:25.448136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:25.459140 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff0cec42-cfd2-4b2a-9602-7a45709895e0 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.155419 Aug 29 16:42:25.459652 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3662/7497] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:25 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:26.479615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:26.480246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:26.487210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:26.487770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:26.488267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:26.488975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:26.489449 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:26.489886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:26.625421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:26.634365 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d090219e-dca2-48ca-8d83-1823fcaaf28c tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.158673 Aug 29 16:42:26.634943 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3836/7498] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:26 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:27.655869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:27.656395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:27.664302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:27.664792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:27.665232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:27.665923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:27.666421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:27.666811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:27.805206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:27.813754 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1974c6ee-db16-4577-bb75-1337c65caab4 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.161906 Aug 29 16:42:27.814335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3663/7499] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:27 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:28.835283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:28.836714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:28.843522 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:28.844025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:28.844476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:28.845177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:28.845647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:28.846082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:28.978821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:28.987145 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5a1fc1a-adf2-4824-a9b8-2c66044df56d tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.156648 Aug 29 16:42:28.987733 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3837/7500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:28 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:30.007934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:30.008491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:30.015434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:30.015922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:30.016367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:30.017056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:30.017519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:30.017946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:30.147346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:30.155651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5e9539c7-8893-4e5d-ad36-cd6810e2e4c6 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.151740 Aug 29 16:42:30.156227 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3664/7501] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:30 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:31.177285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:31.177846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:31.184999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:31.185502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:31.185959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:31.186664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:31.187167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:31.187610 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:31.317898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:31.326288 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1f8ccb23-3d8e-4d1a-80f6-c89f4849056f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.153585 Aug 29 16:42:31.326866 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3838/7502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:31 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:32.347609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:32.348238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:32.355454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:32.356128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:32.356570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:32.357267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:32.357727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:32.358155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:32.496730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:32.505823 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-682020e3-bff2-4c4b-a6eb-3750cb29d980 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1722 microversion: 2.1 time: 0.162429 Aug 29 16:42:32.506406 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3665/7503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:32 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:33.527252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:33.527886 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:33.535233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.535733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.536183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:33.536877 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.537342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.537776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:33.669663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:33.678215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-831f6cbf-b5ec-4bb2-b953-26be49bfb100 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1715 microversion: 2.1 time: 0.154887 Aug 29 16:42:33.678792 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3839/7504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:33 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:33.699313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:33.700043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:33.708228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.708717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.709156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:33.709867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.710311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.710738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:33.838070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:33.846319 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1229b2bd-6800-4e0b-b8a5-b43e6b4a8a41 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1715 microversion: 2.1 time: 0.150934 Aug 29 16:42:33.847526 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3666/7505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:33 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:33.867183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:33.867818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:33.873869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.874369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.874825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:33.875558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:33.876034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:33.876478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:34.004433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:34.012694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dfe394a2-ca8c-4751-a29d-563b96c14707 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1715 microversion: 2.1 time: 0.150034 Aug 29 16:42:34.013274 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3840/7506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:33 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:34.032905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:34.033409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:34.040131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:34.040563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:34.041037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:34.041733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:34.042191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:34.042618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:34.046592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:34.071035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:42:34.148919 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ff03ba7-42e4-4cbc-9832-6538df9a6f21 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 204 len: 0 microversion: 2.1 time: 0.119471 Aug 29 16:42:34.149533 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3667/7507] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:42:34 2022] DELETE /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:42:34.157656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:34.158300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:34.165083 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:34.165591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:34.166069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:34.166778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:34.167279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:34.167721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:34.311861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:34.321132 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-52c83903-651a-4f3a-ba02-b6f84365a42a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1721 microversion: 2.1 time: 0.167228 Aug 29 16:42:34.321703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3841/7508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:34 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:34.379313 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bde5cbab-92c8-4750-a419-9b8ffaa66642 req-703ef3b9-7d1d-41c6-a882-ce468c90282e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "name": "network-vif-plugged", "status": "completed", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:34.388765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bde5cbab-92c8-4750-a419-9b8ffaa66642 req-703ef3b9-7d1d-41c6-a882-ce468c90282e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:34.389274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bde5cbab-92c8-4750-a419-9b8ffaa66642 req-703ef3b9-7d1d-41c6-a882-ce468c90282e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:34.389666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bde5cbab-92c8-4750-a419-9b8ffaa66642 req-703ef3b9-7d1d-41c6-a882-ce468c90282e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:34.403076 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bde5cbab-92c8-4750-a419-9b8ffaa66642 req-703ef3b9-7d1d-41c6-a882-ce468c90282e service nova] Creating event network-vif-plugged:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h2-836830-13 Aug 29 16:42:34.408075 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bde5cbab-92c8-4750-a419-9b8ffaa66642 req-703ef3b9-7d1d-41c6-a882-ce468c90282e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033545 Aug 29 16:42:34.408692 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3668/7509] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:35.343208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:35.343845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:35.350837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:35.351370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:35.351836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:35.352531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:35.353006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:35.353448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:35.483718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:35.492015 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59a16737-5881-4124-8884-64efcf29821a tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1721 microversion: 2.1 time: 0.152714 Aug 29 16:42:35.492595 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3842/7510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:35 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:36.514292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:36.515176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:36.523201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:36.523689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:36.524131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:36.524830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:36.525339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:36.525763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:36.602096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:36.623068 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a0e09209-4389-43d1-b0a5-6304ab16f505 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1654 microversion: 2.1 time: 0.113454 Aug 29 16:42:36.624589 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3669/7511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:36 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1654 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:42:36.910266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-de2ee74f-79c1-4c49-ac38-73ac8f2c868a req-0f493e87-21e8-4700-8642-a997b4afa266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42eb165f-89c9-4451-a10d-2b1809f4eeda", "name": "network-vif-deleted", "tag": "a08b86e7-19d8-4857-90ec-27845ba1b411"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:36.925841 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-de2ee74f-79c1-4c49-ac38-73ac8f2c868a req-0f493e87-21e8-4700-8642-a997b4afa266 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:36.926334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-de2ee74f-79c1-4c49-ac38-73ac8f2c868a req-0f493e87-21e8-4700-8642-a997b4afa266 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:36.926783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-de2ee74f-79c1-4c49-ac38-73ac8f2c868a req-0f493e87-21e8-4700-8642-a997b4afa266 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:36.953611 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-de2ee74f-79c1-4c49-ac38-73ac8f2c868a req-0f493e87-21e8-4700-8642-a997b4afa266 service nova] Creating event network-vif-deleted:a08b86e7-19d8-4857-90ec-27845ba1b411 for instance 42eb165f-89c9-4451-a10d-2b1809f4eeda on n-h2-836830-13 Aug 29 16:42:36.959208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-de2ee74f-79c1-4c49-ac38-73ac8f2c868a req-0f493e87-21e8-4700-8642-a997b4afa266 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052566 Aug 29 16:42:36.959824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3843/7512] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:37.645903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:37.647270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:37.655601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.656104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.656550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.657283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:37.657743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:37.658171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:37.723574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:37.732297 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1504948-5246-4618-a7cc-5b325e5db992 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1370 microversion: 2.1 time: 0.091043 Aug 29 16:42:37.733083 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3670/7513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:37 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:38.755007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:38.755852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:38.758964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=36 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:38.764714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:38.765217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:38.765663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:38.766375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:38.766837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:38.767299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:38.770700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:38.839013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:38.848324 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89da4ebb-0485-4043-b168-25e44d5e1598 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1370 microversion: 2.1 time: 0.098374 Aug 29 16:42:38.848903 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3844/7514] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:38 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:39.872718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:39.873765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:39.879372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:39.885829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:39.886329 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:39.886778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:39.887518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:39.887976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:39.888399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:39.956731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:39.965197 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4a35f88b-1813-4536-82e6-4bd1c9e5803b tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1370 microversion: 2.1 time: 0.097894 Aug 29 16:42:39.965785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3671/7515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:39 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:40.986043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:40.986599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:40.994137 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:40.994648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:40.995128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:40.995851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:40.996325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:40.996774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:41.063701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea14a64fabd24976a0946f6817d2f679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2904332eef460b8b57f38b445a30aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:41.072384 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e391a921-d466-4e03-abbe-f223de8b8411 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 200 len: 1370 microversion: 2.1 time: 0.090361 Aug 29 16:42:41.072979 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3845/7516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:40 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:42.093585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:42.094209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:42.101169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:42.101660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:42.102102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:42.102795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:42.103291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:42.103722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:42.117271 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda HTTP/1.1 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '42eb165f-89c9-4451-a10d-2b1809f4eeda'} Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:42.118936 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8e2ed6b-047e-4cd1-80f9-a97b58936fb3 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 404 len: 111 microversion: 2.1 time: 0.030795 Aug 29 16:42:42.123243 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3672/7517] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:42 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:42.180489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:42.182698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:42.189940 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:42.191217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:42.191677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:42.192379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:42.192856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:42.193297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:42.205876 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/os-volume_attachments HTTP/1.1 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '42eb165f-89c9-4451-a10d-2b1809f4eeda'} Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:42.207774 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-60f4253c-69d4-4ae7-b1d9-f93245f092af tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032912 Aug 29 16:42:42.212331 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3846/7518] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:42:42 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.533510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.534580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.541975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.542543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.542978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.543776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.544231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.544660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.558674 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda HTTP/1.1 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '42eb165f-89c9-4451-a10d-2b1809f4eeda'} Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.560506 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1cbc4aa5-4a3b-4a75-be45-968b8f937ff2 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 404 len: 111 microversion: 2.1 time: 0.032262 Aug 29 16:42:45.567883 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3673/7519] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:42:45 2022] DELETE /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.573874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.574515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 42eb165f-89c9-4451-a10d-2b1809f4eeda] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.581889 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.582390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.582843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.583575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.584046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.584523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.599652 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda HTTP/1.1 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '42eb165f-89c9-4451-a10d-2b1809f4eeda'} Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.601265 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 42eb165f-89c9-4451-a10d-2b1809f4eeda could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9c75cd18-c01e-44d4-812b-ddd143e58701 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda" status: 404 len: 111 microversion: 2.1 time: 0.032712 Aug 29 16:42:45.605233 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3847/7520] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:45 2022] GET /compute/v2.1/servers/42eb165f-89c9-4451-a10d-2b1809f4eeda => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.611429 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.613826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.619972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.620460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.620898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.621588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.622048 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.622517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.636239 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf HTTP/1.1 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf'} Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.637806 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-876f5e26-34fd-4f31-a8bb-c2e725db8bb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 404 len: 111 microversion: 2.1 time: 0.031656 Aug 29 16:42:45.642183 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3674/7521] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:42:45 2022] DELETE /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.647982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.648777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.654873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.655402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.655856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.656552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.657025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.657471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.671599 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf HTTP/1.1 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf'} Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.673166 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-84303fe3-df0a-4b50-9106-87276635ea26 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf" status: 404 len: 111 microversion: 2.1 time: 0.030643 Aug 29 16:42:45.678375 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3848/7522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:45 2022] GET /compute/v2.1/servers/83d3a1b2-7245-4b31-b4b9-e5a25cfa01bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.684057 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.684808 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.691233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.691725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.692158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.692866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.693317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.693876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.708868 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 HTTP/1.1 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '4025dfa5-add4-400d-bb67-0b8ad672be12'} Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.710476 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c5d740a-a3da-47d2-917b-444dc566b6b9 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 404 len: 111 microversion: 2.1 time: 0.031781 Aug 29 16:42:45.714222 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3675/7523] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:42:45 2022] DELETE /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.721066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.722381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: 4025dfa5-add4-400d-bb67-0b8ad672be12] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.729003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.729519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.729972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.730691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.731192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.731634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.748408 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 HTTP/1.1 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '4025dfa5-add4-400d-bb67-0b8ad672be12'} Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.750143 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance 4025dfa5-add4-400d-bb67-0b8ad672be12 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71cf5ba4-6beb-413d-8e4c-6fcc5bb9c86f tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12" status: 404 len: 111 microversion: 2.1 time: 0.034824 Aug 29 16:42:45.755420 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3849/7524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:45 2022] GET /compute/v2.1/servers/4025dfa5-add4-400d-bb67-0b8ad672be12 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.761383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.761810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.768835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.769331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.769768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.770466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.770915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.771368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.785784 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b HTTP/1.1 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'ea861908-2f1a-4d44-9c6e-6c1208d3311b'} Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.787387 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a50dba5b-cffc-4311-9060-386e90ea7397 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 404 len: 111 microversion: 2.1 time: 0.031417 Aug 29 16:42:45.791237 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3676/7525] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:42:45 2022] DELETE /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.797382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.798002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] [instance: ea861908-2f1a-4d44-9c6e-6c1208d3311b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:45.804590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.805086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.805530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.806221 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:45.806683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:45.807149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:45.824397 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] HTTP exception thrown: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Request method failure captured: Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b HTTP/1.1 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOrZ6oj2D8DiwYnOe4IdgaDk_zyIUo4uBH2eBpUrbjpa5aiXEreJOIjGZcJ3qYpHLr65IZAlSfs7XFdT1L5K3CzpO_B1kEPFJHeUXnRmymC9puUhhCbsTL0wGR9uiF7FyLrI8IzOn2z9qSSfZP68vzRDkRUUl35t7NtVy4oW0Bpczw0 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fe2904332eef460b8b57f38b445a30aa", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fe2904332eef460b8b57f38b445a30aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fe2904332eef460b8b57f38b445a30aa"}]}] Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: fe2904332eef460b8b57f38b445a30aa Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServerActionsTestJSON-275146473 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: ea14a64fabd24976a0946f6817d2f679 Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServerActionsTestJSON-275146473-project Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'ea861908-2f1a-4d44-9c6e-6c1208d3311b'} Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:42:45.825951 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Returning 404 to user: Instance ea861908-2f1a-4d44-9c6e-6c1208d3311b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-48993716-7e80-48e3-8982-a19020f33265 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b" status: 404 len: 111 microversion: 2.1 time: 0.033816 Aug 29 16:42:45.829948 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3850/7526] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:45 2022] GET /compute/v2.1/servers/ea861908-2f1a-4d44-9c6e-6c1208d3311b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:42:45.837232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51cb27bf-8765-4d72-af19-51626b26fcb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] Calling method '.version_select at 0x7f32ed530af0>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:45.860945 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-51cb27bf-8765-4d72-af19-51626b26fcb5 tempest-ServerActionsTestJSON-275146473 tempest-ServerActionsTestJSON-275146473-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107980636" status: 202 len: 0 microversion: 2.1 time: 0.027577 Aug 29 16:42:45.861528 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3677/7527] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 16:42:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107980636 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:42:55.576517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-343425307", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "1dd3fcdb-787e-4bde-ae12-eac9e358a07d"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:55.650587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] validate_networks() for [('1dd3fcdb-787e-4bde-ae12-eac9e358a07d', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:42:55.812233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=21 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:56.033189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:42:56.033680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:42:56.034160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:42:56.034582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:42:56.034999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:42:56.043959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:56.044453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:56.044900 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:56.045632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:56.046096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:56.046535 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:56.065095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Getting quotas for project 8916574f66d44b14922a241d52602a21. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:42:56.070451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Getting quotas for user 3822e8832e1d4d09b0b68658e1e7a313 and project 8916574f66d44b14922a241d52602a21. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:42:56.083770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:42:56.086071 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:42:56.134409 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-df346c58-23cd-473e-95f7-92ea65fe93bb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697436 Aug 29 16:42:56.135745 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3851/7528] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:42:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:42:56.145226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:56.146218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:42:56.150515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c24bbd24-ce06-4488-9fc4-aa7d8d58770a tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:56.151179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c24bbd24-ce06-4488-9fc4-aa7d8d58770a tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:56.216855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c24bbd24-ce06-4488-9fc4-aa7d8d58770a tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:56.224523 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c24bbd24-ce06-4488-9fc4-aa7d8d58770a tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1216 microversion: 2.1 time: 0.082157 Aug 29 16:42:56.225104 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3678/7529] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:56 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:57.244906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:57.245615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:57.255437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:57.255947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:57.256390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:57.257116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:57.257586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:57.258132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:57.344335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:57.354829 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eb3aad67-f144-4e34-ab4f-d040d643aef9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1286 microversion: 2.1 time: 0.113366 Aug 29 16:42:57.355808 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3852/7530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:57 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:58.379406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:58.380340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:58.387672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:58.388389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:58.388923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:58.389935 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:58.390464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:58.390962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:58.588017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:58.597267 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-09abf081-951a-4603-9da1-068d3452b364 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1316 microversion: 2.1 time: 0.223132 Aug 29 16:42:58.598021 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3679/7531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:58 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:42:58.676213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-f418f040-2ebf-4a92-aea2-5f19edc3beb4 req-5eebe046-d4be-4e7f-a1de-5f8d0c456d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "704ca8a3-0671-405b-8882-1daaf10f6e03", "tag": "ffcd5450-b38c-4163-b808-a3067c91d150"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:42:58.688969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f418f040-2ebf-4a92-aea2-5f19edc3beb4 req-5eebe046-d4be-4e7f-a1de-5f8d0c456d94 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:58.689515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f418f040-2ebf-4a92-aea2-5f19edc3beb4 req-5eebe046-d4be-4e7f-a1de-5f8d0c456d94 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:58.690433 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-f418f040-2ebf-4a92-aea2-5f19edc3beb4 req-5eebe046-d4be-4e7f-a1de-5f8d0c456d94 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:58.706911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-f418f040-2ebf-4a92-aea2-5f19edc3beb4 req-5eebe046-d4be-4e7f-a1de-5f8d0c456d94 service nova] Creating event network-changed:ffcd5450-b38c-4163-b808-a3067c91d150 for instance 704ca8a3-0671-405b-8882-1daaf10f6e03 on n-h1-836830-13 Aug 29 16:42:58.713218 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-f418f040-2ebf-4a92-aea2-5f19edc3beb4 req-5eebe046-d4be-4e7f-a1de-5f8d0c456d94 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041711 Aug 29 16:42:58.714531 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3853/7532] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:42:59.618259 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:42:59.618870 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:42:59.625685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:59.626165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:59.626595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:59.627447 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:42:59.627899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:42:59.628317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:42:59.759942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:42:59.768887 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ff6340a8-05d4-42a8-836d-6d262cbc184f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1316 microversion: 2.1 time: 0.154544 Aug 29 16:42:59.769469 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3680/7533] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:42:59 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:00.790589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:00.791368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:00.797727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:00.798230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:00.798936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:00.799452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:00.799919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:00.800364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:00.940159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:00.948071 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cb67b473-7395-4508-a806-e36003b88ee7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1316 microversion: 2.1 time: 0.162616 Aug 29 16:43:00.948646 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3854/7534] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:00 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:01.969085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:01.969687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:01.978061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:01.978541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:01.978970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:01.979675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:01.980125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:01.980549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:02.113473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:02.121181 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5df9c6f5-2e04-45f7-8197-f80ba374dda7 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1316 microversion: 2.1 time: 0.156147 Aug 29 16:43:02.121753 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3681/7535] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:01 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:03.145187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:03.145722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:03.152503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:03.152996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:03.153440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:03.154129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:03.154590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:03.155038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:03.287468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:03.295290 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b3c131ad-6bed-4645-ae0d-e349870d5515 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1316 microversion: 2.1 time: 0.155125 Aug 29 16:43:03.295870 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3855/7536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:03 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:04.316925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:04.317519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:04.324356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:04.324835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:04.325264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:04.325941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:04.326391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:04.326807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:04.460504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:04.468230 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-109c6791-eef1-4933-a53f-5c548de4b97e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1316 microversion: 2.1 time: 0.155766 Aug 29 16:43:04.468795 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3682/7537] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:04 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:05.438599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-988c9a66-f332-4a57-b97f-8c9a6133889e req-f53f104a-0a78-43f0-8028-d86c16519faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704ca8a3-0671-405b-8882-1daaf10f6e03", "name": "network-vif-plugged", "status": "completed", "tag": "ffcd5450-b38c-4163-b808-a3067c91d150"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:05.448775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-988c9a66-f332-4a57-b97f-8c9a6133889e req-f53f104a-0a78-43f0-8028-d86c16519faf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:05.449292 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-988c9a66-f332-4a57-b97f-8c9a6133889e req-f53f104a-0a78-43f0-8028-d86c16519faf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:05.449736 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-988c9a66-f332-4a57-b97f-8c9a6133889e req-f53f104a-0a78-43f0-8028-d86c16519faf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:05.461180 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-988c9a66-f332-4a57-b97f-8c9a6133889e req-f53f104a-0a78-43f0-8028-d86c16519faf service nova] Creating event network-vif-plugged:ffcd5450-b38c-4163-b808-a3067c91d150 for instance 704ca8a3-0671-405b-8882-1daaf10f6e03 on n-h1-836830-13 Aug 29 16:43:05.466143 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-988c9a66-f332-4a57-b97f-8c9a6133889e req-f53f104a-0a78-43f0-8028-d86c16519faf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Aug 29 16:43:05.466735 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3856/7538] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:43:05.491519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:05.492129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:05.500739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:05.501235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:05.501776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:05.503458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:05.503966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:05.504480 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:05.694813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:05.702673 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2b88cd76-00c3-45d4-8d3c-d97ff4fdb214 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1316 microversion: 2.1 time: 0.217585 Aug 29 16:43:05.703295 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3683/7539] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:05 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:06.722437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:06.723266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:06.728674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:06.729401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:06.737026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:06.737544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:06.737992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:06.738710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:06.739212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:06.739658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:06.878165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:06.886152 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-95b6f221-7749-45b8-ab2c-96e9a5e75053 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1505 microversion: 2.1 time: 0.164682 Aug 29 16:43:06.886786 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3857/7540] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:06 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:06.946167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1073657997", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "1dd3fcdb-787e-4bde-ae12-eac9e358a07d"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:06.954428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:07.000669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] validate_networks() for [('1dd3fcdb-787e-4bde-ae12-eac9e358a07d', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:43:07.415533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:43:07.415962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:43:07.416439 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:43:07.416904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:43:07.417299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:43:07.427291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:07.427780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:07.428221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:07.428948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:07.429408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:07.429838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:07.446888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Getting quotas for project 8916574f66d44b14922a241d52602a21. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:43:07.452121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Getting quotas for user 3822e8832e1d4d09b0b68658e1e7a313 and project 8916574f66d44b14922a241d52602a21. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:43:07.464557 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:43:07.466888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:43:07.513892 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-22772416-6e6f-4521-89fa-f00f424ce82f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571519 Aug 29 16:43:07.514559 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3684/7541] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:43:07.525573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ced13a7a-fcf6-4834-8411-cc4b942994d4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:07.526213 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ced13a7a-fcf6-4834-8411-cc4b942994d4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:07.581743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ced13a7a-fcf6-4834-8411-cc4b942994d4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:07.588961 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ced13a7a-fcf6-4834-8411-cc4b942994d4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1217 microversion: 2.1 time: 0.067335 Aug 29 16:43:07.589540 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3858/7542] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:07 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:08.610576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:08.612113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:08.619052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:08.619561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:08.619991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:08.620679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:08.621310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:08.622099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:08.694945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:08.711724 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee41b34e-1443-4499-8178-f345ab534147 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1287 microversion: 2.1 time: 0.104993 Aug 29 16:43:08.712337 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3685/7543] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:08 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:09.733303 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:09.734107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:09.737193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:09.749758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:09.750428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:09.750985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:09.751862 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:09.753000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:09.753586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:09.985999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:09.994880 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c6a923ac-7e7f-45f1-948b-074e11f3e22f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.265577 Aug 29 16:43:09.995454 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3859/7544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:09 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:10.262946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-030da2f6-04e3-4775-8259-1a1f39a6134f req-23894be4-2ef2-4fdf-8a64-ecf1f72e9d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d079d3-f376-4ac1-bcc8-b5f919d01fd8", "tag": "e86343fd-f221-45c5-9e02-2048a801c4fd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:10.275247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-030da2f6-04e3-4775-8259-1a1f39a6134f req-23894be4-2ef2-4fdf-8a64-ecf1f72e9d4f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:10.275832 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-030da2f6-04e3-4775-8259-1a1f39a6134f req-23894be4-2ef2-4fdf-8a64-ecf1f72e9d4f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:10.276375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-030da2f6-04e3-4775-8259-1a1f39a6134f req-23894be4-2ef2-4fdf-8a64-ecf1f72e9d4f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:10.290152 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-030da2f6-04e3-4775-8259-1a1f39a6134f req-23894be4-2ef2-4fdf-8a64-ecf1f72e9d4f service nova] Creating event network-changed:e86343fd-f221-45c5-9e02-2048a801c4fd for instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 on n-h2-836830-13 Aug 29 16:43:10.295954 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-030da2f6-04e3-4775-8259-1a1f39a6134f req-23894be4-2ef2-4fdf-8a64-ecf1f72e9d4f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036891 Aug 29 16:43:10.296731 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3686/7545] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:43:11.016713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:11.017327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:11.025037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:11.025536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:11.025988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:11.026692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:11.027182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:11.027619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:11.158192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:11.166048 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4543abc1-fc59-4702-845c-391a27fcc7f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.153552 Aug 29 16:43:11.166622 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3860/7546] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:11 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:12.187742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:12.188452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:12.194698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:12.195237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:12.195679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:12.196368 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:12.196825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:12.197252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:12.327035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:12.335384 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d296cc5f-90b4-4559-8110-6e6f123aa7cf tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.153041 Aug 29 16:43:12.335961 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3687/7547] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:12 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:13.357285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:13.357899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:13.365902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:13.366402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:13.366854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:13.367587 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:13.368058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:13.368627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:13.500539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:13.509363 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8c9a03a2-7a86-40ba-b199-bc3856b8b936 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.156071 Aug 29 16:43:13.509997 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3861/7548] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:13 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:43:14.529700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:14.530376 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:14.537361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:14.537845 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:14.538286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:14.538977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:14.539455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:14.539877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:14.674629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:14.682901 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a37d4130-a3ad-4fc2-81ff-8210ccb3dc53 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.157023 Aug 29 16:43:14.683538 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3688/7549] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:14 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:15.705327 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:15.706036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:15.713778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:15.714275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:15.714725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:15.715452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:15.715920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:15.716356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:15.847203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:15.855875 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8bb79c1-2c22-4648-9baf-36c6b55259d9 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.154494 Aug 29 16:43:15.856441 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3862/7550] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:15 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:16.422380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ad46e8d6-a7ac-474b-b41e-e9596196ac35 req-651514e3-a586-463b-9302-37dbc5e0edff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d079d3-f376-4ac1-bcc8-b5f919d01fd8", "name": "network-vif-plugged", "status": "completed", "tag": "e86343fd-f221-45c5-9e02-2048a801c4fd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:16.438428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ad46e8d6-a7ac-474b-b41e-e9596196ac35 req-651514e3-a586-463b-9302-37dbc5e0edff service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:16.438933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ad46e8d6-a7ac-474b-b41e-e9596196ac35 req-651514e3-a586-463b-9302-37dbc5e0edff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:16.440353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ad46e8d6-a7ac-474b-b41e-e9596196ac35 req-651514e3-a586-463b-9302-37dbc5e0edff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:16.452326 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ad46e8d6-a7ac-474b-b41e-e9596196ac35 req-651514e3-a586-463b-9302-37dbc5e0edff service nova] Creating event network-vif-plugged:e86343fd-f221-45c5-9e02-2048a801c4fd for instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 on n-h2-836830-13 Aug 29 16:43:16.458451 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ad46e8d6-a7ac-474b-b41e-e9596196ac35 req-651514e3-a586-463b-9302-37dbc5e0edff service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039698 Aug 29 16:43:16.459091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3689/7551] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:43:16.878085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:16.878783 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:16.885735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:16.886228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:16.886671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:16.887394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:16.887855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:16.888288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:17.019421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:17.027077 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4600a4f-33a7-493b-9423-8f64f97e1a2f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.153631 Aug 29 16:43:17.027650 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3863/7552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:16 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:18.048575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:18.049485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:18.052420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:18.053093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:18.059669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:18.060154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:18.060585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:18.061263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:18.061712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:18.062130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:18.203719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:18.211620 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fe70124e-ea1c-4226-875c-b3a05cd1a00b tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1317 microversion: 2.1 time: 0.167254 Aug 29 16:43:18.212196 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3690/7553] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:18 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:19.232653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:19.233284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:19.235723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:19.241328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:19.241828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:19.242279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:19.242978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:19.243466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:19.243904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:19.374010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:19.382311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77276b83-95b5-48ce-aa74-c0af86462091 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1505 microversion: 2.1 time: 0.153613 Aug 29 16:43:19.382889 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3864/7554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:19 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:19.403234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:19.403770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:19.411321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:19.411818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:19.412265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:19.412981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:19.413450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:19.413882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:19.439161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:43:19.517077 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-035ed417-0ee0-4867-8b9a-ef12b056da47 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 204 len: 0 microversion: 2.1 time: 0.117414 Aug 29 16:43:19.517616 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3691/7555] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:43:19 2022] DELETE /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:43:19.526498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:19.527177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:19.533312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:19.533815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:19.534460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:19.535202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:19.535674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:19.536115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:19.671170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:19.679609 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30b3509b-7776-452f-8af0-a7bf840c87ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1511 microversion: 2.1 time: 0.157105 Aug 29 16:43:19.680184 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3865/7556] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:19 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:20.701766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:20.702481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:20.710467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:20.710961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:20.711430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:20.712127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:20.712583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:20.713015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:20.854625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:20.863093 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bcdfef12-5a21-4450-a334-48d2f3d580eb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1511 microversion: 2.1 time: 0.165646 Aug 29 16:43:20.863683 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3692/7557] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:20 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:21.609761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-9dd64dd3-51a0-4367-9e09-4aacb22fbee2 req-3f621c23-5c36-4ed5-830c-814a9b2b3249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d079d3-f376-4ac1-bcc8-b5f919d01fd8", "name": "network-vif-deleted", "tag": "e86343fd-f221-45c5-9e02-2048a801c4fd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:21.621724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9dd64dd3-51a0-4367-9e09-4aacb22fbee2 req-3f621c23-5c36-4ed5-830c-814a9b2b3249 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:21.622237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9dd64dd3-51a0-4367-9e09-4aacb22fbee2 req-3f621c23-5c36-4ed5-830c-814a9b2b3249 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:21.622670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-9dd64dd3-51a0-4367-9e09-4aacb22fbee2 req-3f621c23-5c36-4ed5-830c-814a9b2b3249 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:21.635872 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-9dd64dd3-51a0-4367-9e09-4aacb22fbee2 req-3f621c23-5c36-4ed5-830c-814a9b2b3249 service nova] Creating event network-vif-deleted:e86343fd-f221-45c5-9e02-2048a801c4fd for instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 on n-h2-836830-13 Aug 29 16:43:21.642522 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-9dd64dd3-51a0-4367-9e09-4aacb22fbee2 req-3f621c23-5c36-4ed5-830c-814a9b2b3249 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036054 Aug 29 16:43:21.644272 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3866/7558] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:43:21.882956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:21.883607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:21.890389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:21.890871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:21.891347 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:21.892034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:21.893007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:21.893688 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:21.925971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:21.926453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:21.926887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:21.927356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lazy-loading 'fault' on Instance uuid d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:43:21.967456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:21.975922 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-55936254-5bf4-48f6-bcd3-3561cc9b2963 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 200 len: 1307 microversion: 2.1 time: 0.096784 Aug 29 16:43:21.976496 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3693/7559] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:21 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:22.998260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:22.998883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.005869 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.006361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.006811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.007516 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.007979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.008411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.022849 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] HTTP exception thrown: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Request method failure captured: Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 HTTP/1.1 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOyPXBmP_SNq0VuvVD5rpLP1-N3xwWuLmgxGQ_7wLNxgMNWa-tey3BaztWc3ChhwAL12auqEMIzLVgXX7tCWz7w5AFkXfvotLDBW9WTzqZzs6DxFFF4FB6hnXSoPnr0c3zHLm9GOdkLFC5KHh1ECsUuwdggMGiwV_FPLq_vvHsZbHgw Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8916574f66d44b14922a241d52602a21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8916574f66d44b14922a241d52602a21"}]}] Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3822e8832e1d4d09b0b68658e1e7a313 Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd3d079d3-f376-4ac1-bcc8-b5f919d01fd8'} Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.024520 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Returning 404 to user: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5e3f4e88-cd1a-42f8-b461-cd32f0a8408f tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 404 len: 111 microversion: 2.1 time: 0.032874 Aug 29 16:43:23.029358 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3867/7560] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:22 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:43:23.036615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:23.037245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.044349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.044883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.045326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.046020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.046478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.046908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.177263 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:23.185217 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-713790b5-636d-4904-acc1-6f46183b1cae tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1505 microversion: 2.1 time: 0.153162 Aug 29 16:43:23.185784 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3694/7561] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:23 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:23.205193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f24fdf2e-b8f2-41e3-ae8c-22d1355a58ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:23.207472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f24fdf2e-b8f2-41e3-ae8c-22d1355a58ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.213006 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f24fdf2e-b8f2-41e3-ae8c-22d1355a58ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] HTTP exception thrown: Instance 3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1 could not be found. Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f24fdf2e-b8f2-41e3-ae8c-22d1355a58ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Request method failure captured: Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1/action HTTP/1.1 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 32 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOyPXBmP_SNq0VuvVD5rpLP1-N3xwWuLmgxGQ_7wLNxgMNWa-tey3BaztWc3ChhwAL12auqEMIzLVgXX7tCWz7w5AFkXfvotLDBW9WTzqZzs6DxFFF4FB6hnXSoPnr0c3zHLm9GOdkLFC5KHh1ECsUuwdggMGiwV_FPLq_vvHsZbHgw Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8916574f66d44b14922a241d52602a21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8916574f66d44b14922a241d52602a21"}]}] Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3822e8832e1d4d09b0b68658e1e7a313 Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: {"resize": {"flavorRef": "452"}} Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1 could not be found. Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1', 'body': {'resize': {'flavorRef': '452'}}} Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1 could not be found. Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:43:23.214561 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1 could not be found. Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1 could not be found. Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f24fdf2e-b8f2-41e3-ae8c-22d1355a58ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Returning 404 to user: Instance 3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f24fdf2e-b8f2-41e3-ae8c-22d1355a58ef tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "POST /compute/v2.1/servers/3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1/action" status: 404 len: 111 microversion: 2.1 time: 0.014924 Aug 29 16:43:23.219251 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3868/7562] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:23 2022] POST /compute/v2.1/servers/3a50a6d3-9cfd-4c22-aa64-a70c5ee84db1/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:43:23.224911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:23.225525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.231401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.231878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.232306 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.232977 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.233422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.233839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.252874 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:23.369882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:23.377666 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0eba0349-611c-4594-9e6e-f0e8504233fd tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1505 microversion: 2.1 time: 0.157077 Aug 29 16:43:23.378240 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3695/7563] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:23 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:23.399293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:23.399953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.407050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.407586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.408099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.409311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.409778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.410214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.545164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:23.553145 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e42d5ed9-dd01-4ec5-908d-f0828834acb4 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1505 microversion: 2.1 time: 0.157750 Aug 29 16:43:23.553721 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3869/7564] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:23 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:23.573146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "68cf5a54-5815-4e83-a321-d623de63cf1b"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:23.575415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.582184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.582675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.583151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.583844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.584295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.584720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.624401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:23.630178 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] HTTP exception thrown: Flavor 68cf5a54-5815-4e83-a321-d623de63cf1b could not be found. Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Request method failure captured: Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: request: POST /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03/action HTTP/1.1 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 65 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOyPXBmP_SNq0VuvVD5rpLP1-N3xwWuLmgxGQ_7wLNxgMNWa-tey3BaztWc3ChhwAL12auqEMIzLVgXX7tCWz7w5AFkXfvotLDBW9WTzqZzs6DxFFF4FB6hnXSoPnr0c3zHLm9GOdkLFC5KHh1ECsUuwdggMGiwV_FPLq_vvHsZbHgw Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8916574f66d44b14922a241d52602a21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8916574f66d44b14922a241d52602a21"}]}] Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3822e8832e1d4d09b0b68658e1e7a313 Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: {"resize": {"flavorRef": "68cf5a54-5815-4e83-a321-d623de63cf1b"}} Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: exception: Flavor 68cf5a54-5815-4e83-a321-d623de63cf1b could not be found. Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '704ca8a3-0671-405b-8882-1daaf10f6e03', 'body': {'resize': {'flavorRef': '68cf5a54-5815-4e83-a321-d623de63cf1b'}}} Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:23.632156 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 68cf5a54-5815-4e83-a321-d623de63cf1b could not be found. Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 68cf5a54-5815-4e83-a321-d623de63cf1b could not be found. Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 68cf5a54-5815-4e83-a321-d623de63cf1b could not be found. Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Returning 400 to user: Flavor 68cf5a54-5815-4e83-a321-d623de63cf1b could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0c60585c-2cbb-4ab7-afb2-fe35c4806fa5 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "POST /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03/action" status: 400 len: 107 microversion: 2.1 time: 0.064407 Aug 29 16:43:23.636730 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3696/7565] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:23 2022] POST /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03/action => generated 107 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:43:23.642335 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:23.643664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.649632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.650123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.650564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.651284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.651747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.652181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.787692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:23.795459 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7a4d20d0-5aa2-4cd7-b727-66a102f552db tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1505 microversion: 2.1 time: 0.156940 Aug 29 16:43:23.795966 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3870/7566] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:23 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:23.817354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:23.817962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:23.823879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.824399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.824830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.825509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:23.825953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:23.826370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:23.956227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:23.963983 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b1541eb8-a4ba-422e-af76-f5c86bf224f3 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1505 microversion: 2.1 time: 0.151041 Aug 29 16:43:23.964545 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3697/7567] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:23 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:23.983755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19b3acda-ef58-4e3f-baa6-f3a0c022b3ea tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19b3acda-ef58-4e3f-baa6-f3a0c022b3ea tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Request method failure captured: Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: request: POST /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03/action HTTP/1.1 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 29 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOyPXBmP_SNq0VuvVD5rpLP1-N3xwWuLmgxGQ_7wLNxgMNWa-tey3BaztWc3ChhwAL12auqEMIzLVgXX7tCWz7w5AFkXfvotLDBW9WTzqZzs6DxFFF4FB6hnXSoPnr0c3zHLm9GOdkLFC5KHh1ECsUuwdggMGiwV_FPLq_vvHsZbHgw Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8916574f66d44b14922a241d52602a21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8916574f66d44b14922a241d52602a21"}]}] Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3822e8832e1d4d09b0b68658e1e7a313 Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: {"resize": {"flavorRef": ""}} Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '704ca8a3-0671-405b-8882-1daaf10f6e03', 'body': {'resize': {'flavorRef': ''}}} Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise error Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi '' Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.987461 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19b3acda-ef58-4e3f-baa6-f3a0c022b3ea tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19b3acda-ef58-4e3f-baa6-f3a0c022b3ea tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "POST /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03/action" status: 400 len: 113 microversion: 2.1 time: 0.009093 Aug 29 16:43:23.992428 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3871/7568] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:43:23 2022] POST /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 16:43:23.996983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:23.997604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:24.004162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.004653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.005098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.005793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.006252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.006687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.141630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:24.150644 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-896b5d8f-3f4d-4444-afcc-b44ff36b57fb tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1505 microversion: 2.1 time: 0.157338 Aug 29 16:43:24.151246 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3698/7569] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:23 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:24.175865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:24.176393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:24.183441 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.183944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.184653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.185362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.185830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.186273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.199314 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] HTTP exception thrown: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Request method failure captured: Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 HTTP/1.1 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOyPXBmP_SNq0VuvVD5rpLP1-N3xwWuLmgxGQ_7wLNxgMNWa-tey3BaztWc3ChhwAL12auqEMIzLVgXX7tCWz7w5AFkXfvotLDBW9WTzqZzs6DxFFF4FB6hnXSoPnr0c3zHLm9GOdkLFC5KHh1ECsUuwdggMGiwV_FPLq_vvHsZbHgw Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8916574f66d44b14922a241d52602a21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8916574f66d44b14922a241d52602a21"}]}] Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3822e8832e1d4d09b0b68658e1e7a313 Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'd3d079d3-f376-4ac1-bcc8-b5f919d01fd8'} Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:43:24.200873 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Returning 404 to user: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-533b5a24-1522-4417-80d6-ae88ec2d702c tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 404 len: 111 microversion: 2.1 time: 0.031368 Aug 29 16:43:24.205632 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3872/7570] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:43:24 2022] DELETE /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:43:24.211491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:24.212116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: d3d079d3-f376-4ac1-bcc8-b5f919d01fd8] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:24.218089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.218568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.218999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.219705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.220158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.221238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.234699 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] HTTP exception thrown: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Request method failure captured: Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 HTTP/1.1 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOyPXBmP_SNq0VuvVD5rpLP1-N3xwWuLmgxGQ_7wLNxgMNWa-tey3BaztWc3ChhwAL12auqEMIzLVgXX7tCWz7w5AFkXfvotLDBW9WTzqZzs6DxFFF4FB6hnXSoPnr0c3zHLm9GOdkLFC5KHh1ECsUuwdggMGiwV_FPLq_vvHsZbHgw Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8916574f66d44b14922a241d52602a21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8916574f66d44b14922a241d52602a21"}]}] Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: 3822e8832e1d4d09b0b68658e1e7a313 Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd3d079d3-f376-4ac1-bcc8-b5f919d01fd8'} Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:24.236367 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Returning 404 to user: Instance d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c9abfa2a-9a37-49f9-9f38-d50a28417e3e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8" status: 404 len: 111 microversion: 2.1 time: 0.030148 Aug 29 16:43:24.241175 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3699/7571] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:24 2022] GET /compute/v2.1/servers/d3d079d3-f376-4ac1-bcc8-b5f919d01fd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:43:24.246318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:24.246858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:24.253310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.253807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.254261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.254976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.255475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.255917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.281453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:43:24.308171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=100 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:43:24.364135 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-646cef13-60fe-469a-9525-cb0ee310e439 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "DELETE /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 204 len: 0 microversion: 2.1 time: 0.120970 Aug 29 16:43:24.364824 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3873/7572] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:43:24 2022] DELETE /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:43:24.372772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:24.373384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:24.379530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.380008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.380432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.381108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:24.381552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:24.381972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:24.514005 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:24.522944 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3138bc6a-c6bd-46e7-ae46-3aeb46e85ce0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1511 microversion: 2.1 time: 0.154016 Aug 29 16:43:24.523545 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3700/7573] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:24 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:25.543654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:25.544286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:25.551382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:25.551887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:25.552336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:25.553049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:25.553515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:25.553955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:25.690935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3822e8832e1d4d09b0b68658e1e7a313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8916574f66d44b14922a241d52602a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:43:25.699075 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4ce8b3a8-25d2-4386-a747-3fb56f387e0e tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 200 len: 1511 microversion: 2.1 time: 0.159604 Aug 29 16:43:25.699577 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3874/7574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:25 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:43:26.142608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d19d6dec-a370-4d15-8ee0-2270f4f3f305 req-8a44288d-cdd5-405a-af09-90a0f663b0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "704ca8a3-0671-405b-8882-1daaf10f6e03", "name": "network-vif-deleted", "tag": "ffcd5450-b38c-4163-b808-a3067c91d150"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:43:26.153092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d19d6dec-a370-4d15-8ee0-2270f4f3f305 req-8a44288d-cdd5-405a-af09-90a0f663b0f4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:26.153574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d19d6dec-a370-4d15-8ee0-2270f4f3f305 req-8a44288d-cdd5-405a-af09-90a0f663b0f4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:26.154004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d19d6dec-a370-4d15-8ee0-2270f4f3f305 req-8a44288d-cdd5-405a-af09-90a0f663b0f4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:26.168249 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d19d6dec-a370-4d15-8ee0-2270f4f3f305 req-8a44288d-cdd5-405a-af09-90a0f663b0f4 service nova] Creating event network-vif-deleted:ffcd5450-b38c-4163-b808-a3067c91d150 for instance 704ca8a3-0671-405b-8882-1daaf10f6e03 on n-h1-836830-13 Aug 29 16:43:26.176055 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d19d6dec-a370-4d15-8ee0-2270f4f3f305 req-8a44288d-cdd5-405a-af09-90a0f663b0f4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 Aug 29 16:43:26.176681 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3701/7575] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:43:26.719901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:43:26.720523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] [instance: 704ca8a3-0671-405b-8882-1daaf10f6e03] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:43:26.727668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:26.728173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:26.728626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:26.729333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:43:26.729800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:43:26.730238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:43:26.744320 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] HTTP exception thrown: Instance 704ca8a3-0671-405b-8882-1daaf10f6e03 could not be found. Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Request method failure captured: Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 HTTP/1.1 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOyPXBmP_SNq0VuvVD5rpLP1-N3xwWuLmgxGQ_7wLNxgMNWa-tey3BaztWc3ChhwAL12auqEMIzLVgXX7tCWz7w5AFkXfvotLDBW9WTzqZzs6DxFFF4FB6hnXSoPnr0c3zHLm9GOdkLFC5KHh1ECsUuwdggMGiwV_FPLq_vvHsZbHgw Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8916574f66d44b14922a241d52602a21", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8916574f66d44b14922a241d52602a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8916574f66d44b14922a241d52602a21"}]}] Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8916574f66d44b14922a241d52602a21 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1358744843 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: 3822e8832e1d4d09b0b68658e1e7a313 Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-ServersNegativeTestJSON-1358744843-project Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 704ca8a3-0671-405b-8882-1daaf10f6e03 could not be found. Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '704ca8a3-0671-405b-8882-1daaf10f6e03'} Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704ca8a3-0671-405b-8882-1daaf10f6e03 could not be found. Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704ca8a3-0671-405b-8882-1daaf10f6e03 could not be found. Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:43:26.746269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704ca8a3-0671-405b-8882-1daaf10f6e03 could not be found. Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] Returning 404 to user: Instance 704ca8a3-0671-405b-8882-1daaf10f6e03 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f484f1a9-269b-452f-8a0c-db7af8d24cf0 tempest-ServersNegativeTestJSON-1358744843 tempest-ServersNegativeTestJSON-1358744843-project] 10.222.0.83 "GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03" status: 404 len: 111 microversion: 2.1 time: 0.031900 Aug 29 16:43:26.750854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3875/7576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:43:26 2022] GET /compute/v2.1/servers/704ca8a3-0671-405b-8882-1daaf10f6e03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:44:00.450167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:00.451302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=28 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:00.674576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b3004a8d-3a2f-4fdf-ab9c-9c0bd60f18a0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: .version_select at 0x7f32ed41a700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1178803005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1YQhADUTZapBjFAT8ojtlT4xzHyraaM6F/U61pIHjc5K3aO8aDU3A1IY5xlLOqf2yseAUINNPYaVcwtNv78sENU7Fh7ymewWdYdcAgB0UxvpLEEWuLI2k+37kxhxBIjw=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:00.693137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b3004a8d-3a2f-4fdf-ab9c-9c0bd60f18a0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:44:00.699326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-b3004a8d-3a2f-4fdf-ab9c-9c0bd60f18a0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for user e3fc099340254aafbe1798f54d26d977 and project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:44:00.728092 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b3004a8d-3a2f-4fdf-ab9c-9c0bd60f18a0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.284272 Aug 29 16:44:00.728803 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3702/7577] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:44:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:44:00.784033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-281639194", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1178803005", "networks": [{"uuid": "a0120314-af3f-4387-8848-c38550dd8915"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:00.795432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:00.796288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:00.848175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] validate_networks() for [('a0120314-af3f-4387-8848-c38550dd8915', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:44:01.348093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:44:01.348529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:44:01.349018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:44:01.349442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:44:01.349897 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:44:01.360025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:01.360527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:01.360978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:01.361711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:01.362183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:01.362676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:01.380231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:44:01.385622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for user e3fc099340254aafbe1798f54d26d977 and project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:44:01.400144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:44:01.402485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:44:01.457515 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bfd040de-d094-464f-892b-2f3fd28b5272 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676690 Aug 29 16:44:01.463817 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3876/7578] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:44:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:44:01.469314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8947f19-7505-48c0-a769-e206dea52ab0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:01.470090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8947f19-7505-48c0-a769-e206dea52ab0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:01.541867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8947f19-7505-48c0-a769-e206dea52ab0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:01.549971 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8947f19-7505-48c0-a769-e206dea52ab0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1262 microversion: 2.1 time: 0.084713 Aug 29 16:44:01.551181 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3703/7579] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:01 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:02.571813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:02.572445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:02.579998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:02.580731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:02.581196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:02.582597 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:02.583543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:02.584060 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:02.651445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:02.661217 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5e49cfc-840f-4f8e-8cac-23a9590afb06 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1314 microversion: 2.1 time: 0.093148 Aug 29 16:44:02.662188 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3877/7580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:02 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1314 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:44:03.682726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:03.684392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:03.695710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:03.696459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:03.697129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:03.703831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:03.704613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:03.705556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:03.965683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:03.974468 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19f13e5c-9a33-4387-a1c4-aea7be5d46c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1362 microversion: 2.1 time: 0.296386 Aug 29 16:44:03.975816 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3704/7581] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:03 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:04.173139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b1a9bf24-de06-4570-951d-035d720b05f1 req-c9e8871c-7748-4c5e-a191-a8e10fbbc1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5530272e-c00d-4ff2-9adf-b30fd73a08ec", "tag": "5c91e876-ea67-409a-928c-6c0e2245b8db"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:04.186793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1a9bf24-de06-4570-951d-035d720b05f1 req-c9e8871c-7748-4c5e-a191-a8e10fbbc1ff service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:04.187328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1a9bf24-de06-4570-951d-035d720b05f1 req-c9e8871c-7748-4c5e-a191-a8e10fbbc1ff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:04.187769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b1a9bf24-de06-4570-951d-035d720b05f1 req-c9e8871c-7748-4c5e-a191-a8e10fbbc1ff service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:04.208656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b1a9bf24-de06-4570-951d-035d720b05f1 req-c9e8871c-7748-4c5e-a191-a8e10fbbc1ff service nova] Creating event network-changed:5c91e876-ea67-409a-928c-6c0e2245b8db for instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec on n-h1-836830-13 Aug 29 16:44:04.214750 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b1a9bf24-de06-4570-951d-035d720b05f1 req-c9e8871c-7748-4c5e-a191-a8e10fbbc1ff service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119364 Aug 29 16:44:04.215714 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3878/7582] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:04.996790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:04.997413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:05.005131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:05.005621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:05.006058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:05.006763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:05.007247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:05.007687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:05.144498 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:05.152269 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-133bf8e2-95a3-48f4-8fcc-e8ad54a33c0a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1362 microversion: 2.1 time: 0.159450 Aug 29 16:44:05.152853 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3705/7583] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:04 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:06.174226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:06.174956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:06.181299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:06.181801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:06.182252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:06.182979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:06.183477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:06.184177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:06.319861 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:06.327822 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0c550bce-9d27-41fa-89ff-27f2c7c4fe11 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1362 microversion: 2.1 time: 0.158674 Aug 29 16:44:06.328403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3879/7584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:06 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:07.350031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:07.350651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:07.357519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.357943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.358371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.359071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:07.359525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:07.359943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:07.491740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:07.499386 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e4993027-706b-4465-bdb5-f55597969556 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1362 microversion: 2.1 time: 0.153787 Aug 29 16:44:07.499963 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3706/7585] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:07 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:08.519820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:08.520350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:08.527231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:08.527735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:08.528182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:08.528885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:08.529352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:08.529820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:08.658731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:08.667095 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54714796-c44e-4ba9-9c30-d968cd15e996 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1362 microversion: 2.1 time: 0.151599 Aug 29 16:44:08.667673 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3880/7586] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:08 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:09.687614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:09.688221 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:09.696667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:09.697242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:09.697679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:09.698381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:09.698835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:09.699285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:09.705983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4c75ee5d-79ef-4b41-9dbf-4ff9c80fb51d req-5fd93ce7-2093-423e-8664-59ea26c9c05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5530272e-c00d-4ff2-9adf-b30fd73a08ec", "name": "network-vif-plugged", "status": "completed", "tag": "5c91e876-ea67-409a-928c-6c0e2245b8db"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:09.718772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c75ee5d-79ef-4b41-9dbf-4ff9c80fb51d req-5fd93ce7-2093-423e-8664-59ea26c9c05c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:09.719296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c75ee5d-79ef-4b41-9dbf-4ff9c80fb51d req-5fd93ce7-2093-423e-8664-59ea26c9c05c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:09.719735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4c75ee5d-79ef-4b41-9dbf-4ff9c80fb51d req-5fd93ce7-2093-423e-8664-59ea26c9c05c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:09.732201 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4c75ee5d-79ef-4b41-9dbf-4ff9c80fb51d req-5fd93ce7-2093-423e-8664-59ea26c9c05c service nova] Creating event network-vif-plugged:5c91e876-ea67-409a-928c-6c0e2245b8db for instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec on n-h1-836830-13 Aug 29 16:44:09.737208 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4c75ee5d-79ef-4b41-9dbf-4ff9c80fb51d req-5fd93ce7-2093-423e-8664-59ea26c9c05c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035898 Aug 29 16:44:09.738245 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3881/7587] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:09.894610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:09.902998 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-61b4d3b9-89f4-43a3-b6f3-98219058e4b5 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1362 microversion: 2.1 time: 0.219479 Aug 29 16:44:09.903608 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3707/7588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:09 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:10.924590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:10.925431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:10.931745 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:10.932246 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:10.932702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:10.933435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:10.934164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:10.934607 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:11.074374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:11.082943 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9979cffe-9cf0-418c-84a6-67c27663269a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1554 microversion: 2.1 time: 0.163555 Aug 29 16:44:11.083641 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3882/7589] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:10 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:11.103375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:11.104000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:11.110924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:11.111470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:11.111912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:11.112661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:11.113125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:11.113552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:11.244486 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:11.252387 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-349abea8-e7e6-4c89-bd96-e708c584d8ce tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1554 microversion: 2.1 time: 0.152941 Aug 29 16:44:11.252961 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3708/7590] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:11 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:12.867176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2470d83d-670d-4ae2-a7f9-aa7c557f0ad8"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:12.869553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:12.871621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:12.872390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:12.880153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:12.880599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:12.881052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:12.881757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:12.882228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:12.882669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:13.417911 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a0c9078a-675f-4817-85e4-f6992cf7fbea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555043 Aug 29 16:44:13.418452 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3883/7591] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:44:12 2022] POST /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:24.113955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:24.114530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:24.117039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:24.118646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:24.119348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=30 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:24.126021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:24.126505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:24.126941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:24.127672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:24.128131 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:24.128554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:24.210682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lazy-loading 'services' on Instance uuid 5530272e-c00d-4ff2-9adf-b30fd73a08ec {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:44:24.281552 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eaf38b14-e5a1-485e-ac2b-7ca595fbba2e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments/2470d83d-670d-4ae2-a7f9-aa7c557f0ad8" status: 202 len: 0 microversion: 2.1 time: 0.171384 Aug 29 16:44:24.282164 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3709/7592] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:44:24 2022] DELETE /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments/2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:44:24.293751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:24.296093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:24.300477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:24.301324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:24.308461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:24.309219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:24.309758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:24.310464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:24.310946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:24.311392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:24.345865 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-db4da23e-c6c8-4202-902b-2de8cd9a0985 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058698 Aug 29 16:44:24.346416 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3884/7593] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:44:24 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:25.359526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:25.361889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:25.369037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:25.369530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:25.369973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:25.370710 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:25.371196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:25.371649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:25.403741 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a667d24d-88c5-4079-b291-bc01d8fab826 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049588 Aug 29 16:44:25.404334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3710/7594] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:44:25 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:26.416321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:26.418609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:26.425579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:26.426082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:26.426531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:26.427293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:26.428445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:26.429274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:26.462443 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7d17203-5c45-4d5e-b6b1-7855704a7a52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050282 Aug 29 16:44:26.463237 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3885/7595] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:44:26 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:27.473878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:27.476685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:27.483610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:27.484102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:27.484536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:27.485228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:27.485685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:27.486108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:27.517093 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1b83a018-3da7-4c7f-be65-a5ed8a8a1b52 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047192 Aug 29 16:44:27.517669 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3711/7596] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:44:27 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:28.529734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:28.531936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:28.539157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:28.539653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:28.540135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:28.540852 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:28.541322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:28.541867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:28.574748 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c80c3032-cf69-4c21-a9f5-e2e53ec8aad0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049096 Aug 29 16:44:28.575359 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3886/7597] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:44:28 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:29.587897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:29.590114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:29.596975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:29.597475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:29.597904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:29.598596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:29.599087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:29.600253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:29.632531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-701233f2-04ea-4ca5-81c8-3c0566dc1ce2 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049569 Aug 29 16:44:29.633106 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3712/7598] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:44:29 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:44:29.644038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:29.644560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:29.652214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:29.652716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:29.653197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:29.653905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:29.654378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:29.654833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:29.731651 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] HTTP exception thrown: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec is not attached to volume 2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Request method failure captured: Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments/2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 HTTP/1.1 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOzLW2QA8rCp4esmvavQhUs7rFhiwOC6CN8OcDu4ohYor--V3N-NL7jV1r-w3Rj761sKgaMLh4AgO54A4eagJPmXUHKaysJ0Nj-sCgxDkR1w_P3AwfbzoQN_Z3TNpWUPaVWfnn0sASp05juya7wXweUGLGsWKXLHwtJ8ppfxvZT5X6Q Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_52e3fd33e0a3498bbddebe188d0f6514", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/52e3fd33e0a3498bbddebe188d0f6514"}]}] Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e3fc099340254aafbe1798f54d26d977 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec is not attached to volume 2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '5530272e-c00d-4ff2-9adf-b30fd73a08ec', 'id': '2470d83d-670d-4ae2-a7f9-aa7c557f0ad8'} Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2470d83d-670d-4ae2-a7f9-aa7c557f0ad8. Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec is not attached to volume 2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:44:29.737675 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:44:29.742429 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:44:29.742429 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:44:29.742429 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec is not attached to volume 2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 Aug 29 16:44:29.742429 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:29.742429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Returning 404 to user: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec is not attached to volume 2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:44:29.742429 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec132433-a03e-43e7-9e38-6db92733bbef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments/2470d83d-670d-4ae2-a7f9-aa7c557f0ad8" status: 404 len: 154 microversion: 2.1 time: 0.099184 Aug 29 16:44:29.742429 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3887/7599] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:44:29 2022] DELETE /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec/os-volume_attachments/2470d83d-670d-4ae2-a7f9-aa7c557f0ad8 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:44:33.087072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:33.087862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:33.094908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:33.095491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:33.095936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:33.096642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:33.097100 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:33.097527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:33.134552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:44:33.216355 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8a352d34-c88a-452c-82d9-bdbf2661ef30 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 204 len: 0 microversion: 2.1 time: 0.134603 Aug 29 16:44:33.218800 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3713/7600] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:44:33 2022] DELETE /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 16:44:33.226883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:33.227598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:33.235193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:33.235699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:33.236153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:33.236860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:33.237333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:33.237773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:33.376000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:33.385137 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0c07d9e3-cbec-4924-90c0-d75bb62220b0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1560 microversion: 2.1 time: 0.163250 Aug 29 16:44:33.385733 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3888/7601] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:33 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:34.406417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:34.407043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:34.413923 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:34.414403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:34.414830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:34.415534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:34.415981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:34.416396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:34.549891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:34.558409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b37d8385-a24c-4411-a4a6-74bd8467da85 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1560 microversion: 2.1 time: 0.156313 Aug 29 16:44:34.559281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3714/7602] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:34 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:35.223059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e8b6f9b5-d9fa-4929-8b2e-7ec74eba5562 req-2080c33e-c562-4d5c-9654-18f80c335859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5530272e-c00d-4ff2-9adf-b30fd73a08ec", "name": "network-vif-deleted", "tag": "5c91e876-ea67-409a-928c-6c0e2245b8db"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:35.234217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e8b6f9b5-d9fa-4929-8b2e-7ec74eba5562 req-2080c33e-c562-4d5c-9654-18f80c335859 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:35.234633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e8b6f9b5-d9fa-4929-8b2e-7ec74eba5562 req-2080c33e-c562-4d5c-9654-18f80c335859 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:35.235435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e8b6f9b5-d9fa-4929-8b2e-7ec74eba5562 req-2080c33e-c562-4d5c-9654-18f80c335859 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:35.248860 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e8b6f9b5-d9fa-4929-8b2e-7ec74eba5562 req-2080c33e-c562-4d5c-9654-18f80c335859 service nova] Creating event network-vif-deleted:5c91e876-ea67-409a-928c-6c0e2245b8db for instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec on n-h1-836830-13 Aug 29 16:44:35.254746 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e8b6f9b5-d9fa-4929-8b2e-7ec74eba5562 req-2080c33e-c562-4d5c-9654-18f80c335859 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Aug 29 16:44:35.255634 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3889/7603] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:35.580158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:35.580689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:35.588509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:35.588999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:35.589441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:35.590132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:35.590590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:35.591018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:35.626090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:35.626584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:35.627043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:35.627500 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lazy-loading 'fault' on Instance uuid 5530272e-c00d-4ff2-9adf-b30fd73a08ec {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:44:35.672888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:35.681034 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a6bd9d5-9e41-4a57-96b1-5fc36ebca723 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 200 len: 1352 microversion: 2.1 time: 0.104918 Aug 29 16:44:35.681622 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3715/7604] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:35 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:36.705091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:36.705762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 5530272e-c00d-4ff2-9adf-b30fd73a08ec] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:36.713123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:36.713696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:36.714255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:36.715075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:36.715552 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:36.715998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:36.732513 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] HTTP exception thrown: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec could not be found. Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Request method failure captured: Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec HTTP/1.1 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOzLW2QA8rCp4esmvavQhUs7rFhiwOC6CN8OcDu4ohYor--V3N-NL7jV1r-w3Rj761sKgaMLh4AgO54A4eagJPmXUHKaysJ0Nj-sCgxDkR1w_P3AwfbzoQN_Z3TNpWUPaVWfnn0sASp05juya7wXweUGLGsWKXLHwtJ8ppfxvZT5X6Q Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_52e3fd33e0a3498bbddebe188d0f6514", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/52e3fd33e0a3498bbddebe188d0f6514"}]}] Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e3fc099340254aafbe1798f54d26d977 Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec could not be found. Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '5530272e-c00d-4ff2-9adf-b30fd73a08ec'} Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec could not be found. Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec could not be found. Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:36.734580 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec could not be found. Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Returning 404 to user: Instance 5530272e-c00d-4ff2-9adf-b30fd73a08ec could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4f933543-9544-4919-8ca9-269ffed8c094 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec" status: 404 len: 111 microversion: 2.1 time: 0.036505 Aug 29 16:44:36.739507 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3890/7605] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:36 2022] GET /compute/v2.1/servers/5530272e-c00d-4ff2-9adf-b30fd73a08ec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:44:36.746415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-06ea9138-f36d-4a88-844b-afe8a0171d0f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '.version_select at 0x7f32edbf8c10>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:36.768146 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-06ea9138-f36d-4a88-844b-afe8a0171d0f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1178803005" status: 202 len: 0 microversion: 2.1 time: 0.026489 Aug 29 16:44:36.768726 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3716/7606] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:44:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1178803005 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:44:36.786732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b61dc42a-454b-4435-b526-405852cc093b tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: .version_select at 0x7f32edcb01f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1612755400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUvy4GMi2Cg1dy98Tqh7SXlKJqgeQ2y+jMXTp1f6UyRN8vethx8/GsaJYjdkzZlkOD1kjv4Dqv5eDoiDRa6mOv8h6rqER99SxiDkgk4BJE1ct+QcGuscQF2k34/Thi6wA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:36.802699 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b61dc42a-454b-4435-b526-405852cc093b tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:44:36.807928 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b61dc42a-454b-4435-b526-405852cc093b tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for user e3fc099340254aafbe1798f54d26d977 and project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:44:36.833849 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b61dc42a-454b-4435-b526-405852cc093b tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051086 Aug 29 16:44:36.835003 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3891/7607] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:44:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:36.885112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-703311640", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1612755400", "networks": [{"uuid": "a0120314-af3f-4387-8848-c38550dd8915"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:36.939990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] validate_networks() for [('a0120314-af3f-4387-8848-c38550dd8915', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:44:37.322563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:44:37.322979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:44:37.323475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:44:37.323880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:44:37.324287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:44:37.333031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:37.333501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:37.333930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:37.335344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:37.335794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:37.336219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:37.352550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:44:37.357831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for user e3fc099340254aafbe1798f54d26d977 and project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:44:37.370069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:44:37.372383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:44:37.420089 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2850b5f0-ccad-423e-a214-9cf6574a9f93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539309 Aug 29 16:44:37.420749 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3717/7608] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:44:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:44:37.431447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1473b5a-4fb1-4466-9a41-036548c28483 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:37.432077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1473b5a-4fb1-4466-9a41-036548c28483 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:37.487606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e1473b5a-4fb1-4466-9a41-036548c28483 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:37.496275 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1473b5a-4fb1-4466-9a41-036548c28483 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1262 microversion: 2.1 time: 0.068748 Aug 29 16:44:37.496841 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3892/7609] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:37 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:38.520893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:38.521511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:38.528866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:38.529601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:38.530241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:38.530947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:38.531589 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:38.532018 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:38.622675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:38.630623 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-802bbb3d-7a9d-465b-aa18-d8f32c828b19 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1332 microversion: 2.1 time: 0.114460 Aug 29 16:44:38.631384 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3718/7610] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:38 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:39.653712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:39.654310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:39.661094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:39.661593 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:39.662038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:39.662737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:39.663333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:39.664258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:39.767188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-fca7d66f-f847-4b9a-ac4f-8be4732916f2 req-831b5dd6-9fa1-43a8-bded-08ac8b4be0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dff3c049-2ccf-4462-b8e1-bbc44fc05fc3", "tag": "e573c968-1dab-4dd0-8b53-193a9ccfe89d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:39.779971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fca7d66f-f847-4b9a-ac4f-8be4732916f2 req-831b5dd6-9fa1-43a8-bded-08ac8b4be0d2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:39.780731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fca7d66f-f847-4b9a-ac4f-8be4732916f2 req-831b5dd6-9fa1-43a8-bded-08ac8b4be0d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:39.781442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fca7d66f-f847-4b9a-ac4f-8be4732916f2 req-831b5dd6-9fa1-43a8-bded-08ac8b4be0d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:39.807228 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-fca7d66f-f847-4b9a-ac4f-8be4732916f2 req-831b5dd6-9fa1-43a8-bded-08ac8b4be0d2 service nova] Creating event network-changed:e573c968-1dab-4dd0-8b53-193a9ccfe89d for instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 on n-h1-836830-13 Aug 29 16:44:39.812914 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-fca7d66f-f847-4b9a-ac4f-8be4732916f2 req-831b5dd6-9fa1-43a8-bded-08ac8b4be0d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049606 Aug 29 16:44:39.814043 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3719/7611] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:44:40.141925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:40.153613 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a9c5760e-190d-45dc-9c90-619fa2d924ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1362 microversion: 2.1 time: 0.504302 Aug 29 16:44:40.154208 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3893/7612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:39 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:41.177267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:41.177889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:41.185116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:41.185606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:41.186044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:41.186733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:41.187238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:41.187684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:41.321031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:41.328859 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e002cf4b-ec00-491b-806b-f31a8359acea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1362 microversion: 2.1 time: 0.156765 Aug 29 16:44:41.329525 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3720/7613] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:41 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:42.349858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:42.350491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:42.357627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:42.358136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:42.358589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:42.359324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:42.359802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:42.360250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:42.488742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:42.496477 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b08987c-7186-46e7-bded-771d49a431ca tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1362 microversion: 2.1 time: 0.150569 Aug 29 16:44:42.497049 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3894/7614] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:42 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:43.517886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:43.518489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:43.525542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:43.526032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:43.526471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:43.527270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:43.527729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:43.528159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:43.656349 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:43.664268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5507f9af-d085-4ccd-8002-98c7b0f9cd83 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1362 microversion: 2.1 time: 0.150404 Aug 29 16:44:43.665422 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3721/7615] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:43 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:44.686103 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:44.686729 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:44.693952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:44.694454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:44.694909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:44.695638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:44.696101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:44.696531 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:44.839568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:44.847548 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1ea9aca4-ff7a-4854-9ad9-a4a5164d22e4 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1362 microversion: 2.1 time: 0.165642 Aug 29 16:44:44.848134 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3895/7616] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:44 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:44:45.870408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:45.871043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:45.878326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:45.878798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:45.879254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:45.879947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:45.880399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:45.880820 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:45.901891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4ea1d416-4ac9-4057-8873-a3f8e6736d33 req-36af7add-421f-42e2-a0d1-e5b519081730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff3c049-2ccf-4462-b8e1-bbc44fc05fc3", "name": "network-vif-plugged", "status": "completed", "tag": "e573c968-1dab-4dd0-8b53-193a9ccfe89d"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:45.914799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4ea1d416-4ac9-4057-8873-a3f8e6736d33 req-36af7add-421f-42e2-a0d1-e5b519081730 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:45.915372 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4ea1d416-4ac9-4057-8873-a3f8e6736d33 req-36af7add-421f-42e2-a0d1-e5b519081730 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:45.916123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4ea1d416-4ac9-4057-8873-a3f8e6736d33 req-36af7add-421f-42e2-a0d1-e5b519081730 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:45.929444 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4ea1d416-4ac9-4057-8873-a3f8e6736d33 req-36af7add-421f-42e2-a0d1-e5b519081730 service nova] Creating event network-vif-plugged:e573c968-1dab-4dd0-8b53-193a9ccfe89d for instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 on n-h1-836830-13 Aug 29 16:44:45.936167 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4ea1d416-4ac9-4057-8873-a3f8e6736d33 req-36af7add-421f-42e2-a0d1-e5b519081730 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041158 Aug 29 16:44:45.937201 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3896/7617] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:44:46.057419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:46.066682 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-83964a15-a119-4993-acac-4134cdc7b5e9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1362 microversion: 2.1 time: 0.200638 Aug 29 16:44:46.067310 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3722/7618] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:45 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:47.089935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:47.090572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:47.096932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:47.097437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:47.097890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:47.098600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:47.099100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:47.099577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:47.241975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:47.250623 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-89971135-c718-4aea-8e88-7ccd1afecac3 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1362 microversion: 2.1 time: 0.166512 Aug 29 16:44:47.251416 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3897/7619] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:47 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:48.271671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:48.272301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:48.278316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:48.279015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:48.283382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:48.283880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:48.284324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:48.285034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:48.285502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:48.285929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:48.501071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:48.509501 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e913c78c-d76d-4f90-bccd-3a882f61415a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1553 microversion: 2.1 time: 0.241662 Aug 29 16:44:48.510104 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3723/7620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:48 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:48.530448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:44:48.531115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:48.533230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:48.539477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:48.540659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:48.541095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:48.541849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:48.542331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:48.542780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:48.677692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:44:48.686261 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7aa9e177-22af-4635-a261-24433b96041c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1553 microversion: 2.1 time: 0.159796 Aug 29 16:44:48.686844 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3898/7621] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:44:48 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:44:50.203320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ffdfe45-ff80-4a43-a027-81f3dc68c931"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:44:50.205779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:44:50.213086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:50.213568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:50.214000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:50.214671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:44:50.215173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:44:50.215593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:44:50.340071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:44:50.458653 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-191ea8e9-6274-4e7a-b7b6-d0a6ca8effe9 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259079 Aug 29 16:44:50.459226 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3724/7622] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:44:50 2022] POST /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:01.158326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:01.158864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:01.161674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:01.162394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=66 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:01.169348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:01.169919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:01.170369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:01.171101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:01.171570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:01.172004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:01.253678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lazy-loading 'services' on Instance uuid dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:45:01.328497 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-03bcc53c-eec5-4027-9b66-fd3b5cc7b634 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments/9ffdfe45-ff80-4a43-a027-81f3dc68c931" status: 202 len: 0 microversion: 2.1 time: 0.173981 Aug 29 16:45:01.329091 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3899/7623] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:45:01 2022] DELETE /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments/9ffdfe45-ff80-4a43-a027-81f3dc68c931 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:45:01.335572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:01.336506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:01.341036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:01.343390 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:01.351001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:01.351537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:01.351950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:01.352660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:01.353155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:01.353844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:01.394340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6ed25f27-8af9-422e-9bf4-2e46983e942f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060674 Aug 29 16:45:01.394942 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3725/7624] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:01 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:45:02.408871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:02.411169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:02.418459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:02.418958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:02.419430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:02.420134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:02.420598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:02.421132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:02.453001 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e246b132-98d6-46e0-8f5e-1196fc1b1a3d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049387 Aug 29 16:45:02.453549 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3900/7625] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:02 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:03.466112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:03.468351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:03.475509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:03.476001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:03.476437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:03.477136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:03.477592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:03.478021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:03.508828 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee428cd8-1a89-4059-aa98-6684440eea8e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047470 Aug 29 16:45:03.509435 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3726/7626] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:03 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:04.520748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:04.523010 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:04.530562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:04.531089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:04.531543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:04.532254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:04.532727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:04.533169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:04.563217 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d8de6354-bab1-4ee1-aaf8-72471eb8e0d0 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Aug 29 16:45:04.563790 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3901/7627] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:04 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:05.575766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:05.577864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:05.584938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:05.585425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:05.585857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:05.586551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:05.587006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:05.588084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:05.619340 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a2b7762a-a05e-4a4c-9e45-da6ecbf66d5d tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047771 Aug 29 16:45:05.619932 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3727/7628] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:05 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:06.631678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:06.633899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:06.641784 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:06.642283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:06.642735 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:06.643462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:06.643936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:06.644376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:06.675182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-59419e55-5b7e-48bf-be4c-6ba31c3828c7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047523 Aug 29 16:45:06.675745 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3902/7629] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:06 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:45:06.686679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:06.687253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:06.694058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:06.694550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:06.694996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:06.695715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:06.696176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:06.696604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:06.778513 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] HTTP exception thrown: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 is not attached to volume 9ffdfe45-ff80-4a43-a027-81f3dc68c931 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Request method failure captured: Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: request: DELETE /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments/9ffdfe45-ff80-4a43-a027-81f3dc68c931 HTTP/1.1 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOzLW2QA8rCp4esmvavQhUs7rFhiwOC6CN8OcDu4ohYor--V3N-NL7jV1r-w3Rj761sKgaMLh4AgO54A4eagJPmXUHKaysJ0Nj-sCgxDkR1w_P3AwfbzoQN_Z3TNpWUPaVWfnn0sASp05juya7wXweUGLGsWKXLHwtJ8ppfxvZT5X6Q Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_52e3fd33e0a3498bbddebe188d0f6514", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/52e3fd33e0a3498bbddebe188d0f6514"}]}] Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e3fc099340254aafbe1798f54d26d977 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 is not attached to volume 9ffdfe45-ff80-4a43-a027-81f3dc68c931 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'server_id': 'dff3c049-2ccf-4462-b8e1-bbc44fc05fc3', 'id': '9ffdfe45-ff80-4a43-a027-81f3dc68c931'} Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9ffdfe45-ff80-4a43-a027-81f3dc68c931. Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 is not attached to volume 9ffdfe45-ff80-4a43-a027-81f3dc68c931 Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:06.780495 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:06.785225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:45:06.785225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:45:06.785225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 is not attached to volume 9ffdfe45-ff80-4a43-a027-81f3dc68c931 Aug 29 16:45:06.785225 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:06.785225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Returning 404 to user: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 is not attached to volume 9ffdfe45-ff80-4a43-a027-81f3dc68c931 {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:45:06.785225 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8104f76-bb02-432d-9af6-9473178c5517 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments/9ffdfe45-ff80-4a43-a027-81f3dc68c931" status: 404 len: 154 microversion: 2.1 time: 0.099644 Aug 29 16:45:06.785225 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3728/7630] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:45:06 2022] DELETE /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3/os-volume_attachments/9ffdfe45-ff80-4a43-a027-81f3dc68c931 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:45:10.127419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:10.127962 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:10.135478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:10.135766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:10.136243 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:10.136961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:10.137430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:10.137871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:10.168998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:45:10.247741 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-85baff24-7c7b-4879-89ea-2735195306cd tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 204 len: 0 microversion: 2.1 time: 0.123941 Aug 29 16:45:10.248667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3903/7631] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:45:10 2022] DELETE /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:45:10.257393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:10.258621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:10.269559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:10.270479 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:10.271423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:10.272162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:10.272863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:10.273527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:10.424998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:10.433907 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9538fe82-8636-46b4-a03b-2d3f8d03e804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1559 microversion: 2.1 time: 0.180601 Aug 29 16:45:10.434566 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3729/7632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:10 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:11.455425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:11.456179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:11.463903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:11.464404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:11.464857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:11.465566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:11.466034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:11.466471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:11.600169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:11.608177 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-27891f0c-cd32-4abd-a204-be23111d3b9e tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1559 microversion: 2.1 time: 0.157010 Aug 29 16:45:11.608764 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3904/7633] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:11 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:12.233497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2c348bc4-74da-419d-b8ab-2f8c2b1dc5fd req-2ff61d6d-0a85-40c2-82b9-389c704f61bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dff3c049-2ccf-4462-b8e1-bbc44fc05fc3", "name": "network-vif-deleted", "tag": "e573c968-1dab-4dd0-8b53-193a9ccfe89d"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:12.245128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c348bc4-74da-419d-b8ab-2f8c2b1dc5fd req-2ff61d6d-0a85-40c2-82b9-389c704f61bf service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:12.245611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c348bc4-74da-419d-b8ab-2f8c2b1dc5fd req-2ff61d6d-0a85-40c2-82b9-389c704f61bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:12.246037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2c348bc4-74da-419d-b8ab-2f8c2b1dc5fd req-2ff61d6d-0a85-40c2-82b9-389c704f61bf service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:12.258049 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2c348bc4-74da-419d-b8ab-2f8c2b1dc5fd req-2ff61d6d-0a85-40c2-82b9-389c704f61bf service nova] Creating event network-vif-deleted:e573c968-1dab-4dd0-8b53-193a9ccfe89d for instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 on n-h1-836830-13 Aug 29 16:45:12.262972 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2c348bc4-74da-419d-b8ab-2f8c2b1dc5fd req-2ff61d6d-0a85-40c2-82b9-389c704f61bf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 Aug 29 16:45:12.263610 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3730/7634] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:12.629573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:12.630214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:12.638677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:12.639561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:12.640417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:12.641578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:12.642262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:12.642959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:12.677212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:12.677708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:12.678154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:12.678614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lazy-loading 'fault' on Instance uuid dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:45:12.723217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:12.732130 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4c1e2c48-bb36-464d-8de0-42a047a499b7 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 200 len: 1352 microversion: 2.1 time: 0.106384 Aug 29 16:45:12.732968 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3905/7635] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:12 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:13.756563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:13.757285 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: dff3c049-2ccf-4462-b8e1-bbc44fc05fc3] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:13.763555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:13.764035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:13.764464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:13.765134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:13.765583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:13.765996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:13.779885 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] HTTP exception thrown: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 could not be found. Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Request method failure captured: Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 HTTP/1.1 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDOzLW2QA8rCp4esmvavQhUs7rFhiwOC6CN8OcDu4ohYor--V3N-NL7jV1r-w3Rj761sKgaMLh4AgO54A4eagJPmXUHKaysJ0Nj-sCgxDkR1w_P3AwfbzoQN_Z3TNpWUPaVWfnn0sASp05juya7wXweUGLGsWKXLHwtJ8ppfxvZT5X6Q Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_52e3fd33e0a3498bbddebe188d0f6514", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/52e3fd33e0a3498bbddebe188d0f6514"}]}] Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e3fc099340254aafbe1798f54d26d977 Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 could not be found. Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'dff3c049-2ccf-4462-b8e1-bbc44fc05fc3'} Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 could not be found. Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 could not be found. Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:13.781509 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 could not be found. Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Returning 404 to user: Instance dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21db6522-1fec-424a-9284-b18a1a028435 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3" status: 404 len: 111 microversion: 2.1 time: 0.031525 Aug 29 16:45:13.786177 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3731/7636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:13 2022] GET /compute/v2.1/servers/dff3c049-2ccf-4462-b8e1-bbc44fc05fc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:45:13.792832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-71b501c8-4d81-4531-8042-255fc1c17804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '.version_select at 0x7f32edcaaaf0>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:13.813406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-71b501c8-4d81-4531-8042-255fc1c17804 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1612755400" status: 202 len: 0 microversion: 2.1 time: 0.025419 Aug 29 16:45:13.813990 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3906/7637] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:45:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1612755400 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:45:13.831382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a77cf29c-6d8a-462e-b294-9447885324ed tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: .version_select at 0x7f32ed375430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1335221738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX7gcqSve7HHJ0B1PyW+9F5pAFUiWi1J2T0ExwHA/0Lcd/Wi69zl/MzTdnr1IlQLjwfdBNcc5HEx/tFDWfVCxcZQ/b956h1cGpEBAInu862sunGXju0WE6EPKNG749V5Q=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:13.847377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a77cf29c-6d8a-462e-b294-9447885324ed tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:45:13.854087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a77cf29c-6d8a-462e-b294-9447885324ed tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for user e3fc099340254aafbe1798f54d26d977 and project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:45:13.877079 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a77cf29c-6d8a-462e-b294-9447885324ed tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049677 Aug 29 16:45:13.877680 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3732/7638] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:45:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:13.929157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-117246657", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1335221738", "networks": [{"uuid": "a0120314-af3f-4387-8848-c38550dd8915"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:13.983123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] validate_networks() for [('a0120314-af3f-4387-8848-c38550dd8915', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:45:14.362004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:45:14.362447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:45:14.362994 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:45:14.363393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:45:14.363825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:45:14.373254 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:14.373761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:14.374212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:14.374950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:14.375517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:14.375961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:14.393893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:45:14.399231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Getting quotas for user e3fc099340254aafbe1798f54d26d977 and project 52e3fd33e0a3498bbddebe188d0f6514. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:45:14.412471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:45:14.414811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:45:14.463193 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-75897586-b14f-4be5-b9a7-f83300790534 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537451 Aug 29 16:45:14.463854 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3907/7639] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:45:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:45:14.474572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9f944abf-fdee-42fc-9332-054472bdc408 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:14.475256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9f944abf-fdee-42fc-9332-054472bdc408 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:14.531955 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9f944abf-fdee-42fc-9332-054472bdc408 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:14.539476 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9f944abf-fdee-42fc-9332-054472bdc408 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1262 microversion: 2.1 time: 0.068777 Aug 29 16:45:14.540120 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3733/7640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:14 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:15.562270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:15.562925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:15.569476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:15.569981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:15.570428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:15.571162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:15.572794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:15.572794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:15.640622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:15.648552 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9be61a66-ef3a-434c-9737-b2468e3b99ac tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1320 microversion: 2.1 time: 0.092535 Aug 29 16:45:15.649148 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3908/7641] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:15 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1320 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:45:16.670496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:16.671149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:16.678024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:16.678466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:16.678907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:16.679723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:16.680177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:16.680612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:16.708159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-450909cd-88ee-4bf6-8ec1-0b2873d8b764 req-4aeea018-4bdf-4040-99ec-8d9b5e08f20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d691ef-e2f7-42a7-8e23-3f3997788c77", "tag": "654b02c6-3f22-431d-a69d-61d84f2a1bf3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:16.723297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-450909cd-88ee-4bf6-8ec1-0b2873d8b764 req-4aeea018-4bdf-4040-99ec-8d9b5e08f20c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:16.724381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-450909cd-88ee-4bf6-8ec1-0b2873d8b764 req-4aeea018-4bdf-4040-99ec-8d9b5e08f20c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:16.725566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-450909cd-88ee-4bf6-8ec1-0b2873d8b764 req-4aeea018-4bdf-4040-99ec-8d9b5e08f20c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:16.740156 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-450909cd-88ee-4bf6-8ec1-0b2873d8b764 req-4aeea018-4bdf-4040-99ec-8d9b5e08f20c service nova] Creating event network-changed:654b02c6-3f22-431d-a69d-61d84f2a1bf3 for instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 on n-h1-836830-13 Aug 29 16:45:16.747061 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-450909cd-88ee-4bf6-8ec1-0b2873d8b764 req-4aeea018-4bdf-4040-99ec-8d9b5e08f20c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043275 Aug 29 16:45:16.748390 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3909/7642] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:16.949803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:16.957647 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3d9ebcec-e292-432b-913e-352572df35cb tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1362 microversion: 2.1 time: 0.291062 Aug 29 16:45:16.958242 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3734/7643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:16 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:17.979850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:17.980474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:17.986762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:17.987282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:17.987734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:17.988426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:17.988887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:17.989336 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:18.126700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:18.135694 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ae5f0ac4-891b-4d94-91fa-cf055b7a514f tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1362 microversion: 2.1 time: 0.161035 Aug 29 16:45:18.136296 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3910/7644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:17 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:19.157158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:19.157718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:19.164835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:19.165863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:19.166327 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:19.167064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:19.167569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:19.168022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:19.297614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:19.305362 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3ffc2c4-6fee-40a4-a59b-b4fea6bb9b48 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1362 microversion: 2.1 time: 0.152318 Aug 29 16:45:19.305995 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3735/7645] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:19 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:45:20.326563 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:20.327211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:20.334172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:20.334669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:20.335140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:20.335847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:20.336310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:20.336743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:20.468504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:20.476305 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8572f135-74e2-487c-947c-327831736cb6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1362 microversion: 2.1 time: 0.153743 Aug 29 16:45:20.476886 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3911/7646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:20 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:21.497707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:21.498518 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:21.505411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:21.505901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:21.506346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:21.507062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:21.507522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:21.507947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:21.637422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:21.645283 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d90445f3-15a6-43b8-b5b3-2508b994cd00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1362 microversion: 2.1 time: 0.151825 Aug 29 16:45:21.645860 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3736/7647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:21 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:22.072494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fdf638a0-fec8-40be-85c4-21e46749021c req-e8bfce59-9f1d-4f0f-9961-ac31c0c986fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d691ef-e2f7-42a7-8e23-3f3997788c77", "name": "network-vif-plugged", "status": "completed", "tag": "654b02c6-3f22-431d-a69d-61d84f2a1bf3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:22.086846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fdf638a0-fec8-40be-85c4-21e46749021c req-e8bfce59-9f1d-4f0f-9961-ac31c0c986fa service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:22.086846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fdf638a0-fec8-40be-85c4-21e46749021c req-e8bfce59-9f1d-4f0f-9961-ac31c0c986fa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:22.087264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fdf638a0-fec8-40be-85c4-21e46749021c req-e8bfce59-9f1d-4f0f-9961-ac31c0c986fa service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:22.099103 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fdf638a0-fec8-40be-85c4-21e46749021c req-e8bfce59-9f1d-4f0f-9961-ac31c0c986fa service nova] Creating event network-vif-plugged:654b02c6-3f22-431d-a69d-61d84f2a1bf3 for instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 on n-h1-836830-13 Aug 29 16:45:22.104680 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fdf638a0-fec8-40be-85c4-21e46749021c req-e8bfce59-9f1d-4f0f-9961-ac31c0c986fa service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036269 Aug 29 16:45:22.105251 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3912/7648] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:22.666475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:22.667052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:22.673971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:22.674448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:22.674879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:22.675591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:22.676040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:22.676459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:22.809696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:22.817391 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-efc7fe31-6fa1-4178-b482-a11c416c3587 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1362 microversion: 2.1 time: 0.155524 Aug 29 16:45:22.817968 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3737/7649] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:22 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:23.839183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:23.839895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:23.846178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:23.846669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:23.847216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:23.847917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:23.848382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:23.848818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:23.983945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:23.991731 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8145ffb0-2c63-458c-9946-231994847939 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1554 microversion: 2.1 time: 0.157696 Aug 29 16:45:23.992311 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3913/7650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:23 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:24.012309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:24.012956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:24.019906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:24.020392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:24.020837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:24.021714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:24.022175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:24.022601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:24.154875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:24.162693 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b53ddfd6-f416-4717-92f3-8a4f6e2717aa tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1554 microversion: 2.1 time: 0.154834 Aug 29 16:45:24.163304 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3738/7651] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:24 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:25.650107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89409b95-c68c-4799-8652-5f2ff893e9ea"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:25.652580 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:25.654569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:25.655404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:25.662114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:25.662623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:25.663105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:25.663811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:25.664280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:25.664718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:25.892347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:25.911862 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0ec19bba-5455-4c04-b3a0-97f0c1a36d64 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "POST /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265646 Aug 29 16:45:25.912449 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3914/7652] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:45:25 2022] POST /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:45:36.626092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:36.626601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:36.628552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:36.629380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:36.630528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=64 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:36.635828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:36.636314 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:36.636749 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:36.637432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:36.637887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:36.638304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:36.723228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lazy-loading 'services' on Instance uuid 18d691ef-e2f7-42a7-8e23-3f3997788c77 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:45:36.796768 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-85a64432-0f5a-4a7a-bec0-18c58650868c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments/89409b95-c68c-4799-8652-5f2ff893e9ea" status: 202 len: 0 microversion: 2.1 time: 0.174700 Aug 29 16:45:36.797649 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3739/7653] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:45:36 2022] DELETE /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments/89409b95-c68c-4799-8652-5f2ff893e9ea => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:45:36.804063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:36.805033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:45:36.810195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:36.812627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:36.820598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:36.821105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:36.821561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:36.822280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:36.822758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:36.823974 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:36.862278 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-44a1f810-69b1-49a3-8846-bee5d2fc014a tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060077 Aug 29 16:45:36.862862 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3915/7654] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:36 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:37.876821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:37.879377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:37.886290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:37.886879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:37.887190 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:37.889541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:37.890001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:37.890425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:37.924135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-300bedc6-4641-406f-aa05-38e1b8c82ac6 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052467 Aug 29 16:45:37.924706 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3740/7655] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:37 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:38.937304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:38.939718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:38.946594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:38.947220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:38.947737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:38.949029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:38.949559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:38.950066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:38.984095 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-10caac66-a0f3-4d42-ba19-17d65813b32c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051534 Aug 29 16:45:38.984604 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3916/7656] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:38 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:39.996361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:39.998599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:40.005529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:40.006020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:40.006452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:40.007212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:40.007671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:40.008096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:40.038938 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2d150f45-7b79-4705-861c-c688ac06b646 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046655 Aug 29 16:45:40.039546 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3741/7657] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:39 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:41.051304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:41.053544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:41.061998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:41.062503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:41.062959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:41.063701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:41.064180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:41.064622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:41.096168 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-714a2aae-eb6b-4c9f-87f8-2ff00ce1abea tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048900 Aug 29 16:45:41.096984 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3917/7658] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:41 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:42.108705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:42.110788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:42.118107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:42.118595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:42.119051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:42.119825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:42.120526 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:42.120760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:42.152389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aa5135da-e1db-471a-9e29-5ee4e85c7c93 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047961 Aug 29 16:45:42.152978 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3742/7659] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:45:42 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:45:42.163409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:42.163913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:42.171301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:42.171807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:42.172264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:42.172996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:42.173469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:42.173913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:42.251438 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] HTTP exception thrown: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 is not attached to volume 89409b95-c68c-4799-8652-5f2ff893e9ea Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Request method failure captured: Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments/89409b95-c68c-4799-8652-5f2ff893e9ea HTTP/1.1 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOzLW2QA8rCp4esmvavQhUs7rFhiwOC6CN8OcDu4ohYor--V3N-NL7jV1r-w3Rj761sKgaMLh4AgO54A4eagJPmXUHKaysJ0Nj-sCgxDkR1w_P3AwfbzoQN_Z3TNpWUPaVWfnn0sASp05juya7wXweUGLGsWKXLHwtJ8ppfxvZT5X6Q Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_52e3fd33e0a3498bbddebe188d0f6514", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/52e3fd33e0a3498bbddebe188d0f6514"}]}] Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e3fc099340254aafbe1798f54d26d977 Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 is not attached to volume 89409b95-c68c-4799-8652-5f2ff893e9ea Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '18d691ef-e2f7-42a7-8e23-3f3997788c77', 'id': '89409b95-c68c-4799-8652-5f2ff893e9ea'} Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 89409b95-c68c-4799-8652-5f2ff893e9ea. Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 is not attached to volume 89409b95-c68c-4799-8652-5f2ff893e9ea Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:42.253087 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:42.257753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:45:42.257753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:45:42.257753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 is not attached to volume 89409b95-c68c-4799-8652-5f2ff893e9ea Aug 29 16:45:42.257753 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:42.257753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Returning 404 to user: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 is not attached to volume 89409b95-c68c-4799-8652-5f2ff893e9ea {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:45:42.257753 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-178c9b09-c499-4ce1-8623-313ba92c7359 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments/89409b95-c68c-4799-8652-5f2ff893e9ea" status: 404 len: 154 microversion: 2.1 time: 0.095268 Aug 29 16:45:42.257753 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3918/7660] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:45:42 2022] DELETE /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77/os-volume_attachments/89409b95-c68c-4799-8652-5f2ff893e9ea => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:45:45.606649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:45.607333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:45.614705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:45.615250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:45.615695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:45.616410 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:45.616871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:45.617305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:45.645334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:45:45.730544 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b0acb5fb-1857-4b30-b798-110589b5bece tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 204 len: 0 microversion: 2.1 time: 0.127570 Aug 29 16:45:45.731466 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3743/7661] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:45:45 2022] DELETE /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:45:45.739474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:45.740108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:45.748559 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:45.749054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:45.749500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:45.750204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:45.750665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:45.751122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:45.888519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:45.896644 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c08f96b3-61ad-4fd4-aa1a-766b3e0f9152 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1560 microversion: 2.1 time: 0.161160 Aug 29 16:45:45.897143 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3919/7662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:45 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:45:46.919365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:46.920071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:46.926968 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:46.927476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:46.927908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:46.928590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:46.929036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:46.929455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:47.061093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:47.069027 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2505580d-ebc3-4a67-9902-0ab34b2c1d00 tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1560 microversion: 2.1 time: 0.154752 Aug 29 16:45:47.069608 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3744/7663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:46 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:47.762020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8dce5554-80fa-4cc1-b894-3df159917044 req-d7533fe0-3cbb-4ba5-9ece-a6bee30bbe77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d691ef-e2f7-42a7-8e23-3f3997788c77", "name": "network-vif-deleted", "tag": "654b02c6-3f22-431d-a69d-61d84f2a1bf3"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:45:47.779453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8dce5554-80fa-4cc1-b894-3df159917044 req-d7533fe0-3cbb-4ba5-9ece-a6bee30bbe77 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:47.780112 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8dce5554-80fa-4cc1-b894-3df159917044 req-d7533fe0-3cbb-4ba5-9ece-a6bee30bbe77 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:47.780643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8dce5554-80fa-4cc1-b894-3df159917044 req-d7533fe0-3cbb-4ba5-9ece-a6bee30bbe77 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:47.794637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8dce5554-80fa-4cc1-b894-3df159917044 req-d7533fe0-3cbb-4ba5-9ece-a6bee30bbe77 service nova] Creating event network-vif-deleted:654b02c6-3f22-431d-a69d-61d84f2a1bf3 for instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 on n-h1-836830-13 Aug 29 16:45:47.800244 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8dce5554-80fa-4cc1-b894-3df159917044 req-d7533fe0-3cbb-4ba5-9ece-a6bee30bbe77 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043420 Aug 29 16:45:47.801400 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3920/7664] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:45:48.089903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:48.090495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:48.097616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:48.098104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:48.098540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:48.099344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:48.099783 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:48.100207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:48.133943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:48.134437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:48.134883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:48.135377 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lazy-loading 'fault' on Instance uuid 18d691ef-e2f7-42a7-8e23-3f3997788c77 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:45:48.195433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3fc099340254aafbe1798f54d26d977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e3fd33e0a3498bbddebe188d0f6514', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:45:48.203619 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7de310ed-05bc-4d78-aab2-ca63c3bac9ba tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 200 len: 1352 microversion: 2.1 time: 0.117733 Aug 29 16:45:48.204206 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3745/7665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:48 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:45:49.227230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:49.227946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] [instance: 18d691ef-e2f7-42a7-8e23-3f3997788c77] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:45:49.234396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:49.234895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:49.235374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:49.236078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:45:49.236546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:45:49.236988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:45:49.250834 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] HTTP exception thrown: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 could not be found. Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Request method failure captured: Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 HTTP/1.1 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDOzLW2QA8rCp4esmvavQhUs7rFhiwOC6CN8OcDu4ohYor--V3N-NL7jV1r-w3Rj761sKgaMLh4AgO54A4eagJPmXUHKaysJ0Nj-sCgxDkR1w_P3AwfbzoQN_Z3TNpWUPaVWfnn0sASp05juya7wXweUGLGsWKXLHwtJ8ppfxvZT5X6Q Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_52e3fd33e0a3498bbddebe188d0f6514", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/52e3fd33e0a3498bbddebe188d0f6514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/52e3fd33e0a3498bbddebe188d0f6514"}]}] Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 52e3fd33e0a3498bbddebe188d0f6514 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1130330154 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e3fc099340254aafbe1798f54d26d977 Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestEncryptedCinderVolumes-1130330154-project Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 could not be found. Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '18d691ef-e2f7-42a7-8e23-3f3997788c77'} Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 could not be found. Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 could not be found. Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:49.252515 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 could not be found. Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Returning 404 to user: Instance 18d691ef-e2f7-42a7-8e23-3f3997788c77 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b203799c-088f-4a57-8405-abf18330202c tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77" status: 404 len: 111 microversion: 2.1 time: 0.031971 Aug 29 16:45:49.259602 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3921/7666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:45:49 2022] GET /compute/v2.1/servers/18d691ef-e2f7-42a7-8e23-3f3997788c77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:45:49.263742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b10b705c-d3de-4d9d-8912-c137c9f399ef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] Calling method '.version_select at 0x7f32ed375f70>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:45:49.283929 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b10b705c-d3de-4d9d-8912-c137c9f399ef tempest-TestEncryptedCinderVolumes-1130330154 tempest-TestEncryptedCinderVolumes-1130330154-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1335221738" status: 202 len: 0 microversion: 2.1 time: 0.025007 Aug 29 16:45:49.284512 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3746/7667] 10.222.0.83 () {58 vars in 1278 bytes} [Mon Aug 29 16:45:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1335221738 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:46:16.019774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bfd06aeb-c045-4108-843f-cfcebfbb428b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'create', calling method: .version_select at 0x7f32edc44e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2017255489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1dlv6zwmyAYS+VFqhjIbW5KztKNUVJlPtW2xt4I8551/Ex8USD+BpglhoSSmpyFus99c6BrTYY4Im11YDR5fLz66GlC9KdgtpCqtZAjTN3Mv/4nhruiGZCU7kEj3PyXQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:16.026265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=14 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:16.027224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=34 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:16.039330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-bfd06aeb-c045-4108-843f-cfcebfbb428b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:46:16.044553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-bfd06aeb-c045-4108-843f-cfcebfbb428b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for user da236bec13cf409ca4f644e76fbb5e1b and project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:46:16.071294 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bfd06aeb-c045-4108-843f-cfcebfbb428b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055569 Aug 29 16:46:16.072754 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3922/7668] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:46:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:16.126847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:16.127661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:16.132358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-775842894", "imageRef": "c3cf4e9b-fd1b-415f-b3b1-3bdeabd8f6c0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2017255489", "networks": [{"uuid": "234b0e9a-a344-4c5e-90aa-f6aeaa26d6a7"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:16.205560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] validate_networks() for [('234b0e9a-a344-4c5e-90aa-f6aeaa26d6a7', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:46:16.932775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:46:16.933444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:46:16.933926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:46:16.934333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:46:16.934741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:46:16.943604 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:16.944087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:16.944524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:16.945243 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:16.945698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:16.946125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:16.962821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:46:16.968099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for user da236bec13cf409ca4f644e76fbb5e1b and project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:46:16.980905 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:46:16.983159 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c3cf4e9b-fd1b-415f-b3b1-3bdeabd8f6c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:46:17.031001 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e78c4328-7b7c-4dcd-b4fa-ce2d93f48fc8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906563 Aug 29 16:46:17.031774 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3747/7669] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:46:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:46:17.043281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-645e558b-5f88-4ae6-a73e-f668167f78f3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:17.044020 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-645e558b-5f88-4ae6-a73e-f668167f78f3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:17.109412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-645e558b-5f88-4ae6-a73e-f668167f78f3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:17.116671 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-645e558b-5f88-4ae6-a73e-f668167f78f3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1258 microversion: 2.1 time: 0.078172 Aug 29 16:46:17.118278 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3923/7670] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:17 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:46:18.137855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:18.139138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:18.147136 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:18.147632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:18.148220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:18.148920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:18.149399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:18.149806 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:18.225493 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:18.235040 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-de1b95d4-afed-4b2f-9659-09bd6fab5cca tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1318 microversion: 2.1 time: 0.102533 Aug 29 16:46:18.247500 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3748/7671] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:18 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1318 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:19.257485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:19.258600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:19.268951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:19.269953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:19.270411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:19.271169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:19.271647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:19.272313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:19.437554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:19.448540 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-963790f6-c462-4dda-ad34-4279662840b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.194953 Aug 29 16:46:19.461726 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3924/7672] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:19 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:20.470154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:20.470765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:20.478448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:20.479437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:20.479883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:20.480588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:20.481040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:20.481464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:20.630779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:20.640243 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-724869cd-31ef-4dc3-a254-e84d39bfdb7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.174154 Aug 29 16:46:20.647573 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3749/7673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:20 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:46:21.661949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:21.662674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:21.670534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:21.671348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:21.671984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:21.673078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:21.673761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:21.674367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:21.831867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:21.842406 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0b842f03-044f-4a69-bd0f-3be10b856b44 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.184540 Aug 29 16:46:21.843242 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3925/7674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:21 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:22.864818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:22.866228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:22.874912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:22.875549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:22.876067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:22.876844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:22.877311 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:22.877743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:23.016179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:23.024389 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4e0f26f6-4b88-44b9-abd2-14289a4bf536 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.164120 Aug 29 16:46:23.031784 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3750/7675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:22 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:24.046295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:24.046947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:24.054029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:24.054557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:24.055159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:24.057381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:24.057965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:24.058671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:24.216502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:24.225058 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3301c86a-242a-46ca-b811-7320f3dfdd66 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.183240 Aug 29 16:46:24.225650 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3926/7676] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:24 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:25.247837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:25.249391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:25.256294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:25.257102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:25.257634 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:25.258411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:25.258941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:25.260000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:25.638941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:25.648103 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-94bacdb7-dba5-46f0-9b54-b9e23648e82d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.404318 Aug 29 16:46:25.649155 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3751/7677] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:25 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:26.669391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:26.669947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:26.677432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:26.677942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:26.678394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:26.679131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:26.679608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:26.680059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:26.891635 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:26.899741 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-57534bef-cbde-444c-adbc-0dc62382219a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.234334 Aug 29 16:46:26.901015 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3927/7678] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:26 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:27.921046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:27.921733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:27.924387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:27.925073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:27.931481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:27.932102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:27.932540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:27.933492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:27.933950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:27.934378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:28.062982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:28.070652 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-23dd79ed-0edc-4de5-842c-0ff15db6668d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.153631 Aug 29 16:46:28.071269 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3752/7679] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:27 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:29.091537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:29.092150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:29.094063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:29.100353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:29.100860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:29.101318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:29.102031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:29.102501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:29.103512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:29.234367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:29.242207 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-07dd123a-6091-4fb1-b087-e3d0d1647626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.154850 Aug 29 16:46:29.242786 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3928/7680] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:29 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:30.263444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:30.264067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:30.270974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:30.271499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:30.271940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:30.272627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:30.273088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:30.273540 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:30.410099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:30.418705 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40462fc7-cdca-478f-9eeb-3cd759d093ee tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.159692 Aug 29 16:46:30.419338 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3753/7681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:30 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:30.885401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-c48aa8fc-bcd9-45fb-b046-08a1dd0a7719 req-a5f2f717-2241-482a-a5b1-b9d69e4ba9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0439a3f5-328c-4e5e-a7df-a4c42cf2564d", "tag": "b3446d55-928f-4cbd-8be8-daac7f9ce3fd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:30.896212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c48aa8fc-bcd9-45fb-b046-08a1dd0a7719 req-a5f2f717-2241-482a-a5b1-b9d69e4ba9f1 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:30.896663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c48aa8fc-bcd9-45fb-b046-08a1dd0a7719 req-a5f2f717-2241-482a-a5b1-b9d69e4ba9f1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:30.897118 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-c48aa8fc-bcd9-45fb-b046-08a1dd0a7719 req-a5f2f717-2241-482a-a5b1-b9d69e4ba9f1 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:30.922916 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-c48aa8fc-bcd9-45fb-b046-08a1dd0a7719 req-a5f2f717-2241-482a-a5b1-b9d69e4ba9f1 service nova] Creating event network-changed:b3446d55-928f-4cbd-8be8-daac7f9ce3fd for instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d on n-h2-836830-13 Aug 29 16:46:30.928847 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-c48aa8fc-bcd9-45fb-b046-08a1dd0a7719 req-a5f2f717-2241-482a-a5b1-b9d69e4ba9f1 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047439 Aug 29 16:46:30.929470 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3929/7682] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:46:31.440072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:31.440693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:31.447826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:31.448319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:31.448763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:31.449461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:31.449940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:31.450342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:31.582001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:31.590373 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-085f3ee5-23a8-4874-bb9e-900f4584d83c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.154207 Aug 29 16:46:31.591190 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3754/7683] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:31 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:32.613122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:32.613870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:32.620435 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:32.620922 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:32.621393 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:32.622088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:32.622547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:32.623047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:32.758917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:32.767461 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-54995539-d279-45a5-9630-429d285898ad tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.159430 Aug 29 16:46:32.768053 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3930/7684] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:32 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:33.788954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:33.789603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:33.797333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:33.797825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:33.798264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:33.798958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:33.799514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:33.799943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:33.940476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:33.949574 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2da36dc1-d1d1-4f46-845b-c620f5403765 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.164666 Aug 29 16:46:33.950443 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3755/7685] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:33 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:46:34.971431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:34.971982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:34.978148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:34.978637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:34.979107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:34.979807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:34.980274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:34.980713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:35.112491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:35.121042 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6db54385-1262-4a50-a128-16ce91fc346a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.153991 Aug 29 16:46:35.121622 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3931/7686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:34 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:35.427133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7d697ab5-ea96-496b-af4b-5643ecc4df2a req-73b20bf2-ff42-4c7b-8580-a425a6c2feee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0439a3f5-328c-4e5e-a7df-a4c42cf2564d", "name": "network-vif-plugged", "status": "completed", "tag": "b3446d55-928f-4cbd-8be8-daac7f9ce3fd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:35.438450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d697ab5-ea96-496b-af4b-5643ecc4df2a req-73b20bf2-ff42-4c7b-8580-a425a6c2feee service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:35.438971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d697ab5-ea96-496b-af4b-5643ecc4df2a req-73b20bf2-ff42-4c7b-8580-a425a6c2feee service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:35.439408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d697ab5-ea96-496b-af4b-5643ecc4df2a req-73b20bf2-ff42-4c7b-8580-a425a6c2feee service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:35.452123 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7d697ab5-ea96-496b-af4b-5643ecc4df2a req-73b20bf2-ff42-4c7b-8580-a425a6c2feee service nova] Creating event network-vif-plugged:b3446d55-928f-4cbd-8be8-daac7f9ce3fd for instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d on n-h2-836830-13 Aug 29 16:46:35.457143 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7d697ab5-ea96-496b-af4b-5643ecc4df2a req-73b20bf2-ff42-4c7b-8580-a425a6c2feee service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033907 Aug 29 16:46:35.457740 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3756/7687] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:36.141443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:36.142076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:36.148935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:36.149445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:36.150504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:36.151240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:36.151709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:36.152149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:36.285577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:36.293991 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-459c6740-7557-4a9f-81ff-b97a8b9e4af1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1358 microversion: 2.1 time: 0.156532 Aug 29 16:46:36.294574 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3932/7688] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:36 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:37.319454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:37.320457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:37.326931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.327466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.327911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.328619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.329076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.329510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.465582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:37.474186 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a57b9737-f8c0-49a5-8a7d-cae2b698d8a5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1547 microversion: 2.1 time: 0.162561 Aug 29 16:46:37.474777 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3757/7689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:37 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:37.494634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:37.495314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:37.502471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.502971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.503482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.504209 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.504676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.505139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.646293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:37.654282 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b0eff9d3-d282-4cb9-86e4-4de539ae20af tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1547 microversion: 2.1 time: 0.163678 Aug 29 16:46:37.654875 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3933/7690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:37 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:37.673798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:37.678502 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:37.679286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Searching by: {'deleted': False, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da'} {{(pid=129132) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:46:37.685524 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.686004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.686435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.687175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.687623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.688043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.712761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.multi_cell_list [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129132) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:46:37.739821 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-81640bd1-686e-4069-b788-95c976de7589 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069752 Aug 29 16:46:37.740526 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3758/7691] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 16:46:37 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:37.752400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:37.753036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:37.759678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.760181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.760628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.761330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:37.761797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:37.762234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:37.895600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:37.903633 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ba7dc267-63e7-4806-8f72-2b9d61f869ed tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1547 microversion: 2.1 time: 0.155134 Aug 29 16:46:37.904477 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3934/7692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:37 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:39.452386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:39.454777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:39.461671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:39.462779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:39.463262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:39.463962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:39.464418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:39.465866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:39.734303 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-724a1a6c-3e1d-4b87-badf-98beb939b660 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285861 Aug 29 16:46:39.734936 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3759/7693] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:46:39 2022] POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:52.779074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:52.779704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:52.782683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:52.783529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=62 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:52.789985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:52.790483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:52.790932 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:52.792495 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:52.792972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:52.793415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:52.922986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:52.931296 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cf6d291f-2ce3-4dd7-9a4c-dfa0225154f6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1593 microversion: 2.1 time: 0.157078 Aug 29 16:46:52.932585 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3935/7694] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:52 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:54.882851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:54.884325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:54.885256 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:46:54.890516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-16f5a064-1d78-4306-8290-9a0bada4df5b req-0e517ac7-fe8a-49f0-95dc-7dd0f9162cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0439a3f5-328c-4e5e-a7df-a4c42cf2564d", "tag": "b3446d55-928f-4cbd-8be8-daac7f9ce3fd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:54.903980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-16f5a064-1d78-4306-8290-9a0bada4df5b req-0e517ac7-fe8a-49f0-95dc-7dd0f9162cab service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:54.904816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-16f5a064-1d78-4306-8290-9a0bada4df5b req-0e517ac7-fe8a-49f0-95dc-7dd0f9162cab service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:54.905466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-16f5a064-1d78-4306-8290-9a0bada4df5b req-0e517ac7-fe8a-49f0-95dc-7dd0f9162cab service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:54.919865 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-16f5a064-1d78-4306-8290-9a0bada4df5b req-0e517ac7-fe8a-49f0-95dc-7dd0f9162cab service nova] Creating event network-changed:b3446d55-928f-4cbd-8be8-daac7f9ce3fd for instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d on n-h2-836830-13 Aug 29 16:46:54.924983 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-16f5a064-1d78-4306-8290-9a0bada4df5b req-0e517ac7-fe8a-49f0-95dc-7dd0f9162cab service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043854 Aug 29 16:46:54.925797 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3760/7695] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:46:55.887717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1154552606"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:55.888979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:55.898001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:55.899055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:55.899633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:55.900540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:55.901959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:55.902484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.109565 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.network.security_group_api [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Adding security group 6cbd5c82-d9ed-47dc-8b03-4c6828e179e6 to port b3446d55-928f-4cbd-8be8-daac7f9ce3fd Aug 29 16:46:56.444258 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2730c4f6-cb0d-43ac-a249-310f07f489ce tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action" status: 202 len: 0 microversion: 2.1 time: 0.562476 Aug 29 16:46:56.444886 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3936/7696] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:46:55 2022] POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:46:56.455890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:46:56.456596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:46:56.469707 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:56.470451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:56.471121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.472012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:56.472469 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:56.473076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.630341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:46:56.640177 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c8554ca1-e0b8-4ab0-89e6-bd182421178b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1758 microversion: 2.1 time: 0.189645 Aug 29 16:46:56.641172 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3761/7697] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:46:56 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:46:56.942001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-625204c7-6290-4a0c-8383-cd145d4f9a71 req-72fd5974-ee5c-4e8a-b041-30061e9214bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0439a3f5-328c-4e5e-a7df-a4c42cf2564d", "tag": "b3446d55-928f-4cbd-8be8-daac7f9ce3fd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:46:56.953270 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-625204c7-6290-4a0c-8383-cd145d4f9a71 req-72fd5974-ee5c-4e8a-b041-30061e9214bb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:46:56.953779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-625204c7-6290-4a0c-8383-cd145d4f9a71 req-72fd5974-ee5c-4e8a-b041-30061e9214bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:46:56.954233 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-625204c7-6290-4a0c-8383-cd145d4f9a71 req-72fd5974-ee5c-4e8a-b041-30061e9214bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:46:56.967975 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-625204c7-6290-4a0c-8383-cd145d4f9a71 req-72fd5974-ee5c-4e8a-b041-30061e9214bb service nova] Creating event network-changed:b3446d55-928f-4cbd-8be8-daac7f9ce3fd for instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d on n-h2-836830-13 Aug 29 16:46:56.974560 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-625204c7-6290-4a0c-8383-cd145d4f9a71 req-72fd5974-ee5c-4e8a-b041-30061e9214bb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038291 Aug 29 16:46:56.976451 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3937/7698] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:49:17.588060 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:49:17.588982 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:49:17.589460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:17.590208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:17.591638 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:49:17.591776 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action (ip 10.222.0.83) !!! Aug 29 16:49:17.594140 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:49:17.594258 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 16:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action (ip 10.222.0.83) !!! Aug 29 16:49:17.601834 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:49:17.604065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:17.612550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:17.613659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:17.614192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:17.614881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:17.615375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:17.615798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:17.690651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-653f076a-5deb-4ba9-9b7f-37cd5df8797c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action" status: 202 len: 0 microversion: 2.1 time: 0.105093 Aug 29 16:49:17.691779 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3762/7699] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:49:17 2022] POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:49:17.698220 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:49:17.699172 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 16:49:17.699769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:17.700658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=12 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:49:17.701609 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:49:17.701846 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d (ip 10.222.0.83) !!! Aug 29 16:49:17.703324 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 16:49:17.703575 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d (ip 10.222.0.83) !!! Aug 29 16:49:17.709238 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:17.710203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:17.720173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:17.720672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:17.721122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:17.721828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:17.722967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:17.723526 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:17.968570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:17.977627 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0d49db1b-a8c8-44f9-9524-c4817b3b9e9e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1760 microversion: 2.1 time: 0.281602 Aug 29 16:49:17.978230 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3938/7700] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:17 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1760 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:49:19.004703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:49:19.005345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:49:19.014406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:19.014899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:19.015422 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:19.016114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:49:19.016564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:49:19.016982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:49:19.025401 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 48470. Aug 29 16:49:19.026707 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 48468. Aug 29 16:49:19.173995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:49:19.182395 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8cc2139-810e-490c-bfc1-e6937c0a727b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1758 microversion: 2.1 time: 0.187226 Aug 29 16:49:19.182968 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3763/7701] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:49:18 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:50:58.519457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1154552606"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:50:58.520080 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:50:58.524150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:58.524879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:58.525795 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:50:58.525959 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action (ip 10.222.0.83) !!! Aug 29 16:50:58.540632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:58.541150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:58.541604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:58.542321 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:58.542818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:58.543289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:58.551164 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 48504. Aug 29 16:50:58.553576 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 48506. Aug 29 16:50:58.681247 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.network.security_group_api [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Removing security group 6cbd5c82-d9ed-47dc-8b03-4c6828e179e6 from port b3446d55-928f-4cbd-8be8-daac7f9ce3fd Aug 29 16:50:58.996742 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-22f131f2-e862-4fb8-98cf-a0f7b8515a84 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action" status: 202 len: 0 microversion: 2.1 time: 0.482536 Aug 29 16:50:58.997375 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3939/7702] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:50:58 2022] POST /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:50:59.003495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:59.004825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:50:59.148906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2a500ac6-e8b8-413e-895c-08db58f6d099 req-ae581440-f863-4549-89bd-a414906d0e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0439a3f5-328c-4e5e-a7df-a4c42cf2564d", "tag": "b3446d55-928f-4cbd-8be8-daac7f9ce3fd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:50:59.161748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a500ac6-e8b8-413e-895c-08db58f6d099 req-ae581440-f863-4549-89bd-a414906d0e11 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:50:59.162859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a500ac6-e8b8-413e-895c-08db58f6d099 req-ae581440-f863-4549-89bd-a414906d0e11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:50:59.163504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2a500ac6-e8b8-413e-895c-08db58f6d099 req-ae581440-f863-4549-89bd-a414906d0e11 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:50:59.181105 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2a500ac6-e8b8-413e-895c-08db58f6d099 req-ae581440-f863-4549-89bd-a414906d0e11 service nova] Creating event network-changed:b3446d55-928f-4cbd-8be8-daac7f9ce3fd for instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d on n-h2-836830-13 Aug 29 16:50:59.186576 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2a500ac6-e8b8-413e-895c-08db58f6d099 req-ae581440-f863-4549-89bd-a414906d0e11 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185547 Aug 29 16:50:59.187453 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3764/7703] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:51:00.473329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:00.473881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:00.480363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:00.480892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:00.481351 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:00.482058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:00.482532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:00.483287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:00.567045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lazy-loading 'services' on Instance uuid 0439a3f5-328c-4e5e-a7df-a4c42cf2564d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:51:00.640992 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-22157ec6-fcbe-4241-8ac8-4ee109593b5e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments/224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0" status: 202 len: 0 microversion: 2.1 time: 0.173315 Aug 29 16:51:00.641822 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3940/7704] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:51:00 2022] DELETE /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments/224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:51:00.651907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:00.654201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:00.661818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:00.662576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:00.663258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:00.664192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:00.664656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:00.665083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:00.698042 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bdd8bc97-6315-4e79-b852-60ae31a97747 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050487 Aug 29 16:51:00.698865 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3765/7705] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:51:00 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:01.202121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d4e92542-3676-4461-96cf-599274b7c9ba req-f907a31b-3e34-48c8-b2c6-60eb6123a2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0439a3f5-328c-4e5e-a7df-a4c42cf2564d", "tag": "b3446d55-928f-4cbd-8be8-daac7f9ce3fd"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:01.212511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4e92542-3676-4461-96cf-599274b7c9ba req-f907a31b-3e34-48c8-b2c6-60eb6123a2c0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:01.212993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4e92542-3676-4461-96cf-599274b7c9ba req-f907a31b-3e34-48c8-b2c6-60eb6123a2c0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:01.213437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d4e92542-3676-4461-96cf-599274b7c9ba req-f907a31b-3e34-48c8-b2c6-60eb6123a2c0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:01.225775 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d4e92542-3676-4461-96cf-599274b7c9ba req-f907a31b-3e34-48c8-b2c6-60eb6123a2c0 service nova] Creating event network-changed:b3446d55-928f-4cbd-8be8-daac7f9ce3fd for instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d on n-h2-836830-13 Aug 29 16:51:01.230757 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d4e92542-3676-4461-96cf-599274b7c9ba req-f907a31b-3e34-48c8-b2c6-60eb6123a2c0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032864 Aug 29 16:51:01.231403 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3941/7706] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:01.710084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:01.712287 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:01.719246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:01.719736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:01.720169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:01.720864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:01.722041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:01.722401 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:01.754099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8825abe1-5aac-4110-ad6e-4f8d41d2ebc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Aug 29 16:51:01.754673 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3766/7707] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:51:01 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:02.768105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:02.770557 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:02.776951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:02.777461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:02.777918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:02.778634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:02.779138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:02.779586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:02.810817 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-483e3971-0572-4cf7-90fa-564b66b81947 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047960 Aug 29 16:51:02.811415 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3942/7708] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:51:02 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:03.824023 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:03.826140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:03.834307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:03.834793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:03.835272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:03.835979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:03.836435 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:03.836867 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:03.871977 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4237791d-2446-43fb-961f-85b559cfc045 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052013 Aug 29 16:51:03.872561 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3767/7709] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:51:03 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:04.884596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:04.887792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:04.899667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:04.900179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:04.900636 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:04.901409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:04.901882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:04.902326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:04.934230 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-399be36c-9ea6-4050-89c5-b8cafb155ec5 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053462 Aug 29 16:51:04.935041 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3943/7710] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:51:04 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:05.946312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:05.948511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:05.955491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:05.955996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:05.956430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:05.957487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:05.958202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:05.958202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:05.988268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f4186b20-52cc-45d5-89d1-dd2913e3a549 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045915 Aug 29 16:51:05.988835 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3768/7711] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:51:05 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:51:05.999366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:05.999872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:06.006696 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:06.007247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:06.007708 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:06.008425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:06.008898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:06.009342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:06.085468 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] HTTP exception thrown: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d is not attached to volume 224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Request method failure captured: Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments/224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 HTTP/1.1 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDO1J-7SWv-HNmrLj4XvbaK-fFkP4nX4pv06j9xxANFtVy4-AqeWFyKYTTCOiGSf_TWfrYXqO9efeaCkgRr4KSAM1BODj2GJAjuMHNZDHrEtADhEyyrdf5Wk0bc3Bd5AopHf4w0_2SluN476EKxF7cqOs3VJq73uP-9JOg4XtWWuML0M Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e85e2ac1358a4913bfc77ae8d79802da", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e85e2ac1358a4913bfc77ae8d79802da"}]}] Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: da236bec13cf409ca4f644e76fbb5e1b Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d is not attached to volume 224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': '0439a3f5-328c-4e5e-a7df-a4c42cf2564d', 'id': '224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0'} Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0. Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d is not attached to volume 224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:51:06.087132 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:51:06.092656 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:51:06.092656 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:51:06.092656 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d is not attached to volume 224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 Aug 29 16:51:06.092656 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:06.092656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Returning 404 to user: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d is not attached to volume 224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:51:06.092656 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-959d04b2-80af-49f1-89fc-dd14f080a811 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments/224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0" status: 404 len: 154 microversion: 2.1 time: 0.093417 Aug 29 16:51:06.092656 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3944/7712] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:51:05 2022] DELETE /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d/os-volume_attachments/224e301a-1aa3-44ea-8cf9-a86c8b9ca3a0 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 16:51:09.435512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:09.436116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:09.444113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:09.444609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:09.445052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:09.445761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:09.446217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:09.446643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:09.474685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:51:09.558099 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13003385-ec72-4056-99fc-e4e4d9687135 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 204 len: 0 microversion: 2.1 time: 0.126391 Aug 29 16:51:09.559258 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3769/7713] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:51:09 2022] DELETE /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:51:09.567941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:09.569122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:09.577418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:09.577913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:09.578360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:09.579072 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:09.579547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:09.579979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:09.715806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:09.724781 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-46147990-df04-4b3b-9ac9-43b52a76bfbd tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1553 microversion: 2.1 time: 0.161131 Aug 29 16:51:09.725358 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3945/7714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:09 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:10.747529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:10.748257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:10.756145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:10.756629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:10.757082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:10.757763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:10.758211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:10.758631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:10.895148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:10.902945 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-14a8d9b1-af30-499f-92f3-9d8a49d98d49 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1553 microversion: 2.1 time: 0.159747 Aug 29 16:51:10.903542 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3770/7715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:10 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:11.925034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:11.925722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:11.932809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:11.933312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:11.934024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:11.934734 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:11.935229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:11.935672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:12.119750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:12.128343 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6da66701-717f-4771-b98a-46e80e7325a6 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 200 len: 1553 microversion: 2.1 time: 0.207582 Aug 29 16:51:12.128936 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3946/7716] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:11 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:12.232302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-84634f42-b7ac-43ba-ac7a-e602b6d9ed88 req-52a04a45-c327-443d-9700-04ad715d2c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0439a3f5-328c-4e5e-a7df-a4c42cf2564d", "name": "network-vif-deleted", "tag": "b3446d55-928f-4cbd-8be8-daac7f9ce3fd"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:12.242892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-84634f42-b7ac-43ba-ac7a-e602b6d9ed88 req-52a04a45-c327-443d-9700-04ad715d2c12 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:12.243400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-84634f42-b7ac-43ba-ac7a-e602b6d9ed88 req-52a04a45-c327-443d-9700-04ad715d2c12 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:12.243837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-84634f42-b7ac-43ba-ac7a-e602b6d9ed88 req-52a04a45-c327-443d-9700-04ad715d2c12 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:12.255741 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-84634f42-b7ac-43ba-ac7a-e602b6d9ed88 req-52a04a45-c327-443d-9700-04ad715d2c12 service nova] Creating event network-vif-deleted:b3446d55-928f-4cbd-8be8-daac7f9ce3fd for instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d on n-h2-836830-13 Aug 29 16:51:12.260576 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-84634f42-b7ac-43ba-ac7a-e602b6d9ed88 req-52a04a45-c327-443d-9700-04ad715d2c12 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032040 Aug 29 16:51:12.261197 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3771/7717] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:13.149980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:13.150668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: 0439a3f5-328c-4e5e-a7df-a4c42cf2564d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:13.157600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:13.158089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:13.159093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:13.159799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:13.160266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:13.160887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:13.177283 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] HTTP exception thrown: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d could not be found. Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Request method failure captured: Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d HTTP/1.1 Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDO1J-7SWv-HNmrLj4XvbaK-fFkP4nX4pv06j9xxANFtVy4-AqeWFyKYTTCOiGSf_TWfrYXqO9efeaCkgRr4KSAM1BODj2GJAjuMHNZDHrEtADhEyyrdf5Wk0bc3Bd5AopHf4w0_2SluN476EKxF7cqOs3VJq73uP-9JOg4XtWWuML0M Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e85e2ac1358a4913bfc77ae8d79802da", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e85e2ac1358a4913bfc77ae8d79802da"}]}] Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: da236bec13cf409ca4f644e76fbb5e1b Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d could not be found. Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '0439a3f5-328c-4e5e-a7df-a4c42cf2564d'} Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d could not be found. Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d could not be found. Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:51:13.178882 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d could not be found. Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Returning 404 to user: Instance 0439a3f5-328c-4e5e-a7df-a4c42cf2564d could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3bb621f9-8786-45dd-8ead-459eb9b1e50f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d" status: 404 len: 111 microversion: 2.1 time: 0.034314 Aug 29 16:51:13.184149 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3947/7718] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:13 2022] GET /compute/v2.1/servers/0439a3f5-328c-4e5e-a7df-a4c42cf2564d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:51:13.191456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cf103699-e2ca-4e99-acb2-b0f6db8c4db2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '.version_select at 0x7f32edb37700>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:13.215667 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cf103699-e2ca-4e99-acb2-b0f6db8c4db2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2017255489" status: 202 len: 0 microversion: 2.1 time: 0.029078 Aug 29 16:51:13.216369 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3772/7719] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 16:51:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2017255489 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:51:22.269839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b3499256-56dc-4c8a-bc2d-d215cebd1a51 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'create', calling method: .version_select at 0x7f32ee99d9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-805270372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMttus7XjVcrRjbF63x+AdksfTWnUl4dBDZkw3KllmI5fNjXtOuFjSskUkl0rrRCSujCD4mSQibk4lTpyvCEwEGGIic90vMlNNrqJF1RsdMoKVJ8CvkUjmiAETBZ8ckIWA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:22.293041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b3499256-56dc-4c8a-bc2d-d215cebd1a51 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:51:22.301534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-b3499256-56dc-4c8a-bc2d-d215cebd1a51 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for user da236bec13cf409ca4f644e76fbb5e1b and project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:51:22.329713 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b3499256-56dc-4c8a-bc2d-d215cebd1a51 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064016 Aug 29 16:51:22.330330 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3948/7720] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:51:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:22.380146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:22.384281 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-916229391", "imageRef": "12a16def-5b1e-4df3-a960-78fc595e48ff", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-805270372", "networks": [{"uuid": "234b0e9a-a344-4c5e-90aa-f6aeaa26d6a7"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:22.437984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] validate_networks() for [('234b0e9a-a344-4c5e-90aa-f6aeaa26d6a7', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:51:22.881137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:51:22.881577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:51:22.882046 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:51:22.882453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:51:22.882891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:51:22.891555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:22.892032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:22.892459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:22.893171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:22.893619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:22.894788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:22.911750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:51:22.917021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Getting quotas for user da236bec13cf409ca4f644e76fbb5e1b and project e85e2ac1358a4913bfc77ae8d79802da. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:51:22.929795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:51:22.932109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12a16def-5b1e-4df3-a960-78fc595e48ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:51:22.980485 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39c9e63d-1654-4d8e-8547-02e67298ef52 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602264 Aug 29 16:51:22.981149 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3773/7721] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:51:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:51:22.991883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6b622427-d495-4091-9370-2bd6684b6202 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:22.992539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6b622427-d495-4091-9370-2bd6684b6202 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:23.047767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6b622427-d495-4091-9370-2bd6684b6202 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:23.054893 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6b622427-d495-4091-9370-2bd6684b6202 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1257 microversion: 2.1 time: 0.067007 Aug 29 16:51:23.055717 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3949/7722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:22 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:24.077893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:24.078869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:24.086127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:24.087051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:24.087653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:24.088562 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:24.089164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:24.089741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:24.169416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:24.177567 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6e2d35f-4565-4ee9-be4f-2ffbfc147aae tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1327 microversion: 2.1 time: 0.104787 Aug 29 16:51:24.178324 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3774/7723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:24 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:25.199201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:25.199835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:25.203404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:25.210694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:25.211430 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:25.212039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:25.212758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:25.213230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:25.213698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:25.354596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:25.363606 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-289ac53a-e64d-4b99-b941-63ae1c01908b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.168382 Aug 29 16:51:25.364491 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3950/7724] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:25 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:26.384881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:26.386097 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:26.394763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:26.395695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:26.396363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:26.397355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:26.398038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:26.398697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:26.647104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:26.658064 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-36332235-fd3c-47bd-b533-17a214a9b626 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.276958 Aug 29 16:51:26.659353 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3775/7725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:26 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:27.679727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:27.680533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:27.688034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:27.688540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:27.688995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:27.689717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:27.690190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:27.690746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:27.887376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:27.895997 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8588e79-cde8-4720-b243-75dc97dbdb88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.220302 Aug 29 16:51:27.896594 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3951/7726] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:27 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:28.916643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:28.917312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:28.931282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:28.931839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:28.932527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:28.933242 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:28.933975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:28.934434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:29.081537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:29.089856 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b96142be-da8a-4df2-9951-3933eb7776b7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.177149 Aug 29 16:51:29.090799 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3776/7727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:28 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:30.111534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:30.112068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:30.114982 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:30.123318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:30.124175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:30.124835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:30.125549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:30.126129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:30.126758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:30.271139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:30.279209 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a32bbe8d-fb69-4f28-9232-5c062edf2141 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.171562 Aug 29 16:51:30.279798 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3952/7728] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:30 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:31.300973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:31.301677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:31.304265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:31.310344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:31.310887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:31.311284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:31.311979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:31.312432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:31.312880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:31.455743 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:31.464529 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5fb7142c-c6d7-4d14-a5ce-594cb8dfb02b tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.167536 Aug 29 16:51:31.465365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3777/7729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:31 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:32.485577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:32.486214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:32.493963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:32.494477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:32.494936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:32.495807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:32.496290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:32.496737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:32.630542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:32.638499 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a6b560c-bfa3-4ed5-8151-52c821c62061 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.156872 Aug 29 16:51:32.639061 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3953/7730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:32 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:33.651936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:33.654292 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:33.667048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:33.668035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:33.669995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:33.679003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:33.679361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:33.679819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:33.680553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:33.681014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:33.681645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:33.722325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7d2901ad-9326-47bc-9ea4-f0fe9a37acc1 req-59a0aad6-50cd-4546-9299-a1ec10cab97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dc1a75-b35b-4dff-b0c2-0d752ec8507b", "tag": "49267469-7fde-4eeb-8a39-0fb9df59d5fe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:33.732726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d2901ad-9326-47bc-9ea4-f0fe9a37acc1 req-59a0aad6-50cd-4546-9299-a1ec10cab97a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:33.733466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d2901ad-9326-47bc-9ea4-f0fe9a37acc1 req-59a0aad6-50cd-4546-9299-a1ec10cab97a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:33.734130 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7d2901ad-9326-47bc-9ea4-f0fe9a37acc1 req-59a0aad6-50cd-4546-9299-a1ec10cab97a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:33.746458 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7d2901ad-9326-47bc-9ea4-f0fe9a37acc1 req-59a0aad6-50cd-4546-9299-a1ec10cab97a service nova] Creating event network-changed:49267469-7fde-4eeb-8a39-0fb9df59d5fe for instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b on n-h1-836830-13 Aug 29 16:51:33.752202 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7d2901ad-9326-47bc-9ea4-f0fe9a37acc1 req-59a0aad6-50cd-4546-9299-a1ec10cab97a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106086 Aug 29 16:51:33.753113 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3778/7731] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:33.830566 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:33.838968 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-281a3df0-de65-47c6-9865-cec36693a5c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.183134 Aug 29 16:51:33.839579 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3954/7732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:33 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:34.865829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:34.866591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:34.872900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:34.873461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:34.873901 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:34.874590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:34.875065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:34.875495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:35.096318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:35.104442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-27afa136-46c6-4efa-874d-f84cd4c293a8 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.243717 Aug 29 16:51:35.105038 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3779/7733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:34 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:36.134133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:36.137113 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:36.156606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:36.158219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:36.159316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:36.171056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:36.171056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:36.171056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:36.333208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:36.340996 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-eef575e3-2745-451c-ac49-bace15318dba tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.216617 Aug 29 16:51:36.341590 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3955/7734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:36 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:37.361757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:37.363059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:37.370108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:37.370598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:37.371061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:37.371757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:37.372215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:37.372644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:37.502217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:37.510104 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7fa249d3-d9e9-4071-8bc5-6bac9ec10a88 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.152311 Aug 29 16:51:37.510676 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3780/7735] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:37 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:37.890187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8b4b4d99-98ee-497b-b682-23b3b74cb824 req-0f516a4e-317b-4ad5-a30c-95345ef04630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dc1a75-b35b-4dff-b0c2-0d752ec8507b", "name": "network-vif-plugged", "status": "completed", "tag": "49267469-7fde-4eeb-8a39-0fb9df59d5fe"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:37.900867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8b4b4d99-98ee-497b-b682-23b3b74cb824 req-0f516a4e-317b-4ad5-a30c-95345ef04630 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:37.901363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8b4b4d99-98ee-497b-b682-23b3b74cb824 req-0f516a4e-317b-4ad5-a30c-95345ef04630 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:37.901806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8b4b4d99-98ee-497b-b682-23b3b74cb824 req-0f516a4e-317b-4ad5-a30c-95345ef04630 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:37.913371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8b4b4d99-98ee-497b-b682-23b3b74cb824 req-0f516a4e-317b-4ad5-a30c-95345ef04630 service nova] Creating event network-vif-plugged:49267469-7fde-4eeb-8a39-0fb9df59d5fe for instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b on n-h1-836830-13 Aug 29 16:51:37.918567 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8b4b4d99-98ee-497b-b682-23b3b74cb824 req-0f516a4e-317b-4ad5-a30c-95345ef04630 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095821 Aug 29 16:51:37.919132 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3956/7736] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:38.530991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:38.531614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:38.538961 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:38.539477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:38.539912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:38.540621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:38.541054 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:38.541475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:38.678759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:38.686934 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-57efe970-211d-46a4-90bc-d30afbf4cc04 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1357 microversion: 2.1 time: 0.159850 Aug 29 16:51:38.687555 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3781/7737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:38 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:39.708961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:39.709682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:39.716056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.716553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.717005 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:39.717702 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.718171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.718611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:39.851538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:39.859389 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8a783f02-f0db-4ca2-b25a-70d0ba2d352e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1546 microversion: 2.1 time: 0.155609 Aug 29 16:51:39.859969 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3957/7738] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:39 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:39.880113 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:39.880728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:39.887515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.888004 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.888441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:39.889129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:39.889583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:39.890008 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.021610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:40.029315 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7f52b68e-9de0-4301-9551-403acbce4827 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1546 microversion: 2.1 time: 0.153646 Aug 29 16:51:40.029889 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3782/7739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:39 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:40.049135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:40.054499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:40.055315 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Searching by: {'deleted': False, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da'} {{(pid=129133) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 16:51:40.060846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.061337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.061779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.062501 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.062966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.063438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.087578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.multi_cell_list [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 16:51:40.115345 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8047ff5-23c8-4814-984f-175ef8d252cc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070036 Aug 29 16:51:40.115931 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3958/7740] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 16:51:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:40.127503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:40.128261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:40.134415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.134899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.135432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.136126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:40.136567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:40.136993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:40.265774 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:40.273746 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-51c01063-b331-480a-8e3a-9add989f171a tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1546 microversion: 2.1 time: 0.150532 Aug 29 16:51:40.274329 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3783/7741] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:40 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:41.793165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d31e3414-6eb1-4c8f-aca1-69f7620edc59"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:41.795614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:41.803201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:41.803710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:41.804193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:41.804946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:41.805400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:41.805851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:42.053769 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-232eacac-d3fc-47bf-add7-23a2955cbdc9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264449 Aug 29 16:51:42.054396 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3959/7742] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 16:51:41 2022] POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:52.832880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:52.833448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:52.835636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=13 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:52.836378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=58 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:52.842146 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:52.842641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:52.843108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:52.843810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:52.844268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:52.844701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:52.979555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:52.988631 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d54eadc-453b-4b1f-8d38-f16ffadfbd7d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1592 microversion: 2.1 time: 0.160086 Aug 29 16:51:52.989217 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3784/7743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:52 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1592 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:54.980485 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:54.981274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=15 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:54.981947 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:51:54.986147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-26a83ff3-9982-48e8-917f-80f6d5c0bf49 req-e74cddea-84ea-475f-97a7-f4d797b9c4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dc1a75-b35b-4dff-b0c2-0d752ec8507b", "tag": "49267469-7fde-4eeb-8a39-0fb9df59d5fe"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:54.997160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-26a83ff3-9982-48e8-917f-80f6d5c0bf49 req-e74cddea-84ea-475f-97a7-f4d797b9c4fd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:54.997654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-26a83ff3-9982-48e8-917f-80f6d5c0bf49 req-e74cddea-84ea-475f-97a7-f4d797b9c4fd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:54.998102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-26a83ff3-9982-48e8-917f-80f6d5c0bf49 req-e74cddea-84ea-475f-97a7-f4d797b9c4fd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:55.011349 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-26a83ff3-9982-48e8-917f-80f6d5c0bf49 req-e74cddea-84ea-475f-97a7-f4d797b9c4fd service nova] Creating event network-changed:49267469-7fde-4eeb-8a39-0fb9df59d5fe for instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b on n-h1-836830-13 Aug 29 16:51:55.016642 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-26a83ff3-9982-48e8-917f-80f6d5c0bf49 req-e74cddea-84ea-475f-97a7-f4d797b9c4fd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037912 Aug 29 16:51:55.017235 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3960/7744] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:51:55.994871 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-127470366"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:55.995545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:56.002250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:56.002995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:56.003420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:56.004224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:56.004787 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:56.005282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:56.146442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.network.security_group_api [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Adding security group e68d7dd8-d01d-4d91-9b30-85bae625d0d9 to port 49267469-7fde-4eeb-8a39-0fb9df59d5fe Aug 29 16:51:56.465692 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-127b50e7-e8d8-49b4-a911-8f69e662e5dc tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/action" status: 202 len: 0 microversion: 2.1 time: 0.474818 Aug 29 16:51:56.466313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3785/7745] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:51:55 2022] POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 16:51:56.475412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:51:56.476203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:51:56.484586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:56.485091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:56.485543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:56.486251 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:56.486722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:56.487419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:56.645201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:51:56.653767 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d5e8214c-e388-4565-8828-6d5ba9d7fc31 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1756 microversion: 2.1 time: 0.182882 Aug 29 16:51:56.654361 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3961/7746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:51:56 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:51:57.032170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-29c021e2-612e-45a0-ad9c-41f7836bfc78 req-c8ca9598-3d14-4218-a2a6-7dc1b743f905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dc1a75-b35b-4dff-b0c2-0d752ec8507b", "tag": "49267469-7fde-4eeb-8a39-0fb9df59d5fe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:51:57.042464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29c021e2-612e-45a0-ad9c-41f7836bfc78 req-c8ca9598-3d14-4218-a2a6-7dc1b743f905 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:51:57.042939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29c021e2-612e-45a0-ad9c-41f7836bfc78 req-c8ca9598-3d14-4218-a2a6-7dc1b743f905 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:51:57.043409 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-29c021e2-612e-45a0-ad9c-41f7836bfc78 req-c8ca9598-3d14-4218-a2a6-7dc1b743f905 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:51:57.056261 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-29c021e2-612e-45a0-ad9c-41f7836bfc78 req-c8ca9598-3d14-4218-a2a6-7dc1b743f905 service nova] Creating event network-changed:49267469-7fde-4eeb-8a39-0fb9df59d5fe for instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b on n-h1-836830-13 Aug 29 16:51:57.061497 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-29c021e2-612e-45a0-ad9c-41f7836bfc78 req-c8ca9598-3d14-4218-a2a6-7dc1b743f905 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033816 Aug 29 16:51:57.062099 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3786/7747] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:52:12.637199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:52:12.639596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:12.642324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:12.643003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:12.650147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:12.650644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:12.651121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:12.651830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:12.652298 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:12.652737 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:12.725825 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0f79525f-8794-454e-86e2-2af4b2644d8f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/action" status: 202 len: 0 microversion: 2.1 time: 0.092353 Aug 29 16:52:12.726459 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3962/7748] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:52:12 2022] POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:52:12.733547 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:12.734609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:12.740449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:12.741574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:12.749363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:12.749873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:12.750367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:12.751171 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:12.751700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:12.752118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:12.992966 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:13.001615 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f9346f4d-275a-4cf0-a4fd-886608f05b15 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1748 microversion: 2.1 time: 0.270258 Aug 29 16:52:13.015049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3787/7749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:12 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1748 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:14.025602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:14.026313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:14.032528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:14.033018 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:14.033462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:14.034169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:14.035228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:14.035686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:14.184601 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:14.194228 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0773b17b-c8e5-4db7-a13b-e85ddd98efe3 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.173837 Aug 29 16:52:14.194819 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3963/7750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:14 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:15.215484 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:15.216086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:15.223606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:15.224098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:15.224533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:15.225228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:15.225683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:15.226108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:15.373262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:15.381812 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-07874763-49dd-4c03-9dbe-5e91a15ae8b2 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.170266 Aug 29 16:52:15.382389 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3788/7751] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:15 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:16.403304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:16.403964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:16.411626 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:16.412130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:16.412583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:16.413285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:16.413756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:16.414198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:16.555717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:16.564348 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e8c13a0f-146a-49c5-bb6a-8106f2bd2567 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.165058 Aug 29 16:52:16.564923 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3964/7752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:16 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:52:17.586544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:17.587196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:17.594453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:17.594930 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:17.595387 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:17.596083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:17.596531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:17.596980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:17.745775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:17.755143 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7a51872e-41fc-4719-ac19-12004dd4cb21 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.173335 Aug 29 16:52:17.755744 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3789/7753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:17 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:52:18.776588 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:18.777219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:18.783309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:18.783787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:18.784235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:18.784935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:18.785399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:18.786377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:18.933440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:18.942255 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-964b526c-a05a-4a59-8493-977fd3d71f05 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.170518 Aug 29 16:52:18.942937 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3965/7754] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:18 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:19.963947 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:19.964613 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:19.970769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:19.971294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:19.971731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:19.972415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:19.972866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:19.973323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:20.114107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:20.122335 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-87d2515c-ae52-4dc3-b1af-5fdf6441b939 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.162408 Aug 29 16:52:20.122913 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3790/7755] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:19 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:21.143726 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:21.144362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:21.151290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:21.151797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:21.152256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:21.152966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:21.153466 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:21.154002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:21.297930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:21.307013 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5b086f14-78b3-44e0-8cc9-1b8a68fd342e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.167298 Aug 29 16:52:21.307614 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3966/7756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:21 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:22.328413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:22.329015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:22.336492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:22.336965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:22.337396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:22.338071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:22.338521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:22.338942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:22.485857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:22.494223 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3a4ff393-5b2c-401c-8357-873e991b2200 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.169722 Aug 29 16:52:22.494807 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3791/7757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:22 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:23.516380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:23.516988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:23.524672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:23.525174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:23.525625 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:23.526332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:23.526801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:23.527334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:23.675368 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:23.683825 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e25ad365-1e74-46b9-8c27-f8f9477fc93f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1753 microversion: 2.1 time: 0.171496 Aug 29 16:52:23.684676 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3967/7758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:23 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:24.705408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:24.706030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:24.713117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:24.713606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:24.714055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:24.714744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:24.715240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:24.715727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:24.857202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:52:24.866143 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5d420de9-0122-4cf9-bbef-0be01d23211d tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1756 microversion: 2.1 time: 0.164730 Aug 29 16:52:24.866729 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3792/7759] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:52:24 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:52:57.503540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-127470366"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:52:57.504173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:57.506287 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=12 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:57.507139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:57.507844 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:52:57.508104 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:52:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/action (ip 10.222.0.83) !!! Aug 29 16:52:57.516414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:57.516920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:57.517373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:57.518084 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:57.518553 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:57.518995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:57.652638 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.network.security_group_api [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Removing security group e68d7dd8-d01d-4d91-9b30-85bae625d0d9 from port 49267469-7fde-4eeb-8a39-0fb9df59d5fe Aug 29 16:52:57.962536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-eaac3cb0-32fc-48dc-bc13-050a8ea2c68c req-325c038f-8057-42bb-a2dc-de48a5f3f0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dc1a75-b35b-4dff-b0c2-0d752ec8507b", "tag": "49267469-7fde-4eeb-8a39-0fb9df59d5fe"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:52:57.966543 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-baa91f11-6c91-4e2e-b707-7e31de601bc7 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/action" status: 202 len: 0 microversion: 2.1 time: 0.467301 Aug 29 16:52:57.967392 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3968/7760] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:52:57 2022] POST /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:52:57.975665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:57.976776 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=36 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:52:57.980038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-eaac3cb0-32fc-48dc-bc13-050a8ea2c68c req-325c038f-8057-42bb-a2dc-de48a5f3f0c2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:57.980038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-eaac3cb0-32fc-48dc-bc13-050a8ea2c68c req-325c038f-8057-42bb-a2dc-de48a5f3f0c2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:57.980825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-eaac3cb0-32fc-48dc-bc13-050a8ea2c68c req-325c038f-8057-42bb-a2dc-de48a5f3f0c2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:57.994142 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-eaac3cb0-32fc-48dc-bc13-050a8ea2c68c req-325c038f-8057-42bb-a2dc-de48a5f3f0c2 service nova] Creating event network-changed:49267469-7fde-4eeb-8a39-0fb9df59d5fe for instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b on n-h1-836830-13 Aug 29 16:52:58.000994 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-eaac3cb0-32fc-48dc-bc13-050a8ea2c68c req-325c038f-8057-42bb-a2dc-de48a5f3f0c2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042740 Aug 29 16:52:58.002015 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3793/7761] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:52:59.394256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:59.394851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:59.401791 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:59.402301 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:59.402756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:59.403534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:59.404006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:59.404451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:59.503328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lazy-loading 'services' on Instance uuid b2dc1a75-b35b-4dff-b0c2-0d752ec8507b {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:52:59.581081 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b570cb89-95a9-4a73-86cf-0ddd3e011b3e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments/d31e3414-6eb1-4c8f-aca1-69f7620edc59" status: 202 len: 0 microversion: 2.1 time: 0.191658 Aug 29 16:52:59.581849 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3969/7762] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:52:59 2022] DELETE /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments/d31e3414-6eb1-4c8f-aca1-69f7620edc59 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:52:59.592542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:52:59.595649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:52:59.602403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:59.615559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:59.616138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:59.618060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:52:59.618060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:52:59.618942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:52:59.651272 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-928a1468-d53a-4abf-99d9-56110377bc01 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064670 Aug 29 16:52:59.652059 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3794/7763] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:52:59 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:53:00.035694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-72b38e3b-f4ca-4073-840d-b90a14d18d32 req-4a6813c8-e885-4956-ae5f-6e53abbee426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2dc1a75-b35b-4dff-b0c2-0d752ec8507b", "tag": "49267469-7fde-4eeb-8a39-0fb9df59d5fe"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:00.046788 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-72b38e3b-f4ca-4073-840d-b90a14d18d32 req-4a6813c8-e885-4956-ae5f-6e53abbee426 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:00.047390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-72b38e3b-f4ca-4073-840d-b90a14d18d32 req-4a6813c8-e885-4956-ae5f-6e53abbee426 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:00.047908 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-72b38e3b-f4ca-4073-840d-b90a14d18d32 req-4a6813c8-e885-4956-ae5f-6e53abbee426 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:00.060387 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-72b38e3b-f4ca-4073-840d-b90a14d18d32 req-4a6813c8-e885-4956-ae5f-6e53abbee426 service nova] Creating event network-changed:49267469-7fde-4eeb-8a39-0fb9df59d5fe for instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b on n-h1-836830-13 Aug 29 16:53:00.065373 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-72b38e3b-f4ca-4073-840d-b90a14d18d32 req-4a6813c8-e885-4956-ae5f-6e53abbee426 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033780 Aug 29 16:53:00.065982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3970/7764] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:00.664621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:00.666877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:00.673925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:00.674417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:00.674854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:00.675577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:00.676035 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:00.676464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:00.709235 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bfeb1985-de53-4ecb-9d77-0c343f0cb743 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048719 Aug 29 16:53:00.709824 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3795/7765] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:53:00 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:01.723504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:01.725838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:01.732720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:01.733231 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:01.733687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:01.734390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:01.734864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:01.735339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:01.767112 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1840136c-4ab5-466f-8474-097ccaf0a591 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048803 Aug 29 16:53:01.767701 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3971/7766] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:53:01 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:02.780219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:02.782279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:02.789156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:02.789642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:02.790077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:02.790768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:02.791304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:02.791915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:02.831539 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-024a9bc3-a279-4db3-88dd-cbdad0716367 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056019 Aug 29 16:53:02.832129 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3796/7767] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:53:02 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:03.844030 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:03.846300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:03.853337 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:03.853844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:03.854833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:03.855491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:03.856026 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:03.857396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:03.888302 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a5d9787a-3f9d-4df1-96ba-ef7a416e4d6e tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048277 Aug 29 16:53:03.888883 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3972/7768] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:53:03 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:04.900929 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:04.903897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:04.910703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:04.911246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:04.911728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:04.912414 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:04.912864 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:04.913284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:04.941745 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3fc19282-109a-48a2-8c7b-3f16c34a8184 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044832 Aug 29 16:53:04.942296 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3797/7769] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 16:53:04 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 16:53:04.953338 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:04.953851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:04.960930 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:04.961381 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:04.961835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:04.962540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:04.963009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:04.963471 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:05.039682 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] HTTP exception thrown: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b is not attached to volume d31e3414-6eb1-4c8f-aca1-69f7620edc59 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Request method failure captured: Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: request: DELETE /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments/d31e3414-6eb1-4c8f-aca1-69f7620edc59 HTTP/1.1 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDO1J-7SWv-HNmrLj4XvbaK-fFkP4nX4pv06j9xxANFtVy4-AqeWFyKYTTCOiGSf_TWfrYXqO9efeaCkgRr4KSAM1BODj2GJAjuMHNZDHrEtADhEyyrdf5Wk0bc3Bd5AopHf4w0_2SluN476EKxF7cqOs3VJq73uP-9JOg4XtWWuML0M Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e85e2ac1358a4913bfc77ae8d79802da", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e85e2ac1358a4913bfc77ae8d79802da"}]}] Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: da236bec13cf409ca4f644e76fbb5e1b Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b is not attached to volume d31e3414-6eb1-4c8f-aca1-69f7620edc59 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'server_id': 'b2dc1a75-b35b-4dff-b0c2-0d752ec8507b', 'id': 'd31e3414-6eb1-4c8f-aca1-69f7620edc59'} Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d31e3414-6eb1-4c8f-aca1-69f7620edc59. Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b is not attached to volume d31e3414-6eb1-4c8f-aca1-69f7620edc59 Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:05.041384 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:05.046283 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:53:05.046283 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:53:05.046283 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b is not attached to volume d31e3414-6eb1-4c8f-aca1-69f7620edc59 Aug 29 16:53:05.046283 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:05.046283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Returning 404 to user: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b is not attached to volume d31e3414-6eb1-4c8f-aca1-69f7620edc59 {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:53:05.046283 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-150316fe-dd4d-438f-ba0d-831abb67e73f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments/d31e3414-6eb1-4c8f-aca1-69f7620edc59" status: 404 len: 154 microversion: 2.1 time: 0.093784 Aug 29 16:53:05.046283 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3973/7770] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 16:53:04 2022] DELETE /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b/os-volume_attachments/d31e3414-6eb1-4c8f-aca1-69f7620edc59 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:53:08.293631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:08.294129 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:08.301032 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:08.301521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:08.301962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:08.302653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:08.303134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:08.303565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:08.331170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:53:08.414094 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21286707-b3b3-4c70-8b82-876966eaf07f tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 204 len: 0 microversion: 2.1 time: 0.124414 Aug 29 16:53:08.415089 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3798/7771] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:53:08 2022] DELETE /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:53:08.423693 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:08.424417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:08.432680 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:08.433406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:08.434458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:08.435234 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:08.435711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:08.436152 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:08.575816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:08.584149 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-53761084-72eb-418a-a45b-81b88bc347c1 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1552 microversion: 2.1 time: 0.164456 Aug 29 16:53:08.584853 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3974/7772] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:08 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:09.607147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:09.607857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:09.615990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:09.616495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:09.616911 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:09.617606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:09.618086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:09.618507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:09.748496 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:09.756409 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5abd89a-1d0e-4dea-86a3-d5cef2d0db34 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1552 microversion: 2.1 time: 0.154380 Aug 29 16:53:09.756978 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3799/7773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:09 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:10.491619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2c59b0c2-b8f1-4d39-8105-3f39c2bec71a req-d43ed767-594f-4495-930b-8b29aa9b7de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2dc1a75-b35b-4dff-b0c2-0d752ec8507b", "name": "network-vif-deleted", "tag": "49267469-7fde-4eeb-8a39-0fb9df59d5fe"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:10.503046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c59b0c2-b8f1-4d39-8105-3f39c2bec71a req-d43ed767-594f-4495-930b-8b29aa9b7de9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:10.503740 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c59b0c2-b8f1-4d39-8105-3f39c2bec71a req-d43ed767-594f-4495-930b-8b29aa9b7de9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:10.504193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2c59b0c2-b8f1-4d39-8105-3f39c2bec71a req-d43ed767-594f-4495-930b-8b29aa9b7de9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:10.516973 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2c59b0c2-b8f1-4d39-8105-3f39c2bec71a req-d43ed767-594f-4495-930b-8b29aa9b7de9 service nova] Creating event network-vif-deleted:49267469-7fde-4eeb-8a39-0fb9df59d5fe for instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b on n-h1-836830-13 Aug 29 16:53:10.522237 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2c59b0c2-b8f1-4d39-8105-3f39c2bec71a req-d43ed767-594f-4495-930b-8b29aa9b7de9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034405 Aug 29 16:53:10.522829 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3975/7774] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:10.777523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:10.778238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:10.785382 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:10.785877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:10.786338 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:10.787065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:10.787520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:10.787943 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:10.821610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:10.822094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:10.822534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:10.823549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lazy-loading 'fault' on Instance uuid b2dc1a75-b35b-4dff-b0c2-0d752ec8507b {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:53:10.867087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da236bec13cf409ca4f644e76fbb5e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e85e2ac1358a4913bfc77ae8d79802da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:10.876523 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9b2a99ab-9a15-4771-bcaa-de25e6bb1656 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 200 len: 1347 microversion: 2.1 time: 0.103175 Aug 29 16:53:10.877313 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3800/7775] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:10 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:11.899556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:11.900179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] [instance: b2dc1a75-b35b-4dff-b0c2-0d752ec8507b] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:11.906623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:11.907164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:11.907611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:11.908302 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:11.908765 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:11.909197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:11.922570 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] HTTP exception thrown: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b could not be found. Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Request method failure captured: Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b HTTP/1.1 Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDO1J-7SWv-HNmrLj4XvbaK-fFkP4nX4pv06j9xxANFtVy4-AqeWFyKYTTCOiGSf_TWfrYXqO9efeaCkgRr4KSAM1BODj2GJAjuMHNZDHrEtADhEyyrdf5Wk0bc3Bd5AopHf4w0_2SluN476EKxF7cqOs3VJq73uP-9JOg4XtWWuML0M Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_e85e2ac1358a4913bfc77ae8d79802da", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/e85e2ac1358a4913bfc77ae8d79802da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/e85e2ac1358a4913bfc77ae8d79802da"}]}] Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: e85e2ac1358a4913bfc77ae8d79802da Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414181964 Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: da236bec13cf409ca4f644e76fbb5e1b Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestMinimumBasicScenario-1414181964-project Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b could not be found. Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'b2dc1a75-b35b-4dff-b0c2-0d752ec8507b'} Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b could not be found. Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b could not be found. Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:53:11.924269 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b could not be found. Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Returning 404 to user: Instance b2dc1a75-b35b-4dff-b0c2-0d752ec8507b could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b001f2c3-3a57-47e5-95bb-6faeb5b310a9 tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b" status: 404 len: 111 microversion: 2.1 time: 0.031337 Aug 29 16:53:11.929063 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3976/7776] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:11 2022] GET /compute/v2.1/servers/b2dc1a75-b35b-4dff-b0c2-0d752ec8507b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:53:11.935315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6641e1a8-505e-4195-b412-129e0d54ae3c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] Calling method '.version_select at 0x7f32ed393d30>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:11.955797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6641e1a8-505e-4195-b412-129e0d54ae3c tempest-TestMinimumBasicScenario-1414181964 tempest-TestMinimumBasicScenario-1414181964-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-805270372" status: 202 len: 0 microversion: 2.1 time: 0.025130 Aug 29 16:53:11.956381 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3801/7777] 10.222.0.83 () {58 vars in 1269 bytes} [Mon Aug 29 16:53:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-805270372 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:53:21.385121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-31da2cde-8f6f-47d1-9635-49abc6b57196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: .version_select at 0x7f32ee246a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1190474990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADFKhDr6C55u5AbR97rTo2tOSm2oxDJoRPeuf7ZwiDGlnIcfyhVrdZ7C5RuMUrz6nRFjTj1TIsvphefBUrBe+NM0tPLIhwaYbwkc7BehQwqFuzlh/qvdf9ECqTXhQ1U/w=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:21.400606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-31da2cde-8f6f-47d1-9635-49abc6b57196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:53:21.407047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-31da2cde-8f6f-47d1-9635-49abc6b57196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:53:21.433033 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-31da2cde-8f6f-47d1-9635-49abc6b57196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.210060 Aug 29 16:53:21.433690 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3977/7778] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:53:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:27.281280 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1731055231", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "3ffc92c1-10de-4e4d-a0ba-4ab77598754f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1190474990", "security_groups": [{"name": "tempest-secgroup-smoke-505965675"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:27.293501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:27.294179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:27.438207 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] validate_networks() for [('3ffc92c1-10de-4e4d-a0ba-4ab77598754f', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:53:27.917316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:53:27.918603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:53:27.919433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:53:27.920049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:53:27.920948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:53:27.932187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:27.932928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:27.933375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:27.934109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:27.934829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:27.935282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:27.955155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:53:27.961028 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:53:27.975790 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:53:27.978442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:53:28.040496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-710a50bc-6330-41e6-9d2f-eae8ed6f1d16 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763733 Aug 29 16:53:28.043152 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3802/7779] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:53:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:53:28.055400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-09a0878d-2818-4cd2-b636-efe0d91aecc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:28.056211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-09a0878d-2818-4cd2-b636-efe0d91aecc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:28.062101 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:28.064417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:28.169356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-09a0878d-2818-4cd2-b636-efe0d91aecc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:28.179410 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-09a0878d-2818-4cd2-b636-efe0d91aecc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1267 microversion: 2.1 time: 0.128543 Aug 29 16:53:28.194928 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3978/7780] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:28 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:29.203804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:29.204426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:29.210971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:29.211570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:29.212012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:29.212727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:29.213712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:29.214137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:29.293288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:29.304171 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-35430ff1-9e29-410e-b005-10078c72c077 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1319 microversion: 2.1 time: 0.104952 Aug 29 16:53:29.305048 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3803/7781] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:29 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1319 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:30.326570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:30.327242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:30.335759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:30.336288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:30.336750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:30.337498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:30.337972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:30.338549 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:30.495319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:30.504308 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-69575fd1-4517-4437-82b5-8437df7035af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1392 microversion: 2.1 time: 0.182112 Aug 29 16:53:30.504899 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3979/7782] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:30 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:30.848865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ef2a74fb-9ad5-4e12-9272-85aa03f5cf9e req-47de8859-4364-4d6a-bb3f-c0fbdd433de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0102b1-114c-42c9-a7fa-94cdb888b876", "tag": "522bfa27-0136-4e6a-bc9d-2edb52a35e7f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:30.862868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ef2a74fb-9ad5-4e12-9272-85aa03f5cf9e req-47de8859-4364-4d6a-bb3f-c0fbdd433de0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:30.863299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ef2a74fb-9ad5-4e12-9272-85aa03f5cf9e req-47de8859-4364-4d6a-bb3f-c0fbdd433de0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:30.863915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ef2a74fb-9ad5-4e12-9272-85aa03f5cf9e req-47de8859-4364-4d6a-bb3f-c0fbdd433de0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:30.876639 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ef2a74fb-9ad5-4e12-9272-85aa03f5cf9e req-47de8859-4364-4d6a-bb3f-c0fbdd433de0 service nova] Creating event network-changed:522bfa27-0136-4e6a-bc9d-2edb52a35e7f for instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 on n-h1-836830-13 Aug 29 16:53:30.881578 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ef2a74fb-9ad5-4e12-9272-85aa03f5cf9e req-47de8859-4364-4d6a-bb3f-c0fbdd433de0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036581 Aug 29 16:53:30.882117 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3804/7783] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:31.525871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:31.526595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:31.533764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:31.534258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:31.534727 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:31.535455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:31.535923 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:31.536357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:31.674422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:31.684171 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-98e44d50-6e5d-4914-b7bb-d10dc94f32f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1392 microversion: 2.1 time: 0.162307 Aug 29 16:53:31.686366 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3980/7784] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:31 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:32.706505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:32.706890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:32.714709 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:32.715426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:32.715872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:32.716574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:32.717025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:32.717449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:32.854316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:32.862022 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-394dac4e-95f5-4964-8d85-deade335ee51 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1392 microversion: 2.1 time: 0.160066 Aug 29 16:53:32.862595 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3805/7785] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:32 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:33.885409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:33.886207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:33.892949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:33.893452 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:33.893920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:33.894615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:33.895181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:33.895630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:34.031345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:34.039043 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5daea708-41a6-4c10-a139-9b261bed5e54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1392 microversion: 2.1 time: 0.158273 Aug 29 16:53:34.039607 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3981/7786] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:33 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:34.473986 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6fa23513-f449-40ca-8856-8dc3e1000cf3 req-cc2f38e3-9644-48cc-bf57-3e1a12de4147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0102b1-114c-42c9-a7fa-94cdb888b876", "name": "network-vif-plugged", "status": "completed", "tag": "522bfa27-0136-4e6a-bc9d-2edb52a35e7f"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:34.486362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6fa23513-f449-40ca-8856-8dc3e1000cf3 req-cc2f38e3-9644-48cc-bf57-3e1a12de4147 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:34.486362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6fa23513-f449-40ca-8856-8dc3e1000cf3 req-cc2f38e3-9644-48cc-bf57-3e1a12de4147 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:34.486362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6fa23513-f449-40ca-8856-8dc3e1000cf3 req-cc2f38e3-9644-48cc-bf57-3e1a12de4147 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:34.498119 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6fa23513-f449-40ca-8856-8dc3e1000cf3 req-cc2f38e3-9644-48cc-bf57-3e1a12de4147 service nova] Creating event network-vif-plugged:522bfa27-0136-4e6a-bc9d-2edb52a35e7f for instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 on n-h1-836830-13 Aug 29 16:53:34.502998 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6fa23513-f449-40ca-8856-8dc3e1000cf3 req-cc2f38e3-9644-48cc-bf57-3e1a12de4147 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 Aug 29 16:53:34.503627 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3806/7787] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:35.060575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:35.061122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:35.068035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:35.068532 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:35.068979 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:35.069676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:35.070139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:35.070576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:35.204323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:35.212266 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b5a8bd1c-79b5-48c1-aedb-4433d23dfc33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1392 microversion: 2.1 time: 0.156582 Aug 29 16:53:35.212840 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3982/7788] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:35 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:36.235644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:36.236337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:36.242560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:36.243063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:36.243497 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:36.244273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:36.245421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:36.245863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:36.710738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:36.718511 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0a8a7274-6db9-4e4e-a201-897f5026d335 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1564 microversion: 2.1 time: 0.488076 Aug 29 16:53:36.719110 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3807/7789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:36 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1564 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:36.739770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:36.740536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:36.747494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:36.747996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:36.748447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:36.749146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:36.749611 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:36.750078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:36.888066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:36.896373 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-873070c8-5730-48cc-aa3c-80e1abaa8fdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1564 microversion: 2.1 time: 0.161484 Aug 29 16:53:36.896975 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3983/7790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:36 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:53:38.504795 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:53:38.505598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-21b7ee69-f77a-45e4-b074-157aaf524462 req-7361d71c-218f-4f47-930e-6109d5f1b818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0102b1-114c-42c9-a7fa-94cdb888b876", "tag": "522bfa27-0136-4e6a-bc9d-2edb52a35e7f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:53:38.506140 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:53:38.511806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:38.512780 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:38.513883 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:53:38.515649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:38.516145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:38.516759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:38.517625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:38.518239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:38.518384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-21b7ee69-f77a-45e4-b074-157aaf524462 req-7361d71c-218f-4f47-930e-6109d5f1b818 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:53:38.518878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-21b7ee69-f77a-45e4-b074-157aaf524462 req-7361d71c-218f-4f47-930e-6109d5f1b818 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:53:38.519017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:38.519357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-21b7ee69-f77a-45e4-b074-157aaf524462 req-7361d71c-218f-4f47-930e-6109d5f1b818 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:53:38.531902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-21b7ee69-f77a-45e4-b074-157aaf524462 req-7361d71c-218f-4f47-930e-6109d5f1b818 service nova] Creating event network-changed:522bfa27-0136-4e6a-bc9d-2edb52a35e7f for instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 on n-h1-836830-13 Aug 29 16:53:38.537434 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-21b7ee69-f77a-45e4-b074-157aaf524462 req-7361d71c-218f-4f47-930e-6109d5f1b818 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035493 Aug 29 16:53:38.538222 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3984/7791] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:53:38.747450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:53:38.756019 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c19873df-d5b2-45eb-a136-6e97d3e4f640 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1564 microversion: 2.1 time: 0.255139 Aug 29 16:53:38.756856 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3808/7792] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:53:38 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:00.013893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=15 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:00.014658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=32 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:00.019040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:00.021304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:00.028530 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:00.029032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:00.029478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:00.030170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:00.030632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:00.031090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:00.088774 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c4d753d8-2afa-47d0-a406-9c246f19c2ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action" status: 200 len: 24568 microversion: 2.1 time: 0.077363 Aug 29 16:54:00.089625 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3985/7793] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:00 2022] POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action => generated 24568 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:54:11.071665 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:11.072272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:11.074162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:11.075092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=30 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:11.082374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:11.082863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:11.083332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:11.084022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:11.084476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:11.084899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:11.151034 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c156b68a-beed-4011-a080-dfcc0c245276 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action" status: 202 len: 0 microversion: 2.1 time: 0.083197 Aug 29 16:54:11.151722 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3809/7794] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:11 2022] POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:54:11.161106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:11.161831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:11.164795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:11.165547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:11.172388 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:11.172891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:11.173346 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:11.174077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:11.174542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:11.174983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:11.317959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:11.326501 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-932aa0e7-0be9-47c8-826a-5b008c6d7f33 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1688 microversion: 2.1 time: 0.169556 Aug 29 16:54:11.327011 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3986/7795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:11 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:54:12.349950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:12.350653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:12.358513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:12.359002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:12.359539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:12.360262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:12.360718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:12.361143 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:12.495537 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:12.503321 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ab8e2e70-a31c-488b-8a85-47f3c4602dc3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1668 microversion: 2.1 time: 0.157563 Aug 29 16:54:12.503906 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3810/7796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:12 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:13.594741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:13.596986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:13.604774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:13.605277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:13.606318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:13.607085 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:13.607565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:13.608013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:13.660795 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0fa419ea-921b-4884-8e25-5af873625697 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action" status: 200 len: 32642 microversion: 2.1 time: 0.069876 Aug 29 16:54:13.661450 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3987/7797] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:13 2022] POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action => generated 32642 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:54:13.673717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:13.674244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:13.681122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:13.681616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:13.682055 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:13.682746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:13.683239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:13.683672 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:13.753271 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a858891b-728e-4aa0-928a-cfcaee77027c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action" status: 202 len: 0 microversion: 2.1 time: 0.082916 Aug 29 16:54:13.754075 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3811/7798] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:13 2022] POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:54:13.763673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:13.764720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:13.772192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:13.772687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:13.773141 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:13.773839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:13.774305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:13.774758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:13.913927 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:13.923134 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2691a0c-1725-420a-865a-417aaead8833 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1675 microversion: 2.1 time: 0.164357 Aug 29 16:54:13.923723 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3988/7799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:13 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:54:14.946295 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:14.947061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:14.954969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:14.955430 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:14.955873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:14.956563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:14.957020 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:14.957449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:15.094303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:15.102118 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5a8b63ac-5130-4157-9658-65a456777cd0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1683 microversion: 2.1 time: 0.160088 Aug 29 16:54:15.102676 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3812/7800] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:14 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:15.195428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:15.197648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:15.205565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:15.206002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:15.206456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:15.207201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:15.207679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:15.208122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:15.259267 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bae14357-3421-41f0-bf9a-1f65f182ffa9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action" status: 200 len: 38438 microversion: 2.1 time: 0.067737 Aug 29 16:54:15.259913 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3989/7801] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:54:15 2022] POST /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876/action => generated 38438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:54:16.547579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:16.548117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:16.556521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e11298f0-f496-4605-9a4f-fb8ea06a8fd3 req-bde4ede0-14d9-407d-8805-e6ed36756989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0102b1-114c-42c9-a7fa-94cdb888b876", "tag": "522bfa27-0136-4e6a-bc9d-2edb52a35e7f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:16.569082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e11298f0-f496-4605-9a4f-fb8ea06a8fd3 req-bde4ede0-14d9-407d-8805-e6ed36756989 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:16.569534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e11298f0-f496-4605-9a4f-fb8ea06a8fd3 req-bde4ede0-14d9-407d-8805-e6ed36756989 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:16.569975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e11298f0-f496-4605-9a4f-fb8ea06a8fd3 req-bde4ede0-14d9-407d-8805-e6ed36756989 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:16.570757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:16.571436 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:16.571894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:16.572732 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:16.573210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:16.573645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:16.590934 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e11298f0-f496-4605-9a4f-fb8ea06a8fd3 req-bde4ede0-14d9-407d-8805-e6ed36756989 service nova] Creating event network-changed:522bfa27-0136-4e6a-bc9d-2edb52a35e7f for instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 on n-h1-836830-13 Aug 29 16:54:16.596361 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e11298f0-f496-4605-9a4f-fb8ea06a8fd3 req-bde4ede0-14d9-407d-8805-e6ed36756989 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043752 Aug 29 16:54:16.597341 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3990/7802] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:54:16.601728 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:54:16.707845 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-68e91f07-61b2-4ef0-9b94-15872b29e282 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 204 len: 0 microversion: 2.1 time: 0.163842 Aug 29 16:54:16.708837 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3813/7803] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:54:16 2022] DELETE /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:54:16.717752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:16.718502 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:16.725350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:16.726088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:16.726541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:16.727276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:16.727915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:16.728356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:16.869037 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:16.878272 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b3410eb-2170-4cfe-9130-05df51846123 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1689 microversion: 2.1 time: 0.165075 Aug 29 16:54:16.878958 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3991/7804] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:16 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:17.901239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:17.901857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:17.909084 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:17.909558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:17.909992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:17.910676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:17.911158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:17.911579 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:18.085527 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:18.094377 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-46b7491f-676c-471e-92bb-60537e67442f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1689 microversion: 2.1 time: 0.197455 Aug 29 16:54:18.094950 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3814/7805] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:17 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:18.736667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4eeff281-4c3c-4e58-8673-cecf53ab780f req-dd443219-93ef-4696-9fc6-8628ed3937e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0102b1-114c-42c9-a7fa-94cdb888b876", "name": "network-vif-deleted", "tag": "522bfa27-0136-4e6a-bc9d-2edb52a35e7f"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:18.748605 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4eeff281-4c3c-4e58-8673-cecf53ab780f req-dd443219-93ef-4696-9fc6-8628ed3937e0 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:18.749102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4eeff281-4c3c-4e58-8673-cecf53ab780f req-dd443219-93ef-4696-9fc6-8628ed3937e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:18.749545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4eeff281-4c3c-4e58-8673-cecf53ab780f req-dd443219-93ef-4696-9fc6-8628ed3937e0 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:18.763547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4eeff281-4c3c-4e58-8673-cecf53ab780f req-dd443219-93ef-4696-9fc6-8628ed3937e0 service nova] Creating event network-vif-deleted:522bfa27-0136-4e6a-bc9d-2edb52a35e7f for instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 on n-h1-836830-13 Aug 29 16:54:18.768804 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4eeff281-4c3c-4e58-8673-cecf53ab780f req-dd443219-93ef-4696-9fc6-8628ed3937e0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035832 Aug 29 16:54:18.769598 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3992/7806] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:54:19.116668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:19.117312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:19.124442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:19.124941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:19.125616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:19.126590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:19.127083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:19.127635 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:19.162555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:19.163079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:19.163564 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:19.164024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lazy-loading 'fault' on Instance uuid 1d0102b1-114c-42c9-a7fa-94cdb888b876 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:54:19.208556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:19.217273 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4ff00ca1-8827-46c8-95be-b53f252e9839 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 200 len: 1357 microversion: 2.1 time: 0.105258 Aug 29 16:54:19.217933 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3815/7807] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:19 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:20.241539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:20.242294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 1d0102b1-114c-42c9-a7fa-94cdb888b876] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:20.248835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:20.249344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:20.249802 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:20.250506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:20.250981 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:20.251468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:20.264757 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] HTTP exception thrown: Instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 could not be found. Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Request method failure captured: Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 HTTP/1.1 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDO8A8OfBQr9E97Tgn9hzsylqWms-dzavL3XUeAAJS1fpXzfGusJDWFwdJHOLyiPCctY3ENDMWxRrV_lZwWhLZZ6_TijS2VgpDefXGcTrUdODWO5x7qFio_SsWOK_Lw2PQvokxxR22MSONV0GVxyDsnys-AVbsSOouYLmhR_mw99klb0 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_197e7b145ed049b0a37bd871b4a34920", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/197e7b145ed049b0a37bd871b4a34920"}]}] Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a0e53500b97e4c3286d76015abcf6e0a Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 could not be found. Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '1d0102b1-114c-42c9-a7fa-94cdb888b876'} Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 could not be found. Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 could not be found. Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:54:20.266415 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 could not be found. Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Returning 404 to user: Instance 1d0102b1-114c-42c9-a7fa-94cdb888b876 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e6d462ac-3bc5-4667-8963-c38a3e35e49c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876" status: 404 len: 111 microversion: 2.1 time: 0.031521 Aug 29 16:54:20.271386 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3993/7808] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:20 2022] GET /compute/v2.1/servers/1d0102b1-114c-42c9-a7fa-94cdb888b876 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:54:23.571859 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-abaef792-d453-425d-b70c-62ddc2f3a584 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '.version_select at 0x7f32ed39c160>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:23.604733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-abaef792-d453-425d-b70c-62ddc2f3a584 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1190474990" status: 202 len: 0 microversion: 2.1 time: 0.036490 Aug 29 16:54:23.605235 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3816/7809] 10.222.0.83 () {58 vars in 1284 bytes} [Mon Aug 29 16:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1190474990 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:54:23.632092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2b9d1aba-7d20-4ecf-b3d0-bd145b4c4eab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: .version_select at 0x7f32edd05160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-873138284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdfd1NMLHY5Cky6uH7lszJ3+5sAfFf/cIdunFIePOQUdZXgXgjP9UDPUqYizq8rWExbjkYDiD4+tVX/oQvZ8nKhUdEKuXZXY7c6yWxpdVFLRTS5mtN+GegXbA+rYel1DQ=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:23.650013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-2b9d1aba-7d20-4ecf-b3d0-bd145b4c4eab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:54:23.657196 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-2b9d1aba-7d20-4ecf-b3d0-bd145b4c4eab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:54:23.684413 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2b9d1aba-7d20-4ecf-b3d0-bd145b4c4eab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055762 Aug 29 16:54:23.685288 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3994/7810] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:54:23 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:54:29.173740 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-60824083", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "f908fef1-fa30-49bf-bd93-03c143b8737f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-873138284", "security_groups": [{"name": "tempest-secgroup-smoke-521627465"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:29.216412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:29.320850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] validate_networks() for [('f908fef1-fa30-49bf-bd93-03c143b8737f', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:54:29.772336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:54:29.773510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:54:29.774454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:54:29.775147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:54:29.775772 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:54:29.787606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:29.788705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:29.789456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:29.790608 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:29.791219 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:29.791731 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:29.814305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:54:29.819821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:54:29.832687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:54:29.834987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:54:29.883135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-118e1d31-2132-4c71-913e-81bcf1bdda29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719914 Aug 29 16:54:29.884281 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3817/7811] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:54:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:54:29.899220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6ced3c60-8dc8-477a-9435-3510ecdd62dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:29.900029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6ced3c60-8dc8-477a-9435-3510ecdd62dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:29.957214 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6ced3c60-8dc8-477a-9435-3510ecdd62dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:29.964411 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6ced3c60-8dc8-477a-9435-3510ecdd62dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1264 microversion: 2.1 time: 0.072640 Aug 29 16:54:29.965703 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3995/7812] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:29 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1264 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:30.986224 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-80792966-45f6-4d87-9b8e-2a3c48e20425 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:30.987074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-80792966-45f6-4d87-9b8e-2a3c48e20425 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:31.047331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-80792966-45f6-4d87-9b8e-2a3c48e20425 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:31.054744 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-80792966-45f6-4d87-9b8e-2a3c48e20425 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1264 microversion: 2.1 time: 0.072556 Aug 29 16:54:31.055383 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3818/7813] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:30 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1264 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:32.077190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-175199be-55fe-413e-af3b-59b1b9c5ce67 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:32.078415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-175199be-55fe-413e-af3b-59b1b9c5ce67 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:32.081025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=32 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:32.150906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-175199be-55fe-413e-af3b-59b1b9c5ce67 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:32.159487 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-175199be-55fe-413e-af3b-59b1b9c5ce67 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1264 microversion: 2.1 time: 0.086565 Aug 29 16:54:32.160847 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3996/7814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:32 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1264 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:33.181226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-021fed56-ea65-475c-8d9d-085a9382d376 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:33.181839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-021fed56-ea65-475c-8d9d-085a9382d376 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:33.243443 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-021fed56-ea65-475c-8d9d-085a9382d376 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:33.250905 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-021fed56-ea65-475c-8d9d-085a9382d376 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1264 microversion: 2.1 time: 0.073584 Aug 29 16:54:33.251519 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3819/7815] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:33 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1264 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:34.272058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:34.272685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:34.280467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:34.280963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:34.281410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:34.282106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:34.282567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:34.283003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:34.344594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:34.352328 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c3408cbd-d415-4b2a-93b9-e1b4239c4d21 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1268 microversion: 2.1 time: 0.084250 Aug 29 16:54:34.352904 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3997/7816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:34 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1268 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:35.374271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:35.374948 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:35.382278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.382771 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.383380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.384192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:35.384676 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:35.385107 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:35.448341 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:35.456316 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd321a70-ffee-4c93-8f2c-5904b6af8dff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1322 microversion: 2.1 time: 0.086860 Aug 29 16:54:35.456990 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3820/7817] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:35 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:36.477761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:36.478488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:36.485741 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:36.486241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:36.486688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:36.487428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:36.487895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:36.488331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:36.526433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-abf6bc8f-520d-4980-9f5f-3ef196367c3a req-eacd91ab-607f-4e9d-a704-068a4f813c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070fb22e-3592-4495-bba8-472087cc277c", "tag": "a27bae57-44b5-4316-9203-e61527c7ca98"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:36.540979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-abf6bc8f-520d-4980-9f5f-3ef196367c3a req-eacd91ab-607f-4e9d-a704-068a4f813c53 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:36.542539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-abf6bc8f-520d-4980-9f5f-3ef196367c3a req-eacd91ab-607f-4e9d-a704-068a4f813c53 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:36.543127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-abf6bc8f-520d-4980-9f5f-3ef196367c3a req-eacd91ab-607f-4e9d-a704-068a4f813c53 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:36.555541 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-abf6bc8f-520d-4980-9f5f-3ef196367c3a req-eacd91ab-607f-4e9d-a704-068a4f813c53 service nova] Creating event network-changed:a27bae57-44b5-4316-9203-e61527c7ca98 for instance 070fb22e-3592-4495-bba8-472087cc277c on n-h1-836830-13 Aug 29 16:54:36.562207 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-abf6bc8f-520d-4980-9f5f-3ef196367c3a req-eacd91ab-607f-4e9d-a704-068a4f813c53 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040179 Aug 29 16:54:36.562826 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3821/7818] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:54:36.757721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:36.767446 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ab9eaaac-5e22-4638-892a-3749ba707090 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1389 microversion: 2.1 time: 0.293590 Aug 29 16:54:36.768037 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3998/7819] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:36 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1389 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:37.788014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:37.788636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:37.795886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:37.796372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:37.796813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:37.797499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:37.797954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:37.798378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:37.937766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:37.949976 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-028b6509-b0d4-4f2c-a9ae-2778ac616aff tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1389 microversion: 2.1 time: 0.165163 Aug 29 16:54:37.950581 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3822/7820] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:37 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:38.971779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:38.972419 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:38.980056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:38.981461 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:38.982025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:38.982754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:38.983269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:38.983719 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:39.118545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:39.126940 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b40127f5-47d3-40a9-8100-a005c6d64048 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1389 microversion: 2.1 time: 0.159403 Aug 29 16:54:39.127579 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 3999/7821] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:38 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:54:40.147882 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:40.148504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:40.151807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:40.157583 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:40.158070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:40.158509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:40.159228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:40.159687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:40.160118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:40.297761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:40.305601 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-032aa19b-188d-4543-b01d-581991b64cd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1389 microversion: 2.1 time: 0.161576 Aug 29 16:54:40.306385 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3823/7822] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:40 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:40.656766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-4a89121d-a1b3-4480-a446-f32073bd2bf8 req-db74e2ce-e811-44cd-a464-5c63c8607d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070fb22e-3592-4495-bba8-472087cc277c", "name": "network-vif-plugged", "status": "completed", "tag": "a27bae57-44b5-4316-9203-e61527c7ca98"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:40.668204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4a89121d-a1b3-4480-a446-f32073bd2bf8 req-db74e2ce-e811-44cd-a464-5c63c8607d7b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:40.668707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4a89121d-a1b3-4480-a446-f32073bd2bf8 req-db74e2ce-e811-44cd-a464-5c63c8607d7b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:40.669154 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-4a89121d-a1b3-4480-a446-f32073bd2bf8 req-db74e2ce-e811-44cd-a464-5c63c8607d7b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:40.680937 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-4a89121d-a1b3-4480-a446-f32073bd2bf8 req-db74e2ce-e811-44cd-a464-5c63c8607d7b service nova] Creating event network-vif-plugged:a27bae57-44b5-4316-9203-e61527c7ca98 for instance 070fb22e-3592-4495-bba8-472087cc277c on n-h1-836830-13 Aug 29 16:54:40.686587 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-4a89121d-a1b3-4480-a446-f32073bd2bf8 req-db74e2ce-e811-44cd-a464-5c63c8607d7b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034151 Aug 29 16:54:40.687716 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4000/7823] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:54:41.327967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:41.328584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:41.331312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:41.337038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:41.337523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:41.337960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:41.338646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:41.339122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:41.339623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:41.473696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:41.482199 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7b7adda5-85e5-47cf-bb22-6df79298efa1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1389 microversion: 2.1 time: 0.159049 Aug 29 16:54:41.482776 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3824/7824] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:41 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:42.500989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=8 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:42.505138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:42.505848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:42.507662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:42.513864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:42.514358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:42.514811 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:42.515534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:42.516004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:42.516437 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:42.654722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:42.662573 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dff613df-6842-46aa-96be-f22699c77b54 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1560 microversion: 2.1 time: 0.163417 Aug 29 16:54:42.663179 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4001/7825] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:42 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:42.683007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:42.683781 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:42.690853 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:42.691415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:42.691856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:42.692551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:42.693010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:42.693440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:42.829846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:42.837703 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9a5c572e-f462-4063-bd05-191594f84907 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1560 microversion: 2.1 time: 0.158565 Aug 29 16:54:42.838292 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3825/7826] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:42 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:44.753685 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:54:44.759042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-25dd5ec7-819c-4193-b8b9-18c23ba5e194 req-e23058e6-6ab7-48f5-8734-ebf32eb8b8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070fb22e-3592-4495-bba8-472087cc277c", "tag": "a27bae57-44b5-4316-9203-e61527c7ca98"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:54:44.759654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:54:44.766300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=10 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:54:44.768938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:44.769577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:44.770042 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:44.770772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:44.771271 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:44.771406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-25dd5ec7-819c-4193-b8b9-18c23ba5e194 req-e23058e6-6ab7-48f5-8734-ebf32eb8b8d7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:54:44.771718 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:44.771879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-25dd5ec7-819c-4193-b8b9-18c23ba5e194 req-e23058e6-6ab7-48f5-8734-ebf32eb8b8d7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:54:44.772507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-25dd5ec7-819c-4193-b8b9-18c23ba5e194 req-e23058e6-6ab7-48f5-8734-ebf32eb8b8d7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:54:44.922288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:54:44.931157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cdbf156d-8acf-4e5e-b104-f4a937142751 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1560 microversion: 2.1 time: 0.181647 Aug 29 16:54:44.931756 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4002/7827] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:54:44 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:54:45.045031 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-25dd5ec7-819c-4193-b8b9-18c23ba5e194 req-e23058e6-6ab7-48f5-8734-ebf32eb8b8d7 service nova] Creating event network-changed:a27bae57-44b5-4316-9203-e61527c7ca98 for instance 070fb22e-3592-4495-bba8-472087cc277c on n-h1-836830-13 Aug 29 16:54:45.050635 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-25dd5ec7-819c-4193-b8b9-18c23ba5e194 req-e23058e6-6ab7-48f5-8734-ebf32eb8b8d7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295073 Aug 29 16:54:45.051297 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3826/7828] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:55:06.192239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:55:06.195616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:06.197848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:06.200167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=32 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:06.206429 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:06.206931 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:06.207400 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:06.208110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:06.208572 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:06.209006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:06.260207 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e064a988-83e1-42b7-80e5-e7e6aaa26d60 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c/action" status: 200 len: 24570 microversion: 2.1 time: 0.073426 Aug 29 16:55:06.260847 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4003/7829] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:55:06 2022] POST /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:55:17.309183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:55:17.312407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:17.314548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=5 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:17.315229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=36 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:17.321332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:17.321826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:17.322260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:17.322952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:17.323434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:17.323857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:17.397915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-372d1986-0eb9-49b1-915a-8486a05eb648 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c/action" status: 202 len: 0 microversion: 2.1 time: 0.092995 Aug 29 16:55:17.398747 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3827/7830] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:55:17 2022] POST /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:55:17.408370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:17.409086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:17.412219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:17.413133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:17.419851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:17.420339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:17.420816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:17.421650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:17.422002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:17.422439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:17.647469 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:17.655852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-221e3415-acf2-4641-b610-fd195377ce62 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1671 microversion: 2.1 time: 0.251838 Aug 29 16:55:17.656732 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4004/7831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:17 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1671 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:18.679406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:18.680116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:18.686592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:18.687106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:18.687550 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:18.688238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:18.688697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:18.689125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:18.828607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:18.836442 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f7af465-a28a-4107-99d5-2d0ea395fc98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.162160 Aug 29 16:55:18.837005 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3828/7832] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:18 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:19.857903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:19.858595 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:19.866645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:19.867182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:19.867646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:19.868347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:19.868820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:19.869265 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:20.005833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:20.013630 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-543b1004-14f4-43db-8856-e063c1299bf4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.159784 Aug 29 16:55:20.014431 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4005/7833] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:19 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:21.034687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:21.035274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:21.041395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:21.041898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:21.042345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:21.043070 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:21.043538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:21.043979 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:21.179495 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:21.188407 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c3d3c556-994a-4b9d-81ef-9ed45f7c3e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.157983 Aug 29 16:55:21.189000 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3829/7834] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:21 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:22.209373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:22.210000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:22.216815 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:22.217725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:22.218029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:22.218682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:22.219178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:22.219616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:22.355864 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:22.363822 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-603f8b18-7cfb-4af9-8b70-6277806050e4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.158435 Aug 29 16:55:22.364404 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4006/7835] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:22 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:23.385082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:23.385700 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:23.393148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:23.393644 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:23.394088 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:23.394789 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:23.395290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:23.395722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:23.530358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:23.538203 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a198dce4-683e-4ac9-8a65-87cf6f140295 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.156994 Aug 29 16:55:23.538771 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3830/7836] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:23 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:24.559638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:24.560537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:24.568059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:24.568594 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:24.569050 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:24.569766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:24.570239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:24.570681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:24.701261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:24.709394 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2e7b3272-229e-4756-825a-6e6e4608652a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.153872 Aug 29 16:55:24.709909 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4007/7837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:24 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:25.730687 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:25.731346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:25.738361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:25.738857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:25.739340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:25.740042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:25.740505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:25.740937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:25.875134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:25.882945 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c19d2d0f-f2bb-41e3-95a0-fff8cd79c7fa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.156164 Aug 29 16:55:25.883552 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3831/7838] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:25 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:26.906656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:26.907353 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:26.914773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:26.915313 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:26.915762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:26.916462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:26.916924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:26.917364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:27.056662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:27.065215 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7fb0c92e-f0f0-48ca-846f-b38d36876509 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.163224 Aug 29 16:55:27.065803 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4008/7839] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:26 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:28.086697 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:28.087363 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:28.095063 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:28.095548 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:28.095991 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:28.096685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:28.097141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:28.097571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:28.231318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:28.240820 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-15cc475a-7410-4761-a68f-66fa8ea2e8b2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.157721 Aug 29 16:55:28.241538 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3832/7840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:28 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:29.261410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:29.262045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:29.269677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:29.270177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:29.270628 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:29.271358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:29.271832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:29.272273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:29.406584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:29.414404 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e738fb5e-f2d6-4fbe-8b7c-ef80fc8aa36f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.156979 Aug 29 16:55:29.414977 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4009/7841] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:29 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:30.436454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:30.437103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:30.443951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:30.444437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:30.444873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:30.445558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:30.446009 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:30.446433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:30.581155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:30.588871 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e8fcee38-534b-4555-9cc5-624efc484372 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.156705 Aug 29 16:55:30.589439 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3833/7842] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:30 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:31.611201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:31.611850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:31.618800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:31.619339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:31.619871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:31.620640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:31.621123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:31.621576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:31.758639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:31.767868 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1698894d-f4c9-4a58-9990-cbc7198095e2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.161367 Aug 29 16:55:31.768460 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4010/7843] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:31 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:32.789151 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:32.789777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:32.797065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:32.797565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:32.798010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:32.798716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:32.799246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:32.799682 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:32.932944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:32.941312 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7eaf0a74-f492-4734-b95a-b4e8a772390b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1676 microversion: 2.1 time: 0.156160 Aug 29 16:55:32.941916 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3834/7844] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:32 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:33.962168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:55:33.962804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:33.970203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:33.970819 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:33.971296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:33.971993 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:33.972458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:33.972890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:34.105376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:55:34.114060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-593fb8e8-b085-40cd-a34c-978d8dd48ade tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1679 microversion: 2.1 time: 0.155966 Aug 29 16:55:34.114634 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4011/7845] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:55:33 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:55:58.300342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:55:58.302625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:55:58.305139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:58.305816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:55:58.312375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:58.312875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:58.313325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:58.314031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:55:58.314503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:55:58.314937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:55:58.372312 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-31347149-b3cf-4cab-b4ab-3937902d4439 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c/action" status: 200 len: 68914 microversion: 2.1 time: 0.075692 Aug 29 16:55:58.372987 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3835/7846] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:55:58 2022] POST /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c/action => generated 68914 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 16:56:05.533999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:05.535282 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:05.536759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-562b1e6b-4fe5-4f6f-97bb-f18757367347 req-91827dae-43f5-4c05-84fa-3d88afbb843c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070fb22e-3592-4495-bba8-472087cc277c", "tag": "a27bae57-44b5-4316-9203-e61527c7ca98"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:05.538509 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=16 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:05.539434 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=48 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:05.545935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:05.546528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:05.547104 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:05.548123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:05.548668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:05.549182 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:05.549959 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-562b1e6b-4fe5-4f6f-97bb-f18757367347 req-91827dae-43f5-4c05-84fa-3d88afbb843c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:05.550605 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-562b1e6b-4fe5-4f6f-97bb-f18757367347 req-91827dae-43f5-4c05-84fa-3d88afbb843c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:05.551177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-562b1e6b-4fe5-4f6f-97bb-f18757367347 req-91827dae-43f5-4c05-84fa-3d88afbb843c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:05.564388 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-562b1e6b-4fe5-4f6f-97bb-f18757367347 req-91827dae-43f5-4c05-84fa-3d88afbb843c service nova] Creating event network-changed:a27bae57-44b5-4316-9203-e61527c7ca98 for instance 070fb22e-3592-4495-bba8-472087cc277c on n-h1-836830-13 Aug 29 16:56:05.570651 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-562b1e6b-4fe5-4f6f-97bb-f18757367347 req-91827dae-43f5-4c05-84fa-3d88afbb843c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038424 Aug 29 16:56:05.571744 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3836/7847] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:56:05.584417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:56:05.674441 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3bfec9da-426e-4eb2-bfd3-aa147a64a27d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 204 len: 0 microversion: 2.1 time: 0.144467 Aug 29 16:56:05.676126 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4012/7848] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:56:05 2022] DELETE /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:56:05.685468 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:05.686445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:05.693807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:05.694651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:05.695233 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:05.696330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:05.696816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:05.697250 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:05.853581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:05.863696 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1300c323-44c4-4d3d-90f6-f88888f32ec4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1685 microversion: 2.1 time: 0.182189 Aug 29 16:56:05.867055 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3837/7849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:05 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:06.886376 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:06.886999 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:06.895258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:06.895941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:06.896396 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:06.897148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:06.897619 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:06.898063 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:07.080744 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:07.089617 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-38ef08bc-cbcd-4140-a35d-d76b68e0250c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1685 microversion: 2.1 time: 0.207527 Aug 29 16:56:07.090237 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4013/7850] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:06 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:07.651861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-e65120fa-e8b1-4eda-932b-3256e7c62630 req-c2281c2c-5e02-4d2e-982a-6a0d92fb1028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070fb22e-3592-4495-bba8-472087cc277c", "name": "network-vif-deleted", "tag": "a27bae57-44b5-4316-9203-e61527c7ca98"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:07.663657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e65120fa-e8b1-4eda-932b-3256e7c62630 req-c2281c2c-5e02-4d2e-982a-6a0d92fb1028 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:07.664142 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e65120fa-e8b1-4eda-932b-3256e7c62630 req-c2281c2c-5e02-4d2e-982a-6a0d92fb1028 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:07.664571 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-e65120fa-e8b1-4eda-932b-3256e7c62630 req-c2281c2c-5e02-4d2e-982a-6a0d92fb1028 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:07.675476 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-e65120fa-e8b1-4eda-932b-3256e7c62630 req-c2281c2c-5e02-4d2e-982a-6a0d92fb1028 service nova] Creating event network-vif-deleted:a27bae57-44b5-4316-9203-e61527c7ca98 for instance 070fb22e-3592-4495-bba8-472087cc277c on n-h1-836830-13 Aug 29 16:56:07.681171 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-e65120fa-e8b1-4eda-932b-3256e7c62630 req-c2281c2c-5e02-4d2e-982a-6a0d92fb1028 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Aug 29 16:56:07.681756 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3838/7851] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:56:08.111503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:08.112304 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:08.120150 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:08.120676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:08.121153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:08.122299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:08.122836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:08.123342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:08.160355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:08.160807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:08.161365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:08.161899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lazy-loading 'fault' on Instance uuid 070fb22e-3592-4495-bba8-472087cc277c {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:56:08.208935 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:08.216125 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a435dfa1-fcba-442c-9396-ed0bdd3e4d44 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 200 len: 1354 microversion: 2.1 time: 0.108654 Aug 29 16:56:08.216708 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4014/7852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:08 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 1354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:09.239385 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:09.240094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 070fb22e-3592-4495-bba8-472087cc277c] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:09.246633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:09.247156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:09.247606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:09.248307 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:09.248770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:09.249201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:09.267943 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] HTTP exception thrown: Instance 070fb22e-3592-4495-bba8-472087cc277c could not be found. Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Request method failure captured: Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c HTTP/1.1 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDO8A8OfBQr9E97Tgn9hzsylqWms-dzavL3XUeAAJS1fpXzfGusJDWFwdJHOLyiPCctY3ENDMWxRrV_lZwWhLZZ6_TijS2VgpDefXGcTrUdODWO5x7qFio_SsWOK_Lw2PQvokxxR22MSONV0GVxyDsnys-AVbsSOouYLmhR_mw99klb0 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_197e7b145ed049b0a37bd871b4a34920", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/197e7b145ed049b0a37bd871b4a34920"}]}] Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a0e53500b97e4c3286d76015abcf6e0a Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 070fb22e-3592-4495-bba8-472087cc277c could not be found. Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '070fb22e-3592-4495-bba8-472087cc277c'} Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070fb22e-3592-4495-bba8-472087cc277c could not be found. Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070fb22e-3592-4495-bba8-472087cc277c could not be found. Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:56:09.270291 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070fb22e-3592-4495-bba8-472087cc277c could not be found. Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Returning 404 to user: Instance 070fb22e-3592-4495-bba8-472087cc277c could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-992ffabb-e7b4-49ff-a7de-55ec24ba656f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c" status: 404 len: 111 microversion: 2.1 time: 0.037846 Aug 29 16:56:09.275553 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3839/7853] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:09 2022] GET /compute/v2.1/servers/070fb22e-3592-4495-bba8-472087cc277c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:56:12.652170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-30f3487d-9b63-43c9-be37-0599a689df3e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '.version_select at 0x7f32ee96ec10>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:12.674380 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-30f3487d-9b63-43c9-be37-0599a689df3e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-873138284" status: 202 len: 0 microversion: 2.1 time: 0.026229 Aug 29 16:56:12.675016 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4015/7854] 10.222.0.83 () {58 vars in 1281 bytes} [Mon Aug 29 16:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-873138284 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:56:12.708586 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-63a89f38-46b8-4559-a773-ae8baa5fb83e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: .version_select at 0x7f32ef47c5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1502326671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbcvn4/BOw4q03ZWuQ4QwbiWwvrg4qNIqcOgSrWn1n+t7P1VxXLmOFZUqeNfiwr918jNU8Qe0z3BTcFTNePpQeNxSC28BAXQS37yAnRqccEk9LfA8tYtB+nS4k8u/hz4Q=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:12.728611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-63a89f38-46b8-4559-a773-ae8baa5fb83e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:56:12.733691 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-63a89f38-46b8-4559-a773-ae8baa5fb83e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:56:12.757913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-63a89f38-46b8-4559-a773-ae8baa5fb83e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053805 Aug 29 16:56:12.758534 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3840/7855] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:56:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:56:18.606732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1932019794", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "6fee069c-8229-460d-8d9d-f19ae4db290d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1502326671", "security_groups": [{"name": "tempest-secgroup-smoke-113522854"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:18.618159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:18.730225 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] validate_networks() for [('6fee069c-8229-460d-8d9d-f19ae4db290d', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:56:18.978461 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:56:18.978628 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.83) !!! Aug 29 16:56:19.243770 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:56:19.247188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:56:19.247957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:56:19.248590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:56:19.249033 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:56:19.260776 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:19.261378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:19.262051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:19.263873 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:19.264373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:19.264834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:19.286215 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:56:19.293486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:56:19.308204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:56:19.310564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:56:19.369992 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f1d7fc45-fef8-4ed9-94d9-9f7d88649307 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767400 Aug 29 16:56:19.371294 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4016/7856] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:56:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:56:19.381204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=16 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:19.386012 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-cbbc8799-2580-4e9b-94c8-3c889fe243c7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:19.386648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-cbbc8799-2580-4e9b-94c8-3c889fe243c7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:19.468359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-cbbc8799-2580-4e9b-94c8-3c889fe243c7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:19.475277 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-cbbc8799-2580-4e9b-94c8-3c889fe243c7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1267 microversion: 2.1 time: 0.097127 Aug 29 16:56:19.476024 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3841/7857] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:19 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:20.497460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca3802a2-2629-4b41-90f1-fee381dae953 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:20.498088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca3802a2-2629-4b41-90f1-fee381dae953 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:20.586555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca3802a2-2629-4b41-90f1-fee381dae953 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:20.593817 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca3802a2-2629-4b41-90f1-fee381dae953 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1267 microversion: 2.1 time: 0.100210 Aug 29 16:56:20.594655 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4017/7858] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:20 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:21.614645 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-32f28f4e-3037-4504-b476-b874c3d918dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:21.615348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-32f28f4e-3037-4504-b476-b874c3d918dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:21.677265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-32f28f4e-3037-4504-b476-b874c3d918dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:21.692527 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-32f28f4e-3037-4504-b476-b874c3d918dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1267 microversion: 2.1 time: 0.082535 Aug 29 16:56:21.693170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3842/7859] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:21 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:22.714136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0164a6e3-75dc-4576-ba19-fd3f5ca12e6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:22.715002 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0164a6e3-75dc-4576-ba19-fd3f5ca12e6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:22.773647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0164a6e3-75dc-4576-ba19-fd3f5ca12e6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:22.783116 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0164a6e3-75dc-4576-ba19-fd3f5ca12e6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1267 microversion: 2.1 time: 0.072973 Aug 29 16:56:22.783701 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4018/7860] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:22 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:23.806945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:23.807614 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:23.815651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:23.816873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:23.817533 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:23.818449 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:23.818910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:23.819386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:23.883767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:23.892273 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7db1e8bd-7a30-4eb2-8298-bcc24c0904f0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1271 microversion: 2.1 time: 0.088682 Aug 29 16:56:23.892480 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3843/7861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:23 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:24.913978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:24.914623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:24.922785 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:24.923334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:24.923795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:24.924519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:24.924995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:24.925534 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:24.993806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:25.001894 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f23f8bf3-8d51-435d-825d-23ef1ce58d91 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1325 microversion: 2.1 time: 0.092864 Aug 29 16:56:25.002469 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4019/7862] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:24 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1325 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:25.838398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-bb4f17e7-6b03-4975-9d46-04b2eaab04a4 req-2ab5e92a-c306-486e-a27a-013244759f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:25.851523 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bb4f17e7-6b03-4975-9d46-04b2eaab04a4 req-2ab5e92a-c306-486e-a27a-013244759f88 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:25.852011 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bb4f17e7-6b03-4975-9d46-04b2eaab04a4 req-2ab5e92a-c306-486e-a27a-013244759f88 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:25.852477 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-bb4f17e7-6b03-4975-9d46-04b2eaab04a4 req-2ab5e92a-c306-486e-a27a-013244759f88 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:25.864663 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-bb4f17e7-6b03-4975-9d46-04b2eaab04a4 req-2ab5e92a-c306-486e-a27a-013244759f88 service nova] Creating event network-changed:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h1-836830-13 Aug 29 16:56:25.869612 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-bb4f17e7-6b03-4975-9d46-04b2eaab04a4 req-2ab5e92a-c306-486e-a27a-013244759f88 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035016 Aug 29 16:56:25.870220 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3844/7863] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:56:26.023956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:26.024584 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:26.032162 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:26.032667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:26.033117 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:26.033823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:26.034285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:26.035307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:26.182115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:26.192655 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c8f78835-0e5e-4fd2-88d5-40fa1adc705d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1392 microversion: 2.1 time: 0.172849 Aug 29 16:56:26.193254 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4020/7864] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:26 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:27.221520 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:27.224754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:27.233831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:27.234598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:27.235175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:27.236069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:27.237179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:27.238445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:27.974374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:27.982493 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-445f755a-97c8-444e-ba05-4d5a0ced37b6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1392 microversion: 2.1 time: 0.771284 Aug 29 16:56:27.983088 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3845/7865] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:27 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1392 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:29.004831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:29.005360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:29.011686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:29.012189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:29.012641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:29.013375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:29.013845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:29.014342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:29.177403 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-fddcabc6-0c7f-466f-9f2c-93c83cc8f499 req-94df46e8-3a18-41e1-a1d9-d35d73b26b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "name": "network-vif-plugged", "status": "completed", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:29.185510 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:29.189931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fddcabc6-0c7f-466f-9f2c-93c83cc8f499 req-94df46e8-3a18-41e1-a1d9-d35d73b26b8c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:29.190444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fddcabc6-0c7f-466f-9f2c-93c83cc8f499 req-94df46e8-3a18-41e1-a1d9-d35d73b26b8c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:29.190942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-fddcabc6-0c7f-466f-9f2c-93c83cc8f499 req-94df46e8-3a18-41e1-a1d9-d35d73b26b8c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:29.204115 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-fddcabc6-0c7f-466f-9f2c-93c83cc8f499 req-94df46e8-3a18-41e1-a1d9-d35d73b26b8c service nova] Creating event network-vif-plugged:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h1-836830-13 Aug 29 16:56:29.210280 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-fddcabc6-0c7f-466f-9f2c-93c83cc8f499 req-94df46e8-3a18-41e1-a1d9-d35d73b26b8c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037637 Aug 29 16:56:29.210896 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3846/7866] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:56:29.224207 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:29.232192 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a65f3ce3-76f6-4b0a-9f3c-4324c3159597 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1392 microversion: 2.1 time: 0.232351 Aug 29 16:56:29.233009 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4021/7867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:28 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:30.255890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:30.256590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:30.263273 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:30.263767 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:30.264266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:30.264988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:30.265456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:30.265892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:30.400340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:30.408310 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-52de7ac7-4363-4efe-a1ca-2b577839a45d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1392 microversion: 2.1 time: 0.158200 Aug 29 16:56:30.408900 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3847/7868] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:30 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:31.429733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:31.430269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:31.432144 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:31.438504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:31.439000 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:31.439472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:31.440163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:31.441386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:31.442032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:31.574423 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:31.582573 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bf6d38e5-b187-450d-b142-a24be05259fe tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1564 microversion: 2.1 time: 0.157372 Aug 29 16:56:31.583166 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4022/7869] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:31 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:31.602574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:31.603460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:31.610877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:31.611405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:31.611857 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:31.613067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:31.613546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:31.613976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:31.692051 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=8 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:31.751554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:31.760276 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-39e8b325-82f3-454b-b2f6-9ac862361ed5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1564 microversion: 2.1 time: 0.161629 Aug 29 16:56:31.760853 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3848/7870] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:31 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:33.384286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:56:33.384919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:33.386577 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-4075c1ac-6210-4b06-9180-15fe0add7f77 req-feb71937-b03a-4835-9c51-ebed528ac233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:33.387674 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=10 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:33.392978 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:33.393777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:33.394421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:33.395159 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:33.395630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:33.396244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:33.397253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4075c1ac-6210-4b06-9180-15fe0add7f77 req-feb71937-b03a-4835-9c51-ebed528ac233 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:33.397739 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4075c1ac-6210-4b06-9180-15fe0add7f77 req-feb71937-b03a-4835-9c51-ebed528ac233 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:33.398170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-4075c1ac-6210-4b06-9180-15fe0add7f77 req-feb71937-b03a-4835-9c51-ebed528ac233 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:33.417226 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-4075c1ac-6210-4b06-9180-15fe0add7f77 req-feb71937-b03a-4835-9c51-ebed528ac233 service nova] Creating event network-changed:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h1-836830-13 Aug 29 16:56:33.422614 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-4075c1ac-6210-4b06-9180-15fe0add7f77 req-feb71937-b03a-4835-9c51-ebed528ac233 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039808 Aug 29 16:56:33.423477 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3849/7871] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:56:33.558620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:56:33.568391 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c60979d5-5f05-4ac3-ab55-5187e663e412 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1564 microversion: 2.1 time: 0.187907 Aug 29 16:56:33.568989 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4023/7872] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:56:33 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:56:54.824014 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=7 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:54.824770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=30 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:56:54.829081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:56:54.831428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:56:54.838416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:54.838895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:54.839351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:54.840038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:56:54.840487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:56:54.840910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:56:54.893624 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-12176994-1520-40f8-a259-1881bb9ef679 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action" status: 200 len: 24581 microversion: 2.1 time: 0.071320 Aug 29 16:56:54.894541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3850/7873] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:56:54 2022] POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action => generated 24581 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:57:05.842523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:57:05.844949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:05.846957 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:05.847717 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=32 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:05.853971 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:05.854477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:05.854925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:05.855652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:05.856122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:05.856565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:05.898758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:05.905160 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Old instance type m1.heat2, new instance type m1.heat {{(pid=129133) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 29 16:57:05.912093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:57:05.912645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:57:05.913023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:57:05.913447 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:57:05.913871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:57:05.977956 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8584ab6-ad38-4b43-a61a-32a0aea98908 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action" status: 202 len: 0 microversion: 2.1 time: 0.139616 Aug 29 16:57:05.978501 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4024/7874] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:57:05 2022] POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:57:05.988555 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:05.990183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:05.992950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:05.993606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:57:05.999679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:06.000182 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:06.000611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:06.001312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:06.001768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:06.002203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:06.173519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:06.182636 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d58af2c0-457f-41ad-bb53-230578e48154 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1692 microversion: 2.1 time: 0.198309 Aug 29 16:57:06.183253 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3851/7875] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:05 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1692 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:07.206475 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:07.207206 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:07.214489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:07.215003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:07.215545 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:07.216266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:07.216769 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:07.217260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:07.362688 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:07.371049 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b7c7ea63-64f9-49ab-a885-2cfa318259e5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1692 microversion: 2.1 time: 0.170171 Aug 29 16:57:07.371628 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4025/7876] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:07 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:08.392750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:08.393310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:08.400534 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:08.401006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:08.401457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:08.402161 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:08.402622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:08.403077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:08.535513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:08.544168 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7b52b10-da26-49a4-b3a9-90141d96b520 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.155496 Aug 29 16:57:08.544743 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3852/7877] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:08 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:09.566067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:09.566704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:09.573706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:09.574201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:09.574646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:09.575379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:09.575850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:09.576283 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:09.717845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:09.725686 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-156b5ac9-b336-420f-a99c-5ee4f638d832 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.163600 Aug 29 16:57:09.726263 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4026/7878] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:09 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:10.746747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:10.747393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:10.754299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:10.755350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:10.755865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:10.756572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:10.757042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:10.757466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:10.892812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:10.900739 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9f70906c-4059-4520-9944-3fabff746a68 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.158143 Aug 29 16:57:10.901321 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3853/7879] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:10 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:11.921794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:11.922453 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:11.929697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:11.930197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:11.930650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:11.931379 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:11.931851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:11.932293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:12.065579 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:12.073624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8ed525e0-557a-422c-b31a-d20b1ada6a98 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.155744 Aug 29 16:57:12.074205 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4027/7880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:11 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:13.094576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:13.095902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:13.104324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:13.105298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:13.105450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:13.106058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:13.106515 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:13.106931 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:13.244300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:13.252484 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e7287baa-29c5-4c4c-a770-d28134f56eaa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.162092 Aug 29 16:57:13.253065 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3854/7881] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:13 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:14.275554 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:14.276204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:14.283310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:14.283806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:14.284252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:14.284945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:14.285425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:14.285854 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:14.419422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:14.427597 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d7bd0535-99af-4ea6-a7d0-522c429ef8d0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.156592 Aug 29 16:57:14.428168 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4028/7882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:14 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:15.449358 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:15.450006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:15.457248 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:15.457736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:15.458176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:15.458872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:15.459355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:15.459788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:15.594359 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:15.602758 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a8a4b383-4c79-45c5-a2d0-bacd8b2bfb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.157306 Aug 29 16:57:15.603378 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3855/7883] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:15 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:16.624367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:16.624991 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:16.632941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:16.633432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:16.633880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:16.634578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:16.635092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:16.635527 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:16.774683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:16.784547 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-142a6f58-f1f4-41ad-9f5c-0e55db0455a8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.164210 Aug 29 16:57:16.785128 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4029/7884] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:16 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:17.807209 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:17.807826 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:17.815158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:17.815643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:17.816072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:17.816759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:17.817239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:17.817660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:17.950981 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:17.958733 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f7cbbdff-caec-4025-8a52-ba3529d81da8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.156279 Aug 29 16:57:17.959293 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3856/7885] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:17 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:18.981116 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:18.981704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:18.988573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:18.989068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:18.989517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:18.990210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:18.990672 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:18.991132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:19.127583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:19.136043 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff457408-975d-4dab-96c0-57d08f1ae095 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.159832 Aug 29 16:57:19.136622 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4030/7886] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:18 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:20.158128 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:20.158680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:20.167156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:20.167886 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:20.168149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:20.168858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:20.169322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:20.169752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:20.301568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:20.309363 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-26273813-05ec-48f2-aaaf-4939e2750196 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.155412 Aug 29 16:57:20.309946 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3857/7887] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:20 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:21.330857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:21.331510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:21.338891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:21.339333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:21.339780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:21.340483 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:21.340980 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:21.341418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:21.477556 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:21.485356 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-138e9ddf-cb1a-4298-811c-606bdd6a3ce1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.158441 Aug 29 16:57:21.485927 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4031/7888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:21 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:22.507042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:22.507711 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:22.514680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:22.515212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:22.515659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:22.516353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:22.516813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:22.517245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:22.652077 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:22.659913 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e782d8d8-66a4-41fb-a7b7-b3d90e7a54e7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.156857 Aug 29 16:57:22.660489 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3858/7889] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:22 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:23.682385 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:23.683012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:23.690252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:23.690755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:23.691250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:23.691963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:23.692438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:23.692881 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:23.833195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:23.841592 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8cfdb91c-cc3c-44f2-9765-d732c63db9ea tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.163754 Aug 29 16:57:23.842179 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4032/7890] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:23 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:24.863796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:24.864354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:24.872003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:24.872464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:24.872876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:24.873610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:24.874074 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:24.874508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:25.005766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:25.014278 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0e79916d-60a3-491e-abdf-5a69d64aa562 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1697 microversion: 2.1 time: 0.154402 Aug 29 16:57:25.014874 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3859/7891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:24 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:25.732520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fbe2461e-c31f-45b1-b19c-9db0a0c8eaf8 req-afeaa875-b071-4793-a00b-bf2cacc4721a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "name": "network-vif-unplugged", "status": "completed", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:57:25.742454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbe2461e-c31f-45b1-b19c-9db0a0c8eaf8 req-afeaa875-b071-4793-a00b-bf2cacc4721a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:25.743165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbe2461e-c31f-45b1-b19c-9db0a0c8eaf8 req-afeaa875-b071-4793-a00b-bf2cacc4721a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:25.743698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbe2461e-c31f-45b1-b19c-9db0a0c8eaf8 req-afeaa875-b071-4793-a00b-bf2cacc4721a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:25.756485 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fbe2461e-c31f-45b1-b19c-9db0a0c8eaf8 req-afeaa875-b071-4793-a00b-bf2cacc4721a service nova] Creating event network-vif-unplugged:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h2-836830-13 Aug 29 16:57:25.768486 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [req-fbe2461e-c31f-45b1-b19c-9db0a0c8eaf8 req-afeaa875-b071-4793-a00b-bf2cacc4721a service nova] Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129133) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:57:25.780946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fbe2461e-c31f-45b1-b19c-9db0a0c8eaf8 req-afeaa875-b071-4793-a00b-bf2cacc4721a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109282 Aug 29 16:57:25.781737 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4033/7892] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:57:26.036071 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:26.036698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:26.043957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:26.044450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:26.044892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:26.045601 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:26.046060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:26.046488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:26.194202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:26.203418 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a50b04e8-2ec1-4948-95c8-291078c2755d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1696 microversion: 2.1 time: 0.171200 Aug 29 16:57:26.204006 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3860/7893] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:26 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:27.227355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:27.228096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:27.234280 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:27.234774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:27.235248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:27.235946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:27.236409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:27.236842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:27.374876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:27.383479 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e0efeee-5ed8-432e-9451-75974cae0f2c tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1694 microversion: 2.1 time: 0.161429 Aug 29 16:57:27.384068 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4034/7894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:27 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:27.796609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f4188cc9-18ac-444b-965f-388dff17c523 req-a9fdde27-34a3-4f66-ac13-cc5f2a3da3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:57:27.806827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f4188cc9-18ac-444b-965f-388dff17c523 req-a9fdde27-34a3-4f66-ac13-cc5f2a3da3f7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:27.807354 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f4188cc9-18ac-444b-965f-388dff17c523 req-a9fdde27-34a3-4f66-ac13-cc5f2a3da3f7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:27.807792 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f4188cc9-18ac-444b-965f-388dff17c523 req-a9fdde27-34a3-4f66-ac13-cc5f2a3da3f7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:27.819673 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f4188cc9-18ac-444b-965f-388dff17c523 req-a9fdde27-34a3-4f66-ac13-cc5f2a3da3f7 service nova] Creating event network-changed:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h2-836830-13 Aug 29 16:57:27.825198 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [req-f4188cc9-18ac-444b-965f-388dff17c523 req-a9fdde27-34a3-4f66-ac13-cc5f2a3da3f7 service nova] Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-836830-13', 'n-h1-836830-13'} {{(pid=129132) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 29 16:57:27.837129 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f4188cc9-18ac-444b-965f-388dff17c523 req-a9fdde27-34a3-4f66-ac13-cc5f2a3da3f7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044020 Aug 29 16:57:27.837711 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3861/7895] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:57:28.404387 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:28.405012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:28.412178 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:28.412730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:28.413177 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:28.414040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:28.414542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:28.415051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:28.552941 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:28.562052 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6533b4d8-09c7-473a-9816-5feb795ad7a7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1694 microversion: 2.1 time: 0.161606 Aug 29 16:57:28.562622 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4035/7896] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:28 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:29.583718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:29.584344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:29.592181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:29.592674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:29.593117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:29.593810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:29.594266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:29.594693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:29.746636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:29.755488 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d3a3ad1e-ca5f-43ba-9c87-5fba5b7358df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1694 microversion: 2.1 time: 0.175997 Aug 29 16:57:29.756040 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3862/7897] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:29 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:30.778203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:30.778831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:30.785907 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:30.786410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:30.786867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:30.787608 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:30.788086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:30.788618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:30.926013 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:30.936161 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d0b19094-e978-486d-860f-13252de1d934 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1691 microversion: 2.1 time: 0.162427 Aug 29 16:57:30.937002 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4036/7898] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:30 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:57:30.957225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:57:30.957796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:30.964941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:30.965434 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:30.965922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:30.966621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:30.967112 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:30.967544 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:31.028731 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a6292d37-383c-44b1-bf07-8512b8a28d35 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action" status: 204 len: 0 microversion: 2.1 time: 0.075140 Aug 29 16:57:31.029482 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3863/7899] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:57:30 2022] POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:57:31.037692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:31.038341 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:31.045438 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:31.045944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:31.046500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:31.047366 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:31.047884 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:31.048350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:31.192747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:31.203567 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fbef2ef2-e422-40e1-b5a3-714255e0a3aa tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1691 microversion: 2.1 time: 0.169645 Aug 29 16:57:31.204344 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4037/7900] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:31 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:57:31.227810 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:31.228530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:31.235132 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:31.235936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:31.236386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:31.237342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:31.237813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:31.238246 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:31.638154 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:31.646299 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-49be83fb-1fd6-4b27-9133-bc82678604d3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1691 microversion: 2.1 time: 0.423691 Aug 29 16:57:31.646892 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3864/7901] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:31 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1691 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:57:32.669571 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:57:32.670284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:57:32.692956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:32.693759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:32.694394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:32.695602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:32.697157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:32.697792 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:32.785945 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-84ce81ea-5079-4d96-ad38-f22b4cf09f3a req-5cb5c9b6-c310-4750-8d0e-1bc670c65dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "name": "network-vif-plugged", "status": "completed", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:57:32.796036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-84ce81ea-5079-4d96-ad38-f22b4cf09f3a req-5cb5c9b6-c310-4750-8d0e-1bc670c65dc6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:57:32.797061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-84ce81ea-5079-4d96-ad38-f22b4cf09f3a req-5cb5c9b6-c310-4750-8d0e-1bc670c65dc6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:57:32.797061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-84ce81ea-5079-4d96-ad38-f22b4cf09f3a req-5cb5c9b6-c310-4750-8d0e-1bc670c65dc6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:57:32.809207 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-84ce81ea-5079-4d96-ad38-f22b4cf09f3a req-5cb5c9b6-c310-4750-8d0e-1bc670c65dc6 service nova] Creating event network-vif-plugged:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h2-836830-13 Aug 29 16:57:32.814432 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-84ce81ea-5079-4d96-ad38-f22b4cf09f3a req-5cb5c9b6-c310-4750-8d0e-1bc670c65dc6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141571 Aug 29 16:57:32.815373 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3865/7902] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:57:32.862780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:57:32.871259 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-19137e55-6355-4a20-adaa-635976171362 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1683 microversion: 2.1 time: 0.206078 Aug 29 16:57:32.871848 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4038/7903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:57:32 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1683 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:03.080868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=30 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:03.081437 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:03.086290 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:03.089163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:03.096742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:03.097235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:03.097675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:03.098375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:03.098861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:03.099326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:03.168045 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-dd641001-0ede-49ea-addd-0bd5fe499204 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action" status: 200 len: 24577 microversion: 2.1 time: 0.088834 Aug 29 16:58:03.168706 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3866/7904] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:58:03 2022] POST /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad/action => generated 24577 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:58:20.198830 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:20.199504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:20.202882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=34 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:20.203813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:20.204260 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:20.204851 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 16:58:20.205035 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 16:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad (ip 10.222.0.83) !!! Aug 29 16:58:20.205208 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=4 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:20.218086 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:20.218963 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:20.219686 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:20.221199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:20.221679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:20.222119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:20.254847 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 16:58:20.275016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-406b4e38-ed27-4b6d-9eb6-50224423d27a req-ac1e44c7-c212-47ca-8c9f-6742d88d33bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:20.286919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-406b4e38-ed27-4b6d-9eb6-50224423d27a req-ac1e44c7-c212-47ca-8c9f-6742d88d33bb service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:20.287575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-406b4e38-ed27-4b6d-9eb6-50224423d27a req-ac1e44c7-c212-47ca-8c9f-6742d88d33bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:20.288091 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-406b4e38-ed27-4b6d-9eb6-50224423d27a req-ac1e44c7-c212-47ca-8c9f-6742d88d33bb service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:20.300859 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-406b4e38-ed27-4b6d-9eb6-50224423d27a req-ac1e44c7-c212-47ca-8c9f-6742d88d33bb service nova] Creating event network-changed:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h2-836830-13 Aug 29 16:58:20.306423 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-406b4e38-ed27-4b6d-9eb6-50224423d27a req-ac1e44c7-c212-47ca-8c9f-6742d88d33bb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109045 Aug 29 16:58:20.307719 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3867/7905] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:58:20.338349 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-88b3639d-ab91-4fb2-8c07-1069f1cc0dc8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 204 len: 0 microversion: 2.1 time: 0.143245 Aug 29 16:58:20.339076 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4039/7906] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 16:58:20 2022] DELETE /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 16:58:20.350563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:20.351591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:20.360394 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:20.361150 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:20.361753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:20.363592 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:20.364391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:20.364854 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:20.515641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:20.525134 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-98520206-9158-4721-8501-48d3b74bb073 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1689 microversion: 2.1 time: 0.180519 Aug 29 16:58:20.525632 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3868/7907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:20 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:58:21.599127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:21.600001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:21.606038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:21.606550 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:21.607009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:21.607764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:21.608220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:21.608662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:21.744848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:21.753244 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-2a052019-8e6a-4ccd-8f24-f37aed9c1de8 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1689 microversion: 2.1 time: 0.210358 Aug 29 16:58:21.753835 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4040/7908] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:21 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1689 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:22.575106 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c8befdaa-d746-411e-9aab-d6c09d49becc req-f7308bab-87f9-4411-8e73-2784a9048bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c57b96-76d4-4cf8-a81b-38908d0910ad", "name": "network-vif-deleted", "tag": "5d00d6f3-40e6-4a2f-a0ff-3efec8936e33"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:22.588576 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c8befdaa-d746-411e-9aab-d6c09d49becc req-f7308bab-87f9-4411-8e73-2784a9048bf4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:22.589064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c8befdaa-d746-411e-9aab-d6c09d49becc req-f7308bab-87f9-4411-8e73-2784a9048bf4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:22.589504 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c8befdaa-d746-411e-9aab-d6c09d49becc req-f7308bab-87f9-4411-8e73-2784a9048bf4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:22.603681 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c8befdaa-d746-411e-9aab-d6c09d49becc req-f7308bab-87f9-4411-8e73-2784a9048bf4 service nova] Creating event network-vif-deleted:5d00d6f3-40e6-4a2f-a0ff-3efec8936e33 for instance f7c57b96-76d4-4cf8-a81b-38908d0910ad on n-h2-836830-13 Aug 29 16:58:22.610223 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c8befdaa-d746-411e-9aab-d6c09d49becc req-f7308bab-87f9-4411-8e73-2784a9048bf4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039033 Aug 29 16:58:22.610889 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3869/7909] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:58:22.774043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:22.774711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:22.782667 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:22.783129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:22.783711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:22.784442 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:22.784949 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:22.785392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:22.819119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:22.819618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:22.820074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:22.820540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lazy-loading 'fault' on Instance uuid f7c57b96-76d4-4cf8-a81b-38908d0910ad {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 16:58:22.867876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:22.876652 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4481c2fa-3f57-4635-ba51-a15c287109af tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 200 len: 1357 microversion: 2.1 time: 0.106708 Aug 29 16:58:22.877238 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4041/7910] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:22 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:23.900476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:23.901186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: f7c57b96-76d4-4cf8-a81b-38908d0910ad] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:23.909059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:23.909556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:23.910017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:23.910705 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:23.911268 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:23.911704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:23.940313 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] HTTP exception thrown: Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad could not be found. Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Request method failure captured: Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad HTTP/1.1 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDO8A8OfBQr9E97Tgn9hzsylqWms-dzavL3XUeAAJS1fpXzfGusJDWFwdJHOLyiPCctY3ENDMWxRrV_lZwWhLZZ6_TijS2VgpDefXGcTrUdODWO5x7qFio_SsWOK_Lw2PQvokxxR22MSONV0GVxyDsnys-AVbsSOouYLmhR_mw99klb0 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_197e7b145ed049b0a37bd871b4a34920", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/197e7b145ed049b0a37bd871b4a34920"}]}] Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a0e53500b97e4c3286d76015abcf6e0a Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad could not be found. Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'f7c57b96-76d4-4cf8-a81b-38908d0910ad'} Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad could not be found. Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad could not be found. Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:58:23.942178 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad could not be found. Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Returning 404 to user: Instance f7c57b96-76d4-4cf8-a81b-38908d0910ad could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6b8651ec-327c-4132-a6d5-654adf30fe02 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad" status: 404 len: 111 microversion: 2.1 time: 0.047650 Aug 29 16:58:23.946716 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3870/7911] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:23 2022] GET /compute/v2.1/servers/f7c57b96-76d4-4cf8-a81b-38908d0910ad => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 16:58:27.011211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4b3c3817-03b7-4b72-ae4a-d340fbf2a4c2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '.version_select at 0x7f32ed929d30>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:27.053205 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4b3c3817-03b7-4b72-ae4a-d340fbf2a4c2 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1502326671" status: 202 len: 0 microversion: 2.1 time: 0.046902 Aug 29 16:58:27.053895 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4042/7912] 10.222.0.83 () {58 vars in 1284 bytes} [Mon Aug 29 16:58:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1502326671 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:58:27.086145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ea396a98-abdc-4411-ac0e-7cad6f00e373 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: .version_select at 0x7f32ed420310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1020211811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBmiZHKLurLRYzkMIM+CVT509FE+H6BM1LjykEz8YRv7ur60fKcJOqJ4iynR8Ox11cqgpDPnBF4BmClGqo/rk4X/yyhF/SZT5F8vCEsc3R+trCH6UHR4kFdlyDfMgrx6Q=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:27.104668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ea396a98-abdc-4411-ac0e-7cad6f00e373 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:58:27.111794 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-ea396a98-abdc-4411-ac0e-7cad6f00e373 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:58:27.137096 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ea396a98-abdc-4411-ac0e-7cad6f00e373 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054850 Aug 29 16:58:27.138285 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3871/7913] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 16:58:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:58:32.821021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-662712269", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "901fb097-cc77-4bc2-a70a-93377a450eea"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1020211811", "security_groups": [{"name": "tempest-secgroup-smoke-345121105"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:32.873602 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:32.946345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] validate_networks() for [('901fb097-cc77-4bc2-a70a-93377a450eea', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 16:58:33.377472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 16:58:33.378036 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 16:58:33.378700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 16:58:33.379297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 16:58:33.379823 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 16:58:33.390562 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:33.391180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:33.391707 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:33.392524 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:33.393105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:33.393730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:33.411816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 16:58:33.417352 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 16:58:33.431798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 16:58:33.434956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 16:58:33.485088 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-11dfd981-4524-40bc-8c22-a40c65b892f9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.667918 Aug 29 16:58:33.485755 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4043/7914] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 16:58:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 16:58:33.498017 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c10558b0-0416-4961-a44a-5e64f086f07e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:33.498816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c10558b0-0416-4961-a44a-5e64f086f07e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:33.587065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c10558b0-0416-4961-a44a-5e64f086f07e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:33.595250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c10558b0-0416-4961-a44a-5e64f086f07e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1266 microversion: 2.1 time: 0.102316 Aug 29 16:58:33.596198 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3872/7915] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:33 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:34.617364 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:34.618558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:34.633521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:34.634882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:34.635664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:34.636500 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:34.638252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:34.638743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:34.725444 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:34.737182 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e3b735b3-96ba-4f04-85ac-ea3708fd6f52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1336 microversion: 2.1 time: 0.124889 Aug 29 16:58:34.738127 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4044/7916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:34 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:35.760431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:35.761565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:35.764297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:35.771247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:35.771747 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:35.772197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:35.772900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:35.773392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:35.773825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:36.030025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:36.040111 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f04141d2-c781-4a18-92b6-85cc63364deb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1391 microversion: 2.1 time: 0.284585 Aug 29 16:58:36.041022 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3873/7917] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:35 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:36.138125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-97c7b401-aca7-4ab6-b246-4c1e10b356f5 req-71f2295c-d715-4f26-b3e9-0123fabc6f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64830aa3-b8a3-4c3e-a618-086307ccba71", "tag": "6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:36.170682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-97c7b401-aca7-4ab6-b246-4c1e10b356f5 req-71f2295c-d715-4f26-b3e9-0123fabc6f32 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:36.171219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-97c7b401-aca7-4ab6-b246-4c1e10b356f5 req-71f2295c-d715-4f26-b3e9-0123fabc6f32 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:36.171665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-97c7b401-aca7-4ab6-b246-4c1e10b356f5 req-71f2295c-d715-4f26-b3e9-0123fabc6f32 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:36.185157 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-97c7b401-aca7-4ab6-b246-4c1e10b356f5 req-71f2295c-d715-4f26-b3e9-0123fabc6f32 service nova] Creating event network-changed:6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0 for instance 64830aa3-b8a3-4c3e-a618-086307ccba71 on n-h1-836830-13 Aug 29 16:58:36.190578 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-97c7b401-aca7-4ab6-b246-4c1e10b356f5 req-71f2295c-d715-4f26-b3e9-0123fabc6f32 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057052 Aug 29 16:58:36.191220 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4045/7918] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 16:58:37.061716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:37.062507 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:37.069455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:37.069939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:37.070378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:37.071085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:37.071568 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:37.072019 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:37.203926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:37.211673 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b16801d1-6fc3-4a9c-8411-a1eed66c22e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1391 microversion: 2.1 time: 0.154648 Aug 29 16:58:37.212248 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3874/7919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:37 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:38.234250 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:38.234885 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:38.241223 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:38.241725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:38.242174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:38.242878 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:38.243408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:38.243855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:38.378669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:38.386430 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8d4be6ec-d310-4933-ab66-19c7140cb752 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1391 microversion: 2.1 time: 0.157657 Aug 29 16:58:38.387048 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4046/7920] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:38 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:39.406444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:39.407121 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:39.413956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:39.414445 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:39.414887 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:39.415611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:39.416068 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:39.416499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:39.554491 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:39.563048 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5267be86-4153-42f4-b14d-7a5cc8684d47 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1391 microversion: 2.1 time: 0.161135 Aug 29 16:58:39.563625 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3875/7921] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:39 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:40.584641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:40.585308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:40.592359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:40.592858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:40.593305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:40.594008 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:40.594479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:40.594915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:40.730171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:40.738714 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-be143d21-cdd9-4833-bec1-84a156b57670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1391 microversion: 2.1 time: 0.158117 Aug 29 16:58:40.739320 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4047/7922] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:40 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:41.760860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:41.761722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:41.769629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:41.770137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:41.770603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:41.771319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:41.771782 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:41.772247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:41.854756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-10125aa4-0775-4297-85e0-f3cb4e6ae42d req-3337e29c-d9bd-4d67-99e0-9592385142c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64830aa3-b8a3-4c3e-a618-086307ccba71", "name": "network-vif-plugged", "status": "completed", "tag": "6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:41.866099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-10125aa4-0775-4297-85e0-f3cb4e6ae42d req-3337e29c-d9bd-4d67-99e0-9592385142c8 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:41.866596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-10125aa4-0775-4297-85e0-f3cb4e6ae42d req-3337e29c-d9bd-4d67-99e0-9592385142c8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:41.867269 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-10125aa4-0775-4297-85e0-f3cb4e6ae42d req-3337e29c-d9bd-4d67-99e0-9592385142c8 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:41.880317 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-10125aa4-0775-4297-85e0-f3cb4e6ae42d req-3337e29c-d9bd-4d67-99e0-9592385142c8 service nova] Creating event network-vif-plugged:6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0 for instance 64830aa3-b8a3-4c3e-a618-086307ccba71 on n-h1-836830-13 Aug 29 16:58:41.895829 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-10125aa4-0775-4297-85e0-f3cb4e6ae42d req-3337e29c-d9bd-4d67-99e0-9592385142c8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034765 Aug 29 16:58:41.897009 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4048/7923] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:58:41.943785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:41.952189 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aa8a7406-524b-4711-8568-ae86dc6698ca tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1391 microversion: 2.1 time: 0.195582 Aug 29 16:58:41.952787 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3876/7924] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:41 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:42.974253 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:42.974975 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:42.981855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:42.982361 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:42.982813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:42.983565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:42.984067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:42.984512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:43.129505 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:43.138060 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-283d1c00-f3fb-4d9d-84d9-adb1d4825dd4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1391 microversion: 2.1 time: 0.168860 Aug 29 16:58:43.138729 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4049/7925] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:42 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:44.159791 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:44.160367 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:44.163093 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:44.168651 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:44.169261 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:44.169704 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:44.170415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:44.170878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:44.171333 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:44.304124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:44.312943 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ea64f3b4-28d1-47f1-87fa-1b927ef434c3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1562 microversion: 2.1 time: 0.157208 Aug 29 16:58:44.313517 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3877/7926] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:44 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:58:44.333655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:44.334274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:44.336255 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:44.336938 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:58:44.343825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:44.344319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:44.344760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:44.345451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:44.345914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:44.346344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:44.478748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:44.488304 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ee5c74b2-c776-444c-bf93-0329695ca9a3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1562 microversion: 2.1 time: 0.158302 Aug 29 16:58:44.488695 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4050/7927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:44 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:58:46.074322 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:58:46.075158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:58:46.076484 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-fbb2df2f-90ef-4148-8ca6-c909a2f6a8f9 req-2530a2c6-2ef0-422b-9473-5527fd263186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64830aa3-b8a3-4c3e-a618-086307ccba71", "tag": "6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:58:46.082353 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:46.082846 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:46.083304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:46.084194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:46.084866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:46.085291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:46.088677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbb2df2f-90ef-4148-8ca6-c909a2f6a8f9 req-2530a2c6-2ef0-422b-9473-5527fd263186 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:58:46.089390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbb2df2f-90ef-4148-8ca6-c909a2f6a8f9 req-2530a2c6-2ef0-422b-9473-5527fd263186 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:58:46.090094 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-fbb2df2f-90ef-4148-8ca6-c909a2f6a8f9 req-2530a2c6-2ef0-422b-9473-5527fd263186 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:58:46.102054 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-fbb2df2f-90ef-4148-8ca6-c909a2f6a8f9 req-2530a2c6-2ef0-422b-9473-5527fd263186 service nova] Creating event network-changed:6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0 for instance 64830aa3-b8a3-4c3e-a618-086307ccba71 on n-h1-836830-13 Aug 29 16:58:46.108843 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-fbb2df2f-90ef-4148-8ca6-c909a2f6a8f9 req-2530a2c6-2ef0-422b-9473-5527fd263186 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036579 Aug 29 16:58:46.110039 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4051/7928] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 16:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 16:58:46.326745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:58:46.334732 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d7ad9e2-562b-4391-9728-9067f1de7696 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1562 microversion: 2.1 time: 0.264745 Aug 29 16:58:46.335560 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3878/7929] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:58:46 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:07.628973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:59:07.629812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=38 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:59:07.634409 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:59:07.636767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:07.644570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:07.645067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:07.645511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:07.646205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:07.646668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:07.647126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:07.699178 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9cc384aa-1acd-4441-8f52-ff5fbed71d8d tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action" status: 200 len: 24568 microversion: 2.1 time: 0.072725 Aug 29 16:59:07.699827 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4052/7930] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:59:07 2022] POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:59:18.674877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9cc51e14-dd09-4966-8631-a98538f607cd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:59:18.677640 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:59:18.678482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=36 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:59:18.686525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cc51e14-dd09-4966-8631-a98538f607cd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:18.687010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cc51e14-dd09-4966-8631-a98538f607cd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:18.687725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-9cc51e14-dd09-4966-8631-a98538f607cd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:18.712838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-9cc51e14-dd09-4966-8631-a98538f607cd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Going to try to stop instance {{(pid=129132) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 16:59:18.758457 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9cc51e14-dd09-4966-8631-a98538f607cd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action" status: 202 len: 0 microversion: 2.1 time: 0.087426 Aug 29 16:59:18.758972 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3879/7931] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:59:18 2022] POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:59:18.767872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:18.768590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:18.772028 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:59:18.772689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 16:59:18.780533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:18.781031 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:18.781478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:18.782179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:18.782644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:18.783187 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:18.930670 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:18.938832 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a61ee4b8-e823-423c-bd65-3b77f871e251 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.175173 Aug 29 16:59:18.939439 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4053/7932] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:18 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 16:59:19.963135 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:19.963766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:19.969996 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:19.970483 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:19.970920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:19.971632 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:19.972127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:19.972554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:20.110101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:20.118628 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bdb4ad2a-f019-48b5-bbc9-e16db63539f7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.160811 Aug 29 16:59:20.119216 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3880/7933] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:19 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:21.140503 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:21.141065 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:21.148914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:21.149456 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:21.149918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:21.150633 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:21.151176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:21.151623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:21.287525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:21.295624 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8ff807a4-4c1d-4483-ba73-e007829ae6f5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.159168 Aug 29 16:59:21.296502 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4054/7934] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:21 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:22.323104 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:22.323742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:22.330667 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:22.331196 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:22.331674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:22.332444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:22.332987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:22.333423 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:22.468179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:22.476531 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b4a906e0-1d49-42d1-86c4-13c385b4eee3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.157439 Aug 29 16:59:22.477100 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3881/7935] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:22 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:23.498124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:23.498692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:23.506044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:23.506544 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:23.506995 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:23.507720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:23.508190 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:23.508629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:23.640650 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:23.649308 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a30481c5-d70c-4f6d-b33f-1d91883981df tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.155322 Aug 29 16:59:23.649903 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4055/7936] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:23 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:24.670609 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:24.671257 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:24.678648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:24.679174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:24.679620 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:24.687176 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:24.687983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:24.688426 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:24.823872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:24.832515 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c3d6e7b-ef2f-4625-90f4-9fc794ea03fc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.165271 Aug 29 16:59:24.833089 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3882/7937] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:24 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:25.854318 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:25.854955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:25.861914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:25.862415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:25.863068 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:25.863798 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:25.864263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:25.864704 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:26.004202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:26.011983 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-773d3499-d3dd-462d-bd53-aa1185f0de29 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.161618 Aug 29 16:59:26.012539 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4056/7938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:25 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:27.036199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:27.037021 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:27.043824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:27.044315 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:27.044759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:27.045455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:27.045912 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:27.046339 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:27.180395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:27.188608 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2cb02294-2af8-46ed-8249-6a1a7349ab49 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.157333 Aug 29 16:59:27.189178 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3883/7939] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:27 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:28.211119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:28.211752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:28.218697 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:28.219227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:28.219682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:28.220380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:28.220856 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:28.221295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:28.353122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:28.360946 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-954eb316-85f0-4576-b5a1-6e03dea5ae3b tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.154744 Aug 29 16:59:28.361527 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4057/7940] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:28 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:29.382238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:29.382860 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:29.389942 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:29.390464 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:29.390904 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:29.391630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:29.392086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:29.392512 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:29.525831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:29.533664 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1a97c031-1607-4455-8c7a-798883839e34 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.155835 Aug 29 16:59:29.534256 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3884/7941] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:29 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:30.555370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:30.555998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:30.563075 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:30.563575 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:30.564024 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:30.564723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:30.565189 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:30.565629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:30.701314 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:30.709754 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-74ff8acc-711f-4a67-a3aa-c6218245d219 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.159052 Aug 29 16:59:30.710345 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4058/7942] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:30 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:31.730837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:31.731485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:31.738277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:31.738759 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:31.739222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:31.740612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:31.741188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:31.741616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:31.877593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:31.885499 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-161f0269-00e1-4db9-88bc-67e1f243f0b4 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.158566 Aug 29 16:59:31.886071 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3885/7943] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:31 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:32.907355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:32.907985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:32.915624 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:32.916131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:32.916585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:32.917307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:32.917755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:32.918192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:33.056599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:33.064739 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a3b05427-eaa7-4da4-af72-3f55ffa0b5ba tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1691 microversion: 2.1 time: 0.161581 Aug 29 16:59:33.065316 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4059/7944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:32 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:34.087489 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:34.088047 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:34.094827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:34.095350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:34.095796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:34.096478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:34.096933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:34.097357 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:34.230274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:34.238070 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-080e2d7f-7d9a-4de7-85c7-773918fd53ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1668 microversion: 2.1 time: 0.155903 Aug 29 16:59:34.238646 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3886/7945] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:34 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:35.334228 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:59:35.336668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:35.343512 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:35.344007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:35.344451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:35.345142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:35.345606 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:35.346054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:35.399996 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-788183dc-491e-43d3-a92d-2c838d054304 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action" status: 200 len: 38396 microversion: 2.1 time: 0.069570 Aug 29 16:59:35.400649 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4060/7946] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:59:35 2022] POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action => generated 38396 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 16:59:35.413517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-73ad8414-a811-496b-b27d-20860af63834 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 16:59:35.420744 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ad8414-a811-496b-b27d-20860af63834 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:35.421237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ad8414-a811-496b-b27d-20860af63834 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:35.421679 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-73ad8414-a811-496b-b27d-20860af63834 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:35.445110 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-73ad8414-a811-496b-b27d-20860af63834 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Going to try to start instance {{(pid=129132) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 16:59:35.486991 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-73ad8414-a811-496b-b27d-20860af63834 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action" status: 202 len: 0 microversion: 2.1 time: 0.077999 Aug 29 16:59:35.487687 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3887/7947] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 16:59:35 2022] POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 16:59:35.497779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:35.498694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:35.505969 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:35.506641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:35.507156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:35.508082 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:35.508561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:35.509003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:35.647508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:35.655831 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af188d78-5c28-4ba0-a4ec-cbca2397fb6e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1677 microversion: 2.1 time: 0.162968 Aug 29 16:59:35.656602 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4061/7948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:35 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 16:59:36.679944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 16:59:36.680642 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 16:59:36.686833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:36.687352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:36.688040 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:36.688722 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 16:59:36.689173 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 16:59:36.689619 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 16:59:36.827360 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 16:59:36.835342 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4b43064f-e636-43d4-a0da-8f64bea11d88 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1681 microversion: 2.1 time: 0.161112 Aug 29 16:59:36.835977 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3888/7949] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 16:59:36 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:01.029992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:01.032203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:01.035016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=18 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:01.035871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=52 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:01.043322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:01.043822 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:01.044838 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:01.045582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:01.046046 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:01.046482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:01.100397 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f39de5d6-f5c2-4443-81b8-f95ca21887bb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action" status: 200 len: 62961 microversion: 2.1 time: 0.074374 Aug 29 17:00:01.101069 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4062/7950] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:00:01 2022] POST /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71/action => generated 62961 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 17:00:08.463204 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:08.463733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:08.466216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-e5dfcd74-24d9-4e98-b8a9-5ce7a491e7ed req-09ba1656-3b04-4237-b4a9-5fed6d8e3a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64830aa3-b8a3-4c3e-a618-086307ccba71", "tag": "6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:08.470689 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:00:08.470843 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 (ip 10.222.0.83) !!! Aug 29 17:00:08.472081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=20 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:08.473321 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:08.476995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:08.477481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:08.477916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:08.478625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:08.479148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:08.479580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:08.481616 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5dfcd74-24d9-4e98-b8a9-5ce7a491e7ed req-09ba1656-3b04-4237-b4a9-5fed6d8e3a13 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:08.482273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5dfcd74-24d9-4e98-b8a9-5ce7a491e7ed req-09ba1656-3b04-4237-b4a9-5fed6d8e3a13 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:08.482755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-e5dfcd74-24d9-4e98-b8a9-5ce7a491e7ed req-09ba1656-3b04-4237-b4a9-5fed6d8e3a13 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:08.495534 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-e5dfcd74-24d9-4e98-b8a9-5ce7a491e7ed req-09ba1656-3b04-4237-b4a9-5fed6d8e3a13 service nova] Creating event network-changed:6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0 for instance 64830aa3-b8a3-4c3e-a618-086307ccba71 on n-h1-836830-13 Aug 29 17:00:08.500913 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-e5dfcd74-24d9-4e98-b8a9-5ce7a491e7ed req-09ba1656-3b04-4237-b4a9-5fed6d8e3a13 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039003 Aug 29 17:00:08.502146 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4063/7951] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:00:08.511596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Going to try to terminate instance {{(pid=129132) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:00:08.606866 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-30514168-047e-4def-8100-d48ab4472b4a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 204 len: 0 microversion: 2.1 time: 0.147366 Aug 29 17:00:08.610905 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3889/7952] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 17:00:08 2022] DELETE /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:00:08.617274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:08.618133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:08.625153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:08.625750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:08.626293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:08.627136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:08.627689 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:08.628244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:08.782197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:08.792457 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5de10c4c-1407-4e80-8534-ecf5cb758c52 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1687 microversion: 2.1 time: 0.179857 Aug 29 17:00:08.793074 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4064/7953] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:08 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:09.814872 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:09.815610 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:09.822847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:09.823617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:09.824241 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:09.825139 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:09.826762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:09.827258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:10.025441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:10.033496 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2ecdb97d-0e44-4a95-9a8b-908e84e3ee8f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1687 microversion: 2.1 time: 0.223137 Aug 29 17:00:10.034096 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3890/7954] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:09 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:00:10.578843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-ff477f34-8cb8-41a6-9f41-d7df41af4c8a req-14503934-bd7b-4cb6-96c9-3abe4284af0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64830aa3-b8a3-4c3e-a618-086307ccba71", "name": "network-vif-deleted", "tag": "6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:10.590210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff477f34-8cb8-41a6-9f41-d7df41af4c8a req-14503934-bd7b-4cb6-96c9-3abe4284af0d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:10.590630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff477f34-8cb8-41a6-9f41-d7df41af4c8a req-14503934-bd7b-4cb6-96c9-3abe4284af0d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:10.591098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-ff477f34-8cb8-41a6-9f41-d7df41af4c8a req-14503934-bd7b-4cb6-96c9-3abe4284af0d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:10.603015 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-ff477f34-8cb8-41a6-9f41-d7df41af4c8a req-14503934-bd7b-4cb6-96c9-3abe4284af0d service nova] Creating event network-vif-deleted:6d26d6fc-7d65-4a23-8ebc-c0f42fc3a7b0 for instance 64830aa3-b8a3-4c3e-a618-086307ccba71 on n-h1-836830-13 Aug 29 17:00:10.608558 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-ff477f34-8cb8-41a6-9f41-d7df41af4c8a req-14503934-bd7b-4cb6-96c9-3abe4284af0d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034055 Aug 29 17:00:10.609158 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4065/7955] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:00:11.055587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:11.056247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:11.063748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:11.064244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:11.064685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:11.065395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:11.065850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:11.066392 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:11.102475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:11.102840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:11.103304 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:11.103770 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lazy-loading 'fault' on Instance uuid 64830aa3-b8a3-4c3e-a618-086307ccba71 {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:00:11.146521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:11.156135 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b374df5d-56ff-427f-b4cc-71d108400a56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 200 len: 1356 microversion: 2.1 time: 0.104446 Aug 29 17:00:11.157286 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3891/7956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:11 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:12.180252 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:12.180872 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 64830aa3-b8a3-4c3e-a618-086307ccba71] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:12.188328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:12.188824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:12.189276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:12.189973 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:12.190439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:12.190871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:12.204868 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] HTTP exception thrown: Instance 64830aa3-b8a3-4c3e-a618-086307ccba71 could not be found. Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Request method failure captured: Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 HTTP/1.1 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDO8A8OfBQr9E97Tgn9hzsylqWms-dzavL3XUeAAJS1fpXzfGusJDWFwdJHOLyiPCctY3ENDMWxRrV_lZwWhLZZ6_TijS2VgpDefXGcTrUdODWO5x7qFio_SsWOK_Lw2PQvokxxR22MSONV0GVxyDsnys-AVbsSOouYLmhR_mw99klb0 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_197e7b145ed049b0a37bd871b4a34920", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/197e7b145ed049b0a37bd871b4a34920"}]}] Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: a0e53500b97e4c3286d76015abcf6e0a Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance 64830aa3-b8a3-4c3e-a618-086307ccba71 could not be found. Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': '64830aa3-b8a3-4c3e-a618-086307ccba71'} Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64830aa3-b8a3-4c3e-a618-086307ccba71 could not be found. Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64830aa3-b8a3-4c3e-a618-086307ccba71 could not be found. Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:00:12.206555 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64830aa3-b8a3-4c3e-a618-086307ccba71 could not be found. Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Returning 404 to user: Instance 64830aa3-b8a3-4c3e-a618-086307ccba71 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a8e987c7-44f8-4c88-9694-8b02d58567b5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71" status: 404 len: 111 microversion: 2.1 time: 0.033120 Aug 29 17:00:12.211638 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4066/7957] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:12 2022] GET /compute/v2.1/servers/64830aa3-b8a3-4c3e-a618-086307ccba71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:00:15.263888 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-95f63a11-9620-4330-9e1d-21b4378a2016 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '.version_select at 0x7f32ed3e9b80>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:15.290656 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-95f63a11-9620-4330-9e1d-21b4378a2016 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1020211811" status: 202 len: 0 microversion: 2.1 time: 0.032089 Aug 29 17:00:15.291700 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3892/7958] 10.222.0.83 () {58 vars in 1284 bytes} [Mon Aug 29 17:00:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1020211811 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:00:15.325383 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a12cf74a-f27e-4881-9e2b-7492a9596492 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: .version_select at 0x7f32eec3a670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-375839621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA3dJ4UYIB+ewt6FngXVCdUHoQco9ltIO1lCyzFVwklBqfVYB/eB2qPmjSujrJf6EiC/v//uyHhJhi4aRm9XeYhmR/fz18j/u/u39l/bA809onInUjRVisMz9utjWlhxg=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:15.344399 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a12cf74a-f27e-4881-9e2b-7492a9596492 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:00:15.349780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-a12cf74a-f27e-4881-9e2b-7492a9596492 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:00:15.373554 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a12cf74a-f27e-4881-9e2b-7492a9596492 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052189 Aug 29 17:00:15.374152 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4067/7959] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 17:00:15 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:00:21.180296 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:21.184508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-703253370", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "networks": [{"uuid": "9a372fc9-1854-4d29-bcf8-ed252834077d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-375839621", "security_groups": [{"name": "tempest-secgroup-smoke-220067495"}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:21.297086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] validate_networks() for [('9a372fc9-1854-4d29-bcf8-ed252834077d', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:00:21.778050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:00:21.778656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:00:21.779265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:00:21.780194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:00:21.780833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:00:21.791779 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:21.792970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:21.793958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:21.795686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:21.796402 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:21.797059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:21.827301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:00:21.833069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Getting quotas for user a0e53500b97e4c3286d76015abcf6e0a and project 197e7b145ed049b0a37bd871b4a34920. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:00:21.850239 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:00:21.852838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:00:21.927422 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-583ad780-213d-4aa3-9191-c8e357c2ffd6 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.748906 Aug 29 17:00:21.934527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3893/7960] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 17:00:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 17:00:21.950716 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-34c36314-828d-4622-926d-37e2c9d163dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:21.951690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-34c36314-828d-4622-926d-37e2c9d163dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:22.057131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-34c36314-828d-4622-926d-37e2c9d163dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:22.068882 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-34c36314-828d-4622-926d-37e2c9d163dd tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1265 microversion: 2.1 time: 0.132288 Aug 29 17:00:22.072168 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4068/7961] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:21 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:23.090925 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:23.091822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:23.098472 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:23.098971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:23.099630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:23.100344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:23.100803 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:23.101228 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:23.191411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:23.219079 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6aff3e69-ebe4-4974-9614-15cf219283ab tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1317 microversion: 2.1 time: 0.132876 Aug 29 17:00:23.220452 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3894/7962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:23 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1317 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:24.242766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:24.243454 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:24.246988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=16 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:24.266199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:24.266714 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:24.267230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:24.269450 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:24.269933 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:24.270391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:24.489578 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:24.500244 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6687559a-6a20-4691-b285-758371c466e0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1390 microversion: 2.1 time: 0.262949 Aug 29 17:00:24.501497 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4069/7963] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:24 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1390 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:24.820796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-63b3df19-c6e9-4a4e-8305-85cbc3fd2752 req-9a90de56-29d5-4915-934e-77db9bab38d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b2e498-55a4-4255-881f-94a57f9b139d", "tag": "c4f4afe5-60f2-4bc2-9689-c0fe5936a559"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:24.836778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-63b3df19-c6e9-4a4e-8305-85cbc3fd2752 req-9a90de56-29d5-4915-934e-77db9bab38d6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:24.837511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-63b3df19-c6e9-4a4e-8305-85cbc3fd2752 req-9a90de56-29d5-4915-934e-77db9bab38d6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:24.838101 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-63b3df19-c6e9-4a4e-8305-85cbc3fd2752 req-9a90de56-29d5-4915-934e-77db9bab38d6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:24.852477 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-63b3df19-c6e9-4a4e-8305-85cbc3fd2752 req-9a90de56-29d5-4915-934e-77db9bab38d6 service nova] Creating event network-changed:c4f4afe5-60f2-4bc2-9689-c0fe5936a559 for instance 22b2e498-55a4-4255-881f-94a57f9b139d on n-h1-836830-13 Aug 29 17:00:24.858452 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-63b3df19-c6e9-4a4e-8305-85cbc3fd2752 req-9a90de56-29d5-4915-934e-77db9bab38d6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041322 Aug 29 17:00:24.859376 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3895/7964] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:00:25.529185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:25.529751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:25.536724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:25.537220 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:25.537665 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:25.538356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:25.538848 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:25.539305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:25.672983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:25.680816 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-b2a71f7c-c89a-4be2-9ec4-4c02b03ccd92 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1390 microversion: 2.1 time: 0.155736 Aug 29 17:00:25.681387 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4070/7965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:25 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:26.704599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:26.705003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:26.711141 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:26.711643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:26.712087 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:26.712933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:26.713400 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:26.713839 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:26.855762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:26.864235 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ced86e76-2a6f-4f55-9a95-5ab8159db2a5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1390 microversion: 2.1 time: 0.166081 Aug 29 17:00:26.864831 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3896/7966] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:26 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:27.885732 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:27.886357 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:27.893401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:27.893894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:27.894342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:27.895048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:27.895520 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:27.895953 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:28.032126 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:28.039903 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e7b4ef86-3c2c-407b-baf4-3005f5b46c19 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1390 microversion: 2.1 time: 0.158082 Aug 29 17:00:28.040479 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4071/7967] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:27 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:29.060584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:29.061238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:29.069276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:29.069768 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:29.070211 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:29.070906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:29.071398 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:29.071855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:29.208016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:29.215861 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-72ae9411-1b1f-4d40-a8c2-8bedebdcbf08 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1390 microversion: 2.1 time: 0.159230 Aug 29 17:00:29.216454 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3897/7968] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:29 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:30.238458 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:30.239125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:30.245731 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:30.246239 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:30.246692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:30.247428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:30.247904 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:30.248347 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:30.384985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:30.393382 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8981c254-a7dd-4b64-b9ab-c600bf92ea56 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1390 microversion: 2.1 time: 0.159949 Aug 29 17:00:30.393976 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4072/7969] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:30 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:30.445169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-2d83facf-3326-410a-aca1-8f4183b7af92 req-d7d692f0-ee00-469e-93a4-81451d7e4049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b2e498-55a4-4255-881f-94a57f9b139d", "name": "network-vif-plugged", "status": "completed", "tag": "c4f4afe5-60f2-4bc2-9689-c0fe5936a559"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:30.456554 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d83facf-3326-410a-aca1-8f4183b7af92 req-d7d692f0-ee00-469e-93a4-81451d7e4049 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:30.457045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d83facf-3326-410a-aca1-8f4183b7af92 req-d7d692f0-ee00-469e-93a4-81451d7e4049 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:30.457606 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-2d83facf-3326-410a-aca1-8f4183b7af92 req-d7d692f0-ee00-469e-93a4-81451d7e4049 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:30.469685 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-2d83facf-3326-410a-aca1-8f4183b7af92 req-d7d692f0-ee00-469e-93a4-81451d7e4049 service nova] Creating event network-vif-plugged:c4f4afe5-60f2-4bc2-9689-c0fe5936a559 for instance 22b2e498-55a4-4255-881f-94a57f9b139d on n-h1-836830-13 Aug 29 17:00:30.475042 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-2d83facf-3326-410a-aca1-8f4183b7af92 req-d7d692f0-ee00-469e-93a4-81451d7e4049 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033628 Aug 29 17:00:30.475663 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3898/7970] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:00:31.414056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:31.414644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:31.417463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:31.424179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:31.424684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:31.425166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:31.426001 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:31.426476 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:31.427078 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:31.569589 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:31.578249 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7acf3506-89bc-41f3-90ec-3ff4faac16dc tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1390 microversion: 2.1 time: 0.168079 Aug 29 17:00:31.579697 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4073/7971] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:31 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:32.598695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:32.599494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:32.603750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:32.604470 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:32.612573 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:32.613061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:32.613494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:32.614192 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:32.614646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:32.615095 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:32.753271 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:32.761419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-16022eee-01e7-4c0c-a89c-a1b85096c53f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1561 microversion: 2.1 time: 0.164526 Aug 29 17:00:32.761999 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3899/7972] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:32 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:32.781504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:32.782256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:32.784147 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:32.790510 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:32.791100 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:32.791615 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:32.792328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:32.792804 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:32.793247 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:32.926492 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:32.934292 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5255094b-efbc-475b-aa34-fec25fd8c81f tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1561 microversion: 2.1 time: 0.156698 Aug 29 17:00:32.934870 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4074/7973] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:32 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:34.818089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8099acd7-547b-4b72-83a9-21d69f65711a req-72726365-d56d-45fd-8850-ded8a7c73457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b2e498-55a4-4255-881f-94a57f9b139d", "tag": "c4f4afe5-60f2-4bc2-9689-c0fe5936a559"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:34.824006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:00:34.824652 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:34.832974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:34.833473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:34.833906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:34.834616 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:34.835122 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:34.835323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8099acd7-547b-4b72-83a9-21d69f65711a req-72726365-d56d-45fd-8850-ded8a7c73457 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:34.835551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:34.836106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8099acd7-547b-4b72-83a9-21d69f65711a req-72726365-d56d-45fd-8850-ded8a7c73457 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:34.836564 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8099acd7-547b-4b72-83a9-21d69f65711a req-72726365-d56d-45fd-8850-ded8a7c73457 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:34.853007 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8099acd7-547b-4b72-83a9-21d69f65711a req-72726365-d56d-45fd-8850-ded8a7c73457 service nova] Creating event network-changed:c4f4afe5-60f2-4bc2-9689-c0fe5936a559 for instance 22b2e498-55a4-4255-881f-94a57f9b139d on n-h1-836830-13 Aug 29 17:00:34.858371 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8099acd7-547b-4b72-83a9-21d69f65711a req-72726365-d56d-45fd-8850-ded8a7c73457 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043888 Aug 29 17:00:34.859271 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4075/7974] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:00:34.973669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:00:34.982684 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1893c68c-5668-4cdc-a053-a0d4b155429a tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1561 microversion: 2.1 time: 0.173606 Aug 29 17:00:34.989363 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3900/7975] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:00:34 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:00:56.260281 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=5 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:56.261079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=38 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:00:56.265721 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:00:56.267988 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:00:56.275272 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:56.275767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:56.276210 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:56.276903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:00:56.277367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:00:56.277800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:00:56.330138 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-42162510-dee1-4a9e-8ba0-b101bb9645d1 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action" status: 200 len: 24561 microversion: 2.1 time: 0.071640 Aug 29 17:00:56.331061 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4076/7976] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:00:56 2022] POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action => generated 24561 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 17:01:07.407628 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:07.408179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:07.410120 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:07.410817 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=36 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:07.418115 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:07.418607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:07.419073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:07.419816 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:07.420283 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:07.420712 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:07.446247 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lazy-loading 'flavor' on Instance uuid 22b2e498-55a4-4255-881f-94a57f9b139d {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:01:07.512140 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fab4e732-bb2d-4952-8cba-463caa7813a0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action" status: 202 len: 0 microversion: 2.1 time: 0.108635 Aug 29 17:01:07.512788 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3901/7977] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:01:07 2022] POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:01:07.521445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:07.522319 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:07.525102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:07.526058 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:07.532164 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:07.532673 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:07.533127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:07.533835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:07.534305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:07.534747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:07.671226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:07.679770 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-264956e3-c9f6-45f5-b6bf-68dd66dd0739 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1688 microversion: 2.1 time: 0.162553 Aug 29 17:01:07.680334 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4077/7978] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:07 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:08.703272 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:08.704036 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:08.710454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:08.710944 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:08.711417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:08.712111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:08.712569 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:08.713001 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:08.852487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:08.860344 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b795560b-ca6e-4752-a042-b298e8e7dfc0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1671 microversion: 2.1 time: 0.162316 Aug 29 17:01:08.860912 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3902/7979] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:08 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:09.953285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:09.955508 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:09.964009 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:09.964517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:09.964968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:09.965676 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:09.966167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:09.966614 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:10.017752 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a93d5e10-1733-4eba-9485-1f64c5eb7575 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action" status: 200 len: 38349 microversion: 2.1 time: 0.068231 Aug 29 17:01:10.018731 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4078/7980] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:01:09 2022] POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action => generated 38349 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 17:01:10.031560 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:10.032092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:10.039384 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:10.039881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:10.040332 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:10.041041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:10.041505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:10.041939 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:10.112772 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-449413c3-7e7c-4a43-9c67-76fb4f2692c0 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action" status: 202 len: 0 microversion: 2.1 time: 0.085018 Aug 29 17:01:10.113403 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3903/7981] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:01:10 2022] POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:01:10.123061 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:10.123779 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:10.131244 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:10.132390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:10.132845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:10.133569 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:10.134043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:10.134487 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:10.367618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:10.375750 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d00da17f-a8f2-4497-8f86-594d0bf304c5 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1677 microversion: 2.1 time: 0.257045 Aug 29 17:01:10.376336 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4079/7982] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:10 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:11.399458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:11.400223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:11.406419 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:11.406903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:11.407371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:11.408085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:11.408543 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:11.408971 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:11.560973 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:11.569894 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7bce5b34-dabc-4788-93a4-63ac3c024114 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1677 microversion: 2.1 time: 0.175492 Aug 29 17:01:11.570577 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3904/7983] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:11 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:12.592297 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:12.592958 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:12.601326 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:12.601825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:12.602275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:12.602977 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:12.603472 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:12.603913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:12.738488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:12.746822 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d00f8979-c391-4be4-bae9-488a2e26c743 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1680 microversion: 2.1 time: 0.158489 Aug 29 17:01:12.747435 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4080/7984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:12 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:12.842458 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:12.844729 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:12.851907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:12.852405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:12.852851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:12.853561 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:12.854024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:12.854539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:12.896945 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e6fd5b45-413e-4cdc-8644-844d87b27ef7 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action" status: 200 len: 38349 microversion: 2.1 time: 0.058528 Aug 29 17:01:12.898269 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3905/7985] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:01:12 2022] POST /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d/action => generated 38349 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 17:01:13.891204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:13.891871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:13.894685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-c7ca0113-798f-42e4-9594-7a60b5a36489 req-238c0999-0764-4c83-8a3a-0a0ae26e9b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b2e498-55a4-4255-881f-94a57f9b139d", "tag": "c4f4afe5-60f2-4bc2-9689-c0fe5936a559"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:13.899309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:13.899840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:13.900295 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:13.901006 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:13.901700 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:13.902273 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:13.906317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c7ca0113-798f-42e4-9594-7a60b5a36489 req-238c0999-0764-4c83-8a3a-0a0ae26e9b0b service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:13.906879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c7ca0113-798f-42e4-9594-7a60b5a36489 req-238c0999-0764-4c83-8a3a-0a0ae26e9b0b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:13.907407 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-c7ca0113-798f-42e4-9594-7a60b5a36489 req-238c0999-0764-4c83-8a3a-0a0ae26e9b0b service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:13.919062 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-c7ca0113-798f-42e4-9594-7a60b5a36489 req-238c0999-0764-4c83-8a3a-0a0ae26e9b0b service nova] Creating event network-changed:c4f4afe5-60f2-4bc2-9689-c0fe5936a559 for instance 22b2e498-55a4-4255-881f-94a57f9b139d on n-h1-836830-13 Aug 29 17:01:13.924504 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-c7ca0113-798f-42e4-9594-7a60b5a36489 req-238c0999-0764-4c83-8a3a-0a0ae26e9b0b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034269 Aug 29 17:01:13.925479 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3906/7986] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:01:13.929867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:01:14.018979 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e22d4684-8ecc-4bed-8912-0b316e5debdb tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 204 len: 0 microversion: 2.1 time: 0.131356 Aug 29 17:01:14.020018 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4081/7987] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 17:01:13 2022] DELETE /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:01:14.032197 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:14.033222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:14.040277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:14.040778 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:14.041222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:14.041936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:14.042587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:14.043049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:14.189993 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:14.199117 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-526e1e00-8f63-4c6e-9fc3-38b420e44051 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1686 microversion: 2.1 time: 0.174199 Aug 29 17:01:14.200091 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3907/7988] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:14 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:15.222533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:15.223278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:15.231115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:15.231623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:15.232074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:15.232812 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:15.233285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:15.233723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:15.404561 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:15.412565 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fc840f03-dac9-4521-a341-19f828c8146e tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1686 microversion: 2.1 time: 0.194381 Aug 29 17:01:15.413189 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4082/7989] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:15 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1686 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:15.984506 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-7b5dda09-d1a6-42ea-872c-e96daef9bc59 req-0c05af6b-43db-4fe3-b9be-75e756e0a07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b2e498-55a4-4255-881f-94a57f9b139d", "name": "network-vif-deleted", "tag": "c4f4afe5-60f2-4bc2-9689-c0fe5936a559"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:15.996145 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7b5dda09-d1a6-42ea-872c-e96daef9bc59 req-0c05af6b-43db-4fe3-b9be-75e756e0a07c service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:15.996638 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7b5dda09-d1a6-42ea-872c-e96daef9bc59 req-0c05af6b-43db-4fe3-b9be-75e756e0a07c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:15.997080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-7b5dda09-d1a6-42ea-872c-e96daef9bc59 req-0c05af6b-43db-4fe3-b9be-75e756e0a07c service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:16.010255 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-7b5dda09-d1a6-42ea-872c-e96daef9bc59 req-0c05af6b-43db-4fe3-b9be-75e756e0a07c service nova] Creating event network-vif-deleted:c4f4afe5-60f2-4bc2-9689-c0fe5936a559 for instance 22b2e498-55a4-4255-881f-94a57f9b139d on n-h1-836830-13 Aug 29 17:01:16.016169 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-7b5dda09-d1a6-42ea-872c-e96daef9bc59 req-0c05af6b-43db-4fe3-b9be-75e756e0a07c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035009 Aug 29 17:01:16.016799 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3908/7990] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:01:16.433777 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:16.434518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:16.441627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:16.442121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:16.442565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:16.443289 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:16.443747 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:16.444186 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:16.479604 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:16.480107 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:16.480558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:16.481034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lazy-loading 'fault' on Instance uuid 22b2e498-55a4-4255-881f-94a57f9b139d {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:01:16.528331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e53500b97e4c3286d76015abcf6e0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197e7b145ed049b0a37bd871b4a34920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:16.535531 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-adf434e7-19cb-4950-bb4a-97d6f5be8fd9 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 200 len: 1355 microversion: 2.1 time: 0.105732 Aug 29 17:01:16.536103 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4083/7991] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:16 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:01:17.557536 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:17.558253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] [instance: 22b2e498-55a4-4255-881f-94a57f9b139d] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:17.565865 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:17.566365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:17.566812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:17.567556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:17.568024 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:17.568457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:17.583131 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] HTTP exception thrown: Instance 22b2e498-55a4-4255-881f-94a57f9b139d could not be found. Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Request method failure captured: Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d HTTP/1.1 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDO8A8OfBQr9E97Tgn9hzsylqWms-dzavL3XUeAAJS1fpXzfGusJDWFwdJHOLyiPCctY3ENDMWxRrV_lZwWhLZZ6_TijS2VgpDefXGcTrUdODWO5x7qFio_SsWOK_Lw2PQvokxxR22MSONV0GVxyDsnys-AVbsSOouYLmhR_mw99klb0 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_197e7b145ed049b0a37bd871b4a34920", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/197e7b145ed049b0a37bd871b4a34920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/197e7b145ed049b0a37bd871b4a34920"}]}] Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 197e7b145ed049b0a37bd871b4a34920 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-382141136 Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: a0e53500b97e4c3286d76015abcf6e0a Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestNetworkAdvancedServerOps-382141136-project Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 22b2e498-55a4-4255-881f-94a57f9b139d could not be found. Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '22b2e498-55a4-4255-881f-94a57f9b139d'} Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b2e498-55a4-4255-881f-94a57f9b139d could not be found. Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b2e498-55a4-4255-881f-94a57f9b139d could not be found. Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:01:17.584892 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b2e498-55a4-4255-881f-94a57f9b139d could not be found. Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Returning 404 to user: Instance 22b2e498-55a4-4255-881f-94a57f9b139d could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-b85fe9ce-0700-42a9-931c-3ec584328670 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d" status: 404 len: 111 microversion: 2.1 time: 0.034310 Aug 29 17:01:17.589818 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3909/7992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:17 2022] GET /compute/v2.1/servers/22b2e498-55a4-4255-881f-94a57f9b139d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:01:21.236316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-bc10943a-b4a5-4a8e-a886-777252711ce3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] Calling method '.version_select at 0x7f32ee246a60>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:21.272509 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-bc10943a-b4a5-4a8e-a886-777252711ce3 tempest-TestNetworkAdvancedServerOps-382141136 tempest-TestNetworkAdvancedServerOps-382141136-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-375839621" status: 202 len: 0 microversion: 2.1 time: 0.040814 Aug 29 17:01:21.274327 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4084/7993] 10.222.0.83 () {58 vars in 1281 bytes} [Mon Aug 29 17:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-375839621 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:01:32.613896 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=18 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:32.614683 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:32.862827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c5fd1ef-8700-42a1-864a-a5e81911c8ec tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'create', calling method: .version_select at 0x7f32ee506d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-478537394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRKJyZLhmB0PEQsMqcypkqbq9JKN8wpp67rTgHXlcDngBw+gVF49kOHHngfh8Gp8nIRP8GmLPQmbfhGmAjSQjCgM+h+OjhmytXpDHvuL81aUNU0Wjmv0Y7SHJtNrtzocA=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:32.887223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-8c5fd1ef-8700-42a1-864a-a5e81911c8ec tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for project 6f5ff1a3351844f2a09239c37030423d. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:01:32.894319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-8c5fd1ef-8700-42a1-864a-a5e81911c8ec tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for user e5e3906fec6e465bb21f6b0846c7b70f and project 6f5ff1a3351844f2a09239c37030423d. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:01:32.921621 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c5fd1ef-8700-42a1-864a-a5e81911c8ec tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.313251 Aug 29 17:01:32.922292 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3910/7994] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 17:01:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:01:33.922701 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1135138523", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-478537394", "security_groups": [{"name": "tempest-secgroup-smoke-1518302242"}], "networks": [{"uuid": "b5a992d9-6147-4ce7-a77e-388b554d5cb7"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:33.934950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:33.936194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:34.172199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] validate_networks() for [('b5a992d9-6147-4ce7-a77e-388b554d5cb7', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:01:34.652750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:01:34.653192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:01:34.653684 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:01:34.654115 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:01:34.654542 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:01:34.664262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:34.664764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:34.665216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:34.665966 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:34.666440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:34.666887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:34.690059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for project 6f5ff1a3351844f2a09239c37030423d. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:01:34.695801 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for user e5e3906fec6e465bb21f6b0846c7b70f and project 6f5ff1a3351844f2a09239c37030423d. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:01:34.708837 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:01:34.711285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:01:34.758997 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [e385b3e2-43e8-4aac-8448-f0ab2ce197f4] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 17:01:35.766764 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [e385b3e2-43e8-4aac-8448-f0ab2ce197f4] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50204. Aug 29 17:01:35.770703 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-64379543-296d-448f-8f79-2556bb866524 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.852166 Aug 29 17:01:35.771585 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4085/7995] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 17:01:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 17:01:35.784587 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-65338a5e-e9ab-40ac-84bd-f85a2aa81796 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:35.785316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-65338a5e-e9ab-40ac-84bd-f85a2aa81796 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:35.910013 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-65338a5e-e9ab-40ac-84bd-f85a2aa81796 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:35.923712 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-65338a5e-e9ab-40ac-84bd-f85a2aa81796 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1246 microversion: 2.1 time: 0.144128 Aug 29 17:01:35.925108 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3911/7996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:35 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1246 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:36.948014 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:36.948659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:36.955850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:36.956363 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:36.956825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:36.957703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:36.958198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:36.958622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:37.025599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:37.033650 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-56a5c4e6-56f6-42aa-a9c6-5d458b603628 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1316 microversion: 2.1 time: 0.091749 Aug 29 17:01:37.034318 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4086/7997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:36 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:38.056531 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:38.057345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:38.072761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:38.073275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:38.073726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:38.074454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:38.074921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:38.075386 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:38.253266 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:38.261384 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ee977460-29d0-41d2-bff1-f05e6a419623 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1372 microversion: 2.1 time: 0.209924 Aug 29 17:01:38.261980 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3912/7998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:38 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:38.325826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-2fb09de4-8ac9-4c22-8a69-ce557e343e6f req-f968804d-0789-4b74-be02-42fa43031465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:38.337890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2fb09de4-8ac9-4c22-8a69-ce557e343e6f req-f968804d-0789-4b74-be02-42fa43031465 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:38.338384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2fb09de4-8ac9-4c22-8a69-ce557e343e6f req-f968804d-0789-4b74-be02-42fa43031465 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:38.338833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-2fb09de4-8ac9-4c22-8a69-ce557e343e6f req-f968804d-0789-4b74-be02-42fa43031465 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:38.351804 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-2fb09de4-8ac9-4c22-8a69-ce557e343e6f req-f968804d-0789-4b74-be02-42fa43031465 service nova] Creating event network-changed:51b6a23b-07f5-4c94-a1fe-f5f8379042f1 for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e on n-h1-836830-13 Aug 29 17:01:38.356807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-2fb09de4-8ac9-4c22-8a69-ce557e343e6f req-f968804d-0789-4b74-be02-42fa43031465 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035010 Aug 29 17:01:38.357438 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4087/7999] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:01:39.283235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:39.283862 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:39.291880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:39.292374 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:39.292818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:39.293513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:39.293976 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:39.294425 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:39.428230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:39.436231 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-53c01a24-a64f-4612-b202-22d61441cee1 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1372 microversion: 2.1 time: 0.156974 Aug 29 17:01:39.436820 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3913/8000] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:39 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:40.459088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:40.460402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:40.466942 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:40.467498 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:40.467955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:40.468661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:40.469138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:40.469581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:40.615459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:40.623473 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3e5b36c6-1d39-4f9c-9b54-7ecef58e4c3c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1372 microversion: 2.1 time: 0.169538 Aug 29 17:01:40.624055 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4088/8001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:40 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:41.644188 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:41.644750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:41.652330 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:41.652830 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:41.653276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:41.653974 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:41.654442 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:41.654877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:41.788908 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:41.797100 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-136997af-00ac-4635-8dee-8e8b3f73b935 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1372 microversion: 2.1 time: 0.156845 Aug 29 17:01:41.797740 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3914/8002] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:41 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:42.818056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:42.819362 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:42.826842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:42.827370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:42.827821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:42.828519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:42.828983 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:42.829420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:42.980041 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:42.988414 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a2102f34-fa90-4b58-9077-a586cbeceb33 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1372 microversion: 2.1 time: 0.174516 Aug 29 17:01:42.989023 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4089/8003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:42 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:44.009446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:44.010065 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:44.016957 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:44.017446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:44.017891 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:44.018575 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:44.019066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:44.019478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:44.153541 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:44.161499 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-12ce20a8-ea8f-474c-917e-897771c92be4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1372 microversion: 2.1 time: 0.155973 Aug 29 17:01:44.162083 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3915/8004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:44 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:44.722047 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-b5a2cf8b-8ded-4800-a8a2-7a54fdfaa625 req-3d542467-4b87-4cdb-bfd2-f2e28277888e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "name": "network-vif-plugged", "status": "completed", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:44.728698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:44.729407 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:44.735627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b5a2cf8b-8ded-4800-a8a2-7a54fdfaa625 req-3d542467-4b87-4cdb-bfd2-f2e28277888e service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:44.736123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b5a2cf8b-8ded-4800-a8a2-7a54fdfaa625 req-3d542467-4b87-4cdb-bfd2-f2e28277888e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:44.736570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-b5a2cf8b-8ded-4800-a8a2-7a54fdfaa625 req-3d542467-4b87-4cdb-bfd2-f2e28277888e service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:44.749594 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-b5a2cf8b-8ded-4800-a8a2-7a54fdfaa625 req-3d542467-4b87-4cdb-bfd2-f2e28277888e service nova] Creating event network-vif-plugged:51b6a23b-07f5-4c94-a1fe-f5f8379042f1 for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e on n-h1-836830-13 Aug 29 17:01:44.754636 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-b5a2cf8b-8ded-4800-a8a2-7a54fdfaa625 req-3d542467-4b87-4cdb-bfd2-f2e28277888e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036432 Aug 29 17:01:44.755279 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4090/8005] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:01:45.182274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:45.182821 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:45.190201 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:45.190714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:45.191187 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:45.191900 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:45.192352 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:45.192796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:45.328584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:45.337605 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4191f450-e83c-4125-a7e6-4f096c1ff0c6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1372 microversion: 2.1 time: 0.159487 Aug 29 17:01:45.338216 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3916/8006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:45 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:46.359276 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:46.359902 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:46.366090 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:46.366581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:46.367035 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:46.367742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:46.368199 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:46.368630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:46.499294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:46.508280 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9212df67-e8fa-4b7f-80ca-612a0cc82e48 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1556 microversion: 2.1 time: 0.154199 Aug 29 17:01:46.508867 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4091/8007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:46 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:46.528659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:01:46.529275 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:01:46.531270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:01:46.541270 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:46.541757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:46.546067 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:46.546766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:46.547288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:46.547717 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:46.685602 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:01:46.693692 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-428c5206-449d-4a39-883a-c8c5b97f7947 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1556 microversion: 2.1 time: 0.168993 Aug 29 17:01:46.694917 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3917/8008] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:01:46 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:01:48.657203 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d388da0e-551b-43a5-88de-f67bb94364cb req-f0dfba72-d7ff-4a27-af16-1c066b13c14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:01:48.669845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d388da0e-551b-43a5-88de-f67bb94364cb req-f0dfba72-d7ff-4a27-af16-1c066b13c14f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:01:48.670669 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d388da0e-551b-43a5-88de-f67bb94364cb req-f0dfba72-d7ff-4a27-af16-1c066b13c14f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:01:48.671143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d388da0e-551b-43a5-88de-f67bb94364cb req-f0dfba72-d7ff-4a27-af16-1c066b13c14f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:01:48.682981 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d388da0e-551b-43a5-88de-f67bb94364cb req-f0dfba72-d7ff-4a27-af16-1c066b13c14f service nova] Creating event network-changed:51b6a23b-07f5-4c94-a1fe-f5f8379042f1 for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e on n-h1-836830-13 Aug 29 17:01:48.688064 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d388da0e-551b-43a5-88de-f67bb94364cb req-f0dfba72-d7ff-4a27-af16-1c066b13c14f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034648 Aug 29 17:01:48.688662 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4092/8009] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:03:43.844343 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:03:43.844978 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:03:43.845128 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:03:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e/action (ip 10.222.0.83) !!! Aug 29 17:03:43.846854 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:03:43.846983 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:03:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e/action (ip 10.222.0.83) !!! Aug 29 17:03:43.847934 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:43.848922 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=36 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:43.853175 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:03:43.853715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:43.864725 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:43.865215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:43.865690 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:43.866389 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:43.866852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:43.867305 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:43.894950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.objects.instance [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lazy-loading 'flavor' on Instance uuid f248601e-91bf-40ab-98cb-b9004b2a6e1e {{(pid=129132) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:03:44.078140 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-632f1e79-9227-4df8-898a-d5260bffcd66 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.236546 Aug 29 17:03:44.078869 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3918/8010] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:03:43 2022] POST /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:03:44.089811 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 17:03:44.090302 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 17:03:44.090916 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:44.091750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=32 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:03:44.093475 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 17:03:44.094521 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 17:03:44.100918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:44.101660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:44.110609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:44.111142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:44.111598 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:44.112316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:44.112789 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:44.113232 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:44.250565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:44.258755 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e2ed0144-9e87-49dd-a209-4fbc7294d718 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.171599 Aug 29 17:03:44.259376 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4093/8011] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:44 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:45.282903 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:45.283622 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:45.290880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:45.291393 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:45.291824 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:45.292509 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:45.292960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:45.293381 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:45.299856 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50308. Aug 29 17:03:45.428325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:45.436656 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e58d4674-c276-4a63-9127-71e4c08b08b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.159480 Aug 29 17:03:45.437232 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3919/8012] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:45 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:03:46.458917 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:46.459570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:46.469722 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:46.470216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:46.470662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:46.471390 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:46.471853 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:46.472285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:46.477099 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50316. Aug 29 17:03:46.480116 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50314. Aug 29 17:03:46.606639 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:46.624167 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-26f08f4a-b8ed-46ba-b6e5-a0ef5c8bd6df tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.168324 Aug 29 17:03:46.624937 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4094/8013] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:46 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:47.645574 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:47.646202 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:47.653138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:47.653629 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:47.654073 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:47.655396 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:47.655858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:47.656289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:47.792748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:47.801250 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d72446fd-bdc3-4bbb-84a3-0f713fabc6b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.159667 Aug 29 17:03:47.801823 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3920/8014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:47 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:48.822473 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:48.823132 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:48.831181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:48.831678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:48.832123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:48.832844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:48.833306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:48.833739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:48.970093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:48.977807 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a56115b8-11c8-4b72-972e-0c34d48387b3 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.159354 Aug 29 17:03:48.978376 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4095/8015] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:48 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:49.999064 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:49.999686 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:50.006487 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:50.006982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:50.007453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:50.008157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:50.008623 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:50.009059 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:50.140924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:50.148786 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2c9b339a-b428-4416-b5a7-0b9772031491 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.154367 Aug 29 17:03:50.149365 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3921/8016] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:49 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:51.169775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:51.170952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:51.178062 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:51.178560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:51.179012 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:51.179742 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:51.180212 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:51.180654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:51.317070 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:51.324904 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9eb6935b-414b-43ab-b057-d6e104f851b4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.159167 Aug 29 17:03:51.325485 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4096/8017] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:51 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:52.348061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:52.348693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:52.355940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:52.356428 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:52.356866 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:52.357596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:52.358082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:52.358501 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:52.488229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:52.497334 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-0042beb2-0b43-4bdf-b04d-019d74da7689 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.153227 Aug 29 17:03:52.497916 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3922/8018] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:52 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:53.519133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:53.519682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:53.526644 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:53.527176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:53.527629 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:53.528332 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:53.528799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:53.529240 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:53.660345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:53.668264 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9ad5fbf8-dcf0-4d5b-b1e3-f07f3fda1afd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.153183 Aug 29 17:03:53.673917 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4097/8019] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:53 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:54.690611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:54.691288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:54.698342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:54.698842 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:54.699320 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:54.700034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:54.700503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:54.700941 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:55.174703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:55.182549 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f2a5c938-ff9f-44f9-9948-188b01a64626 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1702 microversion: 2.1 time: 0.496671 Aug 29 17:03:55.183142 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3923/8020] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:54 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1702 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:56.204826 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:56.205459 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:56.212591 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:56.213038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:56.213491 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:56.214226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:56.214692 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:56.215169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:56.349204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:56.357122 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-7de5c1cc-465b-4840-a24b-191b7f5cc920 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1702 microversion: 2.1 time: 0.157004 Aug 29 17:03:56.358241 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4098/8021] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:56 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:57.386511 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:57.387478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:57.407162 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:57.408232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:57.408850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:57.409738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:57.410380 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:57.411618 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:57.603894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:57.612212 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-13de3a24-e88e-484d-8b41-388fffdef2d2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.229678 Aug 29 17:03:57.613107 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3924/8022] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:57 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:58.638414 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:58.640123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:58.649235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:58.649739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:58.650195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:58.650912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:58.651408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:58.651849 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:58.818324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:03:58.828886 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3dea5ef5-1fc3-4dda-ac6f-4c8f62128e77 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.194264 Aug 29 17:03:58.829499 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4099/8023] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:58 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:03:59.423006 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-12ae47d9-a9a4-4f8e-9ac3-75e0dbf95902 req-d9ba937f-e9cd-46b5-bab9-69ed1e11ca67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "name": "network-vif-plugged", "status": "completed", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:03:59.455462 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-12ae47d9-a9a4-4f8e-9ac3-75e0dbf95902 req-d9ba937f-e9cd-46b5-bab9-69ed1e11ca67 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:59.456262 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-12ae47d9-a9a4-4f8e-9ac3-75e0dbf95902 req-d9ba937f-e9cd-46b5-bab9-69ed1e11ca67 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:59.456881 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-12ae47d9-a9a4-4f8e-9ac3-75e0dbf95902 req-d9ba937f-e9cd-46b5-bab9-69ed1e11ca67 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:59.473678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-12ae47d9-a9a4-4f8e-9ac3-75e0dbf95902 req-d9ba937f-e9cd-46b5-bab9-69ed1e11ca67 service nova] Creating event network-vif-plugged:51b6a23b-07f5-4c94-a1fe-f5f8379042f1 for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e on n-h1-836830-13 Aug 29 17:03:59.480465 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-12ae47d9-a9a4-4f8e-9ac3-75e0dbf95902 req-d9ba937f-e9cd-46b5-bab9-69ed1e11ca67 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175024 Aug 29 17:03:59.484459 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3925/8024] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:03:59.851293 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:03:59.852344 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:03:59.859851 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:59.860369 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:59.860952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:03:59.861690 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:03:59.862267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:03:59.862724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:00.015264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:00.023866 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ce21f198-f273-4c6f-b47a-f2fbaea0a916 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.176600 Aug 29 17:04:00.038272 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4100/8025] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:03:59 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:01.049590 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:01.051111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:01.059838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:01.060397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:01.061411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:01.062125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:01.065303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:01.065303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:01.229370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:01.237661 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-da085a62-4360-4f70-92da-adc5476c9526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.196105 Aug 29 17:04:01.238456 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3926/8026] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:01 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:02.260951 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:02.261540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:02.270384 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:02.270920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:02.271406 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:02.272148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:02.272620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:02.273095 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:02.439678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:02.449009 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a39901ac-8ae9-4a1b-b114-08eaaa85bdd2 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.192094 Aug 29 17:04:02.450495 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4101/8027] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:02 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:03.471852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:03.472596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:03.488478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:03.489158 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:03.490286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:03.491082 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:03.492260 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:03.493003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:03.652317 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:03.662746 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-086671df-6042-4ea3-8e84-b4e391a6aaa6 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.196800 Aug 29 17:04:03.677175 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3927/8028] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:03 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:04.689188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:04.690834 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:04.698403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:04.699067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:04.699646 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:04.700464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:04.701048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:04.702218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:04.892652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:04.901776 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f46d5679-2090-48fa-8c75-3e767c5b17f4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.218950 Aug 29 17:04:04.902388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4102/8029] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:04 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:05.924754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:05.925362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:05.932698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:05.933251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:05.933718 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:05.934415 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:05.934868 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:05.935323 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:06.074152 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:06.083384 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8d0de8c9-4a89-491c-9f15-0e74b8bdb0d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1697 microversion: 2.1 time: 0.163141 Aug 29 17:04:06.083970 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3928/8030] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:05 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:07.109045 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:07.109654 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:07.116664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:07.117163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:07.117609 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:07.118308 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:07.118772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:07.119236 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:07.263053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:07.271824 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9e43b873-3587-455c-a7b6-16f8f572fbb0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1679 microversion: 2.1 time: 0.166832 Aug 29 17:04:07.272414 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4103/8031] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:07 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:08.293646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:08.294319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:08.302351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:08.302844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:08.303433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:08.304029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:08.304508 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:08.304937 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:08.444450 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:08.452437 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2350d51c-4aa3-4479-905d-07ebe38d6024 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1679 microversion: 2.1 time: 0.162878 Aug 29 17:04:08.453015 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3929/8032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:08 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:09.290660 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-cc393bd6-862f-407b-a629-29f8ba4a01bd req-727ca9bd-3353-4a4b-bdc4-4a7495d0a2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "name": "network-vif-unplugged", "status": "completed", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:04:09.301538 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cc393bd6-862f-407b-a629-29f8ba4a01bd req-727ca9bd-3353-4a4b-bdc4-4a7495d0a2c5 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:09.302043 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cc393bd6-862f-407b-a629-29f8ba4a01bd req-727ca9bd-3353-4a4b-bdc4-4a7495d0a2c5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:09.302499 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-cc393bd6-862f-407b-a629-29f8ba4a01bd req-727ca9bd-3353-4a4b-bdc4-4a7495d0a2c5 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:09.314230 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.compute.server_external_events [req-cc393bd6-862f-407b-a629-29f8ba4a01bd req-727ca9bd-3353-4a4b-bdc4-4a7495d0a2c5 service nova] Unable to find a host for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e. Dropping event network-vif-unplugged {{(pid=129133) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 17:04:09.315236 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-cc393bd6-862f-407b-a629-29f8ba4a01bd req-727ca9bd-3353-4a4b-bdc4-4a7495d0a2c5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028428 Aug 29 17:04:09.316812 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4104/8033] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 17:04:09.473336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:09.473960 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:09.480813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:09.481300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:09.481741 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:09.482456 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:09.482916 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:09.483373 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:09.624915 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:09.632748 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c90110d7-384e-44d8-875b-22b15d9aaaad tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1622 microversion: 2.1 time: 0.163314 Aug 29 17:04:09.633340 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3930/8034] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:09 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1622 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:09.653443 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:04:09.654074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:09.660167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:09.660659 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:09.661105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:09.661799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:09.662261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:09.662694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:09.705910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129133) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 17:04:09.773485 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-d564a9cd-177b-4a68-8c40-080b4b8c027c tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.123881 Aug 29 17:04:09.774106 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4105/8035] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:04:09 2022] POST /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:04:09.783060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:09.783701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:09.789595 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:09.790157 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:09.790603 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:09.791336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:09.791796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:09.792225 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:09.942265 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:09.950507 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3cca58b9-6b2f-4afe-a16a-74fc35759f28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1630 microversion: 2.1 time: 0.172134 Aug 29 17:04:09.951632 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3931/8036] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:09 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1630 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:10.974098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:10.974661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:10.980645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:10.981138 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:10.981583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:10.982309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:10.982945 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:10.983405 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:11.118858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:11.126902 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca742b16-95e6-4da6-b679-41ab3d5b06fa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.157767 Aug 29 17:04:11.127530 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4106/8037] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:10 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:12.148823 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:12.150069 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:12.158223 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:12.159441 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:12.159965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:12.161117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:12.161654 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:12.162155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:12.330869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:12.339776 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-e72eaa89-1a5f-4b40-ad20-d93b58dba06e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.195472 Aug 29 17:04:12.340503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3932/8038] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:12 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:13.361631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:13.362640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:13.370316 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:13.371114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:13.371748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:13.372643 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:13.374077 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:13.374681 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:13.523752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:13.531883 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-26061c17-4369-4baf-a079-664281490d31 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.174104 Aug 29 17:04:13.532729 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4107/8039] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:13 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:14.554214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:14.554838 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:14.557680 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=31 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:14.570362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:14.570987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:14.571455 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:14.572169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:14.572636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:14.573066 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:14.577156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:14.722982 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:14.731617 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-440c7d4d-63cb-4937-8da6-e2200a0be374 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.181661 Aug 29 17:04:14.732256 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3933/8040] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:14 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:15.753192 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:15.754668 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:15.757761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:15.763870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:15.764712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:15.765172 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:15.765903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:15.766421 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:15.766865 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:15.773279 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:04:15.918753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:15.926900 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-fe4f2e49-fb8c-4d5a-9240-7c99ace28710 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.177918 Aug 29 17:04:15.927728 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4108/8041] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:15 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:16.948570 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:16.950894 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:16.959675 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:16.960558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:16.961193 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:16.962227 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:16.962861 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:16.963478 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:17.124926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:17.133146 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-151a534d-93d5-4fdb-a48e-578d97c02f7e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.188913 Aug 29 17:04:17.133929 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3934/8042] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:16 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:18.155481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:18.156275 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:18.163489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:18.163996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:18.164446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:18.165166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:18.165634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:18.166076 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:18.315305 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:18.323689 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a546bd7-b9c2-4140-a16a-20eb0703ceca tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.172792 Aug 29 17:04:18.324474 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4109/8043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:18 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:19.346372 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:19.347007 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:19.353542 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:19.354033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:19.354473 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:19.355205 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:19.355669 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:19.356096 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:19.496000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:19.503949 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1a264502-8544-487e-b008-0baab5b0d2f0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.162390 Aug 29 17:04:19.504541 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3935/8044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:19 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:20.525536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:20.526165 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:20.533709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:20.534201 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:20.534649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:20.535370 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:20.535832 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:20.536266 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:20.676122 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:20.684039 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5cdae73b-58c2-4f16-a171-3bb46dc399ea tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.162479 Aug 29 17:04:20.684624 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4110/8045] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:20 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:21.709802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:21.709802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:21.717016 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:21.717505 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:21.717951 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:21.718658 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:21.719156 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:21.719607 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:21.854050 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:21.861951 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e4d8d6a-47f3-4249-af82-0fbd05b98b43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.159987 Aug 29 17:04:21.862539 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3936/8046] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:21 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:22.882678 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:22.883328 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:22.890457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:22.890952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:22.891418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:22.892110 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:22.892567 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:22.892997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:23.023426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:23.031874 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d6315ec-8483-4d16-b071-b44e655a8fcf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.153130 Aug 29 17:04:23.032457 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4111/8047] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:22 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:24.053485 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:24.054098 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:24.061752 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:24.062238 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:24.062674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:24.063404 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:24.063850 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:24.064276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:24.201588 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:24.209638 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-190cb242-1c9c-402c-9561-5fbd51e9a612 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.160127 Aug 29 17:04:24.210221 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3937/8048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:24 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:25.230989 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:25.231641 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:25.239249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:25.239748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:25.240198 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:25.240898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:25.241360 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:25.241797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:25.380258 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:25.388737 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-14204656-e2fe-4409-b22e-4af4b3e25bde tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.161503 Aug 29 17:04:25.389326 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4112/8049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:25 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:25.440405 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f64845c1-30b4-4a88-8763-af34cea09044 req-83d6f83e-34df-43f8-a9b1-5986c746d1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "name": "network-vif-plugged", "status": "completed", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:04:25.451755 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f64845c1-30b4-4a88-8763-af34cea09044 req-83d6f83e-34df-43f8-a9b1-5986c746d1d2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:25.452324 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f64845c1-30b4-4a88-8763-af34cea09044 req-83d6f83e-34df-43f8-a9b1-5986c746d1d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:25.452765 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f64845c1-30b4-4a88-8763-af34cea09044 req-83d6f83e-34df-43f8-a9b1-5986c746d1d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:25.466131 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f64845c1-30b4-4a88-8763-af34cea09044 req-83d6f83e-34df-43f8-a9b1-5986c746d1d2 service nova] Creating event network-vif-plugged:51b6a23b-07f5-4c94-a1fe-f5f8379042f1 for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e on n-h1-836830-13 Aug 29 17:04:25.472407 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f64845c1-30b4-4a88-8763-af34cea09044 req-83d6f83e-34df-43f8-a9b1-5986c746d1d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036380 Aug 29 17:04:25.473167 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3938/8050] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:04:26.409828 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:26.410477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:26.417417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:26.417924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:26.418392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:26.419128 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:26.420108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:26.420797 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:26.554918 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:26.564109 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3c6beb94-df76-486a-b50a-cd5eaa733648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1688 microversion: 2.1 time: 0.158129 Aug 29 17:04:26.577162 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4113/8051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:26 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:04:27.587167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:04:27.587880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:04:27.595431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:27.595940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:27.596383 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:27.597089 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:04:27.597580 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:04:27.598015 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:04:27.731235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:04:27.740017 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-461d0650-56fc-4707-b307-65230c4ee799 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1675 microversion: 2.1 time: 0.158245 Aug 29 17:04:27.740619 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3939/8052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:04:27 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:37.644504 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=11 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:37.645288 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=35 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:37.646126 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:05:37.649997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=13 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:37.650954 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=37 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:37.651582 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:05:37.651820 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 17:05:37.652698 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 17:05:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e (ip 10.222.0.83) !!! Aug 29 17:05:37.664436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:37.664952 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:37.676451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:37.676959 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:37.677402 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:37.678124 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:37.678774 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:37.679048 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:37.711990 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:05:37.737061 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d710dfef-29f3-423b-94d9-4ae7d263186d req-e30ef58c-fa48-420b-a544-48423183b558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:37.749375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d710dfef-29f3-423b-94d9-4ae7d263186d req-e30ef58c-fa48-420b-a544-48423183b558 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:37.750000 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d710dfef-29f3-423b-94d9-4ae7d263186d req-e30ef58c-fa48-420b-a544-48423183b558 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:37.750530 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d710dfef-29f3-423b-94d9-4ae7d263186d req-e30ef58c-fa48-420b-a544-48423183b558 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:37.762615 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d710dfef-29f3-423b-94d9-4ae7d263186d req-e30ef58c-fa48-420b-a544-48423183b558 service nova] Creating event network-changed:51b6a23b-07f5-4c94-a1fe-f5f8379042f1 for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e on n-h1-836830-13 Aug 29 17:05:37.768851 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d710dfef-29f3-423b-94d9-4ae7d263186d req-e30ef58c-fa48-420b-a544-48423183b558 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120589 Aug 29 17:05:37.772820 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3940/8053] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:05:37.812841 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-64a84931-0ea6-4e92-ab06-bee7a30406d4 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "DELETE /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 204 len: 0 microversion: 2.1 time: 0.170531 Aug 29 17:05:37.813925 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4114/8054] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 17:05:37 2022] DELETE /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:05:37.825391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:37.826111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:37.834264 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:37.834758 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:37.835232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:37.836042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:37.836492 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:37.836918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:37.975918 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:37.983592 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c5fafc09-38dc-4442-933c-01299cf9b123 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.162948 Aug 29 17:05:37.984170 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3941/8055] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:37 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:39.005306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:39.006025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:39.012860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:39.013355 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:39.013800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:39.014496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:39.014955 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:39.015408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:39.200743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:39.210404 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-177aa309-670a-416e-9a9d-97313e75cf2b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 200 len: 1681 microversion: 2.1 time: 0.209901 Aug 29 17:05:39.211008 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4115/8056] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:38 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:39.784102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-b6dcc73e-78f1-469c-8ed4-a04dfb477ca1 req-e9631abe-60c8-4688-b057-b429cac76227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f248601e-91bf-40ab-98cb-b9004b2a6e1e", "name": "network-vif-deleted", "tag": "51b6a23b-07f5-4c94-a1fe-f5f8379042f1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:39.794258 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b6dcc73e-78f1-469c-8ed4-a04dfb477ca1 req-e9631abe-60c8-4688-b057-b429cac76227 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:39.794671 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b6dcc73e-78f1-469c-8ed4-a04dfb477ca1 req-e9631abe-60c8-4688-b057-b429cac76227 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:39.795125 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-b6dcc73e-78f1-469c-8ed4-a04dfb477ca1 req-e9631abe-60c8-4688-b057-b429cac76227 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:39.807295 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-b6dcc73e-78f1-469c-8ed4-a04dfb477ca1 req-e9631abe-60c8-4688-b057-b429cac76227 service nova] Creating event network-vif-deleted:51b6a23b-07f5-4c94-a1fe-f5f8379042f1 for instance f248601e-91bf-40ab-98cb-b9004b2a6e1e on n-h1-836830-13 Aug 29 17:05:39.812372 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-b6dcc73e-78f1-469c-8ed4-a04dfb477ca1 req-e9631abe-60c8-4688-b057-b429cac76227 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032647 Aug 29 17:05:39.813020 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3942/8057] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:05:40.232465 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:40.233096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: f248601e-91bf-40ab-98cb-b9004b2a6e1e] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:40.240762 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:40.241264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:40.241711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:40.242416 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:40.242882 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:40.243348 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:40.256817 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] HTTP exception thrown: Instance f248601e-91bf-40ab-98cb-b9004b2a6e1e could not be found. Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Request method failure captured: Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e HTTP/1.1 Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDPDnMcrKpRK0Da3mIgfwIHOXAVLWE5XiW12U50Vql4JcS-us2n5bC0x4LeL2jWyKyFX3Jr4KAV_5yfT94VZ5XxTn-oLuro3np8VgSKhB-PaGlEgPaI_OY4RJngQZT_7q_8mzqbkUugkf6r_lHSF5FVi5xMzDodmKiazkWH3YAXrPtbI Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 6f5ff1a3351844f2a09239c37030423d Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestShelveInstance-1930515491 Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f5ff1a3351844f2a09239c37030423d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f5ff1a3351844f2a09239c37030423d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f5ff1a3351844f2a09239c37030423d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f5ff1a3351844f2a09239c37030423d"}]}] Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestShelveInstance-1930515491 Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 6f5ff1a3351844f2a09239c37030423d Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestShelveInstance-1930515491 Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestShelveInstance-1930515491-project Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: e5e3906fec6e465bb21f6b0846c7b70f Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestShelveInstance-1930515491-project Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance f248601e-91bf-40ab-98cb-b9004b2a6e1e could not be found. Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'f248601e-91bf-40ab-98cb-b9004b2a6e1e'} Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f248601e-91bf-40ab-98cb-b9004b2a6e1e could not be found. Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f248601e-91bf-40ab-98cb-b9004b2a6e1e could not be found. Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:05:40.258478 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f248601e-91bf-40ab-98cb-b9004b2a6e1e could not be found. Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Returning 404 to user: Instance f248601e-91bf-40ab-98cb-b9004b2a6e1e could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-798af9fa-d91e-4cfd-9c7b-c0487ce54e51 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e" status: 404 len: 111 microversion: 2.1 time: 0.031540 Aug 29 17:05:40.263653 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4116/8058] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:40 2022] GET /compute/v2.1/servers/f248601e-91bf-40ab-98cb-b9004b2a6e1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:05:40.426532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-9fce924d-c891-42a7-8340-03925ec19648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '.version_select at 0x7f32ee3f8310>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:40.452710 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-9fce924d-c891-42a7-8340-03925ec19648 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-478537394" status: 202 len: 0 microversion: 2.1 time: 0.031015 Aug 29 17:05:40.453314 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3943/8059] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 17:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-478537394 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:05:40.477874 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ed420f8c-965a-445c-81bc-4cde2a232c8d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'create', calling method: .version_select at 0x7f32ed0d6670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1438466552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdPC8v2l1alK0Ldc5d29wHdq+ZngqE6mt0dwpy/WbuQBWGEGOLlIQHuKBsUdjZS8CBdPFjzg+oO2tnaMlK5yTtcO+/lWRbGK9JqMC6WC465k3GjO5IICi/RRFNY5VivZA=="}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:40.493992 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ed420f8c-965a-445c-81bc-4cde2a232c8d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for project 6f5ff1a3351844f2a09239c37030423d. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:05:40.499167 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ed420f8c-965a-445c-81bc-4cde2a232c8d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for user e5e3906fec6e465bb21f6b0846c7b70f and project 6f5ff1a3351844f2a09239c37030423d. Resources: {'key_pairs'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:05:40.526554 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ed420f8c-965a-445c-81bc-4cde2a232c8d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052548 Aug 29 17:05:40.527218 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4117/8060] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 17:05:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:05:56.720659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-393182974", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1438466552", "security_groups": [{"name": "tempest-secgroup-smoke-1423286979"}], "networks": [{"uuid": "b5a992d9-6147-4ce7-a77e-388b554d5cb7"}], "block_device_mapping_v2": [{"uuid": "dd50f738-8035-4e0d-8b11-edbe91c9f18b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:05:56.731217 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=10 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:56.731897 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:56.843633 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.network.neutron [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] validate_networks() for [('b5a992d9-6147-4ce7-a77e-388b554d5cb7', None, None, None, None, None)] {{(pid=129132) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:05:57.260898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Flavor limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:05:57.261325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Image limits 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:05:57.261804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Flavor pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:05:57.262218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Image pref 0:0:0 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:05:57.262661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.virt.hardware [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129132) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:05:57.272138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:57.272626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:57.273094 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:57.273822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:57.274282 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:57.274714 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:57.291769 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for project 6f5ff1a3351844f2a09239c37030423d. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:05:57.296913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Getting quotas for user e5e3906fec6e465bb21f6b0846c7b70f and project 6f5ff1a3351844f2a09239c37030423d. Resources: {'instances', 'cores', 'ram'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:05:57.355698 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Going to run 1 instances... {{(pid=129132) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:05:57.357952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd50f738-8035-4e0d-8b11-edbe91c9f18b',volume_size=None,volume_type=None)] {{(pid=129132) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:05:57.491822 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a669eb5b-b43d-4ba3-a1bc-d0f6ebb33f93 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775882 Aug 29 17:05:57.492651 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3944/8061] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 17:05:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 17:05:57.504054 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ca6d614c-fe3c-4906-a0cf-55468d143a27 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:57.504706 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ca6d614c-fe3c-4906-a0cf-55468d143a27 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:57.507217 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:57.508038 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=4 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:57.508911 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:05:57.572410 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ca6d614c-fe3c-4906-a0cf-55468d143a27 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:57.580265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ca6d614c-fe3c-4906-a0cf-55468d143a27 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1088 microversion: 2.1 time: 0.080736 Aug 29 17:05:57.580840 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4118/8062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:57 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:58.601720 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:58.602274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:58.608666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:58.609166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:58.609617 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:58.611126 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:58.611593 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:58.612037 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:58.690909 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:58.699138 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-aa067cf1-d764-473d-8d01-d6cc682a2d60 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1194 microversion: 2.1 time: 0.102226 Aug 29 17:05:58.709891 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3945/8063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:58 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:05:59.722647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:05:59.724125 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:05:59.731866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:59.732525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:59.733088 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:59.733919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:05:59.734517 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:05:59.735803 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:05:59.951374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:05:59.959908 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8e9d5468-f05a-4ffa-9833-ba470bd8a210 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1272 microversion: 2.1 time: 0.243044 Aug 29 17:05:59.960667 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4119/8064] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:05:59 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:00.237002 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-ce211b13-965b-4dca-80e0-fff234c4b4f3 req-ee4d5f37-5062-42a8-bb99-2fdf0211ff20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:06:00.250482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ce211b13-965b-4dca-80e0-fff234c4b4f3 req-ee4d5f37-5062-42a8-bb99-2fdf0211ff20 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:00.252532 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ce211b13-965b-4dca-80e0-fff234c4b4f3 req-ee4d5f37-5062-42a8-bb99-2fdf0211ff20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:00.252972 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-ce211b13-965b-4dca-80e0-fff234c4b4f3 req-ee4d5f37-5062-42a8-bb99-2fdf0211ff20 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:00.265005 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-ce211b13-965b-4dca-80e0-fff234c4b4f3 req-ee4d5f37-5062-42a8-bb99-2fdf0211ff20 service nova] Creating event network-changed:30311724-ee0f-4f5c-b2dd-926b84aa3260 for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 on n-h2-836830-13 Aug 29 17:06:00.270809 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-ce211b13-965b-4dca-80e0-fff234c4b4f3 req-ee4d5f37-5062-42a8-bb99-2fdf0211ff20 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040198 Aug 29 17:06:00.271653 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3946/8065] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:06:00.981896 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:00.982581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:00.989773 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:00.990451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:00.990898 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:00.991638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:00.992106 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:00.992759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:01.220256 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:01.233695 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-af9f069d-f08a-4723-942c-c707cd8f4240 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1272 microversion: 2.1 time: 0.255727 Aug 29 17:06:01.234496 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4120/8066] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:00 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:02.255539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:02.256165 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:02.263325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:02.263815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:02.264254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:02.264953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:02.265412 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:02.265840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:02.402798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:02.412141 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c0772fb8-4f93-44ea-a4c6-2894ff7702fd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1272 microversion: 2.1 time: 0.161085 Aug 29 17:06:02.412774 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3947/8067] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:02 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:03.435426 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:03.436290 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:03.447759 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:03.448439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:03.448890 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:03.449630 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:03.450108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:03.450543 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:03.608581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:03.621528 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-91593568-c4fd-4217-86d1-036451d89424 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1272 microversion: 2.1 time: 0.191179 Aug 29 17:06:03.622388 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4121/8068] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:03 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:04.646738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:04.647411 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:04.654337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:04.654831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:04.655302 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:04.655997 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:04.656457 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:04.656928 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:04.798454 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:04.806725 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3e785f62-2d00-463f-937d-39376e87c16d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.163874 Aug 29 17:06:04.807423 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3948/8069] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:04 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:05.829649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:05.830333 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:05.837277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:05.837775 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:05.838227 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:05.838936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:05.839431 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:05.839875 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:05.978539 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:05.987426 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9f3dfd48-53d3-4416-a6d0-b436d2d8319f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.161702 Aug 29 17:06:05.988025 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4122/8070] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:05 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:07.008062 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:07.008625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:07.015558 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:07.016636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:07.017424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:07.018133 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:07.018596 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:07.019052 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:07.151440 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:07.160586 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-1ab8e2e3-867b-4093-91ac-367beada82b9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.156453 Aug 29 17:06:07.161188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3949/8071] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:07 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:08.181540 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:08.182173 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:08.185098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:06:08.193121 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:08.193640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:08.194096 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:08.194816 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:08.195322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:08.195761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:08.334919 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:08.343035 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6d18938a-6ad4-4f84-bc16-a3467b06f498 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.165329 Aug 29 17:06:08.343764 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4123/8072] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:08 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:09.366252 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:09.366818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:09.368750 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:06:09.369413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:06:09.376975 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:09.377460 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:09.377899 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:09.378599 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:09.379072 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:09.379503 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:09.516086 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:09.524221 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-acb5481a-7c2f-4f38-9b45-486f9d2859b0 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.161906 Aug 29 17:06:09.525019 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3950/8073] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:09 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:10.545599 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:10.546235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:10.553807 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:10.554307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:10.554760 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:10.555493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:10.555964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:10.556404 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:10.690843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:10.699299 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-131a7317-3cd2-47be-8009-a8c7465d51bd tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.157659 Aug 29 17:06:10.699893 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4124/8074] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:10 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:11.719245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:11.719952 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:11.726766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:11.727299 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:11.727746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:11.728448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:11.728920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:11.729355 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:11.869203 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:11.877705 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4755d5e8-68b6-4e50-adc7-8b380857e5aa tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.162514 Aug 29 17:06:11.878359 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3951/8075] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:11 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:12.897986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:12.898623 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:12.905713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:12.906218 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:12.906805 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:12.907583 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:12.908059 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:12.908506 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:13.044477 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:13.053357 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ff09bda0-0a63-45b9-a553-8e41d4690167 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.159378 Aug 29 17:06:13.053932 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4125/8076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:12 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:14.075513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:14.076138 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:14.083742 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:14.084232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:14.084673 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:14.085371 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:14.085827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:14.086253 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:14.230153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:14.238976 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-da9531b8-3f8d-4c4e-84aa-fe3d11bd7e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.167146 Aug 29 17:06:14.239607 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3952/8077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:14 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:15.259756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:15.260415 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:15.269140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:15.269658 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:15.270547 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:15.270831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:15.271445 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:15.271984 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:15.394715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-95722d03-8ba5-4512-a107-13f7b95cdb73 req-bf33b704-718f-418b-8743-e3c51318db71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "name": "network-vif-plugged", "status": "completed", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:06:15.406517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-95722d03-8ba5-4512-a107-13f7b95cdb73 req-bf33b704-718f-418b-8743-e3c51318db71 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:15.407369 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-95722d03-8ba5-4512-a107-13f7b95cdb73 req-bf33b704-718f-418b-8743-e3c51318db71 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:15.408041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-95722d03-8ba5-4512-a107-13f7b95cdb73 req-bf33b704-718f-418b-8743-e3c51318db71 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:15.415211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:15.419806 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-95722d03-8ba5-4512-a107-13f7b95cdb73 req-bf33b704-718f-418b-8743-e3c51318db71 service nova] Creating event network-vif-plugged:30311724-ee0f-4f5c-b2dd-926b84aa3260 for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 on n-h2-836830-13 Aug 29 17:06:15.425265 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6a0b0b22-d420-4f8b-a968-cac53758b5ba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.169411 Aug 29 17:06:15.425443 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-95722d03-8ba5-4512-a107-13f7b95cdb73 req-bf33b704-718f-418b-8743-e3c51318db71 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036093 Aug 29 17:06:15.425872 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4126/8078] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:15 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:15.431908 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3953/8079] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:06:16.446148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:16.446833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:16.453728 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:16.454224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:16.454712 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:16.455481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:16.455946 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:16.456377 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:16.592723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:16.601453 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-77a089a3-7fa3-42ab-9c1b-2eb548159be7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1260 microversion: 2.1 time: 0.159525 Aug 29 17:06:16.602025 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4127/8080] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:16 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:17.623177 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:17.623919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:17.630793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:17.631310 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:17.631745 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:17.632431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:17.632880 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:17.633300 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:17.769906 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:17.779145 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-24dbddc6-e1ac-45ce-9e67-54d2db01d473 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1444 microversion: 2.1 time: 0.161045 Aug 29 17:06:17.779931 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3954/8081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:17 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:17.800179 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:06:17.800839 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:06:17.807813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:17.808306 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:17.808749 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:17.809440 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:17.809899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:17.810329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:17.946586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:06:17.956117 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5c70bba9-d172-45a6-956a-c8909d6d301e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1444 microversion: 2.1 time: 0.160204 Aug 29 17:06:17.956718 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4128/8082] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:06:17 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:06:19.873267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-74640b46-f80e-4db5-b514-60098ecf0e68 req-4b78e672-9834-476b-85d0-ef73ba7f63ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:06:19.884362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-74640b46-f80e-4db5-b514-60098ecf0e68 req-4b78e672-9834-476b-85d0-ef73ba7f63ca service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:06:19.884858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-74640b46-f80e-4db5-b514-60098ecf0e68 req-4b78e672-9834-476b-85d0-ef73ba7f63ca service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:06:19.885297 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-74640b46-f80e-4db5-b514-60098ecf0e68 req-4b78e672-9834-476b-85d0-ef73ba7f63ca service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:06:19.897027 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-74640b46-f80e-4db5-b514-60098ecf0e68 req-4b78e672-9834-476b-85d0-ef73ba7f63ca service nova] Creating event network-changed:30311724-ee0f-4f5c-b2dd-926b84aa3260 for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 on n-h2-836830-13 Aug 29 17:06:19.902040 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-74640b46-f80e-4db5-b514-60098ecf0e68 req-4b78e672-9834-476b-85d0-ef73ba7f63ca service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Aug 29 17:06:19.902768 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3955/8083] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:08:15.090316 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:08:15.091144 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:08:15.092097 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=24 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:15.092857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=60 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:15.094088 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:08:15.094224 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 17:08:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31/action (ip 10.222.0.83) !!! Aug 29 17:08:15.203264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:08:15.203813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:15.209883 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:15.210374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:15.210818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:15.211533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:15.211998 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:15.212427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:15.236044 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lazy-loading 'flavor' on Instance uuid 7187e6f9-32dd-4821-9255-0c9b982c5a31 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:08:15.308508 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5826a7d9-a84b-43d8-aa58-666371301370 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31/action" status: 202 len: 0 microversion: 2.1 time: 0.219871 Aug 29 17:08:15.309116 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4129/8084] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:08:15 2022] POST /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 17:08:15.317769 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 17:08:15.318967 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:15.322615 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=56 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:15.329875 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:15.330796 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:15.338910 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:15.339431 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:15.339876 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:15.340626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:15.341038 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:15.341685 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:15.538232 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:15.546764 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-eaa924f2-5f17-442e-9572-58e3c0d98047 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.231771 Aug 29 17:08:15.547362 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3956/8085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:15 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:16.570720 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:16.571489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:16.580074 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:16.580573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:16.581023 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:16.581761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:16.582226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:16.582662 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:16.587482 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50840. Aug 29 17:08:16.590576 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50838. Aug 29 17:08:16.779340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:16.787222 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-dbe97860-d027-41e1-a8f5-249c923c3b4d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.222876 Aug 29 17:08:16.787801 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4130/8086] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:16 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:17.808733 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:17.809362 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:17.820581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:17.821081 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:17.821528 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:17.822237 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:17.822701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:17.823163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:17.829630 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 50846. Aug 29 17:08:17.956053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:17.963831 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-69cf6530-3024-4641-9040-767cd1f37402 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.159117 Aug 29 17:08:17.964411 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3957/8087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:17 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:18.985821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:18.986394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:18.993261 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:18.993780 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:18.994208 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:18.994906 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:18.995408 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:18.995840 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:19.134846 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:19.143356 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0fb9e881-ddf1-4f99-afb8-48e8d0491bba tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.161967 Aug 29 17:08:19.143932 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4131/8088] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:18 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:20.163999 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:20.164611 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:20.171361 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:20.171843 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:20.172277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:20.172962 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:20.173424 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:20.173833 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:20.305591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:20.314224 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-7165caf3-9ed3-48e0-aa55-dc4cb4c9f572 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.154170 Aug 29 17:08:20.314795 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3958/8089] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:20 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:21.334976 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:21.335627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:21.342796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:21.343324 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:21.343766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:21.344467 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:21.344925 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:21.345358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:21.476242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:21.484638 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4dc7a0aa-11c4-4b21-80fe-2b057abe497a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.153600 Aug 29 17:08:21.485240 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4132/8090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:21 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:22.505594 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:22.506235 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:22.514210 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:22.514814 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:22.515278 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:22.515998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:22.516452 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:22.516938 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:22.653042 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:22.660943 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-fa4101eb-c980-4ec6-a8ed-72ffff0131db tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.159250 Aug 29 17:08:22.661527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3959/8091] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:22 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:23.682135 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:23.682730 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:23.690263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:23.690800 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:23.691278 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:23.691986 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:23.692451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:23.693134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:23.824105 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:23.832976 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4a15c724-36bd-455d-b7af-76f8e8a653bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.154846 Aug 29 17:08:23.833563 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4133/8092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:23 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:24.853805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:24.854420 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:24.861438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:24.861920 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:24.862395 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:24.863111 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:24.863563 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:24.863984 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:25.002766 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:25.010678 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-40139199-1608-41c0-9fac-cf8ecafe00c7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.160786 Aug 29 17:08:25.011291 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3960/8093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:24 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:26.032752 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:26.033411 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:26.040394 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:26.040891 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:26.041340 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:26.042039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:26.042507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:26.042944 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:26.184488 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:26.192566 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5a7a4a56-37f7-4b29-ac31-7280dc0a1e7b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.164428 Aug 29 17:08:26.193809 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4134/8094] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:26 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:27.213873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:27.214538 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:27.221855 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:27.222348 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:27.222788 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:27.223521 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:27.223980 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:27.224408 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:27.364284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:27.373154 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-854edb9a-ef46-4a35-b565-4b3ffae12077 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.163280 Aug 29 17:08:27.373783 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3961/8095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:27 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:28.394843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:28.395533 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:28.402647 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:28.403183 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:28.403794 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:28.404894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:28.405375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:28.405835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:28.546323 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:28.554715 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-68978235-1913-4679-bf6e-607ba117ba28 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.163933 Aug 29 17:08:28.555349 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4135/8096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:28 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:29.577147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:29.577804 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:29.584829 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:29.585446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:29.585668 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:29.586365 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:29.586822 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:29.587276 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:29.721309 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:29.729233 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-21738cf3-86bf-4878-8def-e612813b495f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1569 microversion: 2.1 time: 0.156689 Aug 29 17:08:29.729812 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3962/8097] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:29 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:29.757574 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:08:29.758185 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:29.765194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:29.765691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:29.766133 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:29.766827 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:29.767320 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:29.767754 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:29.797146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129133) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 17:08:29.865500 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-25348db9-fbf4-4b74-9928-c51bcef886bf tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "POST /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31/action" status: 202 len: 0 microversion: 2.1 time: 0.111691 Aug 29 17:08:29.869001 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4136/8098] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:08:29 2022] POST /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:08:29.874148 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:29.883049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:29.889926 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:29.890827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:29.891475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:29.893191 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:29.893885 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:29.894553 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:30.094331 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:30.102462 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d82db9a8-8dc7-4d60-a3c5-e109bf6fc743 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1517 microversion: 2.1 time: 0.232209 Aug 29 17:08:30.103065 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3963/8099] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:29 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1517 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:31.125470 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:31.126055 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:31.132428 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:31.132926 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:31.133367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:31.134073 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:31.134536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:31.134967 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:31.276858 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:31.285034 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1d858a07-5547-4f4e-974e-7d993eeb2520 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1519 microversion: 2.1 time: 0.165530 Aug 29 17:08:31.285610 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4137/8100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:31 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:32.094103 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-5169d6ae-0e84-4bf1-8fae-0d93cbe90657 req-f1f5ded0-30ba-4206-90b8-c2e22e1daf88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "name": "network-vif-unplugged", "status": "completed", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:08:32.109958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5169d6ae-0e84-4bf1-8fae-0d93cbe90657 req-f1f5ded0-30ba-4206-90b8-c2e22e1daf88 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:32.110453 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5169d6ae-0e84-4bf1-8fae-0d93cbe90657 req-f1f5ded0-30ba-4206-90b8-c2e22e1daf88 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:32.111102 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-5169d6ae-0e84-4bf1-8fae-0d93cbe90657 req-f1f5ded0-30ba-4206-90b8-c2e22e1daf88 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:32.123703 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.compute.server_external_events [req-5169d6ae-0e84-4bf1-8fae-0d93cbe90657 req-f1f5ded0-30ba-4206-90b8-c2e22e1daf88 service nova] Unable to find a host for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31. Dropping event network-vif-unplugged {{(pid=129132) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 17:08:32.124915 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-5169d6ae-0e84-4bf1-8fae-0d93cbe90657 req-f1f5ded0-30ba-4206-90b8-c2e22e1daf88 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035731 Aug 29 17:08:32.125527 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3964/8101] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 17:08:32.307142 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:32.307781 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:32.315139 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:32.315642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:32.316092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:32.316799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:32.317267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:32.317709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:32.452600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:32.460696 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3577a23e-1e13-4882-9a8e-4f36541dd96a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1519 microversion: 2.1 time: 0.157645 Aug 29 17:08:32.461298 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4138/8102] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:32 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:33.482805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:33.483461 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:33.490519 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:33.491043 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:33.491481 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:33.492189 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:33.492648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:33.493080 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:33.630245 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:33.638827 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d5abc318-39df-40b0-9bd9-37918c543a43 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1519 microversion: 2.1 time: 0.160700 Aug 29 17:08:33.639555 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3965/8103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:33 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:34.660130 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:34.660757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:34.667698 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:34.668194 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:34.668642 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:34.670184 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:34.670655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:34.671127 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:34.815420 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:34.823947 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-cd58eb25-c576-4ad3-acdd-f31a32654f47 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1519 microversion: 2.1 time: 0.167728 Aug 29 17:08:34.824531 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4139/8104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:34 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:35.845998 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:35.846627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:35.853517 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:35.854010 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:35.854448 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:35.855169 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:35.855631 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:35.856060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:35.994119 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:36.003245 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2905e103-506b-442c-b455-e2b263e196ef tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.161065 Aug 29 17:08:36.003936 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3966/8105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:35 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:36.494793 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-8477d66e-2202-4a28-bca4-30fb30be900f req-27c30b7f-681e-47ad-86d9-94bf6b93579d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:08:36.507661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8477d66e-2202-4a28-bca4-30fb30be900f req-27c30b7f-681e-47ad-86d9-94bf6b93579d service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:36.507921 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8477d66e-2202-4a28-bca4-30fb30be900f req-27c30b7f-681e-47ad-86d9-94bf6b93579d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:36.508374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-8477d66e-2202-4a28-bca4-30fb30be900f req-27c30b7f-681e-47ad-86d9-94bf6b93579d service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:36.522120 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-8477d66e-2202-4a28-bca4-30fb30be900f req-27c30b7f-681e-47ad-86d9-94bf6b93579d service nova] Creating event network-changed:30311724-ee0f-4f5c-b2dd-926b84aa3260 for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 on n-h1-836830-13 Aug 29 17:08:36.526078 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-8477d66e-2202-4a28-bca4-30fb30be900f req-27c30b7f-681e-47ad-86d9-94bf6b93579d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035625 Aug 29 17:08:36.526702 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4140/8106] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:08:37.025969 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:37.026763 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:37.034627 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:37.035181 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:37.035625 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:37.036342 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:37.036802 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:37.037231 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:37.176160 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:37.184128 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f2256209-779a-48e5-94cf-3c75b1140526 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.162179 Aug 29 17:08:37.184883 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3967/8107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:37 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:38.212131 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:38.212857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:38.221003 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:38.221511 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:38.221964 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:38.222682 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:38.223181 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:38.223631 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:38.366079 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:38.374148 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f36958ee-04e6-48cf-83d4-63af233abb24 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.166373 Aug 29 17:08:38.374738 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4141/8108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:38 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:39.395736 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:39.396303 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:39.404056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:39.404612 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:39.405058 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:39.405761 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:39.406226 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:39.406659 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:39.543254 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:39.551846 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-5f8eb4d7-93e2-49ed-9fd0-fa041934c79d tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.160115 Aug 29 17:08:39.552427 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3968/8109] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:39 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:40.572311 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:40.572871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:40.580796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:40.581299 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:40.581751 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:40.582457 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:40.582934 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:40.583403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:40.714724 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:40.723588 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c090fea0-f2db-458a-bae0-420e10422eb9 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.155477 Aug 29 17:08:40.724169 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4142/8110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:40 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:41.744155 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:41.744757 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:41.752350 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:41.752873 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:41.753316 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:41.754053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:41.754516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:41.754950 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:41.887987 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:41.895804 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8cd67e3d-92c8-4f34-a50a-78506fd832a8 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.155656 Aug 29 17:08:41.896396 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3969/8111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:41 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:42.916867 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:42.917496 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:42.924528 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:42.925029 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:42.925480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:42.926211 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:42.926679 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:42.927157 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:42.931309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:43.064618 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:43.072701 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1225ba43-e825-4ab2-98a3-b9e25a54dc04 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.159821 Aug 29 17:08:43.073277 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4143/8112] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:42 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:44.094674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:44.095267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:44.102164 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:44.102656 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:44.103251 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:44.103956 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:44.104421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:44.104851 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:44.240684 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:44.248561 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-634f2128-2119-4393-8f65-344525790395 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.158687 Aug 29 17:08:44.249139 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3970/8113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:44 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:45.269197 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:45.269835 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:45.272603 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:45.279382 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:45.279887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:45.280350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:45.281052 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:45.281521 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:45.281961 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:45.414551 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:45.423458 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-6e96d398-4af2-4354-8d77-94c078a31f11 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.158122 Aug 29 17:08:45.424034 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4144/8114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:45 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:46.445995 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:46.447034 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:46.451936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=31 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:46.456525 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:46.457025 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:46.457471 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:46.458179 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:46.458643 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:46.459099 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:46.463375 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=87 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:08:46.563195 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-d3911fdc-dd70-44a8-b1ca-d461f336c582 req-fcf151ab-f6ad-4946-be5a-339f085c5709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "name": "network-vif-plugged", "status": "completed", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:08:46.574226 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d3911fdc-dd70-44a8-b1ca-d461f336c582 req-fcf151ab-f6ad-4946-be5a-339f085c5709 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:46.577204 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d3911fdc-dd70-44a8-b1ca-d461f336c582 req-fcf151ab-f6ad-4946-be5a-339f085c5709 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:46.577859 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-d3911fdc-dd70-44a8-b1ca-d461f336c582 req-fcf151ab-f6ad-4946-be5a-339f085c5709 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:46.589852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-d3911fdc-dd70-44a8-b1ca-d461f336c582 req-fcf151ab-f6ad-4946-be5a-339f085c5709 service nova] Creating event network-vif-plugged:30311724-ee0f-4f5c-b2dd-926b84aa3260 for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 on n-h1-836830-13 Aug 29 17:08:46.596192 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-d3911fdc-dd70-44a8-b1ca-d461f336c582 req-fcf151ab-f6ad-4946-be5a-339f085c5709 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037217 Aug 29 17:08:46.596885 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4145/8115] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:08:46.605083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:46.613659 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f80c096b-a4d3-4b24-ac6a-420597939ce5 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.172910 Aug 29 17:08:46.614264 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3971/8116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:46 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:47.636170 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:47.636880 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:47.643901 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:47.644392 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:47.644836 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:47.645525 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:47.646032 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:47.646460 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:47.781920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:47.789782 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3d89b58d-02ec-460d-813f-018eefff4c0f tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1575 microversion: 2.1 time: 0.158783 Aug 29 17:08:47.790348 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4146/8117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:47 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:08:48.811183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:08:48.811785 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:08:48.818793 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:48.819340 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:48.819786 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:48.820475 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:08:48.820965 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:08:48.821399 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:08:48.955184 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:08:48.962902 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8c19d621-25fa-4f72-a357-61af40eb5200 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1562 microversion: 2.1 time: 0.156344 Aug 29 17:08:48.963506 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3972/8118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:08:48 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:02.756572 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:02.757507 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:02.757913 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=11 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:02.758011 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:02.758860 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:10:02.759055 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 17:10:02.761519 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:10:02.761809 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 17:10:02.763274 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:10:02.763548 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 17:10:02.767573 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=5 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:02.769169 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=18 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:02.770254 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:10:02.770424 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 17:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 (ip 10.222.0.83) !!! Aug 29 17:10:02.771134 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-a61db469-cc40-4e0a-a4a2-7e7fa5fdb4c0 req-064007b2-06fd-472d-b0cb-c4213f6024a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:10:02.788652 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:02.789267 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:02.789693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a61db469-cc40-4e0a-a4a2-7e7fa5fdb4c0 req-064007b2-06fd-472d-b0cb-c4213f6024a6 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:02.789813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:02.790186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a61db469-cc40-4e0a-a4a2-7e7fa5fdb4c0 req-064007b2-06fd-472d-b0cb-c4213f6024a6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:02.790630 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-a61db469-cc40-4e0a-a4a2-7e7fa5fdb4c0 req-064007b2-06fd-472d-b0cb-c4213f6024a6 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:02.790748 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:02.791229 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:02.791738 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:02.808185 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-a61db469-cc40-4e0a-a4a2-7e7fa5fdb4c0 req-064007b2-06fd-472d-b0cb-c4213f6024a6 service nova] Creating event network-changed:30311724-ee0f-4f5c-b2dd-926b84aa3260 for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 on n-h1-836830-13 Aug 29 17:10:02.814456 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-a61db469-cc40-4e0a-a4a2-7e7fa5fdb4c0 req-064007b2-06fd-472d-b0cb-c4213f6024a6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059537 Aug 29 17:10:02.815492 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3973/8119] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:10:02.830671 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:10:02.924253 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-21287b44-d718-4ccf-a080-d094be9c407a tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 204 len: 0 microversion: 2.1 time: 0.171744 Aug 29 17:10:02.925457 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4147/8120] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 17:10:02 2022] DELETE /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:10:02.938284 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:02.939584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:02.948195 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:02.949137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:02.950626 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:02.951895 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:02.952567 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:02.953199 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:03.101581 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:03.110088 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-d28bf0b0-9738-48e5-b92a-980ba5af842b tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.179127 Aug 29 17:10:03.110678 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3974/8121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:02 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:04.132439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:04.133069 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:04.140345 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:04.140842 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:04.141294 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:04.141987 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:04.142455 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:04.142892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:04.347119 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:04.355142 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-8522f03d-3ffd-4fb4-88f4-fc704e3c0725 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1568 microversion: 2.1 time: 0.227101 Aug 29 17:10:04.356139 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4148/8122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:04 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:05.294556 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-f27d3d71-502b-4bc3-b1b3-d404a1dc178a req-958001b8-e3e5-4e95-b524-b9d62cc52965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7187e6f9-32dd-4821-9255-0c9b982c5a31", "name": "network-vif-deleted", "tag": "30311724-ee0f-4f5c-b2dd-926b84aa3260"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:10:05.304215 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f27d3d71-502b-4bc3-b1b3-d404a1dc178a req-958001b8-e3e5-4e95-b524-b9d62cc52965 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:05.304694 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f27d3d71-502b-4bc3-b1b3-d404a1dc178a req-958001b8-e3e5-4e95-b524-b9d62cc52965 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:05.305124 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-f27d3d71-502b-4bc3-b1b3-d404a1dc178a req-958001b8-e3e5-4e95-b524-b9d62cc52965 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:05.316877 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-f27d3d71-502b-4bc3-b1b3-d404a1dc178a req-958001b8-e3e5-4e95-b524-b9d62cc52965 service nova] Creating event network-vif-deleted:30311724-ee0f-4f5c-b2dd-926b84aa3260 for instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 on n-h1-836830-13 Aug 29 17:10:05.322081 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-f27d3d71-502b-4bc3-b1b3-d404a1dc178a req-958001b8-e3e5-4e95-b524-b9d62cc52965 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091808 Aug 29 17:10:05.322629 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3975/8123] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:10:05.376833 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:05.378092 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:05.385136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:05.385576 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:05.386049 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:05.387051 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:05.387620 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:05.388056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:05.451795 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:05.459788 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-04a83f35-b72f-4032-a69a-35c3774c66b7 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1219 microversion: 2.1 time: 0.086872 Aug 29 17:10:05.460360 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4149/8124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:05 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:06.482421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:06.483286 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:06.489621 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:06.490116 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:06.490559 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:06.491289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:06.491754 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:06.492186 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:06.556022 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:06.564606 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-19dc4f83-f20d-479b-afa8-1b497dfbb889 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1219 microversion: 2.1 time: 0.087546 Aug 29 17:10:06.565188 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3976/8125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:06 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:07.585985 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:07.586757 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:07.595479 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:07.596091 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:07.596581 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:07.597380 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:07.597924 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:07.598374 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:07.665637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:07.675143 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-267b4253-631e-4ad6-a08d-472e0ad5208e tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1219 microversion: 2.1 time: 0.093028 Aug 29 17:10:07.675750 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4150/8126] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:07 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:08.696279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:08.697494 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:08.705764 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:08.706274 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:08.706719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:08.707516 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:08.707978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:08.708418 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:08.774163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:08.784007 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-6bbc3035-42b4-47d1-873c-379e6c93e089 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1219 microversion: 2.1 time: 0.091610 Aug 29 17:10:08.795206 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3977/8127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:08 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:09.805806 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:09.806558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:09.815537 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:09.815965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:09.816417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:09.817129 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:09.817887 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:09.818356 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:09.853432 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:09.854066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:09.854703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:09.855895 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lazy-loading 'fault' on Instance uuid 7187e6f9-32dd-4821-9255-0c9b982c5a31 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:10:09.900996 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5e3906fec6e465bb21f6b0846c7b70f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ff1a3351844f2a09239c37030423d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:09.909192 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a323eda3-d4f1-48e5-9354-c6b818191256 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 200 len: 1178 microversion: 2.1 time: 0.107634 Aug 29 17:10:09.910050 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4151/8128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:09 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 1178 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:10:10.930988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:10.931639 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] [instance: 7187e6f9-32dd-4821-9255-0c9b982c5a31] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:10.940218 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:10.940715 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:10.941153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:10.941907 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:10.942370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:10.943076 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:10.957691 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] HTTP exception thrown: Instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 could not be found. Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Request method failure captured: Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 HTTP/1.1 Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDPDnMcrKpRK0Da3mIgfwIHOXAVLWE5XiW12U50Vql4JcS-us2n5bC0x4LeL2jWyKyFX3Jr4KAV_5yfT94VZ5XxTn-oLuro3np8VgSKhB-PaGlEgPaI_OY4RJngQZT_7q_8mzqbkUugkf6r_lHSF5FVi5xMzDodmKiazkWH3YAXrPtbI Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 6f5ff1a3351844f2a09239c37030423d Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestShelveInstance-1930515491 Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f5ff1a3351844f2a09239c37030423d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_6f5ff1a3351844f2a09239c37030423d", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/6f5ff1a3351844f2a09239c37030423d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/6f5ff1a3351844f2a09239c37030423d"}]}] Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestShelveInstance-1930515491 Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 6f5ff1a3351844f2a09239c37030423d Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestShelveInstance-1930515491 Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestShelveInstance-1930515491-project Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: e5e3906fec6e465bb21f6b0846c7b70f Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestShelveInstance-1930515491-project Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 could not be found. Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': '7187e6f9-32dd-4821-9255-0c9b982c5a31'} Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 could not be found. Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 could not be found. Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:10:10.959337 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 could not be found. Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Returning 404 to user: Instance 7187e6f9-32dd-4821-9255-0c9b982c5a31 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-56834ab8-b1e7-42be-9ec8-f8f2bafb4952 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31" status: 404 len: 111 microversion: 2.1 time: 0.033729 Aug 29 17:10:10.963775 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3978/8129] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:10 2022] GET /compute/v2.1/servers/7187e6f9-32dd-4821-9255-0c9b982c5a31 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 17:10:11.132687 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-5ce137a5-26d0-4bf4-8c4f-944b5fb8dd15 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] Calling method '.version_select at 0x7f32ed929940>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:11.165558 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-5ce137a5-26d0-4bf4-8c4f-944b5fb8dd15 tempest-TestShelveInstance-1930515491 tempest-TestShelveInstance-1930515491-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1438466552" status: 202 len: 0 microversion: 2.1 time: 0.037248 Aug 29 17:10:11.171532 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4152/8130] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 17:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1438466552 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 17:10:29.309696 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=12 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:29.310451 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=24 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:29.475828 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c85b8a8e-d88b-451b-9569-14e1d66f3191 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Action: 'create', calling method: .version_select at 0x7f32eecdcca0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1393453422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISYtW4p0tvj4uMncru9KuqeHmu4LHVjBDzYjK52mk+kqXkcHnIbjxiCbWHFc8EYd1Kea+cN9Iff84UZbubR8dhoPGbAfhqiz7FPN0BCbxEy1JW5ktCuYiwIyXnxNXSHqg=="}} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:10:29.492033 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c85b8a8e-d88b-451b-9569-14e1d66f3191 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Getting quotas for project 8e27c4a205fa4cae93194ba885284bdd. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:10:29.497902 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.quota [None req-c85b8a8e-d88b-451b-9569-14e1d66f3191 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Getting quotas for user f201d9769b5a469098fa5fb5043399f8 and project 8e27c4a205fa4cae93194ba885284bdd. Resources: {'key_pairs'} {{(pid=129132) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:10:29.527423 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c85b8a8e-d88b-451b-9569-14e1d66f3191 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.222910 Aug 29 17:10:29.528213 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3979/8131] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 17:10:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:10:30.551733 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:30.552871 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:30.558136 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1463380596", "imageRef": "648e7a49-e66c-42cf-859c-64f1df130787", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1393453422", "security_groups": [{"name": "tempest-secgroup-smoke-1953510115"}], "networks": [{"uuid": "d5f0d2c9-b38a-446a-8561-18efdcfa47ba"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:10:30.675912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] validate_networks() for [('d5f0d2c9-b38a-446a-8561-18efdcfa47ba', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:10:31.173205 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:10:31.173653 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:10:31.174148 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:10:31.174582 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:10:31.175034 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:10:31.184529 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:31.184956 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:31.185413 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:31.186163 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:31.186638 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:31.187114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:31.205365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Getting quotas for project 8e27c4a205fa4cae93194ba885284bdd. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:10:31.219894 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Getting quotas for user f201d9769b5a469098fa5fb5043399f8 and project 8e27c4a205fa4cae93194ba885284bdd. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:10:31.236845 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:10:31.239286 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='648e7a49-e66c-42cf-859c-64f1df130787',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:10:31.287637 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-0dfafb9d-ab89-4d34-b81e-7c70d5ea5afd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737821 Aug 29 17:10:31.288461 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4153/8132] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 17:10:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 17:10:31.301267 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-f8319ac2-2b77-4bc5-ac22-78ef6a5d8530 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:31.301919 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-f8319ac2-2b77-4bc5-ac22-78ef6a5d8530 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:31.363289 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-f8319ac2-2b77-4bc5-ac22-78ef6a5d8530 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:31.373383 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-f8319ac2-2b77-4bc5-ac22-78ef6a5d8530 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1249 microversion: 2.1 time: 0.076891 Aug 29 17:10:31.376355 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3980/8133] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:31 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1249 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:32.397350 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:32.398175 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:32.419474 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:32.420039 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:32.420772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:32.426156 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:32.426913 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:32.427627 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:32.504296 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:32.518394 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-1e1f5f19-8611-4883-8c62-11700ad49f7d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1309 microversion: 2.1 time: 0.128018 Aug 29 17:10:32.519437 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4154/8134] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:32 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:33.541319 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:33.542079 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:33.549378 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:33.549879 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:33.550334 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:33.551044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:33.551513 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:33.551946 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:33.765174 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:33.773513 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-75c97f90-74fe-4bc0-99d4-c33cd9e8b4df tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1375 microversion: 2.1 time: 0.236183 Aug 29 17:10:33.774049 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3981/8135] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:33 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1375 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:33.838860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-a30ebf3e-401f-4839-8e40-00974eac069a req-170fc7e7-6069-4133-8243-57c39507c584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c415aea4-f5e9-4b21-b62e-3bd8885758a0", "tag": "e219015e-99d1-4ad5-9928-c4ad1f9109e1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:10:33.850541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a30ebf3e-401f-4839-8e40-00974eac069a req-170fc7e7-6069-4133-8243-57c39507c584 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:33.851098 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a30ebf3e-401f-4839-8e40-00974eac069a req-170fc7e7-6069-4133-8243-57c39507c584 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:33.851565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-a30ebf3e-401f-4839-8e40-00974eac069a req-170fc7e7-6069-4133-8243-57c39507c584 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:33.863741 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-a30ebf3e-401f-4839-8e40-00974eac069a req-170fc7e7-6069-4133-8243-57c39507c584 service nova] Creating event network-changed:e219015e-99d1-4ad5-9928-c4ad1f9109e1 for instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 on n-h1-836830-13 Aug 29 17:10:33.868771 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-a30ebf3e-401f-4839-8e40-00974eac069a req-170fc7e7-6069-4133-8243-57c39507c584 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034029 Aug 29 17:10:33.869532 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4155/8136] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:10:34.796163 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:34.796840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:34.803727 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:34.804220 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:34.804661 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:34.805351 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:34.805811 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:34.806240 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:34.940413 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:34.949104 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a3a8498f-a355-4268-9da3-435a5165cde5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1375 microversion: 2.1 time: 0.156898 Aug 29 17:10:34.949785 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3982/8137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:34 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:35.971683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:35.972401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:35.978634 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:35.979171 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:35.979649 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:35.980349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:35.980817 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:35.981259 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:36.111903 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:36.119724 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f117f540-25c3-4edb-90f3-366947e288c6 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1375 microversion: 2.1 time: 0.153205 Aug 29 17:10:36.120547 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4156/8138] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:35 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:37.141049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:37.141702 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:37.148924 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:37.149345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:37.149777 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:37.150463 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:37.150949 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:37.151433 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:37.285818 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:37.293864 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-bd4ba7da-6c81-4917-8f75-3751cd1e1c26 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1375 microversion: 2.1 time: 0.156735 Aug 29 17:10:37.294456 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3983/8139] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:37 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:38.314277 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:38.314899 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:38.322168 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:38.322666 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:38.323656 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:38.324367 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:38.324831 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:38.325268 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:38.461536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:38.470066 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-06bb1f5f-7eb9-470c-a1bc-5135713a14ff tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1375 microversion: 2.1 time: 0.160104 Aug 29 17:10:38.470638 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4157/8140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:38 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:39.132760 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-9d0c0759-125a-4312-95fc-8cdc94eaa82c req-67c70ad4-68eb-4f40-ab63-acd29949c5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c415aea4-f5e9-4b21-b62e-3bd8885758a0", "name": "network-vif-plugged", "status": "completed", "tag": "e219015e-99d1-4ad5-9928-c4ad1f9109e1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:10:39.142958 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9d0c0759-125a-4312-95fc-8cdc94eaa82c req-67c70ad4-68eb-4f40-ab63-acd29949c5c7 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:39.143499 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9d0c0759-125a-4312-95fc-8cdc94eaa82c req-67c70ad4-68eb-4f40-ab63-acd29949c5c7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:39.143940 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-9d0c0759-125a-4312-95fc-8cdc94eaa82c req-67c70ad4-68eb-4f40-ab63-acd29949c5c7 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:39.155956 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-9d0c0759-125a-4312-95fc-8cdc94eaa82c req-67c70ad4-68eb-4f40-ab63-acd29949c5c7 service nova] Creating event network-vif-plugged:e219015e-99d1-4ad5-9928-c4ad1f9109e1 for instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 on n-h1-836830-13 Aug 29 17:10:39.161060 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-9d0c0759-125a-4312-95fc-8cdc94eaa82c req-67c70ad4-68eb-4f40-ab63-acd29949c5c7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093190 Aug 29 17:10:39.161746 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3984/8141] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:10:39.490577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:39.491264 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:39.499202 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:39.499703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:39.500151 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:39.500850 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:39.501322 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:39.501761 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:39.632767 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:39.640727 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-4110c81e-a327-46b0-926c-26dcf7eeeb93 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1375 microversion: 2.1 time: 0.154083 Aug 29 17:10:39.641309 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4158/8142] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:39 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:40.663090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:40.663812 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:40.670167 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:40.670662 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:40.671137 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:40.671831 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:40.672294 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:40.672730 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:40.806869 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:40.815211 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-33d92a94-fa1c-4ed4-8291-bd7db352ac3e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1559 microversion: 2.1 time: 0.157352 Aug 29 17:10:40.815796 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3985/8143] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:40 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:40.836772 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:10:40.837436 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:10:40.845081 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:40.845570 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:40.846015 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:40.846764 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:40.847248 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:40.847713 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:40.988876 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:10:40.997408 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e0f5d916-2188-426b-97d6-903c49f0f6e4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1559 microversion: 2.1 time: 0.164488 Aug 29 17:10:40.997984 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4159/8144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:10:40 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:10:42.959545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=6 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:10:43.016003 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-1a06292b-4413-4c7b-bbd4-ba18402656ae req-45b3c770-ef04-44ac-aab4-9ffe443a9da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c415aea4-f5e9-4b21-b62e-3bd8885758a0", "tag": "e219015e-99d1-4ad5-9928-c4ad1f9109e1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:10:43.025416 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1a06292b-4413-4c7b-bbd4-ba18402656ae req-45b3c770-ef04-44ac-aab4-9ffe443a9da9 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:10:43.025898 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1a06292b-4413-4c7b-bbd4-ba18402656ae req-45b3c770-ef04-44ac-aab4-9ffe443a9da9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:10:43.026444 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-1a06292b-4413-4c7b-bbd4-ba18402656ae req-45b3c770-ef04-44ac-aab4-9ffe443a9da9 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:10:43.038093 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-1a06292b-4413-4c7b-bbd4-ba18402656ae req-45b3c770-ef04-44ac-aab4-9ffe443a9da9 service nova] Creating event network-changed:e219015e-99d1-4ad5-9928-c4ad1f9109e1 for instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 on n-h1-836830-13 Aug 29 17:10:43.044408 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-1a06292b-4413-4c7b-bbd4-ba18402656ae req-45b3c770-ef04-44ac-aab4-9ffe443a9da9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089154 Aug 29 17:10:43.045018 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3986/8145] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:12:38.115005 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:12:38.115887 n-d-836830-13 devstack@n-api.service[129133]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:12:38.116519 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:38.117300 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:38.118241 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:38.118997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=34 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:38.120480 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:12:38.120613 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 17:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0/action (ip 10.222.0.83) !!! Aug 29 17:12:38.126912 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1013689344"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:38.129480 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:38.143219 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:38.143758 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:38.144342 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:38.145114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:38.145586 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:38.146025 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:38.343336 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c83d4253-13d6-4da7-ba92-10a0a076087d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "POST /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0/action" status: 202 len: 0 microversion: 2.1 time: 0.230193 Aug 29 17:12:38.343996 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4160/8146] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:12:38 2022] POST /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 29 17:12:43.689985 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:12:43.690908 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] AMQP server on 10.222.0.83:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 17:12:43.691585 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:43.692847 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=28 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:43.699844 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-550dafbc-0b7b-4284-b25b-88ce385345eb req-7d1da325-48e8-4776-bd9b-0be3a13fc8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c415aea4-f5e9-4b21-b62e-3bd8885758a0", "name": "network-vif-plugged", "status": "completed", "tag": "e219015e-99d1-4ad5-9928-c4ad1f9109e1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:43.713344 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-550dafbc-0b7b-4284-b25b-88ce385345eb req-7d1da325-48e8-4776-bd9b-0be3a13fc8fd service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:43.713840 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-550dafbc-0b7b-4284-b25b-88ce385345eb req-7d1da325-48e8-4776-bd9b-0be3a13fc8fd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:43.714298 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-550dafbc-0b7b-4284-b25b-88ce385345eb req-7d1da325-48e8-4776-bd9b-0be3a13fc8fd service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:43.727993 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-550dafbc-0b7b-4284-b25b-88ce385345eb req-7d1da325-48e8-4776-bd9b-0be3a13fc8fd service nova] Creating event network-vif-plugged:e219015e-99d1-4ad5-9928-c4ad1f9109e1 for instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 on n-h1-836830-13 Aug 29 17:12:43.735419 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-550dafbc-0b7b-4284-b25b-88ce385345eb req-7d1da325-48e8-4776-bd9b-0be3a13fc8fd service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047378 Aug 29 17:12:43.738335 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3987/8147] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:12:51.900489 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-19927663", "imageRef": "70c6abbf-ed17-468d-8adb-460ca5efba63", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1393453422", "security_groups": [{"name": "tempest-secgroup-smoke-1953510115"}], "networks": [{"uuid": "d5f0d2c9-b38a-446a-8561-18efdcfa47ba"}]}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:51.910155 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:51.910855 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:51.932062 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [83c6267e-24cc-46e7-9ac0-b8e5841f58fa] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 51338. Aug 29 17:12:51.932798 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] [c35d6cb1-529a-43d0-804f-d8dca67a4cac] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 51340. Aug 29 17:12:52.017089 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.network.neutron [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] validate_networks() for [('d5f0d2c9-b38a-446a-8561-18efdcfa47ba', None, None, None, None, None)] {{(pid=129133) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 17:12:52.392709 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Flavor limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 17:12:52.393149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Image limits 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 17:12:52.393640 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Flavor pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 17:12:52.394066 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Image pref 0:0:0 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 17:12:52.394494 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.virt.hardware [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 17:12:52.403843 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:52.404339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:52.404787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:52.405523 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:52.405997 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:52.406439 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:52.424334 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Getting quotas for project 8e27c4a205fa4cae93194ba885284bdd. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 17:12:52.430378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.quota [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Getting quotas for user f201d9769b5a469098fa5fb5043399f8 and project 8e27c4a205fa4cae93194ba885284bdd. Resources: {'instances', 'cores', 'ram'} {{(pid=129133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 17:12:52.443910 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Going to run 1 instances... {{(pid=129133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 17:12:52.446463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='70c6abbf-ed17-468d-8adb-460ca5efba63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 17:12:52.494021 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ef82150a-9c94-4606-b88e-5d9e57ab2c0e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.597891 Aug 29 17:12:52.494597 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4161/8148] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 17:12:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 17:12:52.508206 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c07f68e5-749b-411d-b89b-5dd5559020c5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:52.508921 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c07f68e5-749b-411d-b89b-5dd5559020c5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:52.525439 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 51356. Aug 29 17:12:52.530536 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 51354. Aug 29 17:12:52.578983 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c07f68e5-749b-411d-b89b-5dd5559020c5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:52.587433 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c07f68e5-749b-411d-b89b-5dd5559020c5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1247 microversion: 2.1 time: 0.085783 Aug 29 17:12:52.596998 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3988/8149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:52 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1247 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:53.610017 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:53.610596 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:53.618401 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:53.618905 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:53.619403 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:53.620114 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:53.620585 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:53.621108 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:53.704285 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:53.713054 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3dd0c512-78de-4ce0-ad60-23351b043b53 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1299 microversion: 2.1 time: 0.107927 Aug 29 17:12:53.713939 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4162/8150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:53 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:54.733825 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:54.734565 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:54.737421 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:12:54.751716 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:54.752229 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:54.752677 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:54.753391 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:54.753856 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:54.754291 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:54.912863 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:54.920804 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-af70e26d-a6be-4a74-92e3-594de201f134 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.190932 Aug 29 17:12:54.921414 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3989/8151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:54 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:55.727710 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-357673e0-fff5-4364-a5bf-b8f505da1b22 req-913f127c-2c53-4a49-9bf9-e837b611a2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c415aea4-f5e9-4b21-b62e-3bd8885758a0", "name": "network-vif-unplugged", "status": "completed", "tag": "e219015e-99d1-4ad5-9928-c4ad1f9109e1"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:12:55.742067 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-357673e0-fff5-4364-a5bf-b8f505da1b22 req-913f127c-2c53-4a49-9bf9-e837b611a2e4 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:55.742796 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-357673e0-fff5-4364-a5bf-b8f505da1b22 req-913f127c-2c53-4a49-9bf9-e837b611a2e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:55.743427 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-357673e0-fff5-4364-a5bf-b8f505da1b22 req-913f127c-2c53-4a49-9bf9-e837b611a2e4 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:55.761782 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-357673e0-fff5-4364-a5bf-b8f505da1b22 req-913f127c-2c53-4a49-9bf9-e837b611a2e4 service nova] Creating event network-vif-unplugged:e219015e-99d1-4ad5-9928-c4ad1f9109e1 for instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 on n-h1-836830-13 Aug 29 17:12:55.767982 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-357673e0-fff5-4364-a5bf-b8f505da1b22 req-913f127c-2c53-4a49-9bf9-e837b611a2e4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044149 Aug 29 17:12:55.769700 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4163/8152] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:12:55.940753 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:55.941522 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:55.949213 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:55.949726 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:55.950166 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:55.951117 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:55.951708 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:55.952230 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:56.103214 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:56.111310 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-11a05f66-9ac0-4484-bc10-badedf71c858 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.174512 Aug 29 17:12:56.111981 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3990/8153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:55 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:57.135568 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:57.137577 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:57.146331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:57.147004 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:57.147799 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:57.148622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:57.149102 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:57.149546 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:57.291330 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:57.299949 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-f1c7397c-3ff0-4cfd-90ed-0503b172088d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.171286 Aug 29 17:12:57.300532 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4164/8154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:57 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:58.321222 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:58.321837 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:58.328827 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:58.329312 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:58.329748 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:58.330432 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:58.330889 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:58.331336 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:58.481624 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:58.490811 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f3efced-c332-443a-b76b-da85935b189c tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.173082 Aug 29 17:12:58.491735 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3991/8155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:58 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:12:59.512174 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:12:59.512809 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:12:59.519755 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:59.520274 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:59.520725 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:59.521821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:12:59.522056 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:12:59.522493 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:12:59.664743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:12:59.672520 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c9c8517d-76c7-476b-860d-5a2fb6ac1ed4 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.164337 Aug 29 17:12:59.673114 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4165/8156] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:12:59 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:00.693809 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:00.694551 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:00.701546 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:00.702044 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:00.702482 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:00.703234 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:00.703723 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:00.704127 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:00.851978 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:00.859856 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-ddb28d57-f098-4807-9b87-d3b9b7cbdfda tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.170264 Aug 29 17:13:00.860445 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3992/8157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:00 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:01.881149 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:01.881857 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:01.888766 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:01.889263 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:01.889715 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:01.890422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:01.890892 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:01.891359 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:02.049753 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:02.061403 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-9af5335f-2c62-45a1-bef3-377789afb74b tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.182860 Aug 29 17:13:02.061990 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4166/8158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:01 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:03.083476 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:03.084092 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:03.087514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell0:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:13:03.092933 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:03.093417 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:03.093852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:03.094539 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:03.094992 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:03.095459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:03.226927 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:03.234610 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-4f03c984-e7a8-4ce5-8f46-35b3ada12387 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.155189 Aug 29 17:13:03.235231 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3993/8159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:03 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:04.255481 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:04.256140 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:04.258325 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:13:04.259007 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell0:SELECT=6 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:13:04.265968 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:04.266464 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:04.266914 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:04.267655 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:04.268123 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:04.268560 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:04.497375 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:04.505369 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e527aa44-c4ba-4c3b-af1f-78e0ef5caf3a tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.253712 Aug 29 17:13:04.505982 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4167/8160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:04 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:04.948746 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-3d0bbfda-3620-4e5a-bc4f-63015b5abdfe req-db8574ab-0167-4825-b4bb-5c8404afee8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d585e6a2-df4c-401d-ae86-f4ab1043f364", "tag": "48ba8b22-11b7-4359-bd88-542f49b845b6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:13:04.959762 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3d0bbfda-3620-4e5a-bc4f-63015b5abdfe req-db8574ab-0167-4825-b4bb-5c8404afee8a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:04.961641 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3d0bbfda-3620-4e5a-bc4f-63015b5abdfe req-db8574ab-0167-4825-b4bb-5c8404afee8a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:04.962085 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-3d0bbfda-3620-4e5a-bc4f-63015b5abdfe req-db8574ab-0167-4825-b4bb-5c8404afee8a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:04.973515 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-3d0bbfda-3620-4e5a-bc4f-63015b5abdfe req-db8574ab-0167-4825-b4bb-5c8404afee8a service nova] Creating event network-changed:48ba8b22-11b7-4359-bd88-542f49b845b6 for instance d585e6a2-df4c-401d-ae86-f4ab1043f364 on n-h2-836830-13 Aug 29 17:13:04.979396 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-3d0bbfda-3620-4e5a-bc4f-63015b5abdfe req-db8574ab-0167-4825-b4bb-5c8404afee8a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034997 Aug 29 17:13:04.980021 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3994/8161] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:13:05.527053 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:05.527703 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:05.534677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:05.535224 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:05.535683 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:05.536391 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:05.536866 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:05.537310 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:05.671863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:05.680253 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-3ca33263-ce0e-449e-9f75-5d69e8364242 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.157141 Aug 29 17:13:05.680838 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4168/8162] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:05 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:06.702597 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:06.703346 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:06.709719 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:06.710212 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:06.710657 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:06.711892 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:06.712689 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:06.712798 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:06.851370 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:06.862871 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-62a7df9e-8bd9-412c-b844-a8b81ed421af tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.162715 Aug 29 17:13:06.871503 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3995/8163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:06 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:07.885478 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:07.886099 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:07.892920 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:07.893418 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:07.893936 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:07.894691 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:07.895188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:07.895622 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:08.030972 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:08.038852 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-957473f3-cb4f-4f63-81e9-89696b8229f9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.157262 Aug 29 17:13:08.039903 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4169/8164] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:07 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:09.060029 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:09.060646 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:09.068039 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:09.068529 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:09.068970 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:09.069660 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:09.070118 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:09.070598 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:09.207877 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:09.216189 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-c753e5b5-d68c-4e29-8192-bdf65b37aebe tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.160219 Aug 29 17:13:09.216786 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3996/8165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:09 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:10.237463 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:10.238087 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:10.245645 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:10.246143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:10.246590 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:10.247312 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:10.247778 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:10.248242 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:10.380417 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:10.388563 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-94b40107-61a5-4a10-8677-83e1c2f02f56 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.154964 Aug 29 17:13:10.389163 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4170/8166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:10 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:11.409041 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:11.409693 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:11.417805 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:11.418301 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:11.418738 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:11.419466 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:11.419936 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:11.420356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:11.433134 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [req-30acabfc-d479-433d-9d17-8b27a8162797 req-e3144b62-99c5-4eba-9adb-3488da360b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d585e6a2-df4c-401d-ae86-f4ab1043f364", "name": "network-vif-plugged", "status": "completed", "tag": "48ba8b22-11b7-4359-bd88-542f49b845b6"}]} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:13:11.448613 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-30acabfc-d479-433d-9d17-8b27a8162797 req-e3144b62-99c5-4eba-9adb-3488da360b5a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:11.449412 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-30acabfc-d479-433d-9d17-8b27a8162797 req-e3144b62-99c5-4eba-9adb-3488da360b5a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:11.449909 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [req-30acabfc-d479-433d-9d17-8b27a8162797 req-e3144b62-99c5-4eba-9adb-3488da360b5a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:11.473176 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.compute.server_external_events [req-30acabfc-d479-433d-9d17-8b27a8162797 req-e3144b62-99c5-4eba-9adb-3488da360b5a service nova] Creating event network-vif-plugged:48ba8b22-11b7-4359-bd88-542f49b845b6 for instance d585e6a2-df4c-401d-ae86-f4ab1043f364 on n-h2-836830-13 Aug 29 17:13:11.479831 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [req-30acabfc-d479-433d-9d17-8b27a8162797 req-e3144b62-99c5-4eba-9adb-3488da360b5a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051546 Aug 29 17:13:11.481062 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4171/8167] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 17:13:11.557890 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:11.565797 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-47e95942-5fed-45d2-9ebd-6581e3caf97d tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.160619 Aug 29 17:13:11.566391 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3997/8168] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:11 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:12.589146 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:12.589870 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:12.596235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:12.596739 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:12.597193 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:12.597893 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:12.598365 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:12.598824 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:12.733632 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:12.741445 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-90139e64-d171-43d0-a60f-b4e6a9c073da tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1373 microversion: 2.1 time: 0.157589 Aug 29 17:13:12.742030 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4172/8169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:12 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:13.762045 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:13.762695 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:13.765584 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=25 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:13:13.771168 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:13.771666 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:13.772114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:13.772813 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:13.773277 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:13.774244 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:13.908397 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:13.916483 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2346ae9b-27a0-45b4-bf67-9a7b86d6c9cd tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1558 microversion: 2.1 time: 0.158573 Aug 29 17:13:13.917057 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3998/8170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:13 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:13.936600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:13:13.937237 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:13:13.944373 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:13.944879 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:13.945331 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:13.946600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:13.947093 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:13.947541 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:14.082462 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:13:14.091190 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-23d68058-b24a-4fe7-8b6b-f70bddccbb66 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1558 microversion: 2.1 time: 0.158554 Aug 29 17:13:14.091788 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4173/8171] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:13:13 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:13:16.100279 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-6d020a34-aa81-4005-a007-bf474abaea4f req-9d1d05ca-ec7a-4447-9261-dcc1050bfe2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d585e6a2-df4c-401d-ae86-f4ab1043f364", "tag": "48ba8b22-11b7-4359-bd88-542f49b845b6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:13:16.110807 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6d020a34-aa81-4005-a007-bf474abaea4f req-9d1d05ca-ec7a-4447-9261-dcc1050bfe2a service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:13:16.111446 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6d020a34-aa81-4005-a007-bf474abaea4f req-9d1d05ca-ec7a-4447-9261-dcc1050bfe2a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:13:16.111878 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-6d020a34-aa81-4005-a007-bf474abaea4f req-9d1d05ca-ec7a-4447-9261-dcc1050bfe2a service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:13:16.123083 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-6d020a34-aa81-4005-a007-bf474abaea4f req-9d1d05ca-ec7a-4447-9261-dcc1050bfe2a service nova] Creating event network-changed:48ba8b22-11b7-4359-bd88-542f49b845b6 for instance d585e6a2-df4c-401d-ae86-f4ab1043f364 on n-h2-836830-13 Aug 29 17:13:16.128164 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-6d020a34-aa81-4005-a007-bf474abaea4f req-9d1d05ca-ec7a-4447-9261-dcc1050bfe2a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031767 Aug 29 17:13:16.128764 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 3999/8172] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:15:15.240592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:15.241558 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=66 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:15.243295 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:15:15.243603 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 17:15:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364/action (ip 10.222.0.83) !!! Aug 29 17:15:15.245665 n-d-836830-13 devstack@n-api.service[129133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 17:15:15.245820 n-d-836830-13 devstack@n-api.service[129133]: Mon Aug 29 17:15:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364/action (ip 10.222.0.83) !!! Aug 29 17:15:15.253446 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-816023281"}} {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:15:15.255818 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:15.275664 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:15.276284 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:15.276743 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:15.277468 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:15.277948 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:15.278425 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:15.687945 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c71f0947-25bd-4942-8326-3d34cf5b9744 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "POST /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364/action" status: 202 len: 0 microversion: 2.1 time: 0.449438 Aug 29 17:15:15.688605 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4174/8173] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 17:15:15 2022] POST /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 29 17:15:22.237331 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 17:15:22.240090 n-d-836830-13 devstack@n-api.service[129132]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] AMQP server on 10.222.0.83:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 29 17:15:22.240699 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=3 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:22.241488 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=58 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:22.242644 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:15:22.242808 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:15:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 17:15:22.245583 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 17:15:22.245745 n-d-836830-13 devstack@n-api.service[129132]: Mon Aug 29 17:15:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.83) !!! Aug 29 17:15:22.256649 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-d64bc637-191a-42d8-adaa-af23bc7a8ab0 req-298846f2-8383-4765-ad01-6342afe82051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d585e6a2-df4c-401d-ae86-f4ab1043f364", "name": "network-vif-plugged", "status": "completed", "tag": "48ba8b22-11b7-4359-bd88-542f49b845b6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:15:22.276030 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d64bc637-191a-42d8-adaa-af23bc7a8ab0 req-298846f2-8383-4765-ad01-6342afe82051 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:22.276514 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d64bc637-191a-42d8-adaa-af23bc7a8ab0 req-298846f2-8383-4765-ad01-6342afe82051 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:22.276953 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-d64bc637-191a-42d8-adaa-af23bc7a8ab0 req-298846f2-8383-4765-ad01-6342afe82051 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:22.288600 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-d64bc637-191a-42d8-adaa-af23bc7a8ab0 req-298846f2-8383-4765-ad01-6342afe82051 service nova] Creating event network-vif-plugged:48ba8b22-11b7-4359-bd88-542f49b845b6 for instance d585e6a2-df4c-401d-ae86-f4ab1043f364 on n-h2-836830-13 Aug 29 17:15:22.293833 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-d64bc637-191a-42d8-adaa-af23bc7a8ab0 req-298846f2-8383-4765-ad01-6342afe82051 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059474 Aug 29 17:15:22.295278 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4000/8174] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:15:33.467448 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:33.468307 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:33.469459 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-66c4e4f4-7a45-4d77-a4bf-85e73edff24d req-bbc78442-76ba-4df3-a9ec-aecfed9fce33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d585e6a2-df4c-401d-ae86-f4ab1043f364", "tag": "48ba8b22-11b7-4359-bd88-542f49b845b6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:15:33.476356 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_api:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:33.477194 n-d-836830-13 devstack@n-api.service[129132]: DEBUG dbcounter [-] [129132] Writing DB stats nova_cell1:SELECT=2 {{(pid=129132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:33.478188 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_api:SELECT=2 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:33.483694 n-d-836830-13 devstack@n-api.service[129133]: DEBUG dbcounter [-] [129133] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 17:15:33.484835 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-66c4e4f4-7a45-4d77-a4bf-85e73edff24d req-bbc78442-76ba-4df3-a9ec-aecfed9fce33 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:33.485326 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-66c4e4f4-7a45-4d77-a4bf-85e73edff24d req-bbc78442-76ba-4df3-a9ec-aecfed9fce33 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:33.485815 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-66c4e4f4-7a45-4d77-a4bf-85e73edff24d req-bbc78442-76ba-4df3-a9ec-aecfed9fce33 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:33.486249 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:33.486860 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:33.487612 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:33.488451 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:33.489621 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:33.490176 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:33.500431 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-66c4e4f4-7a45-4d77-a4bf-85e73edff24d req-bbc78442-76ba-4df3-a9ec-aecfed9fce33 service nova] Creating event network-changed:48ba8b22-11b7-4359-bd88-542f49b845b6 for instance d585e6a2-df4c-401d-ae86-f4ab1043f364 on n-h2-836830-13 Aug 29 17:15:33.506010 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [d53ed995-6bc1-47ba-9062-04b0f6241609] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 51690. Aug 29 17:15:33.506752 n-d-836830-13 devstack@n-api.service[129132]: INFO oslo.messaging._drivers.impl_rabbit [-] [e0885513-58b4-4582-b978-498eec0c8634] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 51692. Aug 29 17:15:33.508482 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-66c4e4f4-7a45-4d77-a4bf-85e73edff24d req-bbc78442-76ba-4df3-a9ec-aecfed9fce33 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043038 Aug 29 17:15:33.509334 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4001/8175] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:15:33.532482 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:15:33.619454 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-35eac9e5-312d-4fa6-832d-306333976cca tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 204 len: 0 microversion: 2.1 time: 0.156032 Aug 29 17:15:33.619947 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4175/8176] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 17:15:33 2022] DELETE /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 17:15:33.629345 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:33.630318 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:33.637406 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:33.638114 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:33.638653 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:33.639858 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:33.640056 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:33.640582 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:33.837288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:15:33.845355 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-2dea2744-c780-4061-8077-88a9f0cc1f1e tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1683 microversion: 2.1 time: 0.220718 Aug 29 17:15:33.845933 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4002/8177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:15:33 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1683 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:15:34.867863 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:34.868592 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:34.875661 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:34.876166 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:34.876637 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:34.877329 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:34.877820 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:34.878262 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:35.084349 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:15:35.092469 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-a4274e23-b1f4-450c-87e0-7416b48f2917 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1683 microversion: 2.1 time: 0.228842 Aug 29 17:15:35.093075 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4176/8178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:15:34 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1683 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:15:35.964852 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-01ad3702-22f4-4dbb-a96c-47268993cca2 req-f9222721-a526-48b1-9c9d-9e03be5ff1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d585e6a2-df4c-401d-ae86-f4ab1043f364", "name": "network-vif-deleted", "tag": "48ba8b22-11b7-4359-bd88-542f49b845b6"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:15:35.975147 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-01ad3702-22f4-4dbb-a96c-47268993cca2 req-f9222721-a526-48b1-9c9d-9e03be5ff1d2 service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:35.975636 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-01ad3702-22f4-4dbb-a96c-47268993cca2 req-f9222721-a526-48b1-9c9d-9e03be5ff1d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:35.976288 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-01ad3702-22f4-4dbb-a96c-47268993cca2 req-f9222721-a526-48b1-9c9d-9e03be5ff1d2 service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:35.987813 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-01ad3702-22f4-4dbb-a96c-47268993cca2 req-f9222721-a526-48b1-9c9d-9e03be5ff1d2 service nova] Creating event network-vif-deleted:48ba8b22-11b7-4359-bd88-542f49b845b6 for instance d585e6a2-df4c-401d-ae86-f4ab1043f364 on n-h2-836830-13 Aug 29 17:15:35.993019 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-01ad3702-22f4-4dbb-a96c-47268993cca2 req-f9222721-a526-48b1-9c9d-9e03be5ff1d2 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086501 Aug 29 17:15:35.993729 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4003/8179] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:15:36.114040 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:36.114677 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:36.121518 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:36.122016 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:36.123222 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:36.124216 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:36.124813 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:36.125111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:36.158153 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:36.158648 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:36.159111 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:36.159565 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.objects.instance [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lazy-loading 'fault' on Instance uuid d585e6a2-df4c-401d-ae86-f4ab1043f364 {{(pid=129133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 17:15:36.202950 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:15:36.211133 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-ec9801aa-b52e-4eae-b5b7-e306aaf489c1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 200 len: 1337 microversion: 2.1 time: 0.101025 Aug 29 17:15:36.211719 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4177/8180] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:15:36 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 1337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:15:37.235090 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:37.235799 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: d585e6a2-df4c-401d-ae86-f4ab1043f364] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:37.242060 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:37.242549 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:37.242990 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:37.243701 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:37.244170 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:37.244578 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:37.261040 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.wsgi [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] HTTP exception thrown: Instance d585e6a2-df4c-401d-ae86-f4ab1043f364 could not be found. Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Request method failure captured: Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: request: GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 HTTP/1.1 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: Accept: application/json Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: Accept-Encoding: identity Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: Connection: close Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: Content-Length: 0 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: Content-Type: application/json Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: Host: 10.222.0.83 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: Openstack-System-Scope: None Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: User-Agent: python-urllib3/1.26.12 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Auth-Token: gAAAAABjDPL_rjKTqWSFA96PoL8OlEQP8dVuWPxmmsP5GwBtVPqoSXrswr9AJqnA2CW0TgRKK3YJnyqV63RNWXrBQjH5oHBXUHCNsrWNQ4YNFY06f9WwhBef_oMCx2i4zOSCyvB3woOm4InxfvUV0y1DJR0SuO-r6G7XbgHl3P4vHHZy2Sm3XMU Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Id: None Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Domain-Name: None Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Identity-Status: Confirmed Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Is-Admin-Project: True Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Id: default Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Domain-Name: Default Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Id: 8e27c4a205fa4cae93194ba885284bdd Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Project-Name: tempest-TestSnapshotPattern-2144474067 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Role: reader,member Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Roles: reader,member Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8e27c4a205fa4cae93194ba885284bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8e27c4a205fa4cae93194ba885284bdd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8e27c4a205fa4cae93194ba885284bdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8e27c4a205fa4cae93194ba885284bdd"}]}] Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant: tempest-TestSnapshotPattern-2144474067 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Id: 8e27c4a205fa4cae93194ba885284bdd Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-Tenant-Name: tempest-TestSnapshotPattern-2144474067 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-User: tempest-TestSnapshotPattern-2144474067-project Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Id: default Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Domain-Name: Default Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Id: f201d9769b5a469098fa5fb5043399f8 Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: X-User-Name: tempest-TestSnapshotPattern-2144474067-project Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: method: > Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: exception: Instance d585e6a2-df4c-401d-ae86-f4ab1043f364 could not be found. Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: action_args: {'id': 'd585e6a2-df4c-401d-ae86-f4ab1043f364'} Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d585e6a2-df4c-401d-ae86-f4ab1043f364 could not be found. Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d585e6a2-df4c-401d-ae86-f4ab1043f364 could not be found. Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:15:37.262674 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d585e6a2-df4c-401d-ae86-f4ab1043f364 could not be found. Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: ERROR nova.api.openstack.wsgi Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Returning 404 to user: Instance d585e6a2-df4c-401d-ae86-f4ab1043f364 could not be found. {{(pid=129132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-a472b501-2501-4316-b852-4cccf1a7ceb9 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364" status: 404 len: 111 microversion: 2.1 time: 0.035367 Aug 29 17:15:37.268893 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4004/8181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:15:37 2022] GET /compute/v2.1/servers/d585e6a2-df4c-401d-ae86-f4ab1043f364 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:15:38.616378 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:38.616954 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:38.619109 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-96a78c10-0f4a-4911-acb4-501c148ef118 req-1e05ff34-b45e-4f02-af28-76f74b43eece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c415aea4-f5e9-4b21-b62e-3bd8885758a0", "tag": "e219015e-99d1-4ad5-9928-c4ad1f9109e1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:15:38.624235 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:38.624746 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:38.625200 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:38.625915 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:38.626386 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:38.626825 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:38.630108 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96a78c10-0f4a-4911-acb4-501c148ef118 req-1e05ff34-b45e-4f02-af28-76f74b43eece service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:38.630591 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96a78c10-0f4a-4911-acb4-501c148ef118 req-1e05ff34-b45e-4f02-af28-76f74b43eece service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:38.631053 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-96a78c10-0f4a-4911-acb4-501c148ef118 req-1e05ff34-b45e-4f02-af28-76f74b43eece service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:38.643761 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-96a78c10-0f4a-4911-acb4-501c148ef118 req-1e05ff34-b45e-4f02-af28-76f74b43eece service nova] Creating event network-changed:e219015e-99d1-4ad5-9928-c4ad1f9109e1 for instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 on n-h1-836830-13 Aug 29 17:15:38.649168 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-96a78c10-0f4a-4911-acb4-501c148ef118 req-1e05ff34-b45e-4f02-af28-76f74b43eece service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033588 Aug 29 17:15:38.650004 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4005/8182] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:15:38.660339 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Going to try to terminate instance {{(pid=129133) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 17:15:38.759148 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-c33c79ee-43ad-46b9-a48b-6e79ff75eab5 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "DELETE /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 204 len: 0 microversion: 2.1 time: 0.145602 Aug 29 17:15:38.761736 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4178/8183] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 17:15:38 2022] DELETE /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 17:15:38.772153 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:38.773049 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.compute.api [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129132) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:38.781149 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:38.781648 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:38.782325 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:38.783083 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:38.783552 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:38.783988 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:38.933438 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.policy [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129132) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:15:38.941917 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-8ac9ca07-884a-411e-9f01-43a24c9c7a78 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1683 microversion: 2.1 time: 0.174669 Aug 29 17:15:38.942578 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4006/8184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:15:38 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 17:15:39.963711 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:39.964422 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:39.971844 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:39.972358 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:39.972821 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:39.973536 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:39.974309 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:39.974756 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:40.206021 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.policy [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f201d9769b5a469098fa5fb5043399f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27c4a205fa4cae93194ba885284bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129133) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 17:15:40.214311 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-65be7709-7b2a-4912-aa02-8745a6f2f8d1 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 200 len: 1565 microversion: 2.1 time: 0.254908 Aug 29 17:15:40.215014 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4179/8185] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:15:39 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 1565 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 17:15:40.258994 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [req-396757f0-6f68-4a0b-adb9-6195c97fa9b5 req-cc9d218d-f54c-4a22-879c-3f702b618b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c415aea4-f5e9-4b21-b62e-3bd8885758a0", "name": "network-vif-deleted", "tag": "e219015e-99d1-4ad5-9928-c4ad1f9109e1"}]} {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 17:15:40.269545 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-396757f0-6f68-4a0b-adb9-6195c97fa9b5 req-cc9d218d-f54c-4a22-879c-3f702b618b2f service nova] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:40.270031 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-396757f0-6f68-4a0b-adb9-6195c97fa9b5 req-cc9d218d-f54c-4a22-879c-3f702b618b2f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:40.270467 n-d-836830-13 devstack@n-api.service[129132]: DEBUG oslo_concurrency.lockutils [req-396757f0-6f68-4a0b-adb9-6195c97fa9b5 req-cc9d218d-f54c-4a22-879c-3f702b618b2f service nova] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:40.282400 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.compute.server_external_events [req-396757f0-6f68-4a0b-adb9-6195c97fa9b5 req-cc9d218d-f54c-4a22-879c-3f702b618b2f service nova] Creating event network-vif-deleted:e219015e-99d1-4ad5-9928-c4ad1f9109e1 for instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 on n-h1-836830-13 Aug 29 17:15:40.287268 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [req-396757f0-6f68-4a0b-adb9-6195c97fa9b5 req-cc9d218d-f54c-4a22-879c-3f702b618b2f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 Aug 29 17:15:40.287869 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4007/8186] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 17:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 17:15:41.236143 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '>' {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:41.236787 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.compute.api [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] [instance: c415aea4-f5e9-4b21-b62e-3bd8885758a0] Fetching instance by UUID {{(pid=129133) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 17:15:41.243663 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:41.244158 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:41.244600 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:41.245291 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Acquiring lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 17:15:41.245750 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 17:15:41.246180 n-d-836830-13 devstack@n-api.service[129133]: DEBUG oslo_concurrency.lockutils [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Lock "28b8b8ff-80ab-47bc-a359-1c63b1ee12ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 17:15:41.260307 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.wsgi [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] HTTP exception thrown: Instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 could not be found. Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Request method failure captured: Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: request: GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 HTTP/1.1 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: Accept: application/json Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: Accept-Encoding: identity Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: Connection: close Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: Content-Length: 0 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: Content-Type: application/json Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: Host: 10.222.0.83 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: Openstack-System-Scope: None Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: User-Agent: python-urllib3/1.26.12 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Auth-Token: gAAAAABjDPL_rjKTqWSFA96PoL8OlEQP8dVuWPxmmsP5GwBtVPqoSXrswr9AJqnA2CW0TgRKK3YJnyqV63RNWXrBQjH5oHBXUHCNsrWNQ4YNFY06f9WwhBef_oMCx2i4zOSCyvB3woOm4InxfvUV0y1DJR0SuO-r6G7XbgHl3P4vHHZy2Sm3XMU Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Id: None Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Domain-Name: None Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Identity-Status: Confirmed Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Is-Admin-Project: True Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Id: default Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Domain-Name: Default Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Id: 8e27c4a205fa4cae93194ba885284bdd Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Project-Name: tempest-TestSnapshotPattern-2144474067 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Role: reader,member Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Roles: reader,member Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8e27c4a205fa4cae93194ba885284bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:8080/v1/AUTH_8e27c4a205fa4cae93194ba885284bdd", "adminURL": "http://10.222.0.83:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/8e27c4a205fa4cae93194ba885284bdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/8e27c4a205fa4cae93194ba885284bdd"}]}] Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant: tempest-TestSnapshotPattern-2144474067 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Id: 8e27c4a205fa4cae93194ba885284bdd Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-Tenant-Name: tempest-TestSnapshotPattern-2144474067 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-User: tempest-TestSnapshotPattern-2144474067-project Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Id: default Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-User-Domain-Name: Default Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-User-Id: f201d9769b5a469098fa5fb5043399f8 Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: X-User-Name: tempest-TestSnapshotPattern-2144474067-project Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: method: > Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: exception: Instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 could not be found. Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: action_args: {'id': 'c415aea4-f5e9-4b21-b62e-3bd8885758a0'} Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: {{(pid=129133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 could not be found. Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 could not be found. Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 17:15:41.261965 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 could not be found. Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: ERROR nova.api.openstack.wsgi Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: DEBUG nova.api.openstack.wsgi [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Returning 404 to user: Instance c415aea4-f5e9-4b21-b62e-3bd8885758a0 could not be found. {{(pid=129133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: INFO nova.api.openstack.requestlog [None req-e1084cfc-5586-4233-9539-c473e7facacb tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0" status: 404 len: 111 microversion: 2.1 time: 0.031774 Aug 29 17:15:41.267723 n-d-836830-13 devstack@n-api.service[129133]: [pid: 129133|app: 0|req: 4180/8187] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 17:15:41 2022] GET /compute/v2.1/servers/c415aea4-f5e9-4b21-b62e-3bd8885758a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 17:15:41.432183 n-d-836830-13 devstack@n-api.service[129132]: DEBUG nova.api.openstack.wsgi [None req-3afaee53-7181-4592-9eb1-61f3c9306040 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] Calling method '.version_select at 0x7f32ee446940>' {{(pid=129132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 17:15:41.457639 n-d-836830-13 devstack@n-api.service[129132]: INFO nova.api.openstack.requestlog [None req-3afaee53-7181-4592-9eb1-61f3c9306040 tempest-TestSnapshotPattern-2144474067 tempest-TestSnapshotPattern-2144474067-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1393453422" status: 202 len: 0 microversion: 2.1 time: 0.031844 Aug 29 17:15:41.458249 n-d-836830-13 devstack@n-api.service[129132]: [pid: 129132|app: 0|req: 4008/8188] 10.222.0.83 () {58 vars in 1257 bytes} [Mon Aug 29 17:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1393453422 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)